2025-10-06 04:34:27,580 INFO mapreduce.MiniHadoopClusterManager: Updated 0 configuration settings from command line. 2025-10-06 04:34:27,663 INFO hdfs.MiniDFSCluster: starting cluster: numNameNodes=1, numDataNodes=1 2025-10-06 04:34:28,071 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2025-10-06 04:34:28,164 INFO namenode.NameNode: Formatting using clusterid: testClusterID 2025-10-06 04:34:28,184 INFO namenode.FSEditLog: Edit logging is async:true 2025-10-06 04:34:28,209 INFO namenode.FSNamesystem: KeyProvider: null 2025-10-06 04:34:28,211 INFO namenode.FSNamesystem: fsLock is fair: true 2025-10-06 04:34:28,211 INFO namenode.FSNamesystem: Detailed lock hold time metrics enabled: false 2025-10-06 04:34:28,262 INFO namenode.FSNamesystem: fsOwner = clickhouse (auth:SIMPLE) 2025-10-06 04:34:28,262 INFO namenode.FSNamesystem: supergroup = supergroup 2025-10-06 04:34:28,262 INFO namenode.FSNamesystem: isPermissionEnabled = true 2025-10-06 04:34:28,263 INFO namenode.FSNamesystem: isStoragePolicyEnabled = true 2025-10-06 04:34:28,263 INFO namenode.FSNamesystem: HA Enabled: false 2025-10-06 04:34:28,313 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling 2025-10-06 04:34:28,316 INFO Configuration.deprecation: hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping 2025-10-06 04:34:28,316 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit: configured=1000, counted=60, effected=1000 2025-10-06 04:34:28,316 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true 2025-10-06 04:34:28,321 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000 2025-10-06 04:34:28,321 INFO blockmanagement.BlockManager: The block deletion will start around 2025 Oct 06 04:34:28 2025-10-06 04:34:28,323 INFO util.GSet: Computing capacity for map BlocksMap 2025-10-06 04:34:28,323 INFO util.GSet: VM type = 64-bit 2025-10-06 04:34:28,324 INFO util.GSet: 2.0% max memory 7.6 GB = 156.4 MB 2025-10-06 04:34:28,324 INFO util.GSet: capacity = 2^24 = 16777216 entries 2025-10-06 04:34:28,352 INFO blockmanagement.BlockManager: Storage policy satisfier is disabled 2025-10-06 04:34:28,352 INFO blockmanagement.BlockManager: dfs.block.access.token.enable = false 2025-10-06 04:34:28,358 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.threshold-pct = 0.999 2025-10-06 04:34:28,358 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.min.datanodes = 0 2025-10-06 04:34:28,359 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.extension = 0 2025-10-06 04:34:28,359 INFO blockmanagement.BlockManager: defaultReplication = 1 2025-10-06 04:34:28,359 INFO blockmanagement.BlockManager: maxReplication = 512 2025-10-06 04:34:28,359 INFO blockmanagement.BlockManager: minReplication = 1 2025-10-06 04:34:28,359 INFO blockmanagement.BlockManager: maxReplicationStreams = 2 2025-10-06 04:34:28,359 INFO blockmanagement.BlockManager: redundancyRecheckInterval = 3000ms 2025-10-06 04:34:28,359 INFO blockmanagement.BlockManager: encryptDataTransfer = false 2025-10-06 04:34:28,359 INFO blockmanagement.BlockManager: maxNumBlocksToLog = 1000 2025-10-06 04:34:28,381 INFO namenode.FSDirectory: GLOBAL serial map: bits=29 maxEntries=536870911 2025-10-06 04:34:28,381 INFO namenode.FSDirectory: USER serial map: bits=24 maxEntries=16777215 2025-10-06 04:34:28,381 INFO namenode.FSDirectory: GROUP serial map: bits=24 maxEntries=16777215 2025-10-06 04:34:28,381 INFO namenode.FSDirectory: XATTR serial map: bits=24 maxEntries=16777215 2025-10-06 04:34:28,392 INFO util.GSet: Computing capacity for map INodeMap 2025-10-06 04:34:28,392 INFO util.GSet: VM type = 64-bit 2025-10-06 04:34:28,393 INFO util.GSet: 1.0% max memory 7.6 GB = 78.2 MB 2025-10-06 04:34:28,393 INFO util.GSet: capacity = 2^23 = 8388608 entries 2025-10-06 04:34:28,404 INFO namenode.FSDirectory: ACLs enabled? true 2025-10-06 04:34:28,404 INFO namenode.FSDirectory: POSIX ACL inheritance enabled? true 2025-10-06 04:34:28,404 INFO namenode.FSDirectory: XAttrs enabled? true 2025-10-06 04:34:28,404 INFO namenode.NameNode: Caching file names occurring more than 10 times 2025-10-06 04:34:28,409 INFO snapshot.SnapshotManager: Loaded config captureOpenFiles: false, skipCaptureAccessTimeOnlyChange: false, snapshotDiffAllowSnapRootDescendant: true, maxSnapshotLimit: 65536 2025-10-06 04:34:28,410 INFO snapshot.SnapshotManager: SkipList is disabled 2025-10-06 04:34:28,414 INFO util.GSet: Computing capacity for map cachedBlocks 2025-10-06 04:34:28,414 INFO util.GSet: VM type = 64-bit 2025-10-06 04:34:28,415 INFO util.GSet: 0.25% max memory 7.6 GB = 19.6 MB 2025-10-06 04:34:28,415 INFO util.GSet: capacity = 2^21 = 2097152 entries 2025-10-06 04:34:28,425 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10 2025-10-06 04:34:28,425 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10 2025-10-06 04:34:28,425 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25 2025-10-06 04:34:28,429 INFO namenode.FSNamesystem: Retry cache on namenode is enabled 2025-10-06 04:34:28,429 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis 2025-10-06 04:34:28,430 INFO util.GSet: Computing capacity for map NameNodeRetryCache 2025-10-06 04:34:28,431 INFO util.GSet: VM type = 64-bit 2025-10-06 04:34:28,431 INFO util.GSet: 0.029999999329447746% max memory 7.6 GB = 2.3 MB 2025-10-06 04:34:28,431 INFO util.GSet: capacity = 2^18 = 262144 entries 2025-10-06 04:34:28,456 INFO namenode.FSImage: Allocated new BlockPoolId: BP-2001034388-172.17.0.2-1759743268446 2025-10-06 04:34:28,470 INFO common.Storage: Storage directory /hadoop-3.3.1/target/test/data/dfs/name-0-1 has been successfully formatted. 2025-10-06 04:34:28,475 INFO common.Storage: Storage directory /hadoop-3.3.1/target/test/data/dfs/name-0-2 has been successfully formatted. 2025-10-06 04:34:28,522 INFO namenode.FSImageFormatProtobuf: Saving image file /hadoop-3.3.1/target/test/data/dfs/name-0-2/current/fsimage.ckpt_0000000000000000000 using no compression 2025-10-06 04:34:28,522 INFO namenode.FSImageFormatProtobuf: Saving image file /hadoop-3.3.1/target/test/data/dfs/name-0-1/current/fsimage.ckpt_0000000000000000000 using no compression 2025-10-06 04:34:28,665 INFO namenode.FSImageFormatProtobuf: Image file /hadoop-3.3.1/target/test/data/dfs/name-0-1/current/fsimage.ckpt_0000000000000000000 of size 402 bytes saved in 0 seconds . 2025-10-06 04:34:28,665 INFO namenode.FSImageFormatProtobuf: Image file /hadoop-3.3.1/target/test/data/dfs/name-0-2/current/fsimage.ckpt_0000000000000000000 of size 402 bytes saved in 0 seconds . 2025-10-06 04:34:28,685 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0 2025-10-06 04:34:28,732 INFO namenode.FSNamesystem: Stopping services started for active state 2025-10-06 04:34:28,732 INFO namenode.FSNamesystem: Stopping services started for standby state 2025-10-06 04:34:28,734 INFO namenode.NameNode: createNameNode [] 2025-10-06 04:34:28,801 INFO impl.MetricsConfig: Loaded properties from hadoop-metrics2.properties 2025-10-06 04:34:28,892 INFO impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2025-10-06 04:34:28,892 INFO impl.MetricsSystemImpl: NameNode metrics system started 2025-10-06 04:34:28,914 INFO namenode.NameNodeUtils: fs.defaultFS is hdfs://127.0.0.1:12222 2025-10-06 04:34:28,915 INFO namenode.NameNode: Clients should use 127.0.0.1:12222 to access this namenode/service. 2025-10-06 04:34:28,967 INFO util.JvmPauseMonitor: Starting JVM pause monitor 2025-10-06 04:34:28,979 INFO hdfs.DFSUtil: Filter initializers set : org.apache.hadoop.http.lib.StaticUserWebFilter,org.apache.hadoop.hdfs.web.AuthFilterInitializer 2025-10-06 04:34:28,983 INFO hdfs.DFSUtil: Starting Web-server for hdfs at: http://localhost:0 2025-10-06 04:34:28,996 INFO util.log: Logging initialized @2015ms to org.eclipse.jetty.util.log.Slf4jLog 2025-10-06 04:34:29,085 INFO server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2025-10-06 04:34:29,089 INFO http.HttpRequestLog: Http request log for http.requests.namenode is not defined 2025-10-06 04:34:29,096 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2025-10-06 04:34:29,098 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs 2025-10-06 04:34:29,098 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2025-10-06 04:34:29,098 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2025-10-06 04:34:29,100 INFO http.HttpServer2: Added filter AuthFilter (class=org.apache.hadoop.hdfs.web.AuthFilter) to context hdfs 2025-10-06 04:34:29,100 INFO http.HttpServer2: Added filter AuthFilter (class=org.apache.hadoop.hdfs.web.AuthFilter) to context logs 2025-10-06 04:34:29,100 INFO http.HttpServer2: Added filter AuthFilter (class=org.apache.hadoop.hdfs.web.AuthFilter) to context static 2025-10-06 04:34:29,129 INFO http.HttpServer2: addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/* 2025-10-06 04:34:29,139 INFO http.HttpServer2: Jetty bound to port 42985 2025-10-06 04:34:29,141 INFO server.Server: jetty-9.4.40.v20210413; built: 2021-04-13T20:42:42.668Z; git: b881a572662e1943a14ae12e7e1207989f218b74; jvm 11.0.25+9-post-Ubuntu-1ubuntu122.04 2025-10-06 04:34:29,168 INFO server.session: DefaultSessionIdManager workerName=node0 2025-10-06 04:34:29,168 INFO server.session: No SessionScavenger set, using defaults 2025-10-06 04:34:29,170 INFO server.session: node0 Scavenging every 600000ms 2025-10-06 04:34:29,190 INFO server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2025-10-06 04:34:29,193 INFO handler.ContextHandler: Started o.e.j.s.ServletContextHandler@1bcf67e8{logs,/logs,file:///hadoop-3.3.1/logs,AVAILABLE} 2025-10-06 04:34:29,194 INFO handler.ContextHandler: Started o.e.j.s.ServletContextHandler@74971ed9{static,/static,file:///hadoop-3.3.1/share/hadoop/hdfs/webapps/static/,AVAILABLE} 2025-10-06 04:34:29,280 INFO handler.ContextHandler: Started o.e.j.w.WebAppContext@61f80d55{hdfs,/,file:///hadoop-3.3.1/share/hadoop/hdfs/webapps/hdfs/,AVAILABLE}{file:/hadoop-3.3.1/share/hadoop/hdfs/webapps/hdfs} 2025-10-06 04:34:29,293 INFO server.AbstractConnector: Started ServerConnector@6093d508{HTTP/1.1, (http/1.1)}{localhost:42985} 2025-10-06 04:34:29,294 INFO server.Server: Started @2313ms 2025-10-06 04:34:29,299 INFO namenode.FSEditLog: Edit logging is async:true 2025-10-06 04:34:29,311 INFO namenode.FSNamesystem: KeyProvider: null 2025-10-06 04:34:29,311 INFO namenode.FSNamesystem: fsLock is fair: true 2025-10-06 04:34:29,311 INFO namenode.FSNamesystem: Detailed lock hold time metrics enabled: false 2025-10-06 04:34:29,311 INFO namenode.FSNamesystem: fsOwner = clickhouse (auth:SIMPLE) 2025-10-06 04:34:29,311 INFO namenode.FSNamesystem: supergroup = supergroup 2025-10-06 04:34:29,311 INFO namenode.FSNamesystem: isPermissionEnabled = true 2025-10-06 04:34:29,311 INFO namenode.FSNamesystem: isStoragePolicyEnabled = true 2025-10-06 04:34:29,312 INFO namenode.FSNamesystem: HA Enabled: false 2025-10-06 04:34:29,312 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling 2025-10-06 04:34:29,312 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit: configured=1000, counted=60, effected=1000 2025-10-06 04:34:29,313 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true 2025-10-06 04:34:29,313 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000 2025-10-06 04:34:29,313 INFO blockmanagement.BlockManager: The block deletion will start around 2025 Oct 06 04:34:29 2025-10-06 04:34:29,313 INFO util.GSet: Computing capacity for map BlocksMap 2025-10-06 04:34:29,313 INFO util.GSet: VM type = 64-bit 2025-10-06 04:34:29,313 INFO util.GSet: 2.0% max memory 7.6 GB = 156.4 MB 2025-10-06 04:34:29,313 INFO util.GSet: capacity = 2^24 = 16777216 entries 2025-10-06 04:34:29,336 INFO blockmanagement.BlockManager: Storage policy satisfier is disabled 2025-10-06 04:34:29,336 INFO blockmanagement.BlockManager: dfs.block.access.token.enable = false 2025-10-06 04:34:29,336 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.threshold-pct = 0.999 2025-10-06 04:34:29,336 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.min.datanodes = 0 2025-10-06 04:34:29,336 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.extension = 0 2025-10-06 04:34:29,336 INFO blockmanagement.BlockManager: defaultReplication = 1 2025-10-06 04:34:29,336 INFO blockmanagement.BlockManager: maxReplication = 512 2025-10-06 04:34:29,336 INFO blockmanagement.BlockManager: minReplication = 1 2025-10-06 04:34:29,336 INFO blockmanagement.BlockManager: maxReplicationStreams = 2 2025-10-06 04:34:29,336 INFO blockmanagement.BlockManager: redundancyRecheckInterval = 3000ms 2025-10-06 04:34:29,336 INFO blockmanagement.BlockManager: encryptDataTransfer = false 2025-10-06 04:34:29,336 INFO blockmanagement.BlockManager: maxNumBlocksToLog = 1000 2025-10-06 04:34:29,337 INFO util.GSet: Computing capacity for map INodeMap 2025-10-06 04:34:29,337 INFO util.GSet: VM type = 64-bit 2025-10-06 04:34:29,337 INFO util.GSet: 1.0% max memory 7.6 GB = 78.2 MB 2025-10-06 04:34:29,337 INFO util.GSet: capacity = 2^23 = 8388608 entries 2025-10-06 04:34:29,359 INFO namenode.FSDirectory: ACLs enabled? true 2025-10-06 04:34:29,359 INFO namenode.FSDirectory: POSIX ACL inheritance enabled? true 2025-10-06 04:34:29,359 INFO namenode.FSDirectory: XAttrs enabled? true 2025-10-06 04:34:29,364 INFO namenode.NameNode: Caching file names occurring more than 10 times 2025-10-06 04:34:29,365 INFO snapshot.SnapshotManager: Loaded config captureOpenFiles: false, skipCaptureAccessTimeOnlyChange: false, snapshotDiffAllowSnapRootDescendant: true, maxSnapshotLimit: 65536 2025-10-06 04:34:29,365 INFO snapshot.SnapshotManager: SkipList is disabled 2025-10-06 04:34:29,366 INFO util.GSet: Computing capacity for map cachedBlocks 2025-10-06 04:34:29,366 INFO util.GSet: VM type = 64-bit 2025-10-06 04:34:29,367 INFO util.GSet: 0.25% max memory 7.6 GB = 19.6 MB 2025-10-06 04:34:29,367 INFO util.GSet: capacity = 2^21 = 2097152 entries 2025-10-06 04:34:29,371 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10 2025-10-06 04:34:29,371 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10 2025-10-06 04:34:29,371 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25 2025-10-06 04:34:29,371 INFO namenode.FSNamesystem: Retry cache on namenode is enabled 2025-10-06 04:34:29,371 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis 2025-10-06 04:34:29,371 INFO util.GSet: Computing capacity for map NameNodeRetryCache 2025-10-06 04:34:29,371 INFO util.GSet: VM type = 64-bit 2025-10-06 04:34:29,371 INFO util.GSet: 0.029999999329447746% max memory 7.6 GB = 2.3 MB 2025-10-06 04:34:29,371 INFO util.GSet: capacity = 2^18 = 262144 entries 2025-10-06 04:34:29,381 INFO common.Storage: Lock on /hadoop-3.3.1/target/test/data/dfs/name-0-1/in_use.lock acquired by nodename 417@3cbcefa146bc 2025-10-06 04:34:29,385 INFO common.Storage: Lock on /hadoop-3.3.1/target/test/data/dfs/name-0-2/in_use.lock acquired by nodename 417@3cbcefa146bc 2025-10-06 04:34:29,388 INFO namenode.FileJournalManager: Recovering unfinalized segments in /hadoop-3.3.1/target/test/data/dfs/name-0-1/current 2025-10-06 04:34:29,388 INFO namenode.FileJournalManager: Recovering unfinalized segments in /hadoop-3.3.1/target/test/data/dfs/name-0-2/current 2025-10-06 04:34:29,391 INFO namenode.FSImage: No edit log streams selected. 2025-10-06 04:34:29,392 INFO namenode.FSImage: Planning to load image: FSImageFile(file=/hadoop-3.3.1/target/test/data/dfs/name-0-1/current/fsimage_0000000000000000000, cpktTxId=0000000000000000000) 2025-10-06 04:34:29,416 INFO namenode.FSImageFormatPBINode: Loading 1 INodes. 2025-10-06 04:34:29,417 INFO namenode.FSImageFormatPBINode: Successfully loaded 1 inodes 2025-10-06 04:34:29,422 INFO namenode.FSImageFormatPBINode: Completed update blocks map and name cache, total waiting duration 0ms. 2025-10-06 04:34:29,424 INFO namenode.FSImageFormatProtobuf: Loaded FSImage in 0 seconds. 2025-10-06 04:34:29,424 INFO namenode.FSImage: Loaded image for txid 0 from /hadoop-3.3.1/target/test/data/dfs/name-0-1/current/fsimage_0000000000000000000 2025-10-06 04:34:29,428 INFO namenode.FSNamesystem: Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false) 2025-10-06 04:34:29,429 INFO namenode.FSEditLog: Starting log segment at 1 2025-10-06 04:34:29,446 INFO namenode.NameCache: initialized with 0 entries 0 lookups 2025-10-06 04:34:29,447 INFO namenode.FSNamesystem: Finished loading FSImage in 74 msecs 2025-10-06 04:34:29,601 INFO namenode.NameNode: RPC server is binding to localhost:12222 2025-10-06 04:34:29,601 INFO namenode.NameNode: Enable NameNode state context:false 2025-10-06 04:34:29,610 INFO ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 1000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2025-10-06 04:34:29,620 INFO ipc.Server: Starting Socket Reader #1 for port 12222 2025-10-06 04:34:29,813 INFO namenode.FSNamesystem: Registered FSNamesystemState, ReplicatedBlocksState and ECBlockGroupsState MBeans. 2025-10-06 04:34:29,828 INFO namenode.LeaseManager: Number of blocks under construction: 0 2025-10-06 04:34:29,837 INFO blockmanagement.DatanodeAdminDefaultMonitor: Initialized the Default Decommission and Maintenance monitor 2025-10-06 04:34:29,840 INFO blockmanagement.BlockManager: initializing replication queues 2025-10-06 04:34:29,840 INFO hdfs.StateChange: STATE* Leaving safe mode after 0 secs 2025-10-06 04:34:29,840 INFO hdfs.StateChange: STATE* Network topology has 0 racks and 0 datanodes 2025-10-06 04:34:29,840 INFO hdfs.StateChange: STATE* UnderReplicatedBlocks has 0 blocks 2025-10-06 04:34:29,851 INFO blockmanagement.BlockManager: Total number of blocks = 0 2025-10-06 04:34:29,851 INFO blockmanagement.BlockManager: Number of invalid blocks = 0 2025-10-06 04:34:29,851 INFO blockmanagement.BlockManager: Number of under-replicated blocks = 0 2025-10-06 04:34:29,851 INFO blockmanagement.BlockManager: Number of over-replicated blocks = 0 2025-10-06 04:34:29,851 INFO blockmanagement.BlockManager: Number of blocks being written = 0 2025-10-06 04:34:29,851 INFO hdfs.StateChange: STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 11 msec 2025-10-06 04:34:29,878 INFO ipc.Server: IPC Server Responder: starting 2025-10-06 04:34:29,878 INFO ipc.Server: IPC Server listener on 12222: starting 2025-10-06 04:34:29,881 INFO namenode.NameNode: NameNode RPC up at: localhost/127.0.0.1:12222 2025-10-06 04:34:29,884 INFO namenode.FSNamesystem: Starting services required for active state 2025-10-06 04:34:29,884 INFO namenode.FSDirectory: Initializing quota with 12 thread(s) 2025-10-06 04:34:29,890 INFO namenode.FSDirectory: Quota initialization completed in 6 milliseconds name space=1 storage space=0 storage types=RAM_DISK=0, SSD=0, DISK=0, ARCHIVE=0, PROVIDED=0 2025-10-06 04:34:29,897 INFO blockmanagement.CacheReplicationMonitor: Starting CacheReplicationMonitor with interval 30000 milliseconds 2025-10-06 04:34:29,904 INFO hdfs.MiniDFSCluster: Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1,[DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2 2025-10-06 04:34:29,952 INFO checker.ThrottledAsyncChecker: Scheduling a check for [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1 2025-10-06 04:34:29,962 INFO checker.ThrottledAsyncChecker: Scheduling a check for [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2 2025-10-06 04:34:29,979 INFO impl.MetricsSystemImpl: DataNode metrics system started (again) 2025-10-06 04:34:29,984 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling 2025-10-06 04:34:29,988 INFO datanode.BlockScanner: Initialized block scanner with targetBytesPerSec 1048576 2025-10-06 04:34:29,992 INFO datanode.DataNode: Configured hostname is 127.0.0.1 2025-10-06 04:34:29,993 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling 2025-10-06 04:34:29,997 INFO datanode.DataNode: Starting DataNode with maxLockedMemory = 0 2025-10-06 04:34:30,003 INFO datanode.DataNode: Opened streaming server at /127.0.0.1:37023 2025-10-06 04:34:30,005 INFO datanode.DataNode: Balancing bandwidth is 104857600 bytes/s 2025-10-06 04:34:30,005 INFO datanode.DataNode: Number threads for balancing is 100 2025-10-06 04:34:30,015 INFO server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2025-10-06 04:34:30,016 INFO http.HttpRequestLog: Http request log for http.requests.datanode is not defined 2025-10-06 04:34:30,018 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2025-10-06 04:34:30,019 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode 2025-10-06 04:34:30,019 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2025-10-06 04:34:30,020 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2025-10-06 04:34:30,023 INFO http.HttpServer2: Jetty bound to port 40377 2025-10-06 04:34:30,023 INFO server.Server: jetty-9.4.40.v20210413; built: 2021-04-13T20:42:42.668Z; git: b881a572662e1943a14ae12e7e1207989f218b74; jvm 11.0.25+9-post-Ubuntu-1ubuntu122.04 2025-10-06 04:34:30,024 INFO server.session: DefaultSessionIdManager workerName=node0 2025-10-06 04:34:30,024 INFO server.session: No SessionScavenger set, using defaults 2025-10-06 04:34:30,024 INFO server.session: node0 Scavenging every 660000ms 2025-10-06 04:34:30,025 INFO handler.ContextHandler: Started o.e.j.s.ServletContextHandler@4a3bd45b{logs,/logs,file:///hadoop-3.3.1/logs,AVAILABLE} 2025-10-06 04:34:30,026 INFO handler.ContextHandler: Started o.e.j.s.ServletContextHandler@4f2d995e{static,/static,file:///hadoop-3.3.1/share/hadoop/hdfs/webapps/static/,AVAILABLE} 2025-10-06 04:34:30,035 INFO handler.ContextHandler: Started o.e.j.w.WebAppContext@49e4c2d5{datanode,/,file:///hadoop-3.3.1/share/hadoop/hdfs/webapps/datanode/,AVAILABLE}{file:/hadoop-3.3.1/share/hadoop/hdfs/webapps/datanode} 2025-10-06 04:34:30,036 INFO server.AbstractConnector: Started ServerConnector@1756f7cc{HTTP/1.1, (http/1.1)}{localhost:40377} 2025-10-06 04:34:30,037 INFO server.Server: Started @3056ms 2025-10-06 04:34:30,153 WARN web.DatanodeHttpServer: Got null for restCsrfPreventionFilter - will not do any filtering. 2025-10-06 04:34:30,247 INFO web.DatanodeHttpServer: Listening HTTP traffic on /127.0.0.1:41273 2025-10-06 04:34:30,249 INFO util.JvmPauseMonitor: Starting JVM pause monitor 2025-10-06 04:34:30,250 INFO datanode.DataNode: dnUserName = clickhouse 2025-10-06 04:34:30,250 INFO datanode.DataNode: supergroup = supergroup 2025-10-06 04:34:30,266 INFO ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 1000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2025-10-06 04:34:30,266 INFO ipc.Server: Starting Socket Reader #1 for port 0 2025-10-06 04:34:30,273 INFO datanode.DataNode: Opened IPC server at /127.0.0.1:38775 2025-10-06 04:34:30,297 INFO datanode.DataNode: Refresh request received for nameservices: null 2025-10-06 04:34:30,298 INFO datanode.DataNode: Starting BPOfferServices for nameservices: 2025-10-06 04:34:30,307 INFO datanode.DataNode: Block pool (Datanode Uuid unassigned) service to localhost/127.0.0.1:12222 starting to offer service 2025-10-06 04:34:30,312 INFO ipc.Server: IPC Server Responder: starting 2025-10-06 04:34:30,312 INFO ipc.Server: IPC Server listener on 0: starting 2025-10-06 04:34:30,496 INFO datanode.DataNode: Acknowledging ACTIVE Namenode during handshakeBlock pool (Datanode Uuid unassigned) service to localhost/127.0.0.1:12222 2025-10-06 04:34:30,498 INFO common.Storage: Using 2 threads to upgrade data directories (dfs.datanode.parallel.volumes.load.threads.num=2, dataDirs=2) 2025-10-06 04:34:30,502 INFO common.Storage: Lock on /hadoop-3.3.1/target/test/data/dfs/data/data1/in_use.lock acquired by nodename 417@3cbcefa146bc 2025-10-06 04:34:30,504 INFO common.Storage: Storage directory with location [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1 is not formatted for namespace 34832319. Formatting... 2025-10-06 04:34:30,505 INFO common.Storage: Generated new storageID DS-c81612fd-8a3b-44d6-a8b4-71ac66e71b4e for directory /hadoop-3.3.1/target/test/data/dfs/data/data1 2025-10-06 04:34:30,511 INFO common.Storage: Lock on /hadoop-3.3.1/target/test/data/dfs/data/data2/in_use.lock acquired by nodename 417@3cbcefa146bc 2025-10-06 04:34:30,512 INFO common.Storage: Storage directory with location [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2 is not formatted for namespace 34832319. Formatting... 2025-10-06 04:34:30,512 INFO common.Storage: Generated new storageID DS-35a508a4-fc9b-4d4e-8e26-08431fa3273d for directory /hadoop-3.3.1/target/test/data/dfs/data/data2 2025-10-06 04:34:30,538 INFO common.Storage: Analyzing storage directories for bpid BP-2001034388-172.17.0.2-1759743268446 2025-10-06 04:34:30,539 INFO common.Storage: Locking is disabled for /hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446 2025-10-06 04:34:30,540 INFO common.Storage: Block pool storage directory for location [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1 and block pool id BP-2001034388-172.17.0.2-1759743268446 is not formatted. Formatting ... 2025-10-06 04:34:30,540 INFO common.Storage: Formatting block pool BP-2001034388-172.17.0.2-1759743268446 directory /hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current 2025-10-06 04:34:30,564 INFO common.Storage: Analyzing storage directories for bpid BP-2001034388-172.17.0.2-1759743268446 2025-10-06 04:34:30,565 INFO common.Storage: Locking is disabled for /hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446 2025-10-06 04:34:30,565 INFO common.Storage: Block pool storage directory for location [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2 and block pool id BP-2001034388-172.17.0.2-1759743268446 is not formatted. Formatting ... 2025-10-06 04:34:30,565 INFO common.Storage: Formatting block pool BP-2001034388-172.17.0.2-1759743268446 directory /hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current 2025-10-06 04:34:30,569 INFO datanode.DataNode: Setting up storage: nsid=34832319;bpid=BP-2001034388-172.17.0.2-1759743268446;lv=-57;nsInfo=lv=-66;cid=testClusterID;nsid=34832319;c=1759743268446;bpid=BP-2001034388-172.17.0.2-1759743268446;dnuuid=null 2025-10-06 04:34:30,573 INFO datanode.DataNode: Generated and persisted new Datanode UUID f541b95c-3986-4067-85fc-5448d525fcb5 2025-10-06 04:34:30,586 INFO impl.FsDatasetImpl: The datanode lock is a read write lock 2025-10-06 04:34:30,669 INFO impl.FsDatasetImpl: Added new volume: DS-c81612fd-8a3b-44d6-a8b4-71ac66e71b4e 2025-10-06 04:34:30,669 INFO impl.FsDatasetImpl: Added volume - [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1, StorageType: DISK 2025-10-06 04:34:30,672 INFO impl.FsDatasetImpl: Added new volume: DS-35a508a4-fc9b-4d4e-8e26-08431fa3273d 2025-10-06 04:34:30,672 INFO impl.FsDatasetImpl: Added volume - [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2, StorageType: DISK 2025-10-06 04:34:30,676 INFO impl.MemoryMappableBlockLoader: Initializing cache loader: MemoryMappableBlockLoader. 2025-10-06 04:34:30,681 INFO impl.FsDatasetImpl: Registered FSDatasetState MBean 2025-10-06 04:34:30,687 INFO impl.FsDatasetImpl: Adding block pool BP-2001034388-172.17.0.2-1759743268446 2025-10-06 04:34:30,688 INFO impl.FsDatasetImpl: Scanning block pool BP-2001034388-172.17.0.2-1759743268446 on volume /hadoop-3.3.1/target/test/data/dfs/data/data1... 2025-10-06 04:34:30,688 INFO impl.FsDatasetImpl: Scanning block pool BP-2001034388-172.17.0.2-1759743268446 on volume /hadoop-3.3.1/target/test/data/dfs/data/data2... 2025-10-06 04:34:30,730 INFO impl.FsDatasetImpl: Time taken to scan block pool BP-2001034388-172.17.0.2-1759743268446 on /hadoop-3.3.1/target/test/data/dfs/data/data1: 41ms 2025-10-06 04:34:30,730 INFO impl.FsDatasetImpl: Time taken to scan block pool BP-2001034388-172.17.0.2-1759743268446 on /hadoop-3.3.1/target/test/data/dfs/data/data2: 40ms 2025-10-06 04:34:30,731 INFO impl.FsDatasetImpl: Total time to scan all replicas for block pool BP-2001034388-172.17.0.2-1759743268446: 43ms 2025-10-06 04:34:30,732 INFO impl.FsDatasetImpl: Adding replicas to map for block pool BP-2001034388-172.17.0.2-1759743268446 on volume /hadoop-3.3.1/target/test/data/dfs/data/data1... 2025-10-06 04:34:30,732 INFO impl.FsDatasetImpl: Adding replicas to map for block pool BP-2001034388-172.17.0.2-1759743268446 on volume /hadoop-3.3.1/target/test/data/dfs/data/data2... 2025-10-06 04:34:30,733 INFO impl.BlockPoolSlice: Replica Cache file: /hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/replicas doesn't exist 2025-10-06 04:34:30,733 INFO impl.BlockPoolSlice: Replica Cache file: /hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/replicas doesn't exist 2025-10-06 04:34:30,734 INFO hdfs.MiniDFSCluster: dnInfo.length != numDataNodes 2025-10-06 04:34:30,734 INFO hdfs.MiniDFSCluster: Waiting for cluster to become active 2025-10-06 04:34:30,734 INFO impl.FsDatasetImpl: Time to add replicas to map for block pool BP-2001034388-172.17.0.2-1759743268446 on volume /hadoop-3.3.1/target/test/data/dfs/data/data1: 3ms 2025-10-06 04:34:30,735 INFO impl.FsDatasetImpl: Time to add replicas to map for block pool BP-2001034388-172.17.0.2-1759743268446 on volume /hadoop-3.3.1/target/test/data/dfs/data/data2: 2ms 2025-10-06 04:34:30,735 INFO impl.FsDatasetImpl: Total time to add all replicas to map for block pool BP-2001034388-172.17.0.2-1759743268446: 4ms 2025-10-06 04:34:30,735 INFO checker.ThrottledAsyncChecker: Scheduling a check for /hadoop-3.3.1/target/test/data/dfs/data/data1 2025-10-06 04:34:30,746 INFO checker.DatasetVolumeChecker: Scheduled health check for volume /hadoop-3.3.1/target/test/data/dfs/data/data1 2025-10-06 04:34:30,747 INFO checker.ThrottledAsyncChecker: Scheduling a check for /hadoop-3.3.1/target/test/data/dfs/data/data2 2025-10-06 04:34:30,747 INFO checker.DatasetVolumeChecker: Scheduled health check for volume /hadoop-3.3.1/target/test/data/dfs/data/data2 2025-10-06 04:34:30,750 INFO datanode.VolumeScanner: Now scanning bpid BP-2001034388-172.17.0.2-1759743268446 on volume /hadoop-3.3.1/target/test/data/dfs/data/data2 2025-10-06 04:34:30,750 INFO datanode.VolumeScanner: Now scanning bpid BP-2001034388-172.17.0.2-1759743268446 on volume /hadoop-3.3.1/target/test/data/dfs/data/data1 2025-10-06 04:34:30,751 INFO datanode.VolumeScanner: VolumeScanner(/hadoop-3.3.1/target/test/data/dfs/data/data2, DS-35a508a4-fc9b-4d4e-8e26-08431fa3273d): finished scanning block pool BP-2001034388-172.17.0.2-1759743268446 2025-10-06 04:34:30,751 INFO datanode.VolumeScanner: VolumeScanner(/hadoop-3.3.1/target/test/data/dfs/data/data1, DS-c81612fd-8a3b-44d6-a8b4-71ac66e71b4e): finished scanning block pool BP-2001034388-172.17.0.2-1759743268446 2025-10-06 04:34:30,752 WARN datanode.DirectoryScanner: dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value above 1000 ms/sec. Assuming default value of -1 2025-10-06 04:34:30,752 INFO datanode.DirectoryScanner: Periodic Directory Tree Verification scan starting in 1471282ms with interval of 21600000ms and throttle limit of -1ms/s 2025-10-06 04:34:30,759 INFO datanode.DataNode: Block pool BP-2001034388-172.17.0.2-1759743268446 (Datanode Uuid f541b95c-3986-4067-85fc-5448d525fcb5) service to localhost/127.0.0.1:12222 beginning handshake with NN 2025-10-06 04:34:30,765 INFO datanode.VolumeScanner: VolumeScanner(/hadoop-3.3.1/target/test/data/dfs/data/data2, DS-35a508a4-fc9b-4d4e-8e26-08431fa3273d): no suitable block pools found to scan. Waiting 1814399984 ms. 2025-10-06 04:34:30,766 INFO datanode.VolumeScanner: VolumeScanner(/hadoop-3.3.1/target/test/data/dfs/data/data1, DS-c81612fd-8a3b-44d6-a8b4-71ac66e71b4e): no suitable block pools found to scan. Waiting 1814399985 ms. 2025-10-06 04:34:30,777 INFO hdfs.StateChange: BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1:37023, datanodeUuid=f541b95c-3986-4067-85fc-5448d525fcb5, infoPort=41273, infoSecurePort=0, ipcPort=38775, storageInfo=lv=-57;cid=testClusterID;nsid=34832319;c=1759743268446) storage f541b95c-3986-4067-85fc-5448d525fcb5 2025-10-06 04:34:30,778 INFO net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:37023 2025-10-06 04:34:30,778 INFO blockmanagement.BlockReportLeaseManager: Registered DN f541b95c-3986-4067-85fc-5448d525fcb5 (127.0.0.1:37023). 2025-10-06 04:34:30,783 INFO datanode.DataNode: Block pool BP-2001034388-172.17.0.2-1759743268446 (Datanode Uuid f541b95c-3986-4067-85fc-5448d525fcb5) service to localhost/127.0.0.1:12222 successfully registered with NN 2025-10-06 04:34:30,783 INFO datanode.DataNode: For namenode localhost/127.0.0.1:12222 using BLOCKREPORT_INTERVAL of 21600000msecs CACHEREPORT_INTERVAL of 10000msecs Initial delay: 0msecs; heartBeatInterval=3000 2025-10-06 04:34:30,797 INFO blockmanagement.DatanodeDescriptor: Adding new storage ID DS-c81612fd-8a3b-44d6-a8b4-71ac66e71b4e for DN 127.0.0.1:37023 2025-10-06 04:34:30,797 INFO blockmanagement.DatanodeDescriptor: Adding new storage ID DS-35a508a4-fc9b-4d4e-8e26-08431fa3273d for DN 127.0.0.1:37023 2025-10-06 04:34:30,827 INFO BlockStateChange: BLOCK* processReport 0x28c720e6a12848d0: Processing first storage report for DS-c81612fd-8a3b-44d6-a8b4-71ac66e71b4e from datanode f541b95c-3986-4067-85fc-5448d525fcb5 2025-10-06 04:34:30,830 INFO BlockStateChange: BLOCK* processReport 0x28c720e6a12848d0: from storage DS-c81612fd-8a3b-44d6-a8b4-71ac66e71b4e node DatanodeRegistration(127.0.0.1:37023, datanodeUuid=f541b95c-3986-4067-85fc-5448d525fcb5, infoPort=41273, infoSecurePort=0, ipcPort=38775, storageInfo=lv=-57;cid=testClusterID;nsid=34832319;c=1759743268446), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2025-10-06 04:34:30,830 INFO BlockStateChange: BLOCK* processReport 0x28c720e6a12848d0: Processing first storage report for DS-35a508a4-fc9b-4d4e-8e26-08431fa3273d from datanode f541b95c-3986-4067-85fc-5448d525fcb5 2025-10-06 04:34:30,830 INFO BlockStateChange: BLOCK* processReport 0x28c720e6a12848d0: from storage DS-35a508a4-fc9b-4d4e-8e26-08431fa3273d node DatanodeRegistration(127.0.0.1:37023, datanodeUuid=f541b95c-3986-4067-85fc-5448d525fcb5, infoPort=41273, infoSecurePort=0, ipcPort=38775, storageInfo=lv=-57;cid=testClusterID;nsid=34832319;c=1759743268446), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2025-10-06 04:34:30,845 INFO hdfs.MiniDFSCluster: Cluster is active 2025-10-06 04:34:30,848 INFO datanode.DataNode: Successfully sent block report 0x28c720e6a12848d0 to namenode: localhost/127.0.0.1:12222, containing 2 storage report(s), of which we sent 2. The reports had 0 total blocks and used 1 RPC(s). This took 4 msecs to generate and 33 msecs for RPC and NN processing. Got back one command: FinalizeCommand/5. 2025-10-06 04:34:30,850 INFO datanode.DataNode: Got finalize command for block pool BP-2001034388-172.17.0.2-1759743268446 2025-10-06 04:34:30,851 INFO mapreduce.MiniHadoopClusterManager: Started MiniDFSCluster -- namenode on port 12222 2025-10-06 04:35:23,482 INFO hdfs.StateChange: BLOCK* allocate blk_1073741825_1001, replicas=127.0.0.1:37023 for /02368_data_3.jsonl 2025-10-06 04:35:23,564 INFO hdfs.StateChange: BLOCK* allocate blk_1073741826_1002, replicas=127.0.0.1:37023 for /02368_data_6.jsonl 2025-10-06 04:35:23,569 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741825_1001 src: /127.0.0.1:60032 dest: /127.0.0.1:37023 2025-10-06 04:35:23,573 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741826_1002 src: /127.0.0.1:60044 dest: /127.0.0.1:37023 2025-10-06 04:35:23,576 INFO hdfs.StateChange: BLOCK* allocate blk_1073741827_1003, replicas=127.0.0.1:37023 for /02368_data_7.jsonl 2025-10-06 04:35:23,577 INFO hdfs.StateChange: BLOCK* allocate blk_1073741828_1004, replicas=127.0.0.1:37023 for /02368_data_5.jsonl 2025-10-06 04:35:23,587 INFO hdfs.StateChange: BLOCK* allocate blk_1073741829_1005, replicas=127.0.0.1:37023 for /02368_data_10.jsonl 2025-10-06 04:35:23,589 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741827_1003 src: /127.0.0.1:60054 dest: /127.0.0.1:37023 2025-10-06 04:35:23,598 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741828_1004 src: /127.0.0.1:60060 dest: /127.0.0.1:37023 2025-10-06 04:35:23,600 INFO hdfs.StateChange: BLOCK* allocate blk_1073741830_1006, replicas=127.0.0.1:37023 for /02368_data_1.jsonl 2025-10-06 04:35:23,606 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741829_1005 src: /127.0.0.1:60072 dest: /127.0.0.1:37023 2025-10-06 04:35:23,606 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741830_1006 src: /127.0.0.1:60074 dest: /127.0.0.1:37023 2025-10-06 04:35:23,674 INFO hdfs.StateChange: BLOCK* allocate blk_1073741831_1007, replicas=127.0.0.1:37023 for /02368_data_8.jsonl 2025-10-06 04:35:23,702 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741831_1007 src: /127.0.0.1:60076 dest: /127.0.0.1:37023 2025-10-06 04:35:23,729 INFO hdfs.StateChange: BLOCK* allocate blk_1073741832_1008, replicas=127.0.0.1:37023 for /02368_data_2.jsonl 2025-10-06 04:35:23,753 INFO hdfs.StateChange: BLOCK* allocate blk_1073741833_1009, replicas=127.0.0.1:37023 for /02368_data_4.jsonl 2025-10-06 04:35:23,754 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741832_1008 src: /127.0.0.1:60088 dest: /127.0.0.1:37023 2025-10-06 04:35:23,764 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741833_1009 src: /127.0.0.1:60098 dest: /127.0.0.1:37023 2025-10-06 04:35:23,795 INFO hdfs.StateChange: BLOCK* allocate blk_1073741834_1010, replicas=127.0.0.1:37023 for /02368_data_9.jsonl 2025-10-06 04:35:23,814 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741834_1010 src: /127.0.0.1:60106 dest: /127.0.0.1:37023 2025-10-06 04:35:24,056 INFO DataNode.clienttrace: src: /127.0.0.1:60088, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_11_pid_625_tid_280477847157376, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741832_1008, duration(ns): 270483142 2025-10-06 04:35:24,056 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741832_1008, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,057 INFO DataNode.clienttrace: src: /127.0.0.1:60032, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_12_pid_625_tid_280477458266752, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741825_1001, duration(ns): 428298357 2025-10-06 04:35:24,059 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741825_1001, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,070 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.533558_count_12_pid_625_tid_280477458266752 2025-10-06 04:35:24,071 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.533558_count_11_pid_625_tid_280477847157376 2025-10-06 04:35:24,096 INFO DataNode.clienttrace: src: /127.0.0.1:60054, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_17_pid_625_tid_280478109235840, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741827_1003, duration(ns): 492944520 2025-10-06 04:35:24,097 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741827_1003, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,098 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.533558_count_17_pid_625_tid_280478109235840 2025-10-06 04:35:24,098 INFO DataNode.clienttrace: src: /127.0.0.1:60044, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_20_pid_625_tid_280477771070080, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741826_1002, duration(ns): 495370234 2025-10-06 04:35:24,099 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741826_1002, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,100 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.533558_count_20_pid_625_tid_280477771070080 2025-10-06 04:35:24,109 INFO hdfs.StateChange: BLOCK* allocate blk_1073741835_1011, replicas=127.0.0.1:37023 for /02368_data_3.jsonl 2025-10-06 04:35:24,110 INFO DataNode.clienttrace: src: /127.0.0.1:60060, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_19_pid_625_tid_280478396676736, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741828_1004, duration(ns): 508471141 2025-10-06 04:35:24,110 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741828_1004, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,110 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.533558_count_19_pid_625_tid_280478396676736 2025-10-06 04:35:24,120 INFO hdfs.StateChange: BLOCK* allocate blk_1073741836_1012, replicas=127.0.0.1:37023 for /02368_data_2.jsonl 2025-10-06 04:35:24,123 INFO hdfs.StateChange: BLOCK* allocate blk_1073741837_1013, replicas=127.0.0.1:37023 for /02368_data_6.jsonl 2025-10-06 04:35:24,138 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741835_1011 src: /127.0.0.1:60116 dest: /127.0.0.1:37023 2025-10-06 04:35:24,152 INFO hdfs.StateChange: BLOCK* allocate blk_1073741838_1014, replicas=127.0.0.1:37023 for /02368_data_5.jsonl 2025-10-06 04:35:24,156 INFO hdfs.StateChange: BLOCK* allocate blk_1073741839_1015, replicas=127.0.0.1:37023 for /02368_data_7.jsonl 2025-10-06 04:35:24,160 INFO DataNode.clienttrace: src: /127.0.0.1:60076, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_13_pid_625_tid_280503843592832, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741831_1007, duration(ns): 446954303 2025-10-06 04:35:24,160 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741831_1007, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,160 INFO DataNode.clienttrace: src: /127.0.0.1:60074, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_16_pid_625_tid_280477906336384, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741830_1006, duration(ns): 532821529 2025-10-06 04:35:24,160 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741830_1006, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,162 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.533558_count_13_pid_625_tid_280503843592832 2025-10-06 04:35:24,162 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.533558_count_16_pid_625_tid_280477906336384 2025-10-06 04:35:24,165 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741836_1012 src: /127.0.0.1:60128 dest: /127.0.0.1:37023 2025-10-06 04:35:24,165 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741838_1014 src: /127.0.0.1:60146 dest: /127.0.0.1:37023 2025-10-06 04:35:24,166 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741839_1015 src: /127.0.0.1:60154 dest: /127.0.0.1:37023 2025-10-06 04:35:24,167 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741837_1013 src: /127.0.0.1:60138 dest: /127.0.0.1:37023 2025-10-06 04:35:24,178 INFO hdfs.StateChange: BLOCK* allocate blk_1073741840_1016, replicas=127.0.0.1:37023 for /02368_data_1.jsonl 2025-10-06 04:35:24,188 INFO hdfs.StateChange: BLOCK* allocate blk_1073741841_1017, replicas=127.0.0.1:37023 for /02368_data_8.jsonl 2025-10-06 04:35:24,193 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741840_1016 src: /127.0.0.1:60170 dest: /127.0.0.1:37023 2025-10-06 04:35:24,216 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741841_1017 src: /127.0.0.1:60172 dest: /127.0.0.1:37023 2025-10-06 04:35:24,237 INFO DataNode.clienttrace: src: /127.0.0.1:60106, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_14_pid_625_tid_280477948607104, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741834_1010, duration(ns): 421727782 2025-10-06 04:35:24,237 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741834_1010, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,243 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.533558_count_14_pid_625_tid_280477948607104 2025-10-06 04:35:24,246 INFO hdfs.StateChange: BLOCK* allocate blk_1073741842_1018, replicas=127.0.0.1:37023 for /02368_data_9.jsonl 2025-10-06 04:35:24,249 INFO DataNode.clienttrace: src: /127.0.0.1:60072, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_15_pid_625_tid_280503852046976, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741829_1005, duration(ns): 638946005 2025-10-06 04:35:24,249 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741829_1005, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,251 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.533558_count_15_pid_625_tid_280503852046976 2025-10-06 04:35:24,279 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741842_1018 src: /127.0.0.1:60174 dest: /127.0.0.1:37023 2025-10-06 04:35:24,279 INFO hdfs.StateChange: BLOCK* allocate blk_1073741843_1019, replicas=127.0.0.1:37023 for /02368_data_10.jsonl 2025-10-06 04:35:24,290 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741843_1019 src: /127.0.0.1:60176 dest: /127.0.0.1:37023 2025-10-06 04:35:24,322 INFO DataNode.clienttrace: src: /127.0.0.1:60098, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_9_pid_625_tid_280477931698816, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741833_1009, duration(ns): 542234423 2025-10-06 04:35:24,322 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741833_1009, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,326 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.533558_count_9_pid_625_tid_280477931698816 2025-10-06 04:35:24,331 INFO hdfs.StateChange: BLOCK* allocate blk_1073741844_1020, replicas=127.0.0.1:37023 for /02368_data_4.jsonl 2025-10-06 04:35:24,338 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741844_1020 src: /127.0.0.1:60190 dest: /127.0.0.1:37023 2025-10-06 04:35:24,457 INFO DataNode.clienttrace: src: /127.0.0.1:60116, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_12_pid_625_tid_280477458266752, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741835_1011, duration(ns): 317087528 2025-10-06 04:35:24,457 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741835_1011, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,458 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.533558_count_12_pid_625_tid_280477458266752 2025-10-06 04:35:24,461 INFO hdfs.StateChange: BLOCK* allocate blk_1073741845_1021, replicas=127.0.0.1:37023 for /02368_data_3.jsonl 2025-10-06 04:35:24,468 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741845_1021 src: /127.0.0.1:60192 dest: /127.0.0.1:37023 2025-10-06 04:35:24,509 INFO DataNode.clienttrace: src: /127.0.0.1:60154, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_17_pid_625_tid_280478109235840, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741839_1015, duration(ns): 333135638 2025-10-06 04:35:24,509 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741839_1015, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,509 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.533558_count_17_pid_625_tid_280478109235840 2025-10-06 04:35:24,513 INFO hdfs.StateChange: BLOCK* allocate blk_1073741846_1022, replicas=127.0.0.1:37023 for /02368_data_7.jsonl 2025-10-06 04:35:24,515 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741846_1022 src: /127.0.0.1:60200 dest: /127.0.0.1:37023 2025-10-06 04:35:24,537 INFO DataNode.clienttrace: src: /127.0.0.1:60170, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_16_pid_625_tid_280477906336384, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741840_1016, duration(ns): 340162338 2025-10-06 04:35:24,537 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741840_1016, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,538 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.533558_count_16_pid_625_tid_280477906336384 2025-10-06 04:35:24,540 INFO hdfs.StateChange: BLOCK* allocate blk_1073741847_1023, replicas=127.0.0.1:37023 for /02368_data_1.jsonl 2025-10-06 04:35:24,543 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741847_1023 src: /127.0.0.1:60214 dest: /127.0.0.1:37023 2025-10-06 04:35:24,549 INFO DataNode.clienttrace: src: /127.0.0.1:60138, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_20_pid_625_tid_280477771070080, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741837_1013, duration(ns): 366866599 2025-10-06 04:35:24,549 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741837_1013, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,550 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.533558_count_20_pid_625_tid_280477771070080 2025-10-06 04:35:24,553 INFO hdfs.StateChange: BLOCK* allocate blk_1073741848_1024, replicas=127.0.0.1:37023 for /02368_data_6.jsonl 2025-10-06 04:35:24,557 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741848_1024 src: /127.0.0.1:60224 dest: /127.0.0.1:37023 2025-10-06 04:35:24,563 INFO DataNode.clienttrace: src: /127.0.0.1:60146, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_19_pid_625_tid_280478396676736, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741838_1014, duration(ns): 389876688 2025-10-06 04:35:24,563 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741838_1014, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,564 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.533558_count_19_pid_625_tid_280478396676736 2025-10-06 04:35:24,566 INFO hdfs.StateChange: BLOCK* allocate blk_1073741849_1025, replicas=127.0.0.1:37023 for /02368_data_5.jsonl 2025-10-06 04:35:24,572 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741849_1025 src: /127.0.0.1:60238 dest: /127.0.0.1:37023 2025-10-06 04:35:24,572 INFO DataNode.clienttrace: src: /127.0.0.1:60174, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_14_pid_625_tid_280477948607104, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741842_1018, duration(ns): 288731763 2025-10-06 04:35:24,572 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741842_1018, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,573 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.533558_count_14_pid_625_tid_280477948607104 2025-10-06 04:35:24,577 INFO DataNode.clienttrace: src: /127.0.0.1:60172, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_13_pid_625_tid_280503843592832, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741841_1017, duration(ns): 343118780 2025-10-06 04:35:24,577 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741841_1017, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,577 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.533558_count_13_pid_625_tid_280503843592832 2025-10-06 04:35:24,586 INFO hdfs.StateChange: BLOCK* allocate blk_1073741850_1026, replicas=127.0.0.1:37023 for /02368_data_9.jsonl 2025-10-06 04:35:24,587 INFO hdfs.StateChange: BLOCK* allocate blk_1073741851_1027, replicas=127.0.0.1:37023 for /02368_data_8.jsonl 2025-10-06 04:35:24,588 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741850_1026 src: /127.0.0.1:60254 dest: /127.0.0.1:37023 2025-10-06 04:35:24,591 INFO DataNode.clienttrace: src: /127.0.0.1:60176, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_15_pid_625_tid_280503852046976, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741843_1019, duration(ns): 266667168 2025-10-06 04:35:24,591 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741843_1019, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,592 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.533558_count_15_pid_625_tid_280503852046976 2025-10-06 04:35:24,595 INFO hdfs.StateChange: BLOCK* allocate blk_1073741852_1028, replicas=127.0.0.1:37023 for /02368_data_10.jsonl 2025-10-06 04:35:24,604 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741852_1028 src: /127.0.0.1:60280 dest: /127.0.0.1:37023 2025-10-06 04:35:24,605 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741851_1027 src: /127.0.0.1:60266 dest: /127.0.0.1:37023 2025-10-06 04:35:24,606 INFO DataNode.clienttrace: src: /127.0.0.1:60128, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_11_pid_625_tid_280477847157376, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741836_1012, duration(ns): 434249282 2025-10-06 04:35:24,607 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741836_1012, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,607 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.533558_count_11_pid_625_tid_280477847157376 2025-10-06 04:35:24,610 INFO hdfs.StateChange: BLOCK* allocate blk_1073741853_1029, replicas=127.0.0.1:37023 for /02368_data_2.jsonl 2025-10-06 04:35:24,619 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741853_1029 src: /127.0.0.1:60292 dest: /127.0.0.1:37023 2025-10-06 04:35:24,698 INFO DataNode.clienttrace: src: /127.0.0.1:60190, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_9_pid_625_tid_280477931698816, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741844_1020, duration(ns): 355625759 2025-10-06 04:35:24,699 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.533558_count_9_pid_625_tid_280477931698816 2025-10-06 04:35:24,699 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741844_1020, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,701 INFO hdfs.StateChange: BLOCK* allocate blk_1073741854_1030, replicas=127.0.0.1:37023 for /02368_data_4.jsonl 2025-10-06 04:35:24,703 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741854_1030 src: /127.0.0.1:60302 dest: /127.0.0.1:37023 2025-10-06 04:35:24,714 INFO DataNode.clienttrace: src: /127.0.0.1:60192, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_12_pid_625_tid_280477458266752, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741845_1021, duration(ns): 237949798 2025-10-06 04:35:24,714 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741845_1021, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,715 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.533558_count_12_pid_625_tid_280477458266752 2025-10-06 04:35:24,726 INFO hdfs.StateChange: DIR* completeFile: /02368_data_3.jsonl is closed by libhdfs3_client_rand_0.533558_count_12_pid_625_tid_280477458266752 2025-10-06 04:35:24,758 INFO DataNode.clienttrace: src: /127.0.0.1:60200, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_17_pid_625_tid_280478109235840, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741846_1022, duration(ns): 223742716 2025-10-06 04:35:24,758 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741846_1022, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,759 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.533558_count_17_pid_625_tid_280478109235840 2025-10-06 04:35:24,760 INFO DataNode.clienttrace: src: /127.0.0.1:60214, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_16_pid_625_tid_280477906336384, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741847_1023, duration(ns): 210885131 2025-10-06 04:35:24,760 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741847_1023, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,760 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.533558_count_16_pid_625_tid_280477906336384 2025-10-06 04:35:24,764 INFO hdfs.StateChange: DIR* completeFile: /02368_data_1.jsonl is closed by libhdfs3_client_rand_0.533558_count_16_pid_625_tid_280477906336384 2025-10-06 04:35:24,764 INFO hdfs.StateChange: DIR* completeFile: /02368_data_7.jsonl is closed by libhdfs3_client_rand_0.533558_count_17_pid_625_tid_280478109235840 2025-10-06 04:35:24,790 INFO DataNode.clienttrace: src: /127.0.0.1:60224, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_20_pid_625_tid_280477771070080, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741848_1024, duration(ns): 229903203 2025-10-06 04:35:24,791 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741848_1024, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,791 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.533558_count_20_pid_625_tid_280477771070080 2025-10-06 04:35:24,793 INFO hdfs.StateChange: DIR* completeFile: /02368_data_6.jsonl is closed by libhdfs3_client_rand_0.533558_count_20_pid_625_tid_280477771070080 2025-10-06 04:35:24,803 INFO DataNode.clienttrace: src: /127.0.0.1:60292, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_11_pid_625_tid_280477847157376, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741853_1029, duration(ns): 178004742 2025-10-06 04:35:24,803 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741853_1029, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,804 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.533558_count_11_pid_625_tid_280477847157376 2025-10-06 04:35:24,805 INFO hdfs.StateChange: DIR* completeFile: /02368_data_2.jsonl is closed by libhdfs3_client_rand_0.533558_count_11_pid_625_tid_280477847157376 2025-10-06 04:35:24,820 INFO DataNode.clienttrace: src: /127.0.0.1:60280, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_15_pid_625_tid_280503852046976, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741852_1028, duration(ns): 203587947 2025-10-06 04:35:24,820 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741852_1028, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,820 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.533558_count_15_pid_625_tid_280503852046976 2025-10-06 04:35:24,822 INFO hdfs.StateChange: DIR* completeFile: /02368_data_10.jsonl is closed by libhdfs3_client_rand_0.533558_count_15_pid_625_tid_280503852046976 2025-10-06 04:35:24,827 INFO DataNode.clienttrace: src: /127.0.0.1:60254, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_14_pid_625_tid_280477948607104, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741850_1026, duration(ns): 232317478 2025-10-06 04:35:24,827 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741850_1026, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,827 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.533558_count_14_pid_625_tid_280477948607104 2025-10-06 04:35:24,828 INFO hdfs.StateChange: DIR* completeFile: /02368_data_9.jsonl is closed by libhdfs3_client_rand_0.533558_count_14_pid_625_tid_280477948607104 2025-10-06 04:35:24,833 INFO DataNode.clienttrace: src: /127.0.0.1:60238, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_19_pid_625_tid_280478396676736, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741849_1025, duration(ns): 256669346 2025-10-06 04:35:24,833 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741849_1025, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,834 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.533558_count_19_pid_625_tid_280478396676736 2025-10-06 04:35:24,836 INFO hdfs.StateChange: DIR* completeFile: /02368_data_5.jsonl is closed by libhdfs3_client_rand_0.533558_count_19_pid_625_tid_280478396676736 2025-10-06 04:35:24,853 INFO DataNode.clienttrace: src: /127.0.0.1:60266, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_13_pid_625_tid_280503843592832, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741851_1027, duration(ns): 240404314 2025-10-06 04:35:24,853 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741851_1027, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,853 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.533558_count_13_pid_625_tid_280503843592832 2025-10-06 04:35:24,856 INFO hdfs.StateChange: DIR* completeFile: /02368_data_8.jsonl is closed by libhdfs3_client_rand_0.533558_count_13_pid_625_tid_280503843592832 2025-10-06 04:35:24,879 INFO DataNode.clienttrace: src: /127.0.0.1:60302, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.533558_count_9_pid_625_tid_280477931698816, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741854_1030, duration(ns): 163769179 2025-10-06 04:35:24,879 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741854_1030, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:24,880 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.533558_count_9_pid_625_tid_280477931698816 2025-10-06 04:35:24,881 INFO hdfs.StateChange: DIR* completeFile: /02368_data_4.jsonl is closed by libhdfs3_client_rand_0.533558_count_9_pid_625_tid_280477931698816 2025-10-06 04:35:25,049 INFO hdfs.StateChange: BLOCK* allocate blk_1073741855_1031, replicas=127.0.0.1:37023 for /02368_data_1.jsonl 2025-10-06 04:35:25,052 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741855_1031 src: /127.0.0.1:60316 dest: /127.0.0.1:37023 2025-10-06 04:35:25,055 INFO hdfs.StateChange: BLOCK* allocate blk_1073741856_1032, replicas=127.0.0.1:37023 for /02368_data_5.jsonl 2025-10-06 04:35:25,057 INFO hdfs.StateChange: BLOCK* allocate blk_1073741857_1033, replicas=127.0.0.1:37023 for /02368_data_9.jsonl 2025-10-06 04:35:25,057 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741856_1032 src: /127.0.0.1:60322 dest: /127.0.0.1:37023 2025-10-06 04:35:25,058 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741857_1033 src: /127.0.0.1:60326 dest: /127.0.0.1:37023 2025-10-06 04:35:25,059 INFO hdfs.StateChange: BLOCK* allocate blk_1073741858_1034, replicas=127.0.0.1:37023 for /02368_data_6.jsonl 2025-10-06 04:35:25,061 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741858_1034 src: /127.0.0.1:60334 dest: /127.0.0.1:37023 2025-10-06 04:35:25,083 INFO hdfs.StateChange: BLOCK* allocate blk_1073741859_1035, replicas=127.0.0.1:37023 for /02368_data_7.jsonl 2025-10-06 04:35:25,089 INFO hdfs.StateChange: BLOCK* allocate blk_1073741860_1036, replicas=127.0.0.1:37023 for /02368_data_4.jsonl 2025-10-06 04:35:25,090 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741859_1035 src: /127.0.0.1:60344 dest: /127.0.0.1:37023 2025-10-06 04:35:25,091 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741860_1036 src: /127.0.0.1:60356 dest: /127.0.0.1:37023 2025-10-06 04:35:25,094 INFO hdfs.StateChange: BLOCK* allocate blk_1073741861_1037, replicas=127.0.0.1:37023 for /02368_data_10.jsonl 2025-10-06 04:35:25,099 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741861_1037 src: /127.0.0.1:60364 dest: /127.0.0.1:37023 2025-10-06 04:35:25,099 INFO hdfs.StateChange: BLOCK* allocate blk_1073741862_1038, replicas=127.0.0.1:37023 for /02368_data_2.jsonl 2025-10-06 04:35:25,107 INFO hdfs.StateChange: BLOCK* allocate blk_1073741863_1039, replicas=127.0.0.1:37023 for /02368_data_3.jsonl 2025-10-06 04:35:25,107 INFO hdfs.StateChange: BLOCK* allocate blk_1073741864_1040, replicas=127.0.0.1:37023 for /02368_data_8.jsonl 2025-10-06 04:35:25,115 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741864_1040 src: /127.0.0.1:60390 dest: /127.0.0.1:37023 2025-10-06 04:35:25,115 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741862_1038 src: /127.0.0.1:60376 dest: /127.0.0.1:37023 2025-10-06 04:35:25,134 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741863_1039 src: /127.0.0.1:60400 dest: /127.0.0.1:37023 2025-10-06 04:35:25,401 INFO DataNode.clienttrace: src: /127.0.0.1:60316, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_24_pid_625_tid_280477787978368, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741855_1031, duration(ns): 344566882 2025-10-06 04:35:25,402 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741855_1031, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,403 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.788655_count_24_pid_625_tid_280477787978368 2025-10-06 04:35:25,409 INFO hdfs.StateChange: BLOCK* allocate blk_1073741865_1041, replicas=127.0.0.1:37023 for /02368_data_1.jsonl 2025-10-06 04:35:25,425 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741865_1041 src: /127.0.0.1:60416 dest: /127.0.0.1:37023 2025-10-06 04:35:25,453 INFO DataNode.clienttrace: src: /127.0.0.1:60356, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_23_pid_625_tid_280477804886656, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741860_1036, duration(ns): 350061280 2025-10-06 04:35:25,453 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741860_1036, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,454 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.788655_count_23_pid_625_tid_280477804886656 2025-10-06 04:35:25,454 INFO DataNode.clienttrace: src: /127.0.0.1:60326, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_31_pid_625_tid_280477475175040, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741857_1033, duration(ns): 394354712 2025-10-06 04:35:25,454 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741857_1033, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,456 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.788655_count_31_pid_625_tid_280477475175040 2025-10-06 04:35:25,459 INFO hdfs.StateChange: BLOCK* allocate blk_1073741866_1042, replicas=127.0.0.1:37023 for /02368_data_4.jsonl 2025-10-06 04:35:25,461 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741866_1042 src: /127.0.0.1:60426 dest: /127.0.0.1:37023 2025-10-06 04:35:25,463 INFO hdfs.StateChange: BLOCK* allocate blk_1073741867_1043, replicas=127.0.0.1:37023 for /02368_data_9.jsonl 2025-10-06 04:35:25,465 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741867_1043 src: /127.0.0.1:60440 dest: /127.0.0.1:37023 2025-10-06 04:35:25,473 INFO DataNode.clienttrace: src: /127.0.0.1:60364, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_36_pid_625_tid_280477957061248, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741861_1037, duration(ns): 370690014 2025-10-06 04:35:25,473 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741861_1037, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,474 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.788655_count_36_pid_625_tid_280477957061248 2025-10-06 04:35:25,493 INFO hdfs.StateChange: BLOCK* allocate blk_1073741868_1044, replicas=127.0.0.1:37023 for /02368_data_10.jsonl 2025-10-06 04:35:25,501 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741868_1044 src: /127.0.0.1:60454 dest: /127.0.0.1:37023 2025-10-06 04:35:25,502 INFO DataNode.clienttrace: src: /127.0.0.1:60390, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_39_pid_625_tid_280477914790528, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741864_1040, duration(ns): 369711161 2025-10-06 04:35:25,502 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741864_1040, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,508 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.788655_count_39_pid_625_tid_280477914790528 2025-10-06 04:35:25,514 INFO hdfs.StateChange: BLOCK* allocate blk_1073741869_1045, replicas=127.0.0.1:37023 for /02368_data_8.jsonl 2025-10-06 04:35:25,524 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741869_1045 src: /127.0.0.1:60468 dest: /127.0.0.1:37023 2025-10-06 04:35:25,562 INFO DataNode.clienttrace: src: /127.0.0.1:60376, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_35_pid_625_tid_280478413585024, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741862_1038, duration(ns): 434145321 2025-10-06 04:35:25,562 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741862_1038, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,566 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.788655_count_35_pid_625_tid_280478413585024 2025-10-06 04:35:25,569 INFO DataNode.clienttrace: src: /127.0.0.1:60322, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_34_pid_625_tid_280477940152960, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741856_1032, duration(ns): 509937003 2025-10-06 04:35:25,569 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741856_1032, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,570 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.788655_count_34_pid_625_tid_280477940152960 2025-10-06 04:35:25,572 INFO hdfs.StateChange: BLOCK* allocate blk_1073741870_1046, replicas=127.0.0.1:37023 for /02368_data_2.jsonl 2025-10-06 04:35:25,574 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741870_1046 src: /127.0.0.1:60474 dest: /127.0.0.1:37023 2025-10-06 04:35:25,576 INFO hdfs.StateChange: BLOCK* allocate blk_1073741871_1047, replicas=127.0.0.1:37023 for /02368_data_5.jsonl 2025-10-06 04:35:25,592 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741871_1047 src: /127.0.0.1:60486 dest: /127.0.0.1:37023 2025-10-06 04:35:25,592 INFO DataNode.clienttrace: src: /127.0.0.1:60344, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_32_pid_625_tid_280477754161792, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741859_1035, duration(ns): 500373266 2025-10-06 04:35:25,592 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741859_1035, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,594 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.788655_count_32_pid_625_tid_280477754161792 2025-10-06 04:35:25,602 INFO hdfs.StateChange: BLOCK* allocate blk_1073741872_1048, replicas=127.0.0.1:37023 for /02368_data_7.jsonl 2025-10-06 04:35:25,607 INFO DataNode.clienttrace: src: /127.0.0.1:60334, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_33_pid_625_tid_280477779524224, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741858_1034, duration(ns): 538675134 2025-10-06 04:35:25,607 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741858_1034, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,608 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.788655_count_33_pid_625_tid_280477779524224 2025-10-06 04:35:25,611 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741872_1048 src: /127.0.0.1:60494 dest: /127.0.0.1:37023 2025-10-06 04:35:25,616 INFO hdfs.StateChange: BLOCK* allocate blk_1073741873_1049, replicas=127.0.0.1:37023 for /02368_data_6.jsonl 2025-10-06 04:35:25,630 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741873_1049 src: /127.0.0.1:60498 dest: /127.0.0.1:37023 2025-10-06 04:35:25,720 INFO DataNode.clienttrace: src: /127.0.0.1:60400, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_40_pid_625_tid_280477889428096, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741863_1039, duration(ns): 579399636 2025-10-06 04:35:25,720 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741863_1039, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,721 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.788655_count_40_pid_625_tid_280477889428096 2025-10-06 04:35:25,728 INFO hdfs.StateChange: BLOCK* allocate blk_1073741874_1050, replicas=127.0.0.1:37023 for /02368_data_3.jsonl 2025-10-06 04:35:25,743 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741874_1050 src: /127.0.0.1:60508 dest: /127.0.0.1:37023 2025-10-06 04:35:25,865 INFO DataNode.clienttrace: src: /127.0.0.1:60440, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_31_pid_625_tid_280477475175040, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741867_1043, duration(ns): 398155607 2025-10-06 04:35:25,865 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741867_1043, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,866 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.788655_count_31_pid_625_tid_280477475175040 2025-10-06 04:35:25,872 INFO hdfs.StateChange: BLOCK* allocate blk_1073741875_1051, replicas=127.0.0.1:37023 for /02368_data_9.jsonl 2025-10-06 04:35:25,874 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741875_1051 src: /127.0.0.1:60518 dest: /127.0.0.1:37023 2025-10-06 04:35:25,892 INFO DataNode.clienttrace: src: /127.0.0.1:60426, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_23_pid_625_tid_280477804886656, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741866_1042, duration(ns): 427920792 2025-10-06 04:35:25,893 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741866_1042, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,893 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.788655_count_23_pid_625_tid_280477804886656 2025-10-06 04:35:25,898 INFO hdfs.StateChange: BLOCK* allocate blk_1073741876_1052, replicas=127.0.0.1:37023 for /02368_data_4.jsonl 2025-10-06 04:35:25,901 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741876_1052 src: /127.0.0.1:60520 dest: /127.0.0.1:37023 2025-10-06 04:35:25,972 INFO DataNode.clienttrace: src: /127.0.0.1:60416, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_24_pid_625_tid_280477787978368, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741865_1041, duration(ns): 533060494 2025-10-06 04:35:25,972 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741865_1041, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,972 INFO DataNode.clienttrace: src: /127.0.0.1:60474, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_35_pid_625_tid_280478413585024, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741870_1046, duration(ns): 383872563 2025-10-06 04:35:25,972 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741870_1046, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,973 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.788655_count_35_pid_625_tid_280478413585024 2025-10-06 04:35:25,974 INFO DataNode.clienttrace: src: /127.0.0.1:60494, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_32_pid_625_tid_280477754161792, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741872_1048, duration(ns): 344483160 2025-10-06 04:35:25,975 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741872_1048, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:25,975 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.788655_count_32_pid_625_tid_280477754161792 2025-10-06 04:35:25,977 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.788655_count_24_pid_625_tid_280477787978368 2025-10-06 04:35:25,978 INFO hdfs.StateChange: BLOCK* allocate blk_1073741877_1053, replicas=127.0.0.1:37023 for /02368_data_2.jsonl 2025-10-06 04:35:25,981 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741877_1053 src: /127.0.0.1:60530 dest: /127.0.0.1:37023 2025-10-06 04:35:25,981 INFO hdfs.StateChange: BLOCK* allocate blk_1073741878_1054, replicas=127.0.0.1:37023 for /02368_data_7.jsonl 2025-10-06 04:35:25,985 INFO hdfs.StateChange: BLOCK* allocate blk_1073741879_1055, replicas=127.0.0.1:37023 for /02368_data_1.jsonl 2025-10-06 04:35:25,986 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741878_1054 src: /127.0.0.1:60534 dest: /127.0.0.1:37023 2025-10-06 04:35:25,995 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741879_1055 src: /127.0.0.1:60542 dest: /127.0.0.1:37023 2025-10-06 04:35:26,019 INFO DataNode.clienttrace: src: /127.0.0.1:60454, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_36_pid_625_tid_280477957061248, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741868_1044, duration(ns): 502153372 2025-10-06 04:35:26,019 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741868_1044, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,020 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.788655_count_36_pid_625_tid_280477957061248 2025-10-06 04:35:26,026 INFO hdfs.StateChange: BLOCK* allocate blk_1073741880_1056, replicas=127.0.0.1:37023 for /02368_data_10.jsonl 2025-10-06 04:35:26,029 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741880_1056 src: /127.0.0.1:60552 dest: /127.0.0.1:37023 2025-10-06 04:35:26,061 INFO DataNode.clienttrace: src: /127.0.0.1:60468, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_39_pid_625_tid_280477914790528, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741869_1045, duration(ns): 528937555 2025-10-06 04:35:26,061 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741869_1045, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,066 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.788655_count_39_pid_625_tid_280477914790528 2025-10-06 04:35:26,076 INFO hdfs.StateChange: BLOCK* allocate blk_1073741881_1057, replicas=127.0.0.1:37023 for /02368_data_8.jsonl 2025-10-06 04:35:26,087 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741881_1057 src: /127.0.0.1:60564 dest: /127.0.0.1:37023 2025-10-06 04:35:26,112 INFO DataNode.clienttrace: src: /127.0.0.1:60498, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_33_pid_625_tid_280477779524224, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741873_1049, duration(ns): 473640965 2025-10-06 04:35:26,112 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741873_1049, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,114 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.788655_count_33_pid_625_tid_280477779524224 2025-10-06 04:35:26,120 INFO hdfs.StateChange: BLOCK* allocate blk_1073741882_1058, replicas=127.0.0.1:37023 for /02368_data_6.jsonl 2025-10-06 04:35:26,121 INFO DataNode.clienttrace: src: /127.0.0.1:60486, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_34_pid_625_tid_280477940152960, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741871_1047, duration(ns): 523335835 2025-10-06 04:35:26,121 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741871_1047, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,122 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.788655_count_34_pid_625_tid_280477940152960 2025-10-06 04:35:26,123 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741882_1058 src: /127.0.0.1:60580 dest: /127.0.0.1:37023 2025-10-06 04:35:26,135 INFO hdfs.StateChange: BLOCK* allocate blk_1073741883_1059, replicas=127.0.0.1:37023 for /02368_data_5.jsonl 2025-10-06 04:35:26,143 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741883_1059 src: /127.0.0.1:60584 dest: /127.0.0.1:37023 2025-10-06 04:35:26,254 INFO DataNode.clienttrace: src: /127.0.0.1:60508, dest: /127.0.0.1:37023, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_40_pid_625_tid_280477889428096, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741874_1050, duration(ns): 507877575 2025-10-06 04:35:26,254 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741874_1050, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,255 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.788655_count_40_pid_625_tid_280477889428096 2025-10-06 04:35:26,262 INFO hdfs.StateChange: BLOCK* allocate blk_1073741884_1060, replicas=127.0.0.1:37023 for /02368_data_3.jsonl 2025-10-06 04:35:26,266 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741884_1060 src: /127.0.0.1:60594 dest: /127.0.0.1:37023 2025-10-06 04:35:26,319 INFO DataNode.clienttrace: src: /127.0.0.1:60518, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_31_pid_625_tid_280477475175040, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741875_1051, duration(ns): 442255517 2025-10-06 04:35:26,320 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741875_1051, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,321 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.788655_count_31_pid_625_tid_280477475175040 2025-10-06 04:35:26,324 INFO hdfs.StateChange: DIR* completeFile: /02368_data_9.jsonl is closed by libhdfs3_client_rand_0.788655_count_31_pid_625_tid_280477475175040 2025-10-06 04:35:26,344 INFO DataNode.clienttrace: src: /127.0.0.1:60520, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_23_pid_625_tid_280477804886656, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741876_1052, duration(ns): 433037226 2025-10-06 04:35:26,344 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741876_1052, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,345 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.788655_count_23_pid_625_tid_280477804886656 2025-10-06 04:35:26,347 INFO hdfs.StateChange: DIR* completeFile: /02368_data_4.jsonl is closed by libhdfs3_client_rand_0.788655_count_23_pid_625_tid_280477804886656 2025-10-06 04:35:26,407 INFO DataNode.clienttrace: src: /127.0.0.1:60564, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_39_pid_625_tid_280477914790528, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741881_1057, duration(ns): 310739319 2025-10-06 04:35:26,407 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741881_1057, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,408 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.788655_count_39_pid_625_tid_280477914790528 2025-10-06 04:35:26,409 INFO hdfs.StateChange: DIR* completeFile: /02368_data_8.jsonl is closed by libhdfs3_client_rand_0.788655_count_39_pid_625_tid_280477914790528 2025-10-06 04:35:26,425 INFO DataNode.clienttrace: src: /127.0.0.1:60580, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_33_pid_625_tid_280477779524224, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741882_1058, duration(ns): 287284304 2025-10-06 04:35:26,425 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741882_1058, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,427 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.788655_count_33_pid_625_tid_280477779524224 2025-10-06 04:35:26,428 INFO hdfs.StateChange: DIR* completeFile: /02368_data_6.jsonl is closed by libhdfs3_client_rand_0.788655_count_33_pid_625_tid_280477779524224 2025-10-06 04:35:26,453 INFO DataNode.clienttrace: src: /127.0.0.1:60530, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_35_pid_625_tid_280478413585024, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741877_1053, duration(ns): 468297609 2025-10-06 04:35:26,453 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741877_1053, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,453 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.788655_count_35_pid_625_tid_280478413585024 2025-10-06 04:35:26,455 INFO hdfs.StateChange: DIR* completeFile: /02368_data_2.jsonl is closed by libhdfs3_client_rand_0.788655_count_35_pid_625_tid_280478413585024 2025-10-06 04:35:26,460 INFO DataNode.clienttrace: src: /127.0.0.1:60542, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_24_pid_625_tid_280477787978368, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741879_1055, duration(ns): 460814542 2025-10-06 04:35:26,460 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741879_1055, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,461 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.788655_count_24_pid_625_tid_280477787978368 2025-10-06 04:35:26,463 INFO hdfs.StateChange: DIR* completeFile: /02368_data_1.jsonl is closed by libhdfs3_client_rand_0.788655_count_24_pid_625_tid_280477787978368 2025-10-06 04:35:26,472 INFO DataNode.clienttrace: src: /127.0.0.1:60534, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_32_pid_625_tid_280477754161792, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741878_1054, duration(ns): 480637985 2025-10-06 04:35:26,472 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741878_1054, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,473 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.788655_count_32_pid_625_tid_280477754161792 2025-10-06 04:35:26,474 INFO hdfs.StateChange: DIR* completeFile: /02368_data_7.jsonl is closed by libhdfs3_client_rand_0.788655_count_32_pid_625_tid_280477754161792 2025-10-06 04:35:26,532 INFO DataNode.clienttrace: src: /127.0.0.1:60552, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_36_pid_625_tid_280477957061248, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741880_1056, duration(ns): 501027877 2025-10-06 04:35:26,532 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741880_1056, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,533 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.788655_count_36_pid_625_tid_280477957061248 2025-10-06 04:35:26,534 INFO hdfs.StateChange: DIR* completeFile: /02368_data_10.jsonl is closed by libhdfs3_client_rand_0.788655_count_36_pid_625_tid_280477957061248 2025-10-06 04:35:26,538 INFO DataNode.clienttrace: src: /127.0.0.1:60584, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_34_pid_625_tid_280477940152960, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741883_1059, duration(ns): 388462269 2025-10-06 04:35:26,538 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741883_1059, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,538 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.788655_count_34_pid_625_tid_280477940152960 2025-10-06 04:35:26,540 INFO hdfs.StateChange: DIR* completeFile: /02368_data_5.jsonl is closed by libhdfs3_client_rand_0.788655_count_34_pid_625_tid_280477940152960 2025-10-06 04:35:26,644 INFO DataNode.clienttrace: src: /127.0.0.1:60594, dest: /127.0.0.1:37023, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.788655_count_40_pid_625_tid_280477889428096, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741884_1060, duration(ns): 356074926 2025-10-06 04:35:26,644 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741884_1060, type=LAST_IN_PIPELINE terminating 2025-10-06 04:35:26,644 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.788655_count_40_pid_625_tid_280477889428096 2025-10-06 04:35:26,646 INFO hdfs.StateChange: DIR* completeFile: /02368_data_3.jsonl is closed by libhdfs3_client_rand_0.788655_count_40_pid_625_tid_280477889428096 2025-10-06 04:35:27,798 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741825_1001 replica FinalizedReplica, blk_1073741825_1001, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741825 for deletion 2025-10-06 04:35:27,800 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741826_1002 replica FinalizedReplica, blk_1073741826_1002, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741826 for deletion 2025-10-06 04:35:27,800 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741827_1003 replica FinalizedReplica, blk_1073741827_1003, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741827 for deletion 2025-10-06 04:35:27,800 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741828_1004 replica FinalizedReplica, blk_1073741828_1004, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741828 for deletion 2025-10-06 04:35:27,800 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741829_1005 replica FinalizedReplica, blk_1073741829_1005, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741829 for deletion 2025-10-06 04:35:27,800 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741830_1006 replica FinalizedReplica, blk_1073741830_1006, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741830 for deletion 2025-10-06 04:35:27,801 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741831_1007 replica FinalizedReplica, blk_1073741831_1007, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741831 for deletion 2025-10-06 04:35:27,801 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741832_1008 replica FinalizedReplica, blk_1073741832_1008, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741832 for deletion 2025-10-06 04:35:27,801 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741833_1009 replica FinalizedReplica, blk_1073741833_1009, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741833 for deletion 2025-10-06 04:35:27,801 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741834_1010 replica FinalizedReplica, blk_1073741834_1010, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741834 for deletion 2025-10-06 04:35:27,801 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741835_1011 replica FinalizedReplica, blk_1073741835_1011, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741835 for deletion 2025-10-06 04:35:27,801 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741836_1012 replica FinalizedReplica, blk_1073741836_1012, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741836 for deletion 2025-10-06 04:35:27,802 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741837_1013 replica FinalizedReplica, blk_1073741837_1013, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741837 for deletion 2025-10-06 04:35:27,802 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741838_1014 replica FinalizedReplica, blk_1073741838_1014, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741838 for deletion 2025-10-06 04:35:27,802 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741839_1015 replica FinalizedReplica, blk_1073741839_1015, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741839 for deletion 2025-10-06 04:35:27,802 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741840_1016 replica FinalizedReplica, blk_1073741840_1016, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741840 for deletion 2025-10-06 04:35:27,802 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741841_1017 replica FinalizedReplica, blk_1073741841_1017, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741841 for deletion 2025-10-06 04:35:27,802 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741842_1018 replica FinalizedReplica, blk_1073741842_1018, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741842 for deletion 2025-10-06 04:35:27,802 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741843_1019 replica FinalizedReplica, blk_1073741843_1019, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741843 for deletion 2025-10-06 04:35:27,803 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741844_1020 replica FinalizedReplica, blk_1073741844_1020, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741844 for deletion 2025-10-06 04:35:27,803 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741845_1021 replica FinalizedReplica, blk_1073741845_1021, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741845 for deletion 2025-10-06 04:35:27,803 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741846_1022 replica FinalizedReplica, blk_1073741846_1022, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741846 for deletion 2025-10-06 04:35:27,803 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741847_1023 replica FinalizedReplica, blk_1073741847_1023, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741847 for deletion 2025-10-06 04:35:27,803 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741848_1024 replica FinalizedReplica, blk_1073741848_1024, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741848 for deletion 2025-10-06 04:35:27,803 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741849_1025 replica FinalizedReplica, blk_1073741849_1025, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741849 for deletion 2025-10-06 04:35:27,804 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741850_1026 replica FinalizedReplica, blk_1073741850_1026, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741850 for deletion 2025-10-06 04:35:27,804 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741851_1027 replica FinalizedReplica, blk_1073741851_1027, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741851 for deletion 2025-10-06 04:35:27,804 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741852_1028 replica FinalizedReplica, blk_1073741852_1028, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741852 for deletion 2025-10-06 04:35:27,804 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741853_1029 replica FinalizedReplica, blk_1073741853_1029, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741853 for deletion 2025-10-06 04:35:27,804 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741854_1030 replica FinalizedReplica, blk_1073741854_1030, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741854 for deletion 2025-10-06 04:35:27,811 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741825_1001 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741825 2025-10-06 04:35:27,813 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741826_1002 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741826 2025-10-06 04:35:27,823 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741827_1003 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741827 2025-10-06 04:35:27,825 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741828_1004 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741828 2025-10-06 04:35:27,834 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741829_1005 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741829 2025-10-06 04:35:27,836 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741830_1006 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741830 2025-10-06 04:35:27,845 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741831_1007 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741831 2025-10-06 04:35:27,846 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741832_1008 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741832 2025-10-06 04:35:27,857 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741833_1009 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741833 2025-10-06 04:35:27,858 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741834_1010 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741834 2025-10-06 04:35:27,868 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741835_1011 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741835 2025-10-06 04:35:27,868 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741836_1012 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741836 2025-10-06 04:35:27,878 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741837_1013 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741837 2025-10-06 04:35:27,878 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741839_1015 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741839 2025-10-06 04:35:27,889 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741838_1014 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741838 2025-10-06 04:35:27,889 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741840_1016 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741840 2025-10-06 04:35:27,899 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741842_1018 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741842 2025-10-06 04:35:27,899 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741841_1017 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741841 2025-10-06 04:35:27,910 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741844_1020 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741844 2025-10-06 04:35:27,910 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741843_1019 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741843 2025-10-06 04:35:27,920 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741845_1021 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741845 2025-10-06 04:35:27,920 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741846_1022 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741846 2025-10-06 04:35:27,929 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741848_1024 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741848 2025-10-06 04:35:27,929 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741847_1023 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741847 2025-10-06 04:35:27,938 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741850_1026 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741850 2025-10-06 04:35:27,939 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741849_1025 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741849 2025-10-06 04:35:27,948 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741852_1028 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741852 2025-10-06 04:35:27,948 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741851_1027 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741851 2025-10-06 04:35:27,957 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741853_1029 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741853 2025-10-06 04:35:27,958 INFO impl.FsDatasetAsyncDiskService: Deleted BP-2001034388-172.17.0.2-1759743268446 blk_1073741854_1030 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-2001034388-172.17.0.2-1759743268446/current/finalized/subdir0/subdir0/blk_1073741854 2025-10-06 04:36:45,601 INFO namenode.FSEditLog: Number of transactions: 282 Total time for transactions(ms): 113 Number of transactions batched in Syncs: 112 Number of syncs: 170 SyncTimes(ms): 15 6 2025-10-06 04:36:45,604 INFO hdfs.StateChange: BLOCK* allocate blk_1073741885_1061, replicas=127.0.0.1:37023 for /02845_table_function_hdfs_filter_by_virtual_columns_test_08kzygif.data1.tsv 2025-10-06 04:36:45,606 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741885_1061 src: /127.0.0.1:39532 dest: /127.0.0.1:37023 2025-10-06 04:36:45,608 INFO DataNode.clienttrace: src: /127.0.0.1:39532, dest: /127.0.0.1:37023, bytes: 2, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.591251_count_42_pid_625_tid_280460261554816, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741885_1061, duration(ns): 433487 2025-10-06 04:36:45,608 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741885_1061, type=LAST_IN_PIPELINE terminating 2025-10-06 04:36:45,608 INFO hdfs.StateChange: BLOCK* fsync: /02845_table_function_hdfs_filter_by_virtual_columns_test_08kzygif.data1.tsv for libhdfs3_client_rand_0.591251_count_42_pid_625_tid_280460261554816 2025-10-06 04:36:45,610 INFO hdfs.StateChange: DIR* completeFile: /02845_table_function_hdfs_filter_by_virtual_columns_test_08kzygif.data1.tsv is closed by libhdfs3_client_rand_0.591251_count_42_pid_625_tid_280460261554816 2025-10-06 04:36:45,716 INFO hdfs.StateChange: BLOCK* allocate blk_1073741886_1062, replicas=127.0.0.1:37023 for /02845_table_function_hdfs_filter_by_virtual_columns_test_08kzygif.data2.tsv 2025-10-06 04:36:45,718 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741886_1062 src: /127.0.0.1:39544 dest: /127.0.0.1:37023 2025-10-06 04:36:45,720 INFO DataNode.clienttrace: src: /127.0.0.1:39544, dest: /127.0.0.1:37023, bytes: 2, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.591251_count_44_pid_625_tid_280460261554816, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741886_1062, duration(ns): 335365 2025-10-06 04:36:45,720 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741886_1062, type=LAST_IN_PIPELINE terminating 2025-10-06 04:36:45,720 INFO hdfs.StateChange: BLOCK* fsync: /02845_table_function_hdfs_filter_by_virtual_columns_test_08kzygif.data2.tsv for libhdfs3_client_rand_0.591251_count_44_pid_625_tid_280460261554816 2025-10-06 04:36:45,722 INFO hdfs.StateChange: DIR* completeFile: /02845_table_function_hdfs_filter_by_virtual_columns_test_08kzygif.data2.tsv is closed by libhdfs3_client_rand_0.591251_count_44_pid_625_tid_280460261554816 2025-10-06 04:36:45,829 INFO hdfs.StateChange: BLOCK* allocate blk_1073741887_1063, replicas=127.0.0.1:37023 for /02845_table_function_hdfs_filter_by_virtual_columns_test_08kzygif.data3.tsv 2025-10-06 04:36:45,832 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741887_1063 src: /127.0.0.1:39558 dest: /127.0.0.1:37023 2025-10-06 04:36:45,834 INFO DataNode.clienttrace: src: /127.0.0.1:39558, dest: /127.0.0.1:37023, bytes: 2, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.591251_count_46_pid_625_tid_280460261554816, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741887_1063, duration(ns): 445566 2025-10-06 04:36:45,834 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741887_1063, type=LAST_IN_PIPELINE terminating 2025-10-06 04:36:45,835 INFO hdfs.StateChange: BLOCK* fsync: /02845_table_function_hdfs_filter_by_virtual_columns_test_08kzygif.data3.tsv for libhdfs3_client_rand_0.591251_count_46_pid_625_tid_280460261554816 2025-10-06 04:36:45,836 INFO hdfs.StateChange: DIR* completeFile: /02845_table_function_hdfs_filter_by_virtual_columns_test_08kzygif.data3.tsv is closed by libhdfs3_client_rand_0.591251_count_46_pid_625_tid_280460261554816 2025-10-06 04:47:29,797 INFO namenode.FSEditLog: Number of transactions: 300 Total time for transactions(ms): 118 Number of transactions batched in Syncs: 115 Number of syncs: 185 SyncTimes(ms): 15 6 2025-10-06 04:47:29,816 INFO hdfs.StateChange: BLOCK* allocate blk_1073741888_1064, replicas=127.0.0.1:37023 for /02923_hdfs_engine_size_virtual_column_test_2sv1evqe.data1.tsv 2025-10-06 04:47:29,833 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741888_1064 src: /127.0.0.1:39826 dest: /127.0.0.1:37023 2025-10-06 04:47:29,858 INFO DataNode.clienttrace: src: /127.0.0.1:39826, dest: /127.0.0.1:37023, bytes: 2, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.352148_count_55_pid_625_tid_280459754306176, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741888_1064, duration(ns): 1012495 2025-10-06 04:47:29,858 INFO hdfs.StateChange: BLOCK* fsync: /02923_hdfs_engine_size_virtual_column_test_2sv1evqe.data1.tsv for libhdfs3_client_rand_0.352148_count_55_pid_625_tid_280459754306176 2025-10-06 04:47:29,860 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741888_1064, type=LAST_IN_PIPELINE terminating 2025-10-06 04:47:29,862 INFO hdfs.StateChange: DIR* completeFile: /02923_hdfs_engine_size_virtual_column_test_2sv1evqe.data1.tsv is closed by libhdfs3_client_rand_0.352148_count_55_pid_625_tid_280459754306176 2025-10-06 04:47:30,006 INFO hdfs.StateChange: BLOCK* allocate blk_1073741889_1065, replicas=127.0.0.1:37023 for /02923_hdfs_engine_size_virtual_column_test_2sv1evqe.data2.tsv 2025-10-06 04:47:30,012 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741889_1065 src: /127.0.0.1:38304 dest: /127.0.0.1:37023 2025-10-06 04:47:30,038 INFO DataNode.clienttrace: src: /127.0.0.1:38304, dest: /127.0.0.1:37023, bytes: 3, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.352148_count_57_pid_625_tid_280460143196800, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741889_1065, duration(ns): 5877447 2025-10-06 04:47:30,038 INFO hdfs.StateChange: BLOCK* fsync: /02923_hdfs_engine_size_virtual_column_test_2sv1evqe.data2.tsv for libhdfs3_client_rand_0.352148_count_57_pid_625_tid_280460143196800 2025-10-06 04:47:30,040 INFO namenode.FSNamesystem: BLOCK* blk_1073741889_1065 is COMMITTED but not COMPLETE(numNodes= 0 < minimum = 1) in file /02923_hdfs_engine_size_virtual_column_test_2sv1evqe.data2.tsv 2025-10-06 04:47:30,041 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741889_1065, type=LAST_IN_PIPELINE terminating 2025-10-06 04:47:30,442 INFO hdfs.StateChange: DIR* completeFile: /02923_hdfs_engine_size_virtual_column_test_2sv1evqe.data2.tsv is closed by libhdfs3_client_rand_0.352148_count_57_pid_625_tid_280460143196800 2025-10-06 04:47:30,592 INFO hdfs.StateChange: BLOCK* allocate blk_1073741890_1066, replicas=127.0.0.1:37023 for /02923_hdfs_engine_size_virtual_column_test_2sv1evqe.data3.tsv 2025-10-06 04:47:30,618 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741890_1066 src: /127.0.0.1:38318 dest: /127.0.0.1:37023 2025-10-06 04:47:30,641 INFO DataNode.clienttrace: src: /127.0.0.1:38318, dest: /127.0.0.1:37023, bytes: 4, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.437181_count_59_pid_625_tid_280459703581312, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741890_1066, duration(ns): 386566 2025-10-06 04:47:30,641 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741890_1066, type=LAST_IN_PIPELINE terminating 2025-10-06 04:47:30,641 INFO hdfs.StateChange: BLOCK* fsync: /02923_hdfs_engine_size_virtual_column_test_2sv1evqe.data3.tsv for libhdfs3_client_rand_0.437181_count_59_pid_625_tid_280459703581312 2025-10-06 04:47:30,642 INFO namenode.FSNamesystem: BLOCK* blk_1073741890_1066 is COMMITTED but not COMPLETE(numNodes= 0 < minimum = 1) in file /02923_hdfs_engine_size_virtual_column_test_2sv1evqe.data3.tsv 2025-10-06 04:47:31,044 INFO hdfs.StateChange: DIR* completeFile: /02923_hdfs_engine_size_virtual_column_test_2sv1evqe.data3.tsv is closed by libhdfs3_client_rand_0.437181_count_59_pid_625_tid_280459703581312 2025-10-06 04:56:51,935 INFO namenode.FSEditLog: Number of transactions: 318 Total time for transactions(ms): 119 Number of transactions batched in Syncs: 120 Number of syncs: 198 SyncTimes(ms): 15 7 2025-10-06 04:56:51,940 INFO hdfs.StateChange: BLOCK* allocate blk_1073741891_1067, replicas=127.0.0.1:37023 for /test_02725_1.tsv 2025-10-06 04:56:51,942 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741891_1067 src: /127.0.0.1:43830 dest: /127.0.0.1:37023 2025-10-06 04:56:51,944 INFO DataNode.clienttrace: src: /127.0.0.1:43830, dest: /127.0.0.1:37023, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.140385_count_67_pid_625_tid_280460625083008, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741891_1067, duration(ns): 478608 2025-10-06 04:56:51,944 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741891_1067, type=LAST_IN_PIPELINE terminating 2025-10-06 04:56:51,945 INFO hdfs.StateChange: BLOCK* fsync: /test_02725_1.tsv for libhdfs3_client_rand_0.140385_count_67_pid_625_tid_280460625083008 2025-10-06 04:56:51,947 INFO hdfs.StateChange: DIR* completeFile: /test_02725_1.tsv is closed by libhdfs3_client_rand_0.140385_count_67_pid_625_tid_280460625083008 2025-10-06 04:56:52,055 INFO hdfs.StateChange: BLOCK* allocate blk_1073741892_1068, replicas=127.0.0.1:37023 for /test_02725_2.tsv 2025-10-06 04:56:52,058 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741892_1068 src: /127.0.0.1:43838 dest: /127.0.0.1:37023 2025-10-06 04:56:52,061 INFO DataNode.clienttrace: src: /127.0.0.1:43838, dest: /127.0.0.1:37023, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.225417_count_69_pid_625_tid_280460625083008, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741892_1068, duration(ns): 647490 2025-10-06 04:56:52,061 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741892_1068, type=LAST_IN_PIPELINE terminating 2025-10-06 04:56:52,061 INFO hdfs.StateChange: BLOCK* fsync: /test_02725_2.tsv for libhdfs3_client_rand_0.225417_count_69_pid_625_tid_280460625083008 2025-10-06 04:56:52,063 INFO hdfs.StateChange: DIR* completeFile: /test_02725_2.tsv is closed by libhdfs3_client_rand_0.225417_count_69_pid_625_tid_280460625083008 2025-10-06 04:58:03,858 INFO namenode.FSEditLog: Number of transactions: 330 Total time for transactions(ms): 120 Number of transactions batched in Syncs: 122 Number of syncs: 208 SyncTimes(ms): 15 7 2025-10-06 04:58:03,862 INFO hdfs.StateChange: BLOCK* allocate blk_1073741893_1069, replicas=127.0.0.1:37023 for /test_02536.jsonl 2025-10-06 04:58:03,866 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741893_1069 src: /127.0.0.1:55230 dest: /127.0.0.1:37023 2025-10-06 04:58:03,868 INFO DataNode.clienttrace: src: /127.0.0.1:55230, dest: /127.0.0.1:37023, bytes: 27, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.262721_count_78_pid_625_tid_280460692716160, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741893_1069, duration(ns): 361965 2025-10-06 04:58:03,868 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741893_1069, type=LAST_IN_PIPELINE terminating 2025-10-06 04:58:03,868 INFO hdfs.StateChange: BLOCK* fsync: /test_02536.jsonl for libhdfs3_client_rand_0.262721_count_78_pid_625_tid_280460692716160 2025-10-06 04:58:03,870 INFO hdfs.StateChange: DIR* completeFile: /test_02536.jsonl is closed by libhdfs3_client_rand_0.262721_count_78_pid_625_tid_280460692716160 2025-10-06 04:59:02,053 INFO datanode.DirectoryScanner: Scan Results: BlockPool BP-2001034388-172.17.0.2-1759743268446 Total blocks: 39, missing metadata files: 0, missing block files: 0, missing blocks in memory: 0, mismatched blocks: 0 2025-10-06 04:59:10,561 INFO namenode.FSEditLog: Number of transactions: 336 Total time for transactions(ms): 121 Number of transactions batched in Syncs: 123 Number of syncs: 213 SyncTimes(ms): 16 9 2025-10-06 04:59:10,566 INFO hdfs.StateChange: BLOCK* allocate blk_1073741894_1070, replicas=127.0.0.1:37023 for /test_02458_1.tsv 2025-10-06 04:59:10,568 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741894_1070 src: /127.0.0.1:60656 dest: /127.0.0.1:37023 2025-10-06 04:59:10,570 INFO DataNode.clienttrace: src: /127.0.0.1:60656, dest: /127.0.0.1:37023, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.959895_count_85_pid_625_tid_280474836302464, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741894_1070, duration(ns): 345685 2025-10-06 04:59:10,570 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741894_1070, type=LAST_IN_PIPELINE terminating 2025-10-06 04:59:10,570 INFO hdfs.StateChange: BLOCK* fsync: /test_02458_1.tsv for libhdfs3_client_rand_0.959895_count_85_pid_625_tid_280474836302464 2025-10-06 04:59:10,572 INFO hdfs.StateChange: DIR* completeFile: /test_02458_1.tsv is closed by libhdfs3_client_rand_0.959895_count_85_pid_625_tid_280474836302464 2025-10-06 04:59:10,606 INFO hdfs.StateChange: BLOCK* allocate blk_1073741895_1071, replicas=127.0.0.1:37023 for /test_02458_2.tsv 2025-10-06 04:59:10,607 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741895_1071 src: /127.0.0.1:60668 dest: /127.0.0.1:37023 2025-10-06 04:59:10,610 INFO DataNode.clienttrace: src: /127.0.0.1:60668, dest: /127.0.0.1:37023, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.959895_count_87_pid_625_tid_280474836302464, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741895_1071, duration(ns): 307484 2025-10-06 04:59:10,610 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741895_1071, type=LAST_IN_PIPELINE terminating 2025-10-06 04:59:10,610 INFO hdfs.StateChange: BLOCK* fsync: /test_02458_2.tsv for libhdfs3_client_rand_0.959895_count_87_pid_625_tid_280474836302464 2025-10-06 04:59:10,611 INFO hdfs.StateChange: DIR* completeFile: /test_02458_2.tsv is closed by libhdfs3_client_rand_0.959895_count_87_pid_625_tid_280474836302464 2025-10-06 05:03:44,394 INFO namenode.FSEditLog: Number of transactions: 348 Total time for transactions(ms): 123 Number of transactions batched in Syncs: 125 Number of syncs: 223 SyncTimes(ms): 16 9 2025-10-06 05:03:44,397 INFO hdfs.StateChange: BLOCK* allocate blk_1073741896_1072, replicas=127.0.0.1:37023 for /test_1.tsv 2025-10-06 05:03:44,399 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741896_1072 src: /127.0.0.1:39704 dest: /127.0.0.1:37023 2025-10-06 05:03:44,401 INFO DataNode.clienttrace: src: /127.0.0.1:39704, dest: /127.0.0.1:37023, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.258786_count_104_pid_625_tid_280478100781696, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741896_1072, duration(ns): 389845 2025-10-06 05:03:44,401 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741896_1072, type=LAST_IN_PIPELINE terminating 2025-10-06 05:03:44,402 INFO hdfs.StateChange: BLOCK* fsync: /test_1.tsv for libhdfs3_client_rand_0.258786_count_104_pid_625_tid_280478100781696 2025-10-06 05:03:44,403 INFO hdfs.StateChange: DIR* completeFile: /test_1.tsv is closed by libhdfs3_client_rand_0.258786_count_104_pid_625_tid_280478100781696 2025-10-06 05:03:44,439 INFO hdfs.StateChange: BLOCK* allocate blk_1073741897_1073, replicas=127.0.0.1:37023 for /test_2.tsv 2025-10-06 05:03:44,441 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741897_1073 src: /127.0.0.1:39720 dest: /127.0.0.1:37023 2025-10-06 05:03:44,443 INFO DataNode.clienttrace: src: /127.0.0.1:39720, dest: /127.0.0.1:37023, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.258786_count_106_pid_625_tid_280478100781696, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741897_1073, duration(ns): 360006 2025-10-06 05:03:44,443 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741897_1073, type=LAST_IN_PIPELINE terminating 2025-10-06 05:03:44,444 INFO hdfs.StateChange: BLOCK* fsync: /test_2.tsv for libhdfs3_client_rand_0.258786_count_106_pid_625_tid_280478100781696 2025-10-06 05:03:44,445 INFO hdfs.StateChange: DIR* completeFile: /test_2.tsv is closed by libhdfs3_client_rand_0.258786_count_106_pid_625_tid_280478100781696 2025-10-06 05:03:44,454 INFO hdfs.StateChange: BLOCK* allocate blk_1073741898_1074, replicas=127.0.0.1:37023 for /test_3.tsv 2025-10-06 05:03:44,456 INFO datanode.DataNode: Receiving BP-2001034388-172.17.0.2-1759743268446:blk_1073741898_1074 src: /127.0.0.1:39736 dest: /127.0.0.1:37023 2025-10-06 05:03:44,458 INFO DataNode.clienttrace: src: /127.0.0.1:39736, dest: /127.0.0.1:37023, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.258786_count_108_pid_625_tid_280478100781696, offset: 0, srvID: f541b95c-3986-4067-85fc-5448d525fcb5, blockid: BP-2001034388-172.17.0.2-1759743268446:blk_1073741898_1074, duration(ns): 413846 2025-10-06 05:03:44,458 INFO datanode.DataNode: PacketResponder: BP-2001034388-172.17.0.2-1759743268446:blk_1073741898_1074, type=LAST_IN_PIPELINE terminating 2025-10-06 05:03:44,458 INFO hdfs.StateChange: BLOCK* fsync: /test_3.tsv for libhdfs3_client_rand_0.258786_count_108_pid_625_tid_280478100781696 2025-10-06 05:03:44,460 INFO hdfs.StateChange: DIR* completeFile: /test_3.tsv is closed by libhdfs3_client_rand_0.258786_count_108_pid_625_tid_280478100781696