2025-09-05 10:16:56,832 INFO mapreduce.MiniHadoopClusterManager: Updated 0 configuration settings from command line. 2025-09-05 10:16:56,914 INFO hdfs.MiniDFSCluster: starting cluster: numNameNodes=1, numDataNodes=1 2025-09-05 10:16:57,315 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2025-09-05 10:16:57,405 INFO namenode.NameNode: Formatting using clusterid: testClusterID 2025-09-05 10:16:57,423 INFO namenode.FSEditLog: Edit logging is async:true 2025-09-05 10:16:57,447 INFO namenode.FSNamesystem: KeyProvider: null 2025-09-05 10:16:57,448 INFO namenode.FSNamesystem: fsLock is fair: true 2025-09-05 10:16:57,449 INFO namenode.FSNamesystem: Detailed lock hold time metrics enabled: false 2025-09-05 10:16:57,492 INFO namenode.FSNamesystem: fsOwner = clickhouse (auth:SIMPLE) 2025-09-05 10:16:57,492 INFO namenode.FSNamesystem: supergroup = supergroup 2025-09-05 10:16:57,492 INFO namenode.FSNamesystem: isPermissionEnabled = true 2025-09-05 10:16:57,492 INFO namenode.FSNamesystem: isStoragePolicyEnabled = true 2025-09-05 10:16:57,492 INFO namenode.FSNamesystem: HA Enabled: false 2025-09-05 10:16:57,535 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling 2025-09-05 10:16:57,539 INFO Configuration.deprecation: hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping 2025-09-05 10:16:57,539 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit: configured=1000, counted=60, effected=1000 2025-09-05 10:16:57,539 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true 2025-09-05 10:16:57,543 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000 2025-09-05 10:16:57,544 INFO blockmanagement.BlockManager: The block deletion will start around 2025 Sep 05 10:16:57 2025-09-05 10:16:57,545 INFO util.GSet: Computing capacity for map BlocksMap 2025-09-05 10:16:57,545 INFO util.GSet: VM type = 64-bit 2025-09-05 10:16:57,546 INFO util.GSet: 2.0% max memory 7.6 GB = 156.4 MB 2025-09-05 10:16:57,546 INFO util.GSet: capacity = 2^24 = 16777216 entries 2025-09-05 10:16:57,575 INFO blockmanagement.BlockManager: Storage policy satisfier is disabled 2025-09-05 10:16:57,575 INFO blockmanagement.BlockManager: dfs.block.access.token.enable = false 2025-09-05 10:16:57,581 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.threshold-pct = 0.999 2025-09-05 10:16:57,581 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.min.datanodes = 0 2025-09-05 10:16:57,581 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.extension = 0 2025-09-05 10:16:57,581 INFO blockmanagement.BlockManager: defaultReplication = 1 2025-09-05 10:16:57,581 INFO blockmanagement.BlockManager: maxReplication = 512 2025-09-05 10:16:57,581 INFO blockmanagement.BlockManager: minReplication = 1 2025-09-05 10:16:57,581 INFO blockmanagement.BlockManager: maxReplicationStreams = 2 2025-09-05 10:16:57,581 INFO blockmanagement.BlockManager: redundancyRecheckInterval = 3000ms 2025-09-05 10:16:57,581 INFO blockmanagement.BlockManager: encryptDataTransfer = false 2025-09-05 10:16:57,582 INFO blockmanagement.BlockManager: maxNumBlocksToLog = 1000 2025-09-05 10:16:57,602 INFO namenode.FSDirectory: GLOBAL serial map: bits=29 maxEntries=536870911 2025-09-05 10:16:57,602 INFO namenode.FSDirectory: USER serial map: bits=24 maxEntries=16777215 2025-09-05 10:16:57,602 INFO namenode.FSDirectory: GROUP serial map: bits=24 maxEntries=16777215 2025-09-05 10:16:57,603 INFO namenode.FSDirectory: XATTR serial map: bits=24 maxEntries=16777215 2025-09-05 10:16:57,613 INFO util.GSet: Computing capacity for map INodeMap 2025-09-05 10:16:57,613 INFO util.GSet: VM type = 64-bit 2025-09-05 10:16:57,613 INFO util.GSet: 1.0% max memory 7.6 GB = 78.2 MB 2025-09-05 10:16:57,613 INFO util.GSet: capacity = 2^23 = 8388608 entries 2025-09-05 10:16:57,624 INFO namenode.FSDirectory: ACLs enabled? true 2025-09-05 10:16:57,624 INFO namenode.FSDirectory: POSIX ACL inheritance enabled? true 2025-09-05 10:16:57,624 INFO namenode.FSDirectory: XAttrs enabled? true 2025-09-05 10:16:57,625 INFO namenode.NameNode: Caching file names occurring more than 10 times 2025-09-05 10:16:57,629 INFO snapshot.SnapshotManager: Loaded config captureOpenFiles: false, skipCaptureAccessTimeOnlyChange: false, snapshotDiffAllowSnapRootDescendant: true, maxSnapshotLimit: 65536 2025-09-05 10:16:57,630 INFO snapshot.SnapshotManager: SkipList is disabled 2025-09-05 10:16:57,634 INFO util.GSet: Computing capacity for map cachedBlocks 2025-09-05 10:16:57,634 INFO util.GSet: VM type = 64-bit 2025-09-05 10:16:57,634 INFO util.GSet: 0.25% max memory 7.6 GB = 19.6 MB 2025-09-05 10:16:57,634 INFO util.GSet: capacity = 2^21 = 2097152 entries 2025-09-05 10:16:57,645 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10 2025-09-05 10:16:57,645 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10 2025-09-05 10:16:57,645 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25 2025-09-05 10:16:57,648 INFO namenode.FSNamesystem: Retry cache on namenode is enabled 2025-09-05 10:16:57,648 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis 2025-09-05 10:16:57,650 INFO util.GSet: Computing capacity for map NameNodeRetryCache 2025-09-05 10:16:57,650 INFO util.GSet: VM type = 64-bit 2025-09-05 10:16:57,650 INFO util.GSet: 0.029999999329447746% max memory 7.6 GB = 2.3 MB 2025-09-05 10:16:57,650 INFO util.GSet: capacity = 2^18 = 262144 entries 2025-09-05 10:16:57,675 INFO namenode.FSImage: Allocated new BlockPoolId: BP-1058275958-172.17.0.2-1757089017665 2025-09-05 10:16:57,688 INFO common.Storage: Storage directory /hadoop-3.3.1/target/test/data/dfs/name-0-1 has been successfully formatted. 2025-09-05 10:16:57,691 INFO common.Storage: Storage directory /hadoop-3.3.1/target/test/data/dfs/name-0-2 has been successfully formatted. 2025-09-05 10:16:57,737 INFO namenode.FSImageFormatProtobuf: Saving image file /hadoop-3.3.1/target/test/data/dfs/name-0-1/current/fsimage.ckpt_0000000000000000000 using no compression 2025-09-05 10:16:57,737 INFO namenode.FSImageFormatProtobuf: Saving image file /hadoop-3.3.1/target/test/data/dfs/name-0-2/current/fsimage.ckpt_0000000000000000000 using no compression 2025-09-05 10:16:57,881 INFO namenode.FSImageFormatProtobuf: Image file /hadoop-3.3.1/target/test/data/dfs/name-0-1/current/fsimage.ckpt_0000000000000000000 of size 405 bytes saved in 0 seconds . 2025-09-05 10:16:57,881 INFO namenode.FSImageFormatProtobuf: Image file /hadoop-3.3.1/target/test/data/dfs/name-0-2/current/fsimage.ckpt_0000000000000000000 of size 405 bytes saved in 0 seconds . 2025-09-05 10:16:57,900 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0 2025-09-05 10:16:57,944 INFO namenode.FSNamesystem: Stopping services started for active state 2025-09-05 10:16:57,944 INFO namenode.FSNamesystem: Stopping services started for standby state 2025-09-05 10:16:57,945 INFO namenode.NameNode: createNameNode [] 2025-09-05 10:16:58,008 INFO impl.MetricsConfig: Loaded properties from hadoop-metrics2.properties 2025-09-05 10:16:58,100 INFO impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2025-09-05 10:16:58,100 INFO impl.MetricsSystemImpl: NameNode metrics system started 2025-09-05 10:16:58,121 INFO namenode.NameNodeUtils: fs.defaultFS is hdfs://127.0.0.1:12222 2025-09-05 10:16:58,122 INFO namenode.NameNode: Clients should use 127.0.0.1:12222 to access this namenode/service. 2025-09-05 10:16:58,170 INFO util.JvmPauseMonitor: Starting JVM pause monitor 2025-09-05 10:16:58,181 INFO hdfs.DFSUtil: Filter initializers set : org.apache.hadoop.http.lib.StaticUserWebFilter,org.apache.hadoop.hdfs.web.AuthFilterInitializer 2025-09-05 10:16:58,185 INFO hdfs.DFSUtil: Starting Web-server for hdfs at: http://localhost:0 2025-09-05 10:16:58,198 INFO util.log: Logging initialized @1923ms to org.eclipse.jetty.util.log.Slf4jLog 2025-09-05 10:16:58,283 INFO server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2025-09-05 10:16:58,287 INFO http.HttpRequestLog: Http request log for http.requests.namenode is not defined 2025-09-05 10:16:58,293 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2025-09-05 10:16:58,295 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs 2025-09-05 10:16:58,295 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2025-09-05 10:16:58,295 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2025-09-05 10:16:58,297 INFO http.HttpServer2: Added filter AuthFilter (class=org.apache.hadoop.hdfs.web.AuthFilter) to context hdfs 2025-09-05 10:16:58,297 INFO http.HttpServer2: Added filter AuthFilter (class=org.apache.hadoop.hdfs.web.AuthFilter) to context static 2025-09-05 10:16:58,297 INFO http.HttpServer2: Added filter AuthFilter (class=org.apache.hadoop.hdfs.web.AuthFilter) to context logs 2025-09-05 10:16:58,325 INFO http.HttpServer2: addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/* 2025-09-05 10:16:58,334 INFO http.HttpServer2: Jetty bound to port 43183 2025-09-05 10:16:58,335 INFO server.Server: jetty-9.4.40.v20210413; built: 2021-04-13T20:42:42.668Z; git: b881a572662e1943a14ae12e7e1207989f218b74; jvm 11.0.25+9-post-Ubuntu-1ubuntu122.04 2025-09-05 10:16:58,363 INFO server.session: DefaultSessionIdManager workerName=node0 2025-09-05 10:16:58,363 INFO server.session: No SessionScavenger set, using defaults 2025-09-05 10:16:58,365 INFO server.session: node0 Scavenging every 660000ms 2025-09-05 10:16:58,380 INFO server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2025-09-05 10:16:58,382 INFO handler.ContextHandler: Started o.e.j.s.ServletContextHandler@7dd00705{logs,/logs,file:///hadoop-3.3.1/logs,AVAILABLE} 2025-09-05 10:16:58,383 INFO handler.ContextHandler: Started o.e.j.s.ServletContextHandler@7f02251{static,/static,file:///hadoop-3.3.1/share/hadoop/hdfs/webapps/static/,AVAILABLE} 2025-09-05 10:16:58,463 INFO handler.ContextHandler: Started o.e.j.w.WebAppContext@7ae9a33a{hdfs,/,file:///hadoop-3.3.1/share/hadoop/hdfs/webapps/hdfs/,AVAILABLE}{file:/hadoop-3.3.1/share/hadoop/hdfs/webapps/hdfs} 2025-09-05 10:16:58,477 INFO server.AbstractConnector: Started ServerConnector@41c204a0{HTTP/1.1, (http/1.1)}{localhost:43183} 2025-09-05 10:16:58,477 INFO server.Server: Started @2202ms 2025-09-05 10:16:58,485 INFO namenode.FSEditLog: Edit logging is async:true 2025-09-05 10:16:58,498 INFO namenode.FSNamesystem: KeyProvider: null 2025-09-05 10:16:58,498 INFO namenode.FSNamesystem: fsLock is fair: true 2025-09-05 10:16:58,498 INFO namenode.FSNamesystem: Detailed lock hold time metrics enabled: false 2025-09-05 10:16:58,498 INFO namenode.FSNamesystem: fsOwner = clickhouse (auth:SIMPLE) 2025-09-05 10:16:58,498 INFO namenode.FSNamesystem: supergroup = supergroup 2025-09-05 10:16:58,498 INFO namenode.FSNamesystem: isPermissionEnabled = true 2025-09-05 10:16:58,498 INFO namenode.FSNamesystem: isStoragePolicyEnabled = true 2025-09-05 10:16:58,498 INFO namenode.FSNamesystem: HA Enabled: false 2025-09-05 10:16:58,498 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling 2025-09-05 10:16:58,499 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit: configured=1000, counted=60, effected=1000 2025-09-05 10:16:58,499 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true 2025-09-05 10:16:58,499 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000 2025-09-05 10:16:58,499 INFO blockmanagement.BlockManager: The block deletion will start around 2025 Sep 05 10:16:58 2025-09-05 10:16:58,499 INFO util.GSet: Computing capacity for map BlocksMap 2025-09-05 10:16:58,499 INFO util.GSet: VM type = 64-bit 2025-09-05 10:16:58,499 INFO util.GSet: 2.0% max memory 7.6 GB = 156.4 MB 2025-09-05 10:16:58,499 INFO util.GSet: capacity = 2^24 = 16777216 entries 2025-09-05 10:16:58,522 INFO blockmanagement.BlockManager: Storage policy satisfier is disabled 2025-09-05 10:16:58,522 INFO blockmanagement.BlockManager: dfs.block.access.token.enable = false 2025-09-05 10:16:58,522 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.threshold-pct = 0.999 2025-09-05 10:16:58,522 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.min.datanodes = 0 2025-09-05 10:16:58,522 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.extension = 0 2025-09-05 10:16:58,522 INFO blockmanagement.BlockManager: defaultReplication = 1 2025-09-05 10:16:58,522 INFO blockmanagement.BlockManager: maxReplication = 512 2025-09-05 10:16:58,522 INFO blockmanagement.BlockManager: minReplication = 1 2025-09-05 10:16:58,522 INFO blockmanagement.BlockManager: maxReplicationStreams = 2 2025-09-05 10:16:58,522 INFO blockmanagement.BlockManager: redundancyRecheckInterval = 3000ms 2025-09-05 10:16:58,522 INFO blockmanagement.BlockManager: encryptDataTransfer = false 2025-09-05 10:16:58,522 INFO blockmanagement.BlockManager: maxNumBlocksToLog = 1000 2025-09-05 10:16:58,522 INFO util.GSet: Computing capacity for map INodeMap 2025-09-05 10:16:58,523 INFO util.GSet: VM type = 64-bit 2025-09-05 10:16:58,523 INFO util.GSet: 1.0% max memory 7.6 GB = 78.2 MB 2025-09-05 10:16:58,523 INFO util.GSet: capacity = 2^23 = 8388608 entries 2025-09-05 10:16:58,546 INFO namenode.FSDirectory: ACLs enabled? true 2025-09-05 10:16:58,547 INFO namenode.FSDirectory: POSIX ACL inheritance enabled? true 2025-09-05 10:16:58,547 INFO namenode.FSDirectory: XAttrs enabled? true 2025-09-05 10:16:58,547 INFO namenode.NameNode: Caching file names occurring more than 10 times 2025-09-05 10:16:58,547 INFO snapshot.SnapshotManager: Loaded config captureOpenFiles: false, skipCaptureAccessTimeOnlyChange: false, snapshotDiffAllowSnapRootDescendant: true, maxSnapshotLimit: 65536 2025-09-05 10:16:58,547 INFO snapshot.SnapshotManager: SkipList is disabled 2025-09-05 10:16:58,547 INFO util.GSet: Computing capacity for map cachedBlocks 2025-09-05 10:16:58,548 INFO util.GSet: VM type = 64-bit 2025-09-05 10:16:58,548 INFO util.GSet: 0.25% max memory 7.6 GB = 19.6 MB 2025-09-05 10:16:58,548 INFO util.GSet: capacity = 2^21 = 2097152 entries 2025-09-05 10:16:58,552 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10 2025-09-05 10:16:58,552 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10 2025-09-05 10:16:58,553 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25 2025-09-05 10:16:58,553 INFO namenode.FSNamesystem: Retry cache on namenode is enabled 2025-09-05 10:16:58,553 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis 2025-09-05 10:16:58,553 INFO util.GSet: Computing capacity for map NameNodeRetryCache 2025-09-05 10:16:58,553 INFO util.GSet: VM type = 64-bit 2025-09-05 10:16:58,554 INFO util.GSet: 0.029999999329447746% max memory 7.6 GB = 2.3 MB 2025-09-05 10:16:58,554 INFO util.GSet: capacity = 2^18 = 262144 entries 2025-09-05 10:16:58,565 INFO common.Storage: Lock on /hadoop-3.3.1/target/test/data/dfs/name-0-1/in_use.lock acquired by nodename 427@2e755959ded4 2025-09-05 10:16:58,569 INFO common.Storage: Lock on /hadoop-3.3.1/target/test/data/dfs/name-0-2/in_use.lock acquired by nodename 427@2e755959ded4 2025-09-05 10:16:58,571 INFO namenode.FileJournalManager: Recovering unfinalized segments in /hadoop-3.3.1/target/test/data/dfs/name-0-1/current 2025-09-05 10:16:58,572 INFO namenode.FileJournalManager: Recovering unfinalized segments in /hadoop-3.3.1/target/test/data/dfs/name-0-2/current 2025-09-05 10:16:58,572 INFO namenode.FSImage: No edit log streams selected. 2025-09-05 10:16:58,572 INFO namenode.FSImage: Planning to load image: FSImageFile(file=/hadoop-3.3.1/target/test/data/dfs/name-0-1/current/fsimage_0000000000000000000, cpktTxId=0000000000000000000) 2025-09-05 10:16:58,607 INFO namenode.FSImageFormatPBINode: Loading 1 INodes. 2025-09-05 10:16:58,608 INFO namenode.FSImageFormatPBINode: Successfully loaded 1 inodes 2025-09-05 10:16:58,613 INFO namenode.FSImageFormatPBINode: Completed update blocks map and name cache, total waiting duration 0ms. 2025-09-05 10:16:58,615 INFO namenode.FSImageFormatProtobuf: Loaded FSImage in 0 seconds. 2025-09-05 10:16:58,615 INFO namenode.FSImage: Loaded image for txid 0 from /hadoop-3.3.1/target/test/data/dfs/name-0-1/current/fsimage_0000000000000000000 2025-09-05 10:16:58,619 INFO namenode.FSNamesystem: Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false) 2025-09-05 10:16:58,620 INFO namenode.FSEditLog: Starting log segment at 1 2025-09-05 10:16:58,638 INFO namenode.NameCache: initialized with 0 entries 0 lookups 2025-09-05 10:16:58,638 INFO namenode.FSNamesystem: Finished loading FSImage in 82 msecs 2025-09-05 10:16:58,794 INFO namenode.NameNode: RPC server is binding to localhost:12222 2025-09-05 10:16:58,794 INFO namenode.NameNode: Enable NameNode state context:false 2025-09-05 10:16:58,803 INFO ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 1000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2025-09-05 10:16:58,813 INFO ipc.Server: Starting Socket Reader #1 for port 12222 2025-09-05 10:16:59,016 INFO namenode.FSNamesystem: Registered FSNamesystemState, ReplicatedBlocksState and ECBlockGroupsState MBeans. 2025-09-05 10:16:59,033 INFO namenode.LeaseManager: Number of blocks under construction: 0 2025-09-05 10:16:59,041 INFO blockmanagement.DatanodeAdminDefaultMonitor: Initialized the Default Decommission and Maintenance monitor 2025-09-05 10:16:59,044 INFO blockmanagement.BlockManager: initializing replication queues 2025-09-05 10:16:59,045 INFO hdfs.StateChange: STATE* Leaving safe mode after 0 secs 2025-09-05 10:16:59,045 INFO hdfs.StateChange: STATE* Network topology has 0 racks and 0 datanodes 2025-09-05 10:16:59,045 INFO hdfs.StateChange: STATE* UnderReplicatedBlocks has 0 blocks 2025-09-05 10:16:59,055 INFO blockmanagement.BlockManager: Total number of blocks = 0 2025-09-05 10:16:59,055 INFO blockmanagement.BlockManager: Number of invalid blocks = 0 2025-09-05 10:16:59,056 INFO blockmanagement.BlockManager: Number of under-replicated blocks = 0 2025-09-05 10:16:59,056 INFO blockmanagement.BlockManager: Number of over-replicated blocks = 0 2025-09-05 10:16:59,056 INFO blockmanagement.BlockManager: Number of blocks being written = 0 2025-09-05 10:16:59,056 INFO hdfs.StateChange: STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 10 msec 2025-09-05 10:16:59,080 INFO ipc.Server: IPC Server Responder: starting 2025-09-05 10:16:59,080 INFO ipc.Server: IPC Server listener on 12222: starting 2025-09-05 10:16:59,087 INFO namenode.NameNode: NameNode RPC up at: localhost/127.0.0.1:12222 2025-09-05 10:16:59,091 INFO namenode.FSNamesystem: Starting services required for active state 2025-09-05 10:16:59,092 INFO namenode.FSDirectory: Initializing quota with 12 thread(s) 2025-09-05 10:16:59,097 INFO namenode.FSDirectory: Quota initialization completed in 6 milliseconds name space=1 storage space=0 storage types=RAM_DISK=0, SSD=0, DISK=0, ARCHIVE=0, PROVIDED=0 2025-09-05 10:16:59,104 INFO blockmanagement.CacheReplicationMonitor: Starting CacheReplicationMonitor with interval 30000 milliseconds 2025-09-05 10:16:59,111 INFO hdfs.MiniDFSCluster: Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1,[DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2 2025-09-05 10:16:59,157 INFO checker.ThrottledAsyncChecker: Scheduling a check for [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1 2025-09-05 10:16:59,167 INFO checker.ThrottledAsyncChecker: Scheduling a check for [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2 2025-09-05 10:16:59,184 INFO impl.MetricsSystemImpl: DataNode metrics system started (again) 2025-09-05 10:16:59,189 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling 2025-09-05 10:16:59,192 INFO datanode.BlockScanner: Initialized block scanner with targetBytesPerSec 1048576 2025-09-05 10:16:59,196 INFO datanode.DataNode: Configured hostname is 127.0.0.1 2025-09-05 10:16:59,197 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling 2025-09-05 10:16:59,201 INFO datanode.DataNode: Starting DataNode with maxLockedMemory = 0 2025-09-05 10:16:59,206 INFO datanode.DataNode: Opened streaming server at /127.0.0.1:40007 2025-09-05 10:16:59,209 INFO datanode.DataNode: Balancing bandwidth is 104857600 bytes/s 2025-09-05 10:16:59,209 INFO datanode.DataNode: Number threads for balancing is 100 2025-09-05 10:16:59,221 INFO server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2025-09-05 10:16:59,222 INFO http.HttpRequestLog: Http request log for http.requests.datanode is not defined 2025-09-05 10:16:59,225 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2025-09-05 10:16:59,226 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode 2025-09-05 10:16:59,226 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2025-09-05 10:16:59,226 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2025-09-05 10:16:59,230 INFO http.HttpServer2: Jetty bound to port 35167 2025-09-05 10:16:59,230 INFO server.Server: jetty-9.4.40.v20210413; built: 2021-04-13T20:42:42.668Z; git: b881a572662e1943a14ae12e7e1207989f218b74; jvm 11.0.25+9-post-Ubuntu-1ubuntu122.04 2025-09-05 10:16:59,231 INFO server.session: DefaultSessionIdManager workerName=node0 2025-09-05 10:16:59,231 INFO server.session: No SessionScavenger set, using defaults 2025-09-05 10:16:59,232 INFO server.session: node0 Scavenging every 600000ms 2025-09-05 10:16:59,232 INFO handler.ContextHandler: Started o.e.j.s.ServletContextHandler@bc6288b{logs,/logs,file:///hadoop-3.3.1/logs,AVAILABLE} 2025-09-05 10:16:59,233 INFO handler.ContextHandler: Started o.e.j.s.ServletContextHandler@34c70b5e{static,/static,file:///hadoop-3.3.1/share/hadoop/hdfs/webapps/static/,AVAILABLE} 2025-09-05 10:16:59,243 INFO handler.ContextHandler: Started o.e.j.w.WebAppContext@7c1447b5{datanode,/,file:///hadoop-3.3.1/share/hadoop/hdfs/webapps/datanode/,AVAILABLE}{file:/hadoop-3.3.1/share/hadoop/hdfs/webapps/datanode} 2025-09-05 10:16:59,244 INFO server.AbstractConnector: Started ServerConnector@3667faa8{HTTP/1.1, (http/1.1)}{localhost:35167} 2025-09-05 10:16:59,244 INFO server.Server: Started @2970ms 2025-09-05 10:16:59,393 WARN web.DatanodeHttpServer: Got null for restCsrfPreventionFilter - will not do any filtering. 2025-09-05 10:16:59,531 INFO web.DatanodeHttpServer: Listening HTTP traffic on /127.0.0.1:40201 2025-09-05 10:16:59,532 INFO util.JvmPauseMonitor: Starting JVM pause monitor 2025-09-05 10:16:59,533 INFO datanode.DataNode: dnUserName = clickhouse 2025-09-05 10:16:59,533 INFO datanode.DataNode: supergroup = supergroup 2025-09-05 10:16:59,548 INFO ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 1000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2025-09-05 10:16:59,549 INFO ipc.Server: Starting Socket Reader #1 for port 0 2025-09-05 10:16:59,556 INFO datanode.DataNode: Opened IPC server at /127.0.0.1:43267 2025-09-05 10:16:59,583 INFO datanode.DataNode: Refresh request received for nameservices: null 2025-09-05 10:16:59,584 INFO datanode.DataNode: Starting BPOfferServices for nameservices: 2025-09-05 10:16:59,593 INFO datanode.DataNode: Block pool (Datanode Uuid unassigned) service to localhost/127.0.0.1:12222 starting to offer service 2025-09-05 10:16:59,598 INFO ipc.Server: IPC Server Responder: starting 2025-09-05 10:16:59,598 INFO ipc.Server: IPC Server listener on 0: starting 2025-09-05 10:16:59,803 INFO datanode.DataNode: Acknowledging ACTIVE Namenode during handshakeBlock pool (Datanode Uuid unassigned) service to localhost/127.0.0.1:12222 2025-09-05 10:16:59,806 INFO common.Storage: Using 2 threads to upgrade data directories (dfs.datanode.parallel.volumes.load.threads.num=2, dataDirs=2) 2025-09-05 10:16:59,808 INFO common.Storage: Lock on /hadoop-3.3.1/target/test/data/dfs/data/data1/in_use.lock acquired by nodename 427@2e755959ded4 2025-09-05 10:16:59,809 INFO common.Storage: Storage directory with location [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1 is not formatted for namespace 1872186242. Formatting... 2025-09-05 10:16:59,810 INFO common.Storage: Generated new storageID DS-405a7a14-bc16-40f0-af69-64063ae1e546 for directory /hadoop-3.3.1/target/test/data/dfs/data/data1 2025-09-05 10:16:59,816 INFO common.Storage: Lock on /hadoop-3.3.1/target/test/data/dfs/data/data2/in_use.lock acquired by nodename 427@2e755959ded4 2025-09-05 10:16:59,816 INFO common.Storage: Storage directory with location [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2 is not formatted for namespace 1872186242. Formatting... 2025-09-05 10:16:59,816 INFO common.Storage: Generated new storageID DS-b12085d3-fe85-4463-9568-c6bcca4bcd3f for directory /hadoop-3.3.1/target/test/data/dfs/data/data2 2025-09-05 10:16:59,844 INFO common.Storage: Analyzing storage directories for bpid BP-1058275958-172.17.0.2-1757089017665 2025-09-05 10:16:59,844 INFO common.Storage: Locking is disabled for /hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665 2025-09-05 10:16:59,845 INFO common.Storage: Block pool storage directory for location [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1 and block pool id BP-1058275958-172.17.0.2-1757089017665 is not formatted. Formatting ... 2025-09-05 10:16:59,845 INFO common.Storage: Formatting block pool BP-1058275958-172.17.0.2-1757089017665 directory /hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current 2025-09-05 10:16:59,869 INFO common.Storage: Analyzing storage directories for bpid BP-1058275958-172.17.0.2-1757089017665 2025-09-05 10:16:59,869 INFO common.Storage: Locking is disabled for /hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665 2025-09-05 10:16:59,869 INFO common.Storage: Block pool storage directory for location [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2 and block pool id BP-1058275958-172.17.0.2-1757089017665 is not formatted. Formatting ... 2025-09-05 10:16:59,869 INFO common.Storage: Formatting block pool BP-1058275958-172.17.0.2-1757089017665 directory /hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current 2025-09-05 10:16:59,874 INFO datanode.DataNode: Setting up storage: nsid=1872186242;bpid=BP-1058275958-172.17.0.2-1757089017665;lv=-57;nsInfo=lv=-66;cid=testClusterID;nsid=1872186242;c=1757089017665;bpid=BP-1058275958-172.17.0.2-1757089017665;dnuuid=null 2025-09-05 10:16:59,877 INFO datanode.DataNode: Generated and persisted new Datanode UUID 99ca1da0-e476-4e50-9206-33fb6d7b0583 2025-09-05 10:16:59,890 INFO impl.FsDatasetImpl: The datanode lock is a read write lock 2025-09-05 10:16:59,980 INFO impl.FsDatasetImpl: Added new volume: DS-405a7a14-bc16-40f0-af69-64063ae1e546 2025-09-05 10:16:59,980 INFO impl.FsDatasetImpl: Added volume - [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1, StorageType: DISK 2025-09-05 10:16:59,983 INFO impl.FsDatasetImpl: Added new volume: DS-b12085d3-fe85-4463-9568-c6bcca4bcd3f 2025-09-05 10:16:59,984 INFO impl.FsDatasetImpl: Added volume - [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2, StorageType: DISK 2025-09-05 10:16:59,989 INFO impl.MemoryMappableBlockLoader: Initializing cache loader: MemoryMappableBlockLoader. 2025-09-05 10:16:59,994 INFO impl.FsDatasetImpl: Registered FSDatasetState MBean 2025-09-05 10:16:59,999 INFO impl.FsDatasetImpl: Adding block pool BP-1058275958-172.17.0.2-1757089017665 2025-09-05 10:17:00,000 INFO impl.FsDatasetImpl: Scanning block pool BP-1058275958-172.17.0.2-1757089017665 on volume /hadoop-3.3.1/target/test/data/dfs/data/data1... 2025-09-05 10:17:00,000 INFO impl.FsDatasetImpl: Scanning block pool BP-1058275958-172.17.0.2-1757089017665 on volume /hadoop-3.3.1/target/test/data/dfs/data/data2... 2025-09-05 10:17:00,050 INFO impl.FsDatasetImpl: Time taken to scan block pool BP-1058275958-172.17.0.2-1757089017665 on /hadoop-3.3.1/target/test/data/dfs/data/data1: 50ms 2025-09-05 10:17:00,050 INFO impl.FsDatasetImpl: Time taken to scan block pool BP-1058275958-172.17.0.2-1757089017665 on /hadoop-3.3.1/target/test/data/dfs/data/data2: 50ms 2025-09-05 10:17:00,052 INFO impl.FsDatasetImpl: Total time to scan all replicas for block pool BP-1058275958-172.17.0.2-1757089017665: 52ms 2025-09-05 10:17:00,054 INFO impl.FsDatasetImpl: Adding replicas to map for block pool BP-1058275958-172.17.0.2-1757089017665 on volume /hadoop-3.3.1/target/test/data/dfs/data/data1... 2025-09-05 10:17:00,055 INFO impl.FsDatasetImpl: Adding replicas to map for block pool BP-1058275958-172.17.0.2-1757089017665 on volume /hadoop-3.3.1/target/test/data/dfs/data/data2... 2025-09-05 10:17:00,055 INFO impl.BlockPoolSlice: Replica Cache file: /hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/replicas doesn't exist 2025-09-05 10:17:00,056 INFO impl.BlockPoolSlice: Replica Cache file: /hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/replicas doesn't exist 2025-09-05 10:17:00,058 INFO impl.FsDatasetImpl: Time to add replicas to map for block pool BP-1058275958-172.17.0.2-1757089017665 on volume /hadoop-3.3.1/target/test/data/dfs/data/data1: 4ms 2025-09-05 10:17:00,059 INFO impl.FsDatasetImpl: Time to add replicas to map for block pool BP-1058275958-172.17.0.2-1757089017665 on volume /hadoop-3.3.1/target/test/data/dfs/data/data2: 4ms 2025-09-05 10:17:00,059 INFO impl.FsDatasetImpl: Total time to add all replicas to map for block pool BP-1058275958-172.17.0.2-1757089017665: 6ms 2025-09-05 10:17:00,060 INFO checker.ThrottledAsyncChecker: Scheduling a check for /hadoop-3.3.1/target/test/data/dfs/data/data1 2025-09-05 10:17:00,073 INFO checker.DatasetVolumeChecker: Scheduled health check for volume /hadoop-3.3.1/target/test/data/dfs/data/data1 2025-09-05 10:17:00,073 INFO hdfs.MiniDFSCluster: dnInfo.length != numDataNodes 2025-09-05 10:17:00,073 INFO hdfs.MiniDFSCluster: Waiting for cluster to become active 2025-09-05 10:17:00,074 INFO checker.ThrottledAsyncChecker: Scheduling a check for /hadoop-3.3.1/target/test/data/dfs/data/data2 2025-09-05 10:17:00,074 INFO checker.DatasetVolumeChecker: Scheduled health check for volume /hadoop-3.3.1/target/test/data/dfs/data/data2 2025-09-05 10:17:00,077 INFO datanode.VolumeScanner: Now scanning bpid BP-1058275958-172.17.0.2-1757089017665 on volume /hadoop-3.3.1/target/test/data/dfs/data/data2 2025-09-05 10:17:00,077 INFO datanode.VolumeScanner: Now scanning bpid BP-1058275958-172.17.0.2-1757089017665 on volume /hadoop-3.3.1/target/test/data/dfs/data/data1 2025-09-05 10:17:00,078 INFO datanode.VolumeScanner: VolumeScanner(/hadoop-3.3.1/target/test/data/dfs/data/data2, DS-b12085d3-fe85-4463-9568-c6bcca4bcd3f): finished scanning block pool BP-1058275958-172.17.0.2-1757089017665 2025-09-05 10:17:00,078 INFO datanode.VolumeScanner: VolumeScanner(/hadoop-3.3.1/target/test/data/dfs/data/data1, DS-405a7a14-bc16-40f0-af69-64063ae1e546): finished scanning block pool BP-1058275958-172.17.0.2-1757089017665 2025-09-05 10:17:00,079 WARN datanode.DirectoryScanner: dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value above 1000 ms/sec. Assuming default value of -1 2025-09-05 10:17:00,080 INFO datanode.DirectoryScanner: Periodic Directory Tree Verification scan starting in 462386ms with interval of 21600000ms and throttle limit of -1ms/s 2025-09-05 10:17:00,085 INFO datanode.DataNode: Block pool BP-1058275958-172.17.0.2-1757089017665 (Datanode Uuid 99ca1da0-e476-4e50-9206-33fb6d7b0583) service to localhost/127.0.0.1:12222 beginning handshake with NN 2025-09-05 10:17:00,091 INFO datanode.VolumeScanner: VolumeScanner(/hadoop-3.3.1/target/test/data/dfs/data/data1, DS-405a7a14-bc16-40f0-af69-64063ae1e546): no suitable block pools found to scan. Waiting 1814399986 ms. 2025-09-05 10:17:00,091 INFO datanode.VolumeScanner: VolumeScanner(/hadoop-3.3.1/target/test/data/dfs/data/data2, DS-b12085d3-fe85-4463-9568-c6bcca4bcd3f): no suitable block pools found to scan. Waiting 1814399986 ms. 2025-09-05 10:17:00,103 INFO hdfs.StateChange: BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1:40007, datanodeUuid=99ca1da0-e476-4e50-9206-33fb6d7b0583, infoPort=40201, infoSecurePort=0, ipcPort=43267, storageInfo=lv=-57;cid=testClusterID;nsid=1872186242;c=1757089017665) storage 99ca1da0-e476-4e50-9206-33fb6d7b0583 2025-09-05 10:17:00,105 INFO net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:40007 2025-09-05 10:17:00,105 INFO blockmanagement.BlockReportLeaseManager: Registered DN 99ca1da0-e476-4e50-9206-33fb6d7b0583 (127.0.0.1:40007). 2025-09-05 10:17:00,110 INFO datanode.DataNode: Block pool BP-1058275958-172.17.0.2-1757089017665 (Datanode Uuid 99ca1da0-e476-4e50-9206-33fb6d7b0583) service to localhost/127.0.0.1:12222 successfully registered with NN 2025-09-05 10:17:00,111 INFO datanode.DataNode: For namenode localhost/127.0.0.1:12222 using BLOCKREPORT_INTERVAL of 21600000msecs CACHEREPORT_INTERVAL of 10000msecs Initial delay: 0msecs; heartBeatInterval=3000 2025-09-05 10:17:00,126 INFO blockmanagement.DatanodeDescriptor: Adding new storage ID DS-405a7a14-bc16-40f0-af69-64063ae1e546 for DN 127.0.0.1:40007 2025-09-05 10:17:00,127 INFO blockmanagement.DatanodeDescriptor: Adding new storage ID DS-b12085d3-fe85-4463-9568-c6bcca4bcd3f for DN 127.0.0.1:40007 2025-09-05 10:17:00,155 INFO BlockStateChange: BLOCK* processReport 0x5a5375b5810d7e1b: Processing first storage report for DS-405a7a14-bc16-40f0-af69-64063ae1e546 from datanode 99ca1da0-e476-4e50-9206-33fb6d7b0583 2025-09-05 10:17:00,157 INFO BlockStateChange: BLOCK* processReport 0x5a5375b5810d7e1b: from storage DS-405a7a14-bc16-40f0-af69-64063ae1e546 node DatanodeRegistration(127.0.0.1:40007, datanodeUuid=99ca1da0-e476-4e50-9206-33fb6d7b0583, infoPort=40201, infoSecurePort=0, ipcPort=43267, storageInfo=lv=-57;cid=testClusterID;nsid=1872186242;c=1757089017665), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2025-09-05 10:17:00,158 INFO BlockStateChange: BLOCK* processReport 0x5a5375b5810d7e1b: Processing first storage report for DS-b12085d3-fe85-4463-9568-c6bcca4bcd3f from datanode 99ca1da0-e476-4e50-9206-33fb6d7b0583 2025-09-05 10:17:00,158 INFO BlockStateChange: BLOCK* processReport 0x5a5375b5810d7e1b: from storage DS-b12085d3-fe85-4463-9568-c6bcca4bcd3f node DatanodeRegistration(127.0.0.1:40007, datanodeUuid=99ca1da0-e476-4e50-9206-33fb6d7b0583, infoPort=40201, infoSecurePort=0, ipcPort=43267, storageInfo=lv=-57;cid=testClusterID;nsid=1872186242;c=1757089017665), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2025-09-05 10:17:00,176 INFO datanode.DataNode: Successfully sent block report 0x5a5375b5810d7e1b to namenode: localhost/127.0.0.1:12222, containing 2 storage report(s), of which we sent 2. The reports had 0 total blocks and used 1 RPC(s). This took 4 msecs to generate and 32 msecs for RPC and NN processing. Got back one command: FinalizeCommand/5. 2025-09-05 10:17:00,178 INFO datanode.DataNode: Got finalize command for block pool BP-1058275958-172.17.0.2-1757089017665 2025-09-05 10:17:00,185 INFO hdfs.MiniDFSCluster: Cluster is active 2025-09-05 10:17:00,189 INFO mapreduce.MiniHadoopClusterManager: Started MiniDFSCluster -- namenode on port 12222 2025-09-05 10:20:36,348 INFO namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 37 Number of transactions batched in Syncs: 0 Number of syncs: 2 SyncTimes(ms): 1 1 2025-09-05 10:20:36,380 INFO hdfs.StateChange: BLOCK* allocate blk_1073741825_1001, replicas=127.0.0.1:40007 for /02923_hdfs_engine_size_virtual_column_test_qr6xt91f.data1.tsv 2025-09-05 10:20:36,447 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741825_1001 src: /127.0.0.1:42686 dest: /127.0.0.1:40007 2025-09-05 10:20:36,484 INFO DataNode.clienttrace: src: /127.0.0.1:42686, dest: /127.0.0.1:40007, bytes: 2, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.100740_count_2_pid_635_tid_280722377177728, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741825_1001, duration(ns): 9145528 2025-09-05 10:20:36,484 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741825_1001, type=LAST_IN_PIPELINE terminating 2025-09-05 10:20:36,486 INFO hdfs.StateChange: BLOCK* fsync: /02923_hdfs_engine_size_virtual_column_test_qr6xt91f.data1.tsv for libhdfs3_client_rand_0.100740_count_2_pid_635_tid_280722377177728 2025-09-05 10:20:36,495 INFO namenode.FSNamesystem: BLOCK* blk_1073741825_1001 is COMMITTED but not COMPLETE(numNodes= 0 < minimum = 1) in file /02923_hdfs_engine_size_virtual_column_test_qr6xt91f.data1.tsv 2025-09-05 10:20:36,900 INFO hdfs.StateChange: DIR* completeFile: /02923_hdfs_engine_size_virtual_column_test_qr6xt91f.data1.tsv is closed by libhdfs3_client_rand_0.100740_count_2_pid_635_tid_280722377177728 2025-09-05 10:20:36,991 INFO hdfs.StateChange: BLOCK* allocate blk_1073741826_1002, replicas=127.0.0.1:40007 for /02923_hdfs_engine_size_virtual_column_test_qr6xt91f.data2.tsv 2025-09-05 10:20:36,994 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741826_1002 src: /127.0.0.1:42702 dest: /127.0.0.1:40007 2025-09-05 10:20:36,998 INFO DataNode.clienttrace: src: /127.0.0.1:42702, dest: /127.0.0.1:40007, bytes: 3, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.100740_count_4_pid_635_tid_280722444810880, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741826_1002, duration(ns): 2045019 2025-09-05 10:20:36,998 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741826_1002, type=LAST_IN_PIPELINE terminating 2025-09-05 10:20:36,999 INFO hdfs.StateChange: BLOCK* fsync: /02923_hdfs_engine_size_virtual_column_test_qr6xt91f.data2.tsv for libhdfs3_client_rand_0.100740_count_4_pid_635_tid_280722444810880 2025-09-05 10:20:37,000 INFO hdfs.StateChange: DIR* completeFile: /02923_hdfs_engine_size_virtual_column_test_qr6xt91f.data2.tsv is closed by libhdfs3_client_rand_0.100740_count_4_pid_635_tid_280722444810880 2025-09-05 10:20:37,115 INFO hdfs.StateChange: BLOCK* allocate blk_1073741827_1003, replicas=127.0.0.1:40007 for /02923_hdfs_engine_size_virtual_column_test_qr6xt91f.data3.tsv 2025-09-05 10:20:37,118 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741827_1003 src: /127.0.0.1:42714 dest: /127.0.0.1:40007 2025-09-05 10:20:37,122 INFO DataNode.clienttrace: src: /127.0.0.1:42714, dest: /127.0.0.1:40007, bytes: 4, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.185773_count_6_pid_635_tid_280722529352320, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741827_1003, duration(ns): 2245101 2025-09-05 10:20:37,122 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741827_1003, type=LAST_IN_PIPELINE terminating 2025-09-05 10:20:37,123 INFO hdfs.StateChange: BLOCK* fsync: /02923_hdfs_engine_size_virtual_column_test_qr6xt91f.data3.tsv for libhdfs3_client_rand_0.185773_count_6_pid_635_tid_280722529352320 2025-09-05 10:20:37,125 INFO hdfs.StateChange: DIR* completeFile: /02923_hdfs_engine_size_virtual_column_test_qr6xt91f.data3.tsv is closed by libhdfs3_client_rand_0.185773_count_6_pid_635_tid_280722529352320 2025-09-05 10:20:47,228 INFO hdfs.StateChange: BLOCK* allocate blk_1073741828_1004, replicas=127.0.0.1:40007 for /02845_table_function_hdfs_filter_by_virtual_columns_test_pjhxojfm.data1.tsv 2025-09-05 10:20:47,230 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741828_1004 src: /127.0.0.1:60662 dest: /127.0.0.1:40007 2025-09-05 10:20:47,234 INFO DataNode.clienttrace: src: /127.0.0.1:60662, dest: /127.0.0.1:40007, bytes: 2, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.036097_count_15_pid_635_tid_280722174278272, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741828_1004, duration(ns): 2132380 2025-09-05 10:20:47,235 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741828_1004, type=LAST_IN_PIPELINE terminating 2025-09-05 10:20:47,235 INFO hdfs.StateChange: BLOCK* fsync: /02845_table_function_hdfs_filter_by_virtual_columns_test_pjhxojfm.data1.tsv for libhdfs3_client_rand_0.036097_count_15_pid_635_tid_280722174278272 2025-09-05 10:20:47,237 INFO hdfs.StateChange: DIR* completeFile: /02845_table_function_hdfs_filter_by_virtual_columns_test_pjhxojfm.data1.tsv is closed by libhdfs3_client_rand_0.036097_count_15_pid_635_tid_280722174278272 2025-09-05 10:20:47,352 INFO hdfs.StateChange: BLOCK* allocate blk_1073741829_1005, replicas=127.0.0.1:40007 for /02845_table_function_hdfs_filter_by_virtual_columns_test_pjhxojfm.data2.tsv 2025-09-05 10:20:47,355 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741829_1005 src: /127.0.0.1:60668 dest: /127.0.0.1:40007 2025-09-05 10:20:47,360 INFO DataNode.clienttrace: src: /127.0.0.1:60668, dest: /127.0.0.1:40007, bytes: 2, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.036097_count_17_pid_635_tid_280722191186560, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741829_1005, duration(ns): 2775307 2025-09-05 10:20:47,360 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741829_1005, type=LAST_IN_PIPELINE terminating 2025-09-05 10:20:47,361 INFO hdfs.StateChange: BLOCK* fsync: /02845_table_function_hdfs_filter_by_virtual_columns_test_pjhxojfm.data2.tsv for libhdfs3_client_rand_0.036097_count_17_pid_635_tid_280722191186560 2025-09-05 10:20:47,363 INFO hdfs.StateChange: DIR* completeFile: /02845_table_function_hdfs_filter_by_virtual_columns_test_pjhxojfm.data2.tsv is closed by libhdfs3_client_rand_0.036097_count_17_pid_635_tid_280722191186560 2025-09-05 10:20:47,476 INFO hdfs.StateChange: BLOCK* allocate blk_1073741830_1006, replicas=127.0.0.1:40007 for /02845_table_function_hdfs_filter_by_virtual_columns_test_pjhxojfm.data3.tsv 2025-09-05 10:20:47,479 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741830_1006 src: /127.0.0.1:60682 dest: /127.0.0.1:40007 2025-09-05 10:20:47,483 INFO DataNode.clienttrace: src: /127.0.0.1:60682, dest: /127.0.0.1:40007, bytes: 2, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.036097_count_19_pid_635_tid_280722613893760, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741830_1006, duration(ns): 2256462 2025-09-05 10:20:47,483 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741830_1006, type=LAST_IN_PIPELINE terminating 2025-09-05 10:20:47,484 INFO hdfs.StateChange: BLOCK* fsync: /02845_table_function_hdfs_filter_by_virtual_columns_test_pjhxojfm.data3.tsv for libhdfs3_client_rand_0.036097_count_19_pid_635_tid_280722613893760 2025-09-05 10:20:47,486 INFO hdfs.StateChange: DIR* completeFile: /02845_table_function_hdfs_filter_by_virtual_columns_test_pjhxojfm.data3.tsv is closed by libhdfs3_client_rand_0.036097_count_19_pid_635_tid_280722613893760 2025-09-05 10:23:40,958 INFO namenode.FSEditLog: Number of transactions: 38 Total time for transactions(ms): 41 Number of transactions batched in Syncs: 6 Number of syncs: 32 SyncTimes(ms): 5 2 2025-09-05 10:23:41,390 INFO hdfs.StateChange: BLOCK* allocate blk_1073741831_1007, replicas=127.0.0.1:40007 for /02368_data_9.jsonl 2025-09-05 10:23:41,411 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741831_1007 src: /127.0.0.1:57318 dest: /127.0.0.1:40007 2025-09-05 10:23:41,435 INFO hdfs.StateChange: BLOCK* allocate blk_1073741832_1008, replicas=127.0.0.1:40007 for /02368_data_1.jsonl 2025-09-05 10:23:41,442 INFO hdfs.StateChange: BLOCK* allocate blk_1073741833_1009, replicas=127.0.0.1:40007 for /02368_data_8.jsonl 2025-09-05 10:23:41,466 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741832_1008 src: /127.0.0.1:57322 dest: /127.0.0.1:40007 2025-09-05 10:23:41,485 INFO hdfs.StateChange: BLOCK* allocate blk_1073741834_1010, replicas=127.0.0.1:40007 for /02368_data_2.jsonl 2025-09-05 10:23:41,494 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741833_1009 src: /127.0.0.1:57324 dest: /127.0.0.1:40007 2025-09-05 10:23:41,547 INFO hdfs.StateChange: BLOCK* allocate blk_1073741835_1011, replicas=127.0.0.1:40007 for /02368_data_3.jsonl 2025-09-05 10:23:41,548 INFO hdfs.StateChange: BLOCK* allocate blk_1073741836_1012, replicas=127.0.0.1:40007 for /02368_data_6.jsonl 2025-09-05 10:23:41,573 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741835_1011 src: /127.0.0.1:57340 dest: /127.0.0.1:40007 2025-09-05 10:23:41,575 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741834_1010 src: /127.0.0.1:57334 dest: /127.0.0.1:40007 2025-09-05 10:23:41,628 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741836_1012 src: /127.0.0.1:57352 dest: /127.0.0.1:40007 2025-09-05 10:23:41,628 INFO hdfs.StateChange: BLOCK* allocate blk_1073741837_1013, replicas=127.0.0.1:40007 for /02368_data_5.jsonl 2025-09-05 10:23:41,640 INFO hdfs.StateChange: BLOCK* allocate blk_1073741838_1014, replicas=127.0.0.1:40007 for /02368_data_10.jsonl 2025-09-05 10:23:41,657 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741837_1013 src: /127.0.0.1:57360 dest: /127.0.0.1:40007 2025-09-05 10:23:41,673 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741838_1014 src: /127.0.0.1:57366 dest: /127.0.0.1:40007 2025-09-05 10:23:41,728 INFO hdfs.StateChange: BLOCK* allocate blk_1073741839_1015, replicas=127.0.0.1:40007 for /02368_data_7.jsonl 2025-09-05 10:23:41,730 INFO hdfs.StateChange: BLOCK* allocate blk_1073741840_1016, replicas=127.0.0.1:40007 for /02368_data_4.jsonl 2025-09-05 10:23:41,773 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741839_1015 src: /127.0.0.1:57374 dest: /127.0.0.1:40007 2025-09-05 10:23:41,804 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741840_1016 src: /127.0.0.1:57380 dest: /127.0.0.1:40007 2025-09-05 10:23:42,079 INFO DataNode.clienttrace: src: /127.0.0.1:57318, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_28_pid_635_tid_280722487081600, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741831_1007, duration(ns): 613222978 2025-09-05 10:23:42,079 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741831_1007, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,109 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.746711_count_28_pid_635_tid_280722487081600 2025-09-05 10:23:42,118 INFO hdfs.StateChange: BLOCK* allocate blk_1073741841_1017, replicas=127.0.0.1:40007 for /02368_data_9.jsonl 2025-09-05 10:23:42,229 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741841_1017 src: /127.0.0.1:57394 dest: /127.0.0.1:40007 2025-09-05 10:23:42,236 INFO DataNode.clienttrace: src: /127.0.0.1:57322, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.831744_count_43_pid_635_tid_280722140461696, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741832_1008, duration(ns): 713469576 2025-09-05 10:23:42,237 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741832_1008, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,243 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.831744_count_43_pid_635_tid_280722140461696 2025-09-05 10:23:42,245 INFO hdfs.StateChange: BLOCK* allocate blk_1073741842_1018, replicas=127.0.0.1:40007 for /02368_data_1.jsonl 2025-09-05 10:23:42,248 INFO DataNode.clienttrace: src: /127.0.0.1:57324, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.831744_count_41_pid_635_tid_280722596985472, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741833_1009, duration(ns): 715492204 2025-09-05 10:23:42,248 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741833_1009, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,285 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.831744_count_41_pid_635_tid_280722596985472 2025-09-05 10:23:42,291 INFO hdfs.StateChange: BLOCK* allocate blk_1073741843_1019, replicas=127.0.0.1:40007 for /02368_data_8.jsonl 2025-09-05 10:23:42,303 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741842_1018 src: /127.0.0.1:57408 dest: /127.0.0.1:40007 2025-09-05 10:23:42,318 INFO DataNode.clienttrace: src: /127.0.0.1:57340, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_31_pid_635_tid_280725337307776, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741835_1011, duration(ns): 731254428 2025-09-05 10:23:42,318 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741835_1011, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,327 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741843_1019 src: /127.0.0.1:57424 dest: /127.0.0.1:40007 2025-09-05 10:23:42,328 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.746711_count_31_pid_635_tid_280725337307776 2025-09-05 10:23:42,329 INFO hdfs.StateChange: BLOCK* allocate blk_1073741844_1020, replicas=127.0.0.1:40007 for /02368_data_3.jsonl 2025-09-05 10:23:42,386 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741844_1020 src: /127.0.0.1:57436 dest: /127.0.0.1:40007 2025-09-05 10:23:42,416 INFO DataNode.clienttrace: src: /127.0.0.1:57374, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_40_pid_635_tid_280726921443968, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741839_1015, duration(ns): 619164974 2025-09-05 10:23:42,416 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741839_1015, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,417 INFO DataNode.clienttrace: src: /127.0.0.1:57334, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_26_pid_635_tid_280727437146752, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741834_1010, duration(ns): 817257223 2025-09-05 10:23:42,417 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741834_1010, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,425 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.746711_count_40_pid_635_tid_280726921443968 2025-09-05 10:23:42,426 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.746711_count_26_pid_635_tid_280727437146752 2025-09-05 10:23:42,428 INFO hdfs.StateChange: BLOCK* allocate blk_1073741845_1021, replicas=127.0.0.1:40007 for /02368_data_7.jsonl 2025-09-05 10:23:42,429 INFO hdfs.StateChange: BLOCK* allocate blk_1073741846_1022, replicas=127.0.0.1:40007 for /02368_data_2.jsonl 2025-09-05 10:23:42,431 INFO DataNode.clienttrace: src: /127.0.0.1:57360, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_29_pid_635_tid_280722148915840, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741837_1013, duration(ns): 744732459 2025-09-05 10:23:42,431 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741837_1013, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,434 INFO DataNode.clienttrace: src: /127.0.0.1:57352, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_35_pid_635_tid_280722410994304, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741836_1012, duration(ns): 782457522 2025-09-05 10:23:42,434 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741836_1012, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,445 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.746711_count_29_pid_635_tid_280722148915840 2025-09-05 10:23:42,451 INFO DataNode.clienttrace: src: /127.0.0.1:57366, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_39_pid_635_tid_280722377177728, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741838_1014, duration(ns): 742254184 2025-09-05 10:23:42,451 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741838_1014, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,465 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.746711_count_35_pid_635_tid_280722410994304 2025-09-05 10:23:42,465 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.746711_count_39_pid_635_tid_280722377177728 2025-09-05 10:23:42,476 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741845_1021 src: /127.0.0.1:57448 dest: /127.0.0.1:40007 2025-09-05 10:23:42,484 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741846_1022 src: /127.0.0.1:57458 dest: /127.0.0.1:40007 2025-09-05 10:23:42,491 INFO hdfs.StateChange: BLOCK* allocate blk_1073741847_1023, replicas=127.0.0.1:40007 for /02368_data_10.jsonl 2025-09-05 10:23:42,492 INFO hdfs.StateChange: BLOCK* allocate blk_1073741848_1024, replicas=127.0.0.1:40007 for /02368_data_6.jsonl 2025-09-05 10:23:42,493 INFO hdfs.StateChange: BLOCK* allocate blk_1073741849_1025, replicas=127.0.0.1:40007 for /02368_data_5.jsonl 2025-09-05 10:23:42,507 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741847_1023 src: /127.0.0.1:57466 dest: /127.0.0.1:40007 2025-09-05 10:23:42,552 INFO DataNode.clienttrace: src: /127.0.0.1:57380, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_34_pid_635_tid_280722580077184, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741840_1016, duration(ns): 716553931 2025-09-05 10:23:42,552 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741840_1016, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,567 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741849_1025 src: /127.0.0.1:57468 dest: /127.0.0.1:40007 2025-09-05 10:23:42,570 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.746711_count_34_pid_635_tid_280722580077184 2025-09-05 10:23:42,572 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741848_1024 src: /127.0.0.1:57472 dest: /127.0.0.1:40007 2025-09-05 10:23:42,598 INFO hdfs.StateChange: BLOCK* allocate blk_1073741850_1026, replicas=127.0.0.1:40007 for /02368_data_4.jsonl 2025-09-05 10:23:42,613 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741850_1026 src: /127.0.0.1:57476 dest: /127.0.0.1:40007 2025-09-05 10:23:42,789 INFO DataNode.clienttrace: src: /127.0.0.1:57394, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_28_pid_635_tid_280722487081600, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741841_1017, duration(ns): 514048139 2025-09-05 10:23:42,789 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741841_1017, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,792 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.746711_count_28_pid_635_tid_280722487081600 2025-09-05 10:23:42,796 INFO hdfs.StateChange: BLOCK* allocate blk_1073741851_1027, replicas=127.0.0.1:40007 for /02368_data_9.jsonl 2025-09-05 10:23:42,810 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741851_1027 src: /127.0.0.1:57482 dest: /127.0.0.1:40007 2025-09-05 10:23:42,864 INFO DataNode.clienttrace: src: /127.0.0.1:57408, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.831744_count_43_pid_635_tid_280722140461696, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741842_1018, duration(ns): 544190652 2025-09-05 10:23:42,864 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741842_1018, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,864 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.831744_count_43_pid_635_tid_280722140461696 2025-09-05 10:23:42,873 INFO hdfs.StateChange: BLOCK* allocate blk_1073741852_1028, replicas=127.0.0.1:40007 for /02368_data_1.jsonl 2025-09-05 10:23:42,878 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741852_1028 src: /127.0.0.1:57492 dest: /127.0.0.1:40007 2025-09-05 10:23:42,910 INFO DataNode.clienttrace: src: /127.0.0.1:57424, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.831744_count_41_pid_635_tid_280722596985472, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741843_1019, duration(ns): 569791140 2025-09-05 10:23:42,910 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741843_1019, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,910 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.831744_count_41_pid_635_tid_280722596985472 2025-09-05 10:23:42,913 INFO hdfs.StateChange: BLOCK* allocate blk_1073741853_1029, replicas=127.0.0.1:40007 for /02368_data_8.jsonl 2025-09-05 10:23:42,916 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741853_1029 src: /127.0.0.1:57498 dest: /127.0.0.1:40007 2025-09-05 10:23:42,922 INFO DataNode.clienttrace: src: /127.0.0.1:57472, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_35_pid_635_tid_280722410994304, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741848_1024, duration(ns): 318048926 2025-09-05 10:23:42,923 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741848_1024, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,924 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.746711_count_35_pid_635_tid_280722410994304 2025-09-05 10:23:42,926 INFO hdfs.StateChange: BLOCK* allocate blk_1073741854_1030, replicas=127.0.0.1:40007 for /02368_data_6.jsonl 2025-09-05 10:23:42,966 INFO DataNode.clienttrace: src: /127.0.0.1:57458, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_26_pid_635_tid_280727437146752, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741846_1022, duration(ns): 457469888 2025-09-05 10:23:42,966 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741846_1022, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:42,967 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741854_1030 src: /127.0.0.1:57514 dest: /127.0.0.1:40007 2025-09-05 10:23:42,967 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.746711_count_26_pid_635_tid_280727437146752 2025-09-05 10:23:42,971 INFO hdfs.StateChange: BLOCK* allocate blk_1073741855_1031, replicas=127.0.0.1:40007 for /02368_data_2.jsonl 2025-09-05 10:23:42,983 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741855_1031 src: /127.0.0.1:57524 dest: /127.0.0.1:40007 2025-09-05 10:23:43,000 INFO DataNode.clienttrace: src: /127.0.0.1:57436, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_31_pid_635_tid_280725337307776, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741844_1020, duration(ns): 580418093 2025-09-05 10:23:43,000 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741844_1020, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,001 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.746711_count_31_pid_635_tid_280725337307776 2025-09-05 10:23:43,003 INFO hdfs.StateChange: BLOCK* allocate blk_1073741856_1032, replicas=127.0.0.1:40007 for /02368_data_3.jsonl 2025-09-05 10:23:43,005 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741856_1032 src: /127.0.0.1:57526 dest: /127.0.0.1:40007 2025-09-05 10:23:43,024 INFO DataNode.clienttrace: src: /127.0.0.1:57448, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_40_pid_635_tid_280726921443968, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741845_1021, duration(ns): 522082374 2025-09-05 10:23:43,024 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741845_1021, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,026 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.746711_count_40_pid_635_tid_280726921443968 2025-09-05 10:23:43,027 INFO DataNode.clienttrace: src: /127.0.0.1:57476, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_34_pid_635_tid_280722580077184, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741850_1026, duration(ns): 387137477 2025-09-05 10:23:43,027 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741850_1026, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,029 INFO hdfs.StateChange: BLOCK* allocate blk_1073741857_1033, replicas=127.0.0.1:40007 for /02368_data_7.jsonl 2025-09-05 10:23:43,030 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.746711_count_34_pid_635_tid_280722580077184 2025-09-05 10:23:43,031 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741857_1033 src: /127.0.0.1:57538 dest: /127.0.0.1:40007 2025-09-05 10:23:43,032 INFO hdfs.StateChange: BLOCK* allocate blk_1073741858_1034, replicas=127.0.0.1:40007 for /02368_data_4.jsonl 2025-09-05 10:23:43,038 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741858_1034 src: /127.0.0.1:57546 dest: /127.0.0.1:40007 2025-09-05 10:23:43,061 INFO DataNode.clienttrace: src: /127.0.0.1:57466, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_39_pid_635_tid_280722377177728, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741847_1023, duration(ns): 489420745 2025-09-05 10:23:43,061 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741847_1023, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,065 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.746711_count_39_pid_635_tid_280722377177728 2025-09-05 10:23:43,068 INFO hdfs.StateChange: BLOCK* allocate blk_1073741859_1035, replicas=127.0.0.1:40007 for /02368_data_10.jsonl 2025-09-05 10:23:43,094 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741859_1035 src: /127.0.0.1:57548 dest: /127.0.0.1:40007 2025-09-05 10:23:43,144 INFO DataNode.clienttrace: src: /127.0.0.1:57468, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_29_pid_635_tid_280722148915840, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741849_1025, duration(ns): 530607454 2025-09-05 10:23:43,144 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741849_1025, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,146 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.746711_count_29_pid_635_tid_280722148915840 2025-09-05 10:23:43,149 INFO hdfs.StateChange: BLOCK* allocate blk_1073741860_1036, replicas=127.0.0.1:40007 for /02368_data_5.jsonl 2025-09-05 10:23:43,163 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741860_1036 src: /127.0.0.1:57552 dest: /127.0.0.1:40007 2025-09-05 10:23:43,163 INFO DataNode.clienttrace: src: /127.0.0.1:57482, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_28_pid_635_tid_280722487081600, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741851_1027, duration(ns): 337921167 2025-09-05 10:23:43,163 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741851_1027, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,165 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.746711_count_28_pid_635_tid_280722487081600 2025-09-05 10:23:43,168 INFO hdfs.StateChange: DIR* completeFile: /02368_data_9.jsonl is closed by libhdfs3_client_rand_0.746711_count_28_pid_635_tid_280722487081600 2025-09-05 10:23:43,300 INFO DataNode.clienttrace: src: /127.0.0.1:57498, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.831744_count_41_pid_635_tid_280722596985472, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741853_1029, duration(ns): 342218425 2025-09-05 10:23:43,301 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741853_1029, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,306 INFO DataNode.clienttrace: src: /127.0.0.1:57492, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.831744_count_43_pid_635_tid_280722140461696, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741852_1028, duration(ns): 414002616 2025-09-05 10:23:43,307 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741852_1028, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,309 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.831744_count_41_pid_635_tid_280722596985472 2025-09-05 10:23:43,309 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.831744_count_43_pid_635_tid_280722140461696 2025-09-05 10:23:43,311 INFO hdfs.StateChange: DIR* completeFile: /02368_data_8.jsonl is closed by libhdfs3_client_rand_0.831744_count_41_pid_635_tid_280722596985472 2025-09-05 10:23:43,313 INFO hdfs.StateChange: DIR* completeFile: /02368_data_1.jsonl is closed by libhdfs3_client_rand_0.831744_count_43_pid_635_tid_280722140461696 2025-09-05 10:23:43,357 INFO DataNode.clienttrace: src: /127.0.0.1:57524, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_26_pid_635_tid_280727437146752, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741855_1031, duration(ns): 369010489 2025-09-05 10:23:43,358 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741855_1031, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,359 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.746711_count_26_pid_635_tid_280727437146752 2025-09-05 10:23:43,366 INFO hdfs.StateChange: DIR* completeFile: /02368_data_2.jsonl is closed by libhdfs3_client_rand_0.746711_count_26_pid_635_tid_280727437146752 2025-09-05 10:23:43,380 INFO DataNode.clienttrace: src: /127.0.0.1:57514, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_35_pid_635_tid_280722410994304, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741854_1030, duration(ns): 384592472 2025-09-05 10:23:43,380 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741854_1030, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,381 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.746711_count_35_pid_635_tid_280722410994304 2025-09-05 10:23:43,387 INFO hdfs.StateChange: DIR* completeFile: /02368_data_6.jsonl is closed by libhdfs3_client_rand_0.746711_count_35_pid_635_tid_280722410994304 2025-09-05 10:23:43,401 INFO DataNode.clienttrace: src: /127.0.0.1:57538, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_40_pid_635_tid_280726921443968, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741857_1033, duration(ns): 367627388 2025-09-05 10:23:43,401 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741857_1033, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,403 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.746711_count_40_pid_635_tid_280726921443968 2025-09-05 10:23:43,404 INFO hdfs.StateChange: DIR* completeFile: /02368_data_7.jsonl is closed by libhdfs3_client_rand_0.746711_count_40_pid_635_tid_280726921443968 2025-09-05 10:23:43,427 INFO DataNode.clienttrace: src: /127.0.0.1:57526, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_31_pid_635_tid_280725337307776, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741856_1032, duration(ns): 395154023 2025-09-05 10:23:43,427 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741856_1032, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,428 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.746711_count_31_pid_635_tid_280725337307776 2025-09-05 10:23:43,432 INFO hdfs.StateChange: DIR* completeFile: /02368_data_3.jsonl is closed by libhdfs3_client_rand_0.746711_count_31_pid_635_tid_280725337307776 2025-09-05 10:23:43,436 INFO DataNode.clienttrace: src: /127.0.0.1:57546, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_34_pid_635_tid_280722580077184, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741858_1034, duration(ns): 375335579 2025-09-05 10:23:43,436 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741858_1034, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,437 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.746711_count_34_pid_635_tid_280722580077184 2025-09-05 10:23:43,439 INFO DataNode.clienttrace: src: /127.0.0.1:57548, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_39_pid_635_tid_280722377177728, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741859_1035, duration(ns): 323341834 2025-09-05 10:23:43,439 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741859_1035, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,440 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.746711_count_39_pid_635_tid_280722377177728 2025-09-05 10:23:43,441 INFO hdfs.StateChange: DIR* completeFile: /02368_data_4.jsonl is closed by libhdfs3_client_rand_0.746711_count_34_pid_635_tid_280722580077184 2025-09-05 10:23:43,442 INFO hdfs.StateChange: DIR* completeFile: /02368_data_10.jsonl is closed by libhdfs3_client_rand_0.746711_count_39_pid_635_tid_280722377177728 2025-09-05 10:23:43,454 INFO DataNode.clienttrace: src: /127.0.0.1:57552, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.746711_count_29_pid_635_tid_280722148915840, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741860_1036, duration(ns): 285295688 2025-09-05 10:23:43,454 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741860_1036, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:43,455 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.746711_count_29_pid_635_tid_280722148915840 2025-09-05 10:23:43,458 INFO hdfs.StateChange: DIR* completeFile: /02368_data_5.jsonl is closed by libhdfs3_client_rand_0.746711_count_29_pid_635_tid_280722148915840 2025-09-05 10:23:43,606 INFO hdfs.StateChange: BLOCK* allocate blk_1073741861_1037, replicas=127.0.0.1:40007 for /02368_data_5.jsonl 2025-09-05 10:23:43,621 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741861_1037 src: /127.0.0.1:57560 dest: /127.0.0.1:40007 2025-09-05 10:23:43,624 INFO hdfs.StateChange: BLOCK* allocate blk_1073741862_1038, replicas=127.0.0.1:40007 for /02368_data_8.jsonl 2025-09-05 10:23:43,625 INFO hdfs.StateChange: BLOCK* allocate blk_1073741863_1039, replicas=127.0.0.1:40007 for /02368_data_1.jsonl 2025-09-05 10:23:43,638 INFO hdfs.StateChange: BLOCK* allocate blk_1073741864_1040, replicas=127.0.0.1:40007 for /02368_data_2.jsonl 2025-09-05 10:23:43,639 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741862_1038 src: /127.0.0.1:57574 dest: /127.0.0.1:40007 2025-09-05 10:23:43,640 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741863_1039 src: /127.0.0.1:57566 dest: /127.0.0.1:40007 2025-09-05 10:23:43,641 INFO hdfs.StateChange: BLOCK* allocate blk_1073741865_1041, replicas=127.0.0.1:40007 for /02368_data_7.jsonl 2025-09-05 10:23:43,642 INFO hdfs.StateChange: BLOCK* allocate blk_1073741866_1042, replicas=127.0.0.1:40007 for /02368_data_10.jsonl 2025-09-05 10:23:43,653 INFO hdfs.StateChange: BLOCK* allocate blk_1073741867_1043, replicas=127.0.0.1:40007 for /02368_data_3.jsonl 2025-09-05 10:23:43,654 INFO hdfs.StateChange: BLOCK* allocate blk_1073741868_1044, replicas=127.0.0.1:40007 for /02368_data_9.jsonl 2025-09-05 10:23:43,655 INFO hdfs.StateChange: BLOCK* allocate blk_1073741869_1045, replicas=127.0.0.1:40007 for /02368_data_4.jsonl 2025-09-05 10:23:43,675 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741864_1040 src: /127.0.0.1:57584 dest: /127.0.0.1:40007 2025-09-05 10:23:43,682 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741866_1042 src: /127.0.0.1:57588 dest: /127.0.0.1:40007 2025-09-05 10:23:43,686 INFO hdfs.StateChange: BLOCK* allocate blk_1073741870_1046, replicas=127.0.0.1:40007 for /02368_data_6.jsonl 2025-09-05 10:23:43,689 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741865_1041 src: /127.0.0.1:57600 dest: /127.0.0.1:40007 2025-09-05 10:23:43,689 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741870_1046 src: /127.0.0.1:57630 dest: /127.0.0.1:40007 2025-09-05 10:23:43,689 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741869_1045 src: /127.0.0.1:57614 dest: /127.0.0.1:40007 2025-09-05 10:23:43,732 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741868_1044 src: /127.0.0.1:57622 dest: /127.0.0.1:40007 2025-09-05 10:23:43,839 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741867_1043 src: /127.0.0.1:57612 dest: /127.0.0.1:40007 2025-09-05 10:23:44,177 INFO DataNode.clienttrace: src: /127.0.0.1:57584, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_52_pid_635_tid_280726955260544, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741864_1040, duration(ns): 476105418 2025-09-05 10:23:44,177 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741864_1040, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,179 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.001808_count_52_pid_635_tid_280726955260544 2025-09-05 10:23:44,186 INFO DataNode.clienttrace: src: /127.0.0.1:57574, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_51_pid_635_tid_280722588531328, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741862_1038, duration(ns): 460058988 2025-09-05 10:23:44,187 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741862_1038, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,187 INFO hdfs.StateChange: BLOCK* allocate blk_1073741871_1047, replicas=127.0.0.1:40007 for /02368_data_2.jsonl 2025-09-05 10:23:44,187 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.001808_count_51_pid_635_tid_280722588531328 2025-09-05 10:23:44,199 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741871_1047 src: /127.0.0.1:57640 dest: /127.0.0.1:40007 2025-09-05 10:23:44,201 INFO hdfs.StateChange: BLOCK* allocate blk_1073741872_1048, replicas=127.0.0.1:40007 for /02368_data_8.jsonl 2025-09-05 10:23:44,207 INFO DataNode.clienttrace: src: /127.0.0.1:57600, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_59_pid_635_tid_280727454055040, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741865_1041, duration(ns): 516066710 2025-09-05 10:23:44,207 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741865_1041, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,208 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.001808_count_59_pid_635_tid_280727454055040 2025-09-05 10:23:44,213 INFO hdfs.StateChange: BLOCK* allocate blk_1073741873_1049, replicas=127.0.0.1:40007 for /02368_data_7.jsonl 2025-09-05 10:23:44,215 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741872_1048 src: /127.0.0.1:57644 dest: /127.0.0.1:40007 2025-09-05 10:23:44,216 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741873_1049 src: /127.0.0.1:57654 dest: /127.0.0.1:40007 2025-09-05 10:23:44,235 INFO DataNode.clienttrace: src: /127.0.0.1:57622, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_50_pid_635_tid_280722495535744, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741868_1044, duration(ns): 479659868 2025-09-05 10:23:44,235 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741868_1044, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,236 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.001808_count_50_pid_635_tid_280722495535744 2025-09-05 10:23:44,250 INFO hdfs.StateChange: BLOCK* allocate blk_1073741874_1050, replicas=127.0.0.1:40007 for /02368_data_9.jsonl 2025-09-05 10:23:44,275 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741874_1050 src: /127.0.0.1:57668 dest: /127.0.0.1:40007 2025-09-05 10:23:44,350 INFO DataNode.clienttrace: src: /127.0.0.1:57560, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_45_pid_635_tid_280722174278272, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741861_1037, duration(ns): 718676731 2025-09-05 10:23:44,350 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741861_1037, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,352 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.001808_count_45_pid_635_tid_280722174278272 2025-09-05 10:23:44,357 INFO hdfs.StateChange: BLOCK* allocate blk_1073741875_1051, replicas=127.0.0.1:40007 for /02368_data_5.jsonl 2025-09-05 10:23:44,361 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741875_1051 src: /127.0.0.1:57684 dest: /127.0.0.1:40007 2025-09-05 10:23:44,400 INFO DataNode.clienttrace: src: /127.0.0.1:57588, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_60_pid_635_tid_280727073618560, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741866_1042, duration(ns): 644285103 2025-09-05 10:23:44,401 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741866_1042, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,401 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.001808_count_60_pid_635_tid_280727073618560 2025-09-05 10:23:44,406 INFO hdfs.StateChange: BLOCK* allocate blk_1073741876_1052, replicas=127.0.0.1:40007 for /02368_data_10.jsonl 2025-09-05 10:23:44,409 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741876_1052 src: /127.0.0.1:57694 dest: /127.0.0.1:40007 2025-09-05 10:23:44,447 INFO DataNode.clienttrace: src: /127.0.0.1:57614, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_56_pid_635_tid_280722461719168, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741869_1045, duration(ns): 642352914 2025-09-05 10:23:44,447 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741869_1045, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,449 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.001808_count_56_pid_635_tid_280722461719168 2025-09-05 10:23:44,454 INFO DataNode.clienttrace: src: /127.0.0.1:57630, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_63_pid_635_tid_280725345761920, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741870_1046, duration(ns): 662998249 2025-09-05 10:23:44,454 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741870_1046, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,455 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.001808_count_63_pid_635_tid_280725345761920 2025-09-05 10:23:44,459 INFO hdfs.StateChange: BLOCK* allocate blk_1073741877_1053, replicas=127.0.0.1:40007 for /02368_data_4.jsonl 2025-09-05 10:23:44,460 INFO hdfs.StateChange: BLOCK* allocate blk_1073741878_1054, replicas=127.0.0.1:40007 for /02368_data_6.jsonl 2025-09-05 10:23:44,463 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741878_1054 src: /127.0.0.1:57698 dest: /127.0.0.1:40007 2025-09-05 10:23:44,463 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741877_1053 src: /127.0.0.1:57714 dest: /127.0.0.1:40007 2025-09-05 10:23:44,466 INFO DataNode.clienttrace: src: /127.0.0.1:57566, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_53_pid_635_tid_280722326452864, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741863_1039, duration(ns): 661273065 2025-09-05 10:23:44,466 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741863_1039, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,466 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.001808_count_53_pid_635_tid_280722326452864 2025-09-05 10:23:44,472 INFO hdfs.StateChange: BLOCK* allocate blk_1073741879_1055, replicas=127.0.0.1:40007 for /02368_data_1.jsonl 2025-09-05 10:23:44,477 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741879_1055 src: /127.0.0.1:57720 dest: /127.0.0.1:40007 2025-09-05 10:23:44,552 INFO DataNode.clienttrace: src: /127.0.0.1:57612, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_61_pid_635_tid_280722208094848, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741867_1043, duration(ns): 701466279 2025-09-05 10:23:44,552 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741867_1043, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,557 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.001808_count_61_pid_635_tid_280722208094848 2025-09-05 10:23:44,568 INFO hdfs.StateChange: BLOCK* allocate blk_1073741880_1056, replicas=127.0.0.1:40007 for /02368_data_3.jsonl 2025-09-05 10:23:44,595 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741880_1056 src: /127.0.0.1:57724 dest: /127.0.0.1:40007 2025-09-05 10:23:44,713 INFO DataNode.clienttrace: src: /127.0.0.1:57644, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_51_pid_635_tid_280722588531328, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741872_1048, duration(ns): 475029475 2025-09-05 10:23:44,713 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741872_1048, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,714 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.001808_count_51_pid_635_tid_280722588531328 2025-09-05 10:23:44,728 INFO hdfs.StateChange: BLOCK* allocate blk_1073741881_1057, replicas=127.0.0.1:40007 for /02368_data_8.jsonl 2025-09-05 10:23:44,730 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741881_1057 src: /127.0.0.1:57734 dest: /127.0.0.1:40007 2025-09-05 10:23:44,781 INFO DataNode.clienttrace: src: /127.0.0.1:57654, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_59_pid_635_tid_280727454055040, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741873_1049, duration(ns): 559142759 2025-09-05 10:23:44,781 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741873_1049, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,782 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.001808_count_59_pid_635_tid_280727454055040 2025-09-05 10:23:44,787 INFO hdfs.StateChange: BLOCK* allocate blk_1073741882_1058, replicas=127.0.0.1:40007 for /02368_data_7.jsonl 2025-09-05 10:23:44,790 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741882_1058 src: /127.0.0.1:57748 dest: /127.0.0.1:40007 2025-09-05 10:23:44,809 INFO DataNode.clienttrace: src: /127.0.0.1:57640, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_52_pid_635_tid_280726955260544, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741871_1047, duration(ns): 586831475 2025-09-05 10:23:44,810 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741871_1047, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,811 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.001808_count_52_pid_635_tid_280726955260544 2025-09-05 10:23:44,817 INFO hdfs.StateChange: BLOCK* allocate blk_1073741883_1059, replicas=127.0.0.1:40007 for /02368_data_2.jsonl 2025-09-05 10:23:44,839 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741883_1059 src: /127.0.0.1:57752 dest: /127.0.0.1:40007 2025-09-05 10:23:44,866 INFO DataNode.clienttrace: src: /127.0.0.1:57694, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_60_pid_635_tid_280727073618560, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741876_1052, duration(ns): 430175994 2025-09-05 10:23:44,866 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741876_1052, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,866 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.001808_count_60_pid_635_tid_280727073618560 2025-09-05 10:23:44,871 INFO hdfs.StateChange: BLOCK* allocate blk_1073741884_1060, replicas=127.0.0.1:40007 for /02368_data_10.jsonl 2025-09-05 10:23:44,876 INFO DataNode.clienttrace: src: /127.0.0.1:57668, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_50_pid_635_tid_280722495535744, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741874_1050, duration(ns): 573707807 2025-09-05 10:23:44,877 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741874_1050, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,877 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.001808_count_50_pid_635_tid_280722495535744 2025-09-05 10:23:44,880 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741884_1060 src: /127.0.0.1:57758 dest: /127.0.0.1:40007 2025-09-05 10:23:44,882 INFO DataNode.clienttrace: src: /127.0.0.1:57698, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_63_pid_635_tid_280725345761920, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741878_1054, duration(ns): 396832317 2025-09-05 10:23:44,882 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741878_1054, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,883 INFO hdfs.StateChange: BLOCK* allocate blk_1073741885_1061, replicas=127.0.0.1:40007 for /02368_data_9.jsonl 2025-09-05 10:23:44,890 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.001808_count_63_pid_635_tid_280725345761920 2025-09-05 10:23:44,895 INFO hdfs.StateChange: BLOCK* allocate blk_1073741886_1062, replicas=127.0.0.1:40007 for /02368_data_6.jsonl 2025-09-05 10:23:44,905 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741885_1061 src: /127.0.0.1:57766 dest: /127.0.0.1:40007 2025-09-05 10:23:44,909 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741886_1062 src: /127.0.0.1:57776 dest: /127.0.0.1:40007 2025-09-05 10:23:44,945 INFO DataNode.clienttrace: src: /127.0.0.1:57720, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_53_pid_635_tid_280722326452864, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741879_1055, duration(ns): 456829175 2025-09-05 10:23:44,945 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741879_1055, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,951 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.001808_count_53_pid_635_tid_280722326452864 2025-09-05 10:23:44,953 INFO DataNode.clienttrace: src: /127.0.0.1:57684, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_45_pid_635_tid_280722174278272, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741875_1051, duration(ns): 578265352 2025-09-05 10:23:44,953 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741875_1051, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:44,954 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.001808_count_45_pid_635_tid_280722174278272 2025-09-05 10:23:44,960 INFO hdfs.StateChange: BLOCK* allocate blk_1073741887_1063, replicas=127.0.0.1:40007 for /02368_data_1.jsonl 2025-09-05 10:23:44,964 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741887_1063 src: /127.0.0.1:57784 dest: /127.0.0.1:40007 2025-09-05 10:23:44,965 INFO hdfs.StateChange: BLOCK* allocate blk_1073741888_1064, replicas=127.0.0.1:40007 for /02368_data_5.jsonl 2025-09-05 10:23:44,969 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741888_1064 src: /127.0.0.1:57796 dest: /127.0.0.1:40007 2025-09-05 10:23:45,097 INFO DataNode.clienttrace: src: /127.0.0.1:57734, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_51_pid_635_tid_280722588531328, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741881_1057, duration(ns): 360669957 2025-09-05 10:23:45,097 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741881_1057, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:45,097 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.001808_count_51_pid_635_tid_280722588531328 2025-09-05 10:23:45,099 INFO hdfs.StateChange: DIR* completeFile: /02368_data_8.jsonl is closed by libhdfs3_client_rand_0.001808_count_51_pid_635_tid_280722588531328 2025-09-05 10:23:45,151 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741831_1007 replica FinalizedReplica, blk_1073741831_1007, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741831 for deletion 2025-09-05 10:23:45,153 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741832_1008 replica FinalizedReplica, blk_1073741832_1008, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741832 for deletion 2025-09-05 10:23:45,154 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741833_1009 replica FinalizedReplica, blk_1073741833_1009, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741833 for deletion 2025-09-05 10:23:45,155 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741834_1010 replica FinalizedReplica, blk_1073741834_1010, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741834 for deletion 2025-09-05 10:23:45,155 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741835_1011 replica FinalizedReplica, blk_1073741835_1011, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741835 for deletion 2025-09-05 10:23:45,155 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741836_1012 replica FinalizedReplica, blk_1073741836_1012, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741836 for deletion 2025-09-05 10:23:45,155 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741837_1013 replica FinalizedReplica, blk_1073741837_1013, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741837 for deletion 2025-09-05 10:23:45,156 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741838_1014 replica FinalizedReplica, blk_1073741838_1014, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741838 for deletion 2025-09-05 10:23:45,156 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741839_1015 replica FinalizedReplica, blk_1073741839_1015, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741839 for deletion 2025-09-05 10:23:45,156 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741840_1016 replica FinalizedReplica, blk_1073741840_1016, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741840 for deletion 2025-09-05 10:23:45,156 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741841_1017 replica FinalizedReplica, blk_1073741841_1017, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741841 for deletion 2025-09-05 10:23:45,156 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741842_1018 replica FinalizedReplica, blk_1073741842_1018, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741842 for deletion 2025-09-05 10:23:45,157 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741843_1019 replica FinalizedReplica, blk_1073741843_1019, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741843 for deletion 2025-09-05 10:23:45,157 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741844_1020 replica FinalizedReplica, blk_1073741844_1020, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741844 for deletion 2025-09-05 10:23:45,157 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741845_1021 replica FinalizedReplica, blk_1073741845_1021, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741845 for deletion 2025-09-05 10:23:45,157 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741846_1022 replica FinalizedReplica, blk_1073741846_1022, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741846 for deletion 2025-09-05 10:23:45,157 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741847_1023 replica FinalizedReplica, blk_1073741847_1023, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741847 for deletion 2025-09-05 10:23:45,157 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741848_1024 replica FinalizedReplica, blk_1073741848_1024, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741848 for deletion 2025-09-05 10:23:45,158 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741849_1025 replica FinalizedReplica, blk_1073741849_1025, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741849 for deletion 2025-09-05 10:23:45,158 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741850_1026 replica FinalizedReplica, blk_1073741850_1026, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741850 for deletion 2025-09-05 10:23:45,158 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741851_1027 replica FinalizedReplica, blk_1073741851_1027, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741851 for deletion 2025-09-05 10:23:45,158 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741852_1028 replica FinalizedReplica, blk_1073741852_1028, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741852 for deletion 2025-09-05 10:23:45,158 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741853_1029 replica FinalizedReplica, blk_1073741853_1029, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741853 for deletion 2025-09-05 10:23:45,158 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741854_1030 replica FinalizedReplica, blk_1073741854_1030, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741854 for deletion 2025-09-05 10:23:45,159 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741855_1031 replica FinalizedReplica, blk_1073741855_1031, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741855 for deletion 2025-09-05 10:23:45,159 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741856_1032 replica FinalizedReplica, blk_1073741856_1032, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741856 for deletion 2025-09-05 10:23:45,159 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741857_1033 replica FinalizedReplica, blk_1073741857_1033, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741857 for deletion 2025-09-05 10:23:45,159 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741858_1034 replica FinalizedReplica, blk_1073741858_1034, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741858 for deletion 2025-09-05 10:23:45,159 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741859_1035 replica FinalizedReplica, blk_1073741859_1035, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741859 for deletion 2025-09-05 10:23:45,160 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741860_1036 replica FinalizedReplica, blk_1073741860_1036, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741860 for deletion 2025-09-05 10:23:45,164 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741831_1007 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741831 2025-09-05 10:23:45,172 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741832_1008 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741832 2025-09-05 10:23:45,183 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741833_1009 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741833 2025-09-05 10:23:45,184 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741835_1011 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741835 2025-09-05 10:23:45,185 INFO DataNode.clienttrace: src: /127.0.0.1:57724, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_61_pid_635_tid_280722208094848, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741880_1056, duration(ns): 557049124 2025-09-05 10:23:45,185 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741880_1056, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:45,186 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.001808_count_61_pid_635_tid_280722208094848 2025-09-05 10:23:45,191 INFO hdfs.StateChange: BLOCK* allocate blk_1073741889_1065, replicas=127.0.0.1:40007 for /02368_data_3.jsonl 2025-09-05 10:23:45,194 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741889_1065 src: /127.0.0.1:47486 dest: /127.0.0.1:40007 2025-09-05 10:23:45,196 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741836_1012 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741836 2025-09-05 10:23:45,198 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741834_1010 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741834 2025-09-05 10:23:45,209 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741837_1013 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741837 2025-09-05 10:23:45,210 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741838_1014 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741838 2025-09-05 10:23:45,211 INFO DataNode.clienttrace: src: /127.0.0.1:57748, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_59_pid_635_tid_280727454055040, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741882_1058, duration(ns): 402990079 2025-09-05 10:23:45,211 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741882_1058, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:45,212 INFO DataNode.clienttrace: src: /127.0.0.1:57714, dest: /127.0.0.1:40007, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_56_pid_635_tid_280722461719168, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741877_1053, duration(ns): 734930189 2025-09-05 10:23:45,212 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741877_1053, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:45,213 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.001808_count_56_pid_635_tid_280722461719168 2025-09-05 10:23:45,214 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.001808_count_59_pid_635_tid_280727454055040 2025-09-05 10:23:45,215 INFO hdfs.StateChange: DIR* completeFile: /02368_data_7.jsonl is closed by libhdfs3_client_rand_0.001808_count_59_pid_635_tid_280727454055040 2025-09-05 10:23:45,220 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741839_1015 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741839 2025-09-05 10:23:45,221 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741840_1016 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741840 2025-09-05 10:23:45,224 INFO hdfs.StateChange: BLOCK* allocate blk_1073741890_1066, replicas=127.0.0.1:40007 for /02368_data_4.jsonl 2025-09-05 10:23:45,232 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741841_1017 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741841 2025-09-05 10:23:45,234 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741842_1018 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741842 2025-09-05 10:23:45,236 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741890_1066 src: /127.0.0.1:47492 dest: /127.0.0.1:40007 2025-09-05 10:23:45,244 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741843_1019 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741843 2025-09-05 10:23:45,246 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741844_1020 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741844 2025-09-05 10:23:45,256 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741845_1021 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741845 2025-09-05 10:23:45,257 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741846_1022 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741846 2025-09-05 10:23:45,270 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741847_1023 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741847 2025-09-05 10:23:45,270 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741849_1025 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741849 2025-09-05 10:23:45,278 INFO DataNode.clienttrace: src: /127.0.0.1:57752, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_52_pid_635_tid_280726955260544, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741883_1059, duration(ns): 423396130 2025-09-05 10:23:45,279 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741883_1059, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:45,279 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.001808_count_52_pid_635_tid_280726955260544 2025-09-05 10:23:45,280 INFO namenode.FSNamesystem: BLOCK* blk_1073741883_1059 is COMMITTED but not COMPLETE(numNodes= 0 < minimum = 1) in file /02368_data_2.jsonl 2025-09-05 10:23:45,282 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741848_1024 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741848 2025-09-05 10:23:45,283 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741850_1026 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741850 2025-09-05 10:23:45,292 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741851_1027 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741851 2025-09-05 10:23:45,306 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741853_1029 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741853 2025-09-05 10:23:45,308 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741852_1028 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741852 2025-09-05 10:23:45,330 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741854_1030 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741854 2025-09-05 10:23:45,331 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741855_1031 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741855 2025-09-05 10:23:45,343 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741856_1032 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741856 2025-09-05 10:23:45,354 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741857_1033 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741857 2025-09-05 10:23:45,354 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741858_1034 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741858 2025-09-05 10:23:45,367 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741860_1036 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741860 2025-09-05 10:23:45,370 INFO impl.FsDatasetAsyncDiskService: Deleted BP-1058275958-172.17.0.2-1757089017665 blk_1073741859_1035 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-1058275958-172.17.0.2-1757089017665/current/finalized/subdir0/subdir0/blk_1073741859 2025-09-05 10:23:45,372 INFO DataNode.clienttrace: src: /127.0.0.1:57776, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_63_pid_635_tid_280725345761920, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741886_1062, duration(ns): 436744199 2025-09-05 10:23:45,372 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741886_1062, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:45,373 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.001808_count_63_pid_635_tid_280725345761920 2025-09-05 10:23:45,374 INFO hdfs.StateChange: DIR* completeFile: /02368_data_6.jsonl is closed by libhdfs3_client_rand_0.001808_count_63_pid_635_tid_280725345761920 2025-09-05 10:23:45,398 INFO DataNode.clienttrace: src: /127.0.0.1:57758, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_60_pid_635_tid_280727073618560, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741884_1060, duration(ns): 506690159 2025-09-05 10:23:45,398 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741884_1060, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:45,399 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.001808_count_60_pid_635_tid_280727073618560 2025-09-05 10:23:45,401 INFO hdfs.StateChange: DIR* completeFile: /02368_data_10.jsonl is closed by libhdfs3_client_rand_0.001808_count_60_pid_635_tid_280727073618560 2025-09-05 10:23:45,431 INFO DataNode.clienttrace: src: /127.0.0.1:57766, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_50_pid_635_tid_280722495535744, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741885_1061, duration(ns): 514114744 2025-09-05 10:23:45,431 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741885_1061, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:45,433 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.001808_count_50_pid_635_tid_280722495535744 2025-09-05 10:23:45,434 INFO hdfs.StateChange: DIR* completeFile: /02368_data_9.jsonl is closed by libhdfs3_client_rand_0.001808_count_50_pid_635_tid_280722495535744 2025-09-05 10:23:45,438 INFO DataNode.clienttrace: src: /127.0.0.1:57784, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_53_pid_635_tid_280722326452864, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741887_1063, duration(ns): 453949923 2025-09-05 10:23:45,438 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741887_1063, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:45,439 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.001808_count_53_pid_635_tid_280722326452864 2025-09-05 10:23:45,440 INFO hdfs.StateChange: DIR* completeFile: /02368_data_1.jsonl is closed by libhdfs3_client_rand_0.001808_count_53_pid_635_tid_280722326452864 2025-09-05 10:23:45,455 INFO DataNode.clienttrace: src: /127.0.0.1:57796, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_45_pid_635_tid_280722174278272, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741888_1064, duration(ns): 481507677 2025-09-05 10:23:45,455 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741888_1064, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:45,456 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.001808_count_45_pid_635_tid_280722174278272 2025-09-05 10:23:45,457 INFO hdfs.StateChange: DIR* completeFile: /02368_data_5.jsonl is closed by libhdfs3_client_rand_0.001808_count_45_pid_635_tid_280722174278272 2025-09-05 10:23:45,556 INFO DataNode.clienttrace: src: /127.0.0.1:47486, dest: /127.0.0.1:40007, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_61_pid_635_tid_280722208094848, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741889_1065, duration(ns): 348039050 2025-09-05 10:23:45,556 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741889_1065, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:45,556 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.001808_count_61_pid_635_tid_280722208094848 2025-09-05 10:23:45,558 INFO hdfs.StateChange: DIR* completeFile: /02368_data_3.jsonl is closed by libhdfs3_client_rand_0.001808_count_61_pid_635_tid_280722208094848 2025-09-05 10:23:45,616 INFO DataNode.clienttrace: src: /127.0.0.1:47492, dest: /127.0.0.1:40007, bytes: 57671680, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.001808_count_56_pid_635_tid_280722461719168, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741890_1066, duration(ns): 370324808 2025-09-05 10:23:45,616 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741890_1066, type=LAST_IN_PIPELINE terminating 2025-09-05 10:23:45,617 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.001808_count_56_pid_635_tid_280722461719168 2025-09-05 10:23:45,618 INFO hdfs.StateChange: DIR* completeFile: /02368_data_4.jsonl is closed by libhdfs3_client_rand_0.001808_count_56_pid_635_tid_280722461719168 2025-09-05 10:23:45,682 INFO hdfs.StateChange: DIR* completeFile: /02368_data_2.jsonl is closed by libhdfs3_client_rand_0.001808_count_52_pid_635_tid_280726955260544 2025-09-05 10:24:42,485 INFO datanode.DirectoryScanner: Scan Results: BlockPool BP-1058275958-172.17.0.2-1757089017665 Total blocks: 36, missing metadata files: 0, missing block files: 0, missing blocks in memory: 0, mismatched blocks: 0 2025-09-05 10:40:39,772 INFO namenode.FSEditLog: Number of transactions: 318 Total time for transactions(ms): 101 Number of transactions batched in Syncs: 122 Number of syncs: 196 SyncTimes(ms): 10 7 2025-09-05 10:40:39,778 INFO hdfs.StateChange: BLOCK* allocate blk_1073741891_1067, replicas=127.0.0.1:40007 for /test_02725_1.tsv 2025-09-05 10:40:39,780 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741891_1067 src: /127.0.0.1:49708 dest: /127.0.0.1:40007 2025-09-05 10:40:39,782 INFO DataNode.clienttrace: src: /127.0.0.1:49708, dest: /127.0.0.1:40007, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.394777_count_68_pid_635_tid_280722394086016, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741891_1067, duration(ns): 334684 2025-09-05 10:40:39,782 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741891_1067, type=LAST_IN_PIPELINE terminating 2025-09-05 10:40:39,782 INFO hdfs.StateChange: BLOCK* fsync: /test_02725_1.tsv for libhdfs3_client_rand_0.394777_count_68_pid_635_tid_280722394086016 2025-09-05 10:40:39,784 INFO hdfs.StateChange: DIR* completeFile: /test_02725_1.tsv is closed by libhdfs3_client_rand_0.394777_count_68_pid_635_tid_280722394086016 2025-09-05 10:40:39,896 INFO hdfs.StateChange: BLOCK* allocate blk_1073741892_1068, replicas=127.0.0.1:40007 for /test_02725_2.tsv 2025-09-05 10:40:39,898 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741892_1068 src: /127.0.0.1:49724 dest: /127.0.0.1:40007 2025-09-05 10:40:39,900 INFO DataNode.clienttrace: src: /127.0.0.1:49724, dest: /127.0.0.1:40007, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.394777_count_70_pid_635_tid_280722394086016, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741892_1068, duration(ns): 345284 2025-09-05 10:40:39,900 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741892_1068, type=LAST_IN_PIPELINE terminating 2025-09-05 10:40:39,901 INFO hdfs.StateChange: BLOCK* fsync: /test_02725_2.tsv for libhdfs3_client_rand_0.394777_count_70_pid_635_tid_280722394086016 2025-09-05 10:40:39,903 INFO hdfs.StateChange: DIR* completeFile: /test_02725_2.tsv is closed by libhdfs3_client_rand_0.394777_count_70_pid_635_tid_280722394086016 2025-09-05 10:41:57,355 INFO namenode.FSEditLog: Number of transactions: 330 Total time for transactions(ms): 101 Number of transactions batched in Syncs: 124 Number of syncs: 206 SyncTimes(ms): 12 7 2025-09-05 10:41:57,359 INFO hdfs.StateChange: BLOCK* allocate blk_1073741893_1069, replicas=127.0.0.1:40007 for /test_02536.jsonl 2025-09-05 10:41:57,362 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741893_1069 src: /127.0.0.1:46730 dest: /127.0.0.1:40007 2025-09-05 10:41:57,364 INFO DataNode.clienttrace: src: /127.0.0.1:46730, dest: /127.0.0.1:40007, bytes: 27, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.027308_count_79_pid_635_tid_280726346562176, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741893_1069, duration(ns): 345724 2025-09-05 10:41:57,364 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741893_1069, type=LAST_IN_PIPELINE terminating 2025-09-05 10:41:57,364 INFO hdfs.StateChange: BLOCK* fsync: /test_02536.jsonl for libhdfs3_client_rand_0.027308_count_79_pid_635_tid_280726346562176 2025-09-05 10:41:57,366 INFO hdfs.StateChange: DIR* completeFile: /test_02536.jsonl is closed by libhdfs3_client_rand_0.027308_count_79_pid_635_tid_280726346562176 2025-09-05 10:43:06,276 INFO namenode.FSEditLog: Number of transactions: 336 Total time for transactions(ms): 101 Number of transactions batched in Syncs: 125 Number of syncs: 211 SyncTimes(ms): 14 8 2025-09-05 10:43:06,280 INFO hdfs.StateChange: BLOCK* allocate blk_1073741894_1070, replicas=127.0.0.1:40007 for /test_02458_1.tsv 2025-09-05 10:43:06,282 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741894_1070 src: /127.0.0.1:55528 dest: /127.0.0.1:40007 2025-09-05 10:43:06,285 INFO DataNode.clienttrace: src: /127.0.0.1:55528, dest: /127.0.0.1:40007, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.894547_count_86_pid_635_tid_280722148915840, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741894_1070, duration(ns): 467526 2025-09-05 10:43:06,286 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741894_1070, type=LAST_IN_PIPELINE terminating 2025-09-05 10:43:06,286 INFO hdfs.StateChange: BLOCK* fsync: /test_02458_1.tsv for libhdfs3_client_rand_0.894547_count_86_pid_635_tid_280722148915840 2025-09-05 10:43:06,289 INFO hdfs.StateChange: DIR* completeFile: /test_02458_1.tsv is closed by libhdfs3_client_rand_0.894547_count_86_pid_635_tid_280722148915840 2025-09-05 10:43:06,322 INFO hdfs.StateChange: BLOCK* allocate blk_1073741895_1071, replicas=127.0.0.1:40007 for /test_02458_2.tsv 2025-09-05 10:43:06,324 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741895_1071 src: /127.0.0.1:55538 dest: /127.0.0.1:40007 2025-09-05 10:43:06,326 INFO DataNode.clienttrace: src: /127.0.0.1:55538, dest: /127.0.0.1:40007, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.894547_count_88_pid_635_tid_280722148915840, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741895_1071, duration(ns): 375205 2025-09-05 10:43:06,326 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741895_1071, type=LAST_IN_PIPELINE terminating 2025-09-05 10:43:06,327 INFO hdfs.StateChange: BLOCK* fsync: /test_02458_2.tsv for libhdfs3_client_rand_0.894547_count_88_pid_635_tid_280722148915840 2025-09-05 10:43:06,328 INFO hdfs.StateChange: DIR* completeFile: /test_02458_2.tsv is closed by libhdfs3_client_rand_0.894547_count_88_pid_635_tid_280722148915840 2025-09-05 10:47:41,574 INFO namenode.FSEditLog: Number of transactions: 348 Total time for transactions(ms): 103 Number of transactions batched in Syncs: 128 Number of syncs: 220 SyncTimes(ms): 15 8 2025-09-05 10:47:41,577 INFO hdfs.StateChange: BLOCK* allocate blk_1073741896_1072, replicas=127.0.0.1:40007 for /test_1.tsv 2025-09-05 10:47:41,579 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741896_1072 src: /127.0.0.1:43122 dest: /127.0.0.1:40007 2025-09-05 10:47:41,582 INFO DataNode.clienttrace: src: /127.0.0.1:43122, dest: /127.0.0.1:40007, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.278470_count_105_pid_635_tid_280725345761920, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741896_1072, duration(ns): 362604 2025-09-05 10:47:41,582 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741896_1072, type=LAST_IN_PIPELINE terminating 2025-09-05 10:47:41,582 INFO hdfs.StateChange: BLOCK* fsync: /test_1.tsv for libhdfs3_client_rand_0.278470_count_105_pid_635_tid_280725345761920 2025-09-05 10:47:41,583 INFO hdfs.StateChange: DIR* completeFile: /test_1.tsv is closed by libhdfs3_client_rand_0.278470_count_105_pid_635_tid_280725345761920 2025-09-05 10:47:41,616 INFO hdfs.StateChange: BLOCK* allocate blk_1073741897_1073, replicas=127.0.0.1:40007 for /test_2.tsv 2025-09-05 10:47:41,618 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741897_1073 src: /127.0.0.1:43126 dest: /127.0.0.1:40007 2025-09-05 10:47:41,620 INFO DataNode.clienttrace: src: /127.0.0.1:43126, dest: /127.0.0.1:40007, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.278470_count_107_pid_635_tid_280725345761920, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741897_1073, duration(ns): 519686 2025-09-05 10:47:41,621 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741897_1073, type=LAST_IN_PIPELINE terminating 2025-09-05 10:47:41,621 INFO hdfs.StateChange: BLOCK* fsync: /test_2.tsv for libhdfs3_client_rand_0.278470_count_107_pid_635_tid_280725345761920 2025-09-05 10:47:41,623 INFO hdfs.StateChange: DIR* completeFile: /test_2.tsv is closed by libhdfs3_client_rand_0.278470_count_107_pid_635_tid_280725345761920 2025-09-05 10:47:41,632 INFO hdfs.StateChange: BLOCK* allocate blk_1073741898_1074, replicas=127.0.0.1:40007 for /test_3.tsv 2025-09-05 10:47:41,634 INFO datanode.DataNode: Receiving BP-1058275958-172.17.0.2-1757089017665:blk_1073741898_1074 src: /127.0.0.1:43128 dest: /127.0.0.1:40007 2025-09-05 10:47:41,636 INFO DataNode.clienttrace: src: /127.0.0.1:43128, dest: /127.0.0.1:40007, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.278470_count_109_pid_635_tid_280725345761920, offset: 0, srvID: 99ca1da0-e476-4e50-9206-33fb6d7b0583, blockid: BP-1058275958-172.17.0.2-1757089017665:blk_1073741898_1074, duration(ns): 433765 2025-09-05 10:47:41,636 INFO datanode.DataNode: PacketResponder: BP-1058275958-172.17.0.2-1757089017665:blk_1073741898_1074, type=LAST_IN_PIPELINE terminating 2025-09-05 10:47:41,637 INFO hdfs.StateChange: BLOCK* fsync: /test_3.tsv for libhdfs3_client_rand_0.278470_count_109_pid_635_tid_280725345761920 2025-09-05 10:47:41,638 INFO hdfs.StateChange: DIR* completeFile: /test_3.tsv is closed by libhdfs3_client_rand_0.278470_count_109_pid_635_tid_280725345761920