Package evaluation of RustyObjectStore on Julia 1.10.9 (96dc2d8c45*) started at 2025-06-06T15:09:34.887 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 5.1s ################################################################################ # Installation # Installing RustyObjectStore... Resolving package versions... Updating `~/.julia/environments/v1.10/Project.toml` [1b5eed3d] + RustyObjectStore v0.12.3 Updating `~/.julia/environments/v1.10/Manifest.toml` [d1d4a3ce] + BitFlags v0.1.9 [85eb1798] + CloudBase v1.4.8 [944b1d66] + CodecZlib v0.7.8 [f0e56b4a] + ConcurrentUtilities v2.5.0 [ffbed154] + DocStringExtensions v0.9.4 [460bff9d] + ExceptionUnwrapping v0.1.11 [937e9308] + Figgy v1.1.1 [069b7b12] + FunctionWrappers v1.1.3 [cd3eb016] + HTTP v1.10.16 [692b3bcd] + JLLWrappers v1.7.0 [0f8b85d8] + JSON3 v1.14.3 [e6f89c97] + LoggingExtras v1.1.0 [6ac74813] + MD5 v0.2.3 [739be429] + MbedTLS v1.1.9 [4d8831e6] + OpenSSL v1.5.0 [69de0a69] + Parsers v2.8.3 ⌅ [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [1b5eed3d] + RustyObjectStore v0.12.3 [777ac1f9] + SimpleBufferStream v1.2.0 [856f2bd8] + StructTypes v1.11.0 [3bb67fe8] + TranscodingStreams v0.11.3 [5c2747f8] + URIs v1.5.2 [a4b94fbf] + NodeJS_16_jll v16.15.0+0 [458c3c95] + OpenSSL_jll v3.5.0+0 [d59cea07] + azurite_jll v3.29.0+0 [ad83bbfc] + minio_jll v1.0.0+1 [0e112785] + object_store_ffi_jll v0.12.3+0 [0dad84c5] + ArgTools v1.1.1 [56f22d72] + Artifacts [2a0f44e3] + Base64 [ade2ca70] + Dates [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching [b77e0a4c] + InteractiveUtils [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 [8f399da3] + Libdl [56ddb016] + Logging [d6f4376e] + Markdown [a63ad114] + Mmap [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.10.0 [de0858da] + Printf [3fa0cd96] + REPL [9a3f8284] + Random [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization [6462fe0b] + Sockets [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test [cf7118a7] + UUIDs [4ec0a83e] + Unicode [deac9b47] + LibCURL_jll v8.4.0+0 [e37daf67] + LibGit2_jll v1.6.4+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.2+1 [14a3606d] + MozillaCACerts_jll v2023.1.10 [83775a58] + Zlib_jll v1.2.13+1 [8e850ede] + nghttp2_jll v1.52.0+1 [3f19e933] + p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 5.55s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 20.87s ################################################################################ # Testing # Testing RustyObjectStore Status `/tmp/jl_vBEeXv/Project.toml` [85eb1798] CloudBase v1.4.8 [944b1d66] CodecZlib v0.7.8 [ffbed154] DocStringExtensions v0.9.4 [cd3eb016] HTTP v1.10.16 [0f8b85d8] JSON3 v1.14.3 [817f1d60] ReTestItems v1.31.0 [1b5eed3d] RustyObjectStore v0.12.3 [0e112785] object_store_ffi_jll v0.12.3+0 [2a0f44e3] Base64 [6462fe0b] Sockets [8dfed614] Test Status `/tmp/jl_vBEeXv/Manifest.toml` [d1d4a3ce] BitFlags v0.1.9 [85eb1798] CloudBase v1.4.8 [944b1d66] CodecZlib v0.7.8 [f0e56b4a] ConcurrentUtilities v2.5.0 [ffbed154] DocStringExtensions v0.9.4 [460bff9d] ExceptionUnwrapping v0.1.11 [937e9308] Figgy v1.1.1 [069b7b12] FunctionWrappers v1.1.3 [cd3eb016] HTTP v1.10.16 [692b3bcd] JLLWrappers v1.7.0 [0f8b85d8] JSON3 v1.14.3 [e6f89c97] LoggingExtras v1.1.0 [6ac74813] MD5 v0.2.3 [739be429] MbedTLS v1.1.9 [4d8831e6] OpenSSL v1.5.0 [69de0a69] Parsers v2.8.3 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [817f1d60] ReTestItems v1.31.0 [1b5eed3d] RustyObjectStore v0.12.3 [777ac1f9] SimpleBufferStream v1.2.0 [856f2bd8] StructTypes v1.11.0 [1e6cf692] TestEnv v1.102.1 [3bb67fe8] TranscodingStreams v0.11.3 [5c2747f8] URIs v1.5.2 [a4b94fbf] NodeJS_16_jll v16.15.0+0 [458c3c95] OpenSSL_jll v3.5.0+0 [d59cea07] azurite_jll v3.29.0+0 [ad83bbfc] minio_jll v1.0.0+1 [0e112785] object_store_ffi_jll v0.12.3+0 [0dad84c5] ArgTools v1.1.1 [56f22d72] Artifacts [2a0f44e3] Base64 [ade2ca70] Dates [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching [b77e0a4c] InteractiveUtils [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 [8f399da3] Libdl [56ddb016] Logging [d6f4376e] Markdown [a63ad114] Mmap [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.10.0 [de0858da] Printf [3fa0cd96] REPL [9a3f8284] Random [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization [6462fe0b] Sockets [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test [cf7118a7] UUIDs [4ec0a83e] Unicode [deac9b47] LibCURL_jll v8.4.0+0 [e37daf67] LibGit2_jll v1.6.4+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.2+1 [14a3606d] MozillaCACerts_jll v2023.1.10 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.52.0+1 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... [ Info: Scanning for test items in project `RustyObjectStore` at paths: /home/pkgeval/.julia/packages/RustyObjectStore/JF6aG [ Info: Finished scanning for test items in 3.88 seconds. Scheduling 20 tests on pid 27 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 30: [ Info: Starting test worker 1 on pid = 30, with 2 threads [ Info: Starting running test items Worker 30: 15:10:47 | maxrss 1.2% | mem 2.1% | START ( 1/20) test item "AWSConfig" at test/aws_api_tests.jl:1 Worker 30: 15:10:51 | maxrss 1.3% | mem 2.2% | DONE ( 1/20) test item "AWSConfig" 3.7 secs (77.9% compile, 1.6% GC), 812.55 K allocs (58.936 MB) Worker 30: 15:10:51 | maxrss 1.3% | mem 2.2% | START ( 2/20) test item "Basic S3 exceptions" at test/aws_s3_exception_tests.jl:1 Worker 30: 15:11:24 | maxrss 1.7% | mem 2.5% | DONE ( 2/20) test item "Basic S3 exceptions" 32.9 secs (79.1% compile, 0.1% recompile, 1.8% GC), 8.21 M allocs (591.449 MB) ┌ Warning: Test item "Basic S3 exceptions" at test/aws_s3_exception_tests.jl:1 contains test sets without tests: │ "Delete non-existing file" └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:328 Worker 30: 15:11:27 | maxrss 1.7% | mem 2.5% | START ( 3/20) test item "AWS S3 retries" at test/aws_s3_exception_tests.jl:159 Worker 30: 15:12:19 | maxrss 1.8% | mem 2.5% | DONE ( 3/20) test item "AWS S3 retries" 52.4 secs (15.0% compile, 0.1% GC), 3.58 M allocs (285.800 MB) Worker 30: 15:12:19 | maxrss 1.8% | mem 2.5% | START ( 4/20) test item "AzureConfig" at test/azure_api_tests.jl:1 Worker 30: 15:12:19 | maxrss 1.8% | mem 2.5% | DONE ( 4/20) test item "AzureConfig" 0.4 secs (94.8% compile), 41.97 K allocs (3.175 MB) Worker 30: 15:12:20 | maxrss 1.8% | mem 2.5% | START ( 5/20) test item "Basic BlobStorage exceptions" at test/azure_blobs_exception_tests.jl:1 Worker 30: 15:12:51 | maxrss 2.1% | mem 2.9% | DONE ( 5/20) test item "Basic BlobStorage exceptions" 31.1 secs (64.9% compile, 1.8% GC), 5.60 M allocs (508.745 MB) Worker 30: 15:12:51 | maxrss 2.1% | mem 2.9% | START ( 6/20) test item "BlobStorage retries" at test/azure_blobs_exception_tests.jl:321 Worker 30: 15:13:44 | maxrss 2.1% | mem 2.8% | DONE ( 6/20) test item "BlobStorage retries" 51.8 secs (10.1% compile, 0.6% GC), 3.37 M allocs (306.140 MB) Captured Logs for test item "BlobStorage retries" at test/azure_blobs_exception_tests.jl:321 on worker 30 2025-06-06T15:12:53.421902Z  WARN object_store_ffi: Generic MicrosoftAzure error: Client error with status 400 Bad Request: response body from the dummy server Caused by: 0: Generic MicrosoftAzure error: Client error with status 400 Bad Request: response body from the dummy server 1: Client error with status 400 Bad Request: response body from the dummy server Recent attempts (1 out of 1): reason: Code(400) after 0 retries Total retries: 0 Total Time: 721.891204ms 2025-06-06T15:12:54.383884Z  WARN object_store_ffi: Generic MicrosoftAzure error: Client error with status 400 Bad Request: response body from the dummy server Caused by: 0: Generic MicrosoftAzure error: Client error with status 400 Bad Request: response body from the dummy server 1: Client error with status 400 Bad Request: response body from the dummy server Recent attempts (1 out of 1): reason: Code(400) after 0 retries Total retries: 0 Total Time: 374.827951ms 2025-06-06T15:12:55.320867Z  WARN object_store_ffi: The operation lacked the necessary privileges to complete for path blob: Client error with status 403 Forbidden: response body from the dummy server Caused by: 0: The operation lacked the necessary privileges to complete for path blob: Client error with status 403 Forbidden: response body from the dummy server 1: Client error with status 403 Forbidden: response body from the dummy server Recent attempts (1 out of 1): reason: Code(403) after 0 retries Total retries: 0 Total Time: 359.077255ms 2025-06-06T15:12:56.450878Z  WARN object_store_ffi: The operation lacked the necessary privileges to complete for path blob: Client error with status 403 Forbidden: response body from the dummy server Caused by: 0: The operation lacked the necessary privileges to complete for path blob: Client error with status 403 Forbidden: response body from the dummy server 1: Client error with status 403 Forbidden: response body from the dummy server Recent attempts (1 out of 1): reason: Code(403) after 0 retries Total retries: 0 Total Time: 532.962048ms 2025-06-06T15:12:57.394920Z  WARN object_store_ffi: Object at location blob not found: Client error with status 404 Not Found: response body from the dummy server Caused by: 0: Object at location blob not found: Client error with status 404 Not Found: response body from the dummy server 1: Client error with status 404 Not Found: response body from the dummy server Recent attempts (1 out of 1): reason: Code(404) after 0 retries Total retries: 0 Total Time: 368.274415ms 2025-06-06T15:12:59.046878Z  WARN object_store_ffi: Generic MicrosoftAzure error: Client error with status 405 Method Not Allowed: response body from the dummy server Caused by: 0: Generic MicrosoftAzure error: Client error with status 405 Method Not Allowed: response body from the dummy server 1: Client error with status 405 Method Not Allowed: response body from the dummy server Recent attempts (1 out of 1): reason: Code(405) after 0 retries Total retries: 0 Total Time: 700.072718ms 2025-06-06T15:12:59.815894Z  WARN object_store_ffi: Generic MicrosoftAzure error: Client error with status 405 Method Not Allowed: response body from the dummy server Caused by: 0: Generic MicrosoftAzure error: Client error with status 405 Method Not Allowed: response body from the dummy server 1: Client error with status 405 Method Not Allowed: response body from the dummy server Recent attempts (1 out of 1): reason: Code(405) after 0 retries Total retries: 0 Total Time: 182.958994ms 2025-06-06T15:13:00.516891Z  WARN object_store_ffi: Object at location blob already exists: Client error with status 409 Conflict: response body from the dummy server Caused by: 0: Object at location blob already exists: Client error with status 409 Conflict: response body from the dummy server 1: Client error with status 409 Conflict: response body from the dummy server Recent attempts (1 out of 1): reason: Code(409) after 0 retries Total retries: 0 Total Time: 107.722972ms 2025-06-06T15:13:01.212043Z  WARN object_store_ffi: Object at location blob already exists: Client error with status 409 Conflict: response body from the dummy server Caused by: 0: Object at location blob already exists: Client error with status 409 Conflict: response body from the dummy server 1: Client error with status 409 Conflict: response body from the dummy server Recent attempts (1 out of 1): reason: Code(409) after 0 retries Total retries: 0 Total Time: 106.179387ms 2025-06-06T15:13:01.924988Z  WARN object_store_ffi: Request precondition failure for path blob: Client error with status 412 Precondition Failed: response body from the dummy server Caused by: 0: Request precondition failure for path blob: Client error with status 412 Precondition Failed: response body from the dummy server 1: Client error with status 412 Precondition Failed: response body from the dummy server Recent attempts (1 out of 1): reason: Code(412) after 0 retries Total retries: 0 Total Time: 122.842264ms 2025-06-06T15:13:02.712889Z  WARN object_store_ffi: Request precondition failure for path blob: Client error with status 412 Precondition Failed: response body from the dummy server Caused by: 0: Request precondition failure for path blob: Client error with status 412 Precondition Failed: response body from the dummy server 1: Client error with status 412 Precondition Failed: response body from the dummy server Recent attempts (1 out of 1): reason: Code(412) after 0 retries Total retries: 0 Total Time: 194.028065ms 2025-06-06T15:13:03.543857Z  WARN object_store_ffi: Generic MicrosoftAzure error: Client error with status 413 Payload Too Large: response body from the dummy server Caused by: 0: Generic MicrosoftAzure error: Client error with status 413 Payload Too Large: response body from the dummy server 1: Client error with status 413 Payload Too Large: response body from the dummy server Recent attempts (1 out of 1): reason: Code(413) after 0 retries Total retries: 0 Total Time: 254.042436ms 2025-06-06T15:13:04.396856Z  WARN object_store_ffi: Generic MicrosoftAzure error: Client error with status 429 Too Many Requests: response body from the dummy server Caused by: 0: Generic MicrosoftAzure error: Client error with status 429 Too Many Requests: response body from the dummy server 1: Client error with status 429 Too Many Requests: response body from the dummy server Recent attempts (1 out of 1): reason: Code(429) after 0 retries Total retries: 0 Total Time: 251.191504ms 2025-06-06T15:13:05.072818Z  WARN object_store_ffi: Generic MicrosoftAzure error: Client error with status 429 Too Many Requests: response body from the dummy server Caused by: 0: Generic MicrosoftAzure error: Client error with status 429 Too Many Requests: response body from the dummy server 1: Client error with status 429 Too Many Requests: response body from the dummy server Recent attempts (1 out of 1): reason: Code(429) after 0 retries Total retries: 0 Total Time: 89.897888ms 2025-06-06T15:13:06.803863Z  WARN object_store_ffi: Generic MicrosoftAzure error: Client error with status 429 Too Many Requests: response body from the dummy server Caused by: 0: Generic MicrosoftAzure error: Client error with status 429 Too Many Requests: response body from the dummy server 1: Client error with status 429 Too Many Requests: response body from the dummy server Recent attempts (1 out of 1): reason: Code(429) after 0 retries Total retries: 0 Total Time: 798.017836ms 2025-06-06T15:13:07.643873Z  WARN object_store_ffi: Generic MicrosoftAzure error: Client error with status 429 Too Many Requests: response body from the dummy server Caused by: 0: Generic MicrosoftAzure error: Client error with status 429 Too Many Requests: response body from the dummy server 1: Client error with status 429 Too Many Requests: response body from the dummy server Recent attempts (1 out of 1): reason: Code(429) after 0 retries Total retries: 0 Total Time: 326.413026ms 2025-06-06T15:13:08.978015Z  WARN object_store_ffi: Generic MicrosoftAzure error: Error after 2 retries in 736.367542ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (502 Bad Gateway) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) Caused by: 0: Generic MicrosoftAzure error: Error after 2 retries in 736.367542ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (502 Bad Gateway) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 1: Error after 2 retries in 736.367542ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (502 Bad Gateway) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 2: HTTP status server error (502 Bad Gateway) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) Recent attempts (1 out of 1): reason: Code(502) after 2 retries Total retries: 2 Total Time: 736.52218ms 2025-06-06T15:13:10.356019Z  WARN object_store_ffi: Generic MicrosoftAzure error: Error after 2 retries in 792.436091ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (502 Bad Gateway) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) Caused by: 0: Generic MicrosoftAzure error: Error after 2 retries in 792.436091ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (502 Bad Gateway) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 1: Error after 2 retries in 792.436091ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (502 Bad Gateway) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 2: HTTP status server error (502 Bad Gateway) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) Recent attempts (1 out of 1): reason: Code(502) after 2 retries Total retries: 2 Total Time: 792.594379ms 2025-06-06T15:13:12.197166Z  WARN object_store_ffi: Generic MicrosoftAzure error: Error after 2 retries in 577.462361ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (503 Service Unavailable) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) Caused by: 0: Generic MicrosoftAzure error: Error after 2 retries in 577.462361ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (503 Service Unavailable) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 1: Error after 2 retries in 577.462361ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (503 Service Unavailable) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 2: HTTP status server error (503 Service Unavailable) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) Recent attempts (1 out of 1): reason: Code(503) after 2 retries Total retries: 2 Total Time: 577.614759ms 2025-06-06T15:13:13.549194Z  WARN object_store_ffi: Generic MicrosoftAzure error: Error after 2 retries in 732.244532ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (503 Service Unavailable) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) Caused by: 0: Generic MicrosoftAzure error: Error after 2 retries in 732.244532ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (503 Service Unavailable) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 1: Error after 2 retries in 732.244532ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (503 Service Unavailable) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 2: HTTP status server error (503 Service Unavailable) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) Recent attempts (1 out of 1): reason: Code(503) after 2 retries Total retries: 2 Total Time: 732.40255ms 2025-06-06T15:13:15.204150Z  WARN object_store_ffi: Generic MicrosoftAzure error: Error after 2 retries in 1.055829105s, max_retries:2, retry_timeout:10s, source:HTTP status server error (504 Gateway Timeout) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) Caused by: 0: Generic MicrosoftAzure error: Error after 2 retries in 1.055829105s, max_retries:2, retry_timeout:10s, source:HTTP status server error (504 Gateway Timeout) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 1: Error after 2 retries in 1.055829105s, max_retries:2, retry_timeout:10s, source:HTTP status server error (504 Gateway Timeout) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 2: HTTP status server error (504 Gateway Timeout) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) Recent attempts (1 out of 1): reason: Code(504) after 2 retries Total retries: 2 Total Time: 1.055987043s 2025-06-06T15:13:16.372187Z  WARN object_store_ffi: Generic MicrosoftAzure error: Error after 2 retries in 559.296469ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (504 Gateway Timeout) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) Caused by: 0: Generic MicrosoftAzure error: Error after 2 retries in 559.296469ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (504 Gateway Timeout) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 1: Error after 2 retries in 559.296469ms, max_retries:2, retry_timeout:10s, source:HTTP status server error (504 Gateway Timeout) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 2: HTTP status server error (504 Gateway Timeout) for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) Recent attempts (1 out of 1): reason: Code(504) after 2 retries Total retries: 2 Total Time: 559.459148ms 2025-06-06T15:13:20.535894Z  WARN object_store_ffi: Generic MicrosoftAzure error: Error after 2 retries in 3.248669908s, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) Caused by: 0: Generic MicrosoftAzure error: Error after 2 retries in 3.248669908s, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 1: Error after 2 retries in 3.248669908s, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 2: error sending request for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 3: operation timed out Recent attempts (1 out of 1): reason: Timeout after 2 retries Total retries: 2 Total Time: 3.248810376s [ Info: Listening on: 127.0.0.1:8081, thread id: 2 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 1 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 2 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 1 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 2 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 2 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 1 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 2 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 1 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 2 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 1 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 2 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 2 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 1 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 2 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 1 [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 2 ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [5] write │ @ ./strings/io.jl:248 [inlined] │ [6] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [7] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [8] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [9] invokelatest │ @ ./essentials.jl:889 [inlined] │ [10] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [11] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ GET /myaccount/mycontainer/blob HTTP/1.1 │ content-length: 0 │ date: Fri, 06 Jun 2025 15:13:08 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ """ └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 [ Info: Server on 127.0.0.1:8081 closing ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] write │ @ ./strings/io.jl:248 [inlined] │ [5] write │ @ ./io.jl:691 [inlined] │ [6] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [7] write │ @ ./strings/io.jl:248 [inlined] │ [8] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [9] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [10] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [11] invokelatest │ @ ./essentials.jl:889 [inlined] │ [12] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [13] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ GET /myaccount/mycontainer/blob HTTP/1.1 │ content-length: 0 │ date: Fri, 06 Jun 2025 15:13:08 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ """ └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 [ Info: Listening on: 127.0.0.1:8081, thread id: 1 ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [5] write │ @ ./strings/io.jl:248 [inlined] │ [6] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [7] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [8] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [9] invokelatest │ @ ./essentials.jl:889 [inlined] │ [10] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [11] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ PUT /myaccount/mycontainer/blob HTTP/1.1 │ x-ms-blob-type: BlockBlob │ content-length: 5 │ date: Fri, 06 Jun 2025 15:13:09 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ a,b,c""" └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [5] write │ @ ./strings/io.jl:248 [inlined] │ [6] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [7] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [8] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [9] invokelatest │ @ ./essentials.jl:889 [inlined] │ [10] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [11] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ PUT /myaccount/mycontainer/blob HTTP/1.1 │ x-ms-blob-type: BlockBlob │ content-length: 5 │ date: Fri, 06 Jun 2025 15:13:09 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ a,b,c""" └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 [ Info: Server on 127.0.0.1:8081 closing ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] write │ @ ./strings/io.jl:248 [inlined] │ [5] write │ @ ./io.jl:691 [inlined] │ [6] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [7] write │ @ ./strings/io.jl:248 [inlined] │ [8] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [9] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [10] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [11] invokelatest │ @ ./essentials.jl:889 [inlined] │ [12] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [13] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ PUT /myaccount/mycontainer/blob HTTP/1.1 │ x-ms-blob-type: BlockBlob │ content-length: 5 │ date: Fri, 06 Jun 2025 15:13:09 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ a,b,c""" └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 [ Info: Listening on: 127.0.0.1:8081, thread id: 2 [ Info: Server on 127.0.0.1:8081 closing ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] write │ @ ./strings/io.jl:248 [inlined] │ [5] write │ @ ./io.jl:691 [inlined] │ [6] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [7] write │ @ ./strings/io.jl:248 [inlined] │ [8] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [9] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [10] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [11] invokelatest │ @ ./essentials.jl:889 [inlined] │ [12] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [13] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ GET /myaccount/mycontainer/blob HTTP/1.1 │ content-length: 0 │ date: Fri, 06 Jun 2025 15:13:11 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ """ └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 [ Info: Listening on: 127.0.0.1:8081, thread id: 1 [ Info: Server on 127.0.0.1:8081 closing ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] write │ @ ./strings/io.jl:248 [inlined] │ [5] write │ @ ./io.jl:691 [inlined] │ [6] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [7] write │ @ ./strings/io.jl:248 [inlined] │ [8] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [9] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [10] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [11] invokelatest │ @ ./essentials.jl:889 [inlined] │ [12] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [13] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ PUT /myaccount/mycontainer/blob HTTP/1.1 │ x-ms-blob-type: BlockBlob │ content-length: 5 │ date: Fri, 06 Jun 2025 15:13:12 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ a,b,c""" └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 [ Info: Listening on: 127.0.0.1:8081, thread id: 2 [ Info: Server on 127.0.0.1:8081 closing ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] write │ @ ./strings/io.jl:248 [inlined] │ [5] write │ @ ./io.jl:691 [inlined] │ [6] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [7] write │ @ ./strings/io.jl:248 [inlined] │ [8] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [9] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [10] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [11] invokelatest │ @ ./essentials.jl:889 [inlined] │ [12] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [13] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ GET /myaccount/mycontainer/blob HTTP/1.1 │ content-length: 0 │ date: Fri, 06 Jun 2025 15:13:14 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ """ └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 [ Info: Listening on: 127.0.0.1:8081, thread id: 1 [ Info: Server on 127.0.0.1:8081 closing ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] write │ @ ./strings/io.jl:248 [inlined] │ [5] write │ @ ./io.jl:691 [inlined] │ [6] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [7] write │ @ ./strings/io.jl:248 [inlined] │ [8] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [9] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [10] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [11] invokelatest │ @ ./essentials.jl:889 [inlined] │ [12] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [13] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#1#2"{Int64, Nothing, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ PUT /myaccount/mycontainer/blob HTTP/1.1 │ x-ms-blob-type: BlockBlob │ content-length: 5 │ date: Fri, 06 Jun 2025 15:13:15 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ a,b,c""" └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 [ Info: Listening on: 127.0.0.1:8081, thread id: 2 ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] write │ @ ./strings/io.jl:248 [inlined] │ [5] write │ @ ./io.jl:689 [inlined] │ [6] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [7] write │ @ ./strings/io.jl:248 [inlined] │ [8] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [9] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#17#18"{Int64, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [10] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [11] invokelatest │ @ ./essentials.jl:889 [inlined] │ [12] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [13] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#17#18"{Int64, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ GET /myaccount/mycontainer/blob HTTP/1.1 │ content-length: 0 │ date: Fri, 06 Jun 2025 15:13:17 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ """ └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 [ Info: Server on 127.0.0.1:8081 closing ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] write │ @ ./strings/io.jl:248 [inlined] │ [5] write │ @ ./io.jl:689 [inlined] │ [6] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [7] write │ @ ./strings/io.jl:248 [inlined] │ [8] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [9] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#17#18"{Int64, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [10] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [11] invokelatest │ @ ./essentials.jl:889 [inlined] │ [12] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [13] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#17#18"{Int64, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ GET /myaccount/mycontainer/blob HTTP/1.1 │ content-length: 0 │ date: Fri, 06 Jun 2025 15:13:17 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ """ └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 2025-06-06T15:13:25.680282Z  WARN object_store_ffi: Generic MicrosoftAzure error: Error after 2 retries in 3.307716848s, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) Caused by: 0: Generic MicrosoftAzure error: Error after 2 retries in 3.307716848s, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 1: Error after 2 retries in 3.307716848s, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 2: error sending request for url (http://127.0.0.1:8081/myaccount/mycontainer/blob) 3: operation timed out Recent attempts (1 out of 1): reason: Timeout after 2 retries Total retries: 2 Total Time: 3.307869067s 2025-06-06T15:13:27.695428Z  WARN object_store_ffi: Generic MicrosoftAzure error: Error after 2 retries in 258.291774ms, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) Caused by: 0: Generic MicrosoftAzure error: Error after 2 retries in 258.291774ms, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) 1: Error after 2 retries in 258.291774ms, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) 2: error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) 3: client error (SendRequest) 4: connection closed before message completed Recent attempts (1 out of 1): reason: Io after 2 retries Total retries: 2 Total Time: 258.423633ms 2025-06-06T15:13:27.909373Z  WARN object_store_ffi: Generic MicrosoftAzure error: Error after 2 retries in 212.85478ms, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) Caused by: 0: Generic MicrosoftAzure error: Error after 2 retries in 212.85478ms, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) 1: Error after 2 retries in 212.85478ms, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) 2: error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) 3: client error (SendRequest) 4: connection closed before message completed Recent attempts (1 out of 1): reason: Io after 2 retries Total retries: 2 Total Time: 212.997349ms 2025-06-06T15:13:28.362356Z  WARN object_store_ffi: Generic MicrosoftAzure error: Error after 2 retries in 268.235827ms, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) Caused by: 0: Generic MicrosoftAzure error: Error after 2 retries in 268.235827ms, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) 1: Error after 2 retries in 268.235827ms, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) 2: error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) 3: client error (SendRequest) 4: connection error 5: Connection reset by peer (os error 104) Recent attempts (1 out of 1): reason: Io after 2 retries Total retries: 2 Total Time: 268.384635ms 2025-06-06T15:13:28.618626Z  WARN object_store_ffi: Generic MicrosoftAzure error: Error after 2 retries in 255.390473ms, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) Caused by: 0: Generic MicrosoftAzure error: Error after 2 retries in 255.390473ms, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) 1: Error after 2 retries in 255.390473ms, max_retries:2, retry_timeout:10s, source:error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) 2: error sending request for url (http://127.0.0.1:8082/myaccount/mycontainer/blob) 3: client error (SendRequest) 4: connection error 5: Connection reset by peer (os error 104) Recent attempts (1 out of 1): reason: Io after 2 retries Total retries: 2 Total Time: 255.65113ms 2025-06-06T15:13:29.643890Z  WARN object_store_ffi::crud_ops: Error while reading body: io error while streaming body: Generic MicrosoftAzure error: error decoding response body 2025-06-06T15:13:30.654898Z  WARN object_store_ffi::crud_ops: Error while reading body: io error while streaming body: Generic MicrosoftAzure error: error decoding response body 2025-06-06T15:13:31.592926Z  WARN object_store_ffi::crud_ops: Error while reading body: io error while streaming body: Generic MicrosoftAzure error: error decoding response body 2025-06-06T15:13:31.593055Z  WARN object_store_ffi: io error while streaming body: Generic MicrosoftAzure error: error decoding response body Caused by: 0: Generic MicrosoftAzure error: error decoding response body 1: error decoding response body 2: request or response body error 3: error reading a body from connection 4: end of file before message length reached Recent attempts (3 out of 3): reason: Io after 0 retries reason: Io after 0 retries reason: Io after 0 retries Total retries: 2 Total Time: 2.494886177s 2025-06-06T15:13:33.255847Z  WARN object_store_ffi::crud_ops: Error while reading body: io error while streaming body: Generic MicrosoftAzure error: error decoding response body 2025-06-06T15:13:34.185006Z  WARN object_store_ffi::crud_ops: Error while reading body: io error while streaming body: Generic MicrosoftAzure error: error decoding response body 2025-06-06T15:13:35.300237Z  WARN object_store_ffi::crud_ops: Error while reading body: io error while streaming body: Generic MicrosoftAzure error: error decoding response body 2025-06-06T15:13:35.300356Z  WARN object_store_ffi: io error while streaming body: Generic MicrosoftAzure error: error decoding response body Caused by: 0: Generic MicrosoftAzure error: error decoding response body 1: error decoding response body 2: request or response body error 3: error reading a body from connection 4: Connection reset by peer (os error 104) Recent attempts (3 out of 3): reason: Io after 0 retries reason: Io after 0 retries reason: Io after 0 retries Total retries: 2 Total Time: 2.855440448s 2025-06-06T15:13:36.615157Z  WARN object_store_ffi::crud_ops: Error while reading body: io error while streaming body: Generic MicrosoftAzure error: error decoding response body 2025-06-06T15:13:37.924778Z  WARN object_store_ffi::crud_ops: Error while reading body: io error while streaming body: Generic MicrosoftAzure error: error decoding response body 2025-06-06T15:13:39.544785Z  WARN object_store_ffi::crud_ops: Error while reading body: io error while streaming body: Generic MicrosoftAzure error: error decoding response body 2025-06-06T15:13:39.544951Z  WARN object_store_ffi: io error while streaming body: Generic MicrosoftAzure error: error decoding response body Caused by: 0: Generic MicrosoftAzure error: error decoding response body 1: error decoding response body 2: request or response body error 3: operation timed out Recent attempts (3 out of 3): reason: Timeout after 0 retries reason: Timeout after 0 retries reason: Timeout after 0 retries Total retries: 2 Total Time: 3.930296636s 2025-06-06T15:13:40.809847Z  WARN object_store_ffi: operation was cancelled ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] write │ @ ./strings/io.jl:248 [inlined] │ [5] write │ @ ./io.jl:689 [inlined] │ [6] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [7] write │ @ ./strings/io.jl:248 [inlined] │ [8] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [9] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#17#18"{Int64, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [10] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [11] invokelatest │ @ ./essentials.jl:889 [inlined] │ [12] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [13] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#17#18"{Int64, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ GET /myaccount/mycontainer/blob HTTP/1.1 │ content-length: 0 │ date: Fri, 06 Jun 2025 15:13:17 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ """ └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 [ Info: Listening on: 127.0.0.1:8081, thread id: 1 ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] write │ @ ./strings/io.jl:248 [inlined] │ [5] write │ @ ./io.jl:689 [inlined] │ [6] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [7] write │ @ ./strings/io.jl:248 [inlined] │ [8] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [9] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#17#18"{Int64, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [10] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [11] invokelatest │ @ ./essentials.jl:889 [inlined] │ [12] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [13] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#17#18"{Int64, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ PUT /myaccount/mycontainer/blob HTTP/1.1 │ x-ms-blob-type: BlockBlob │ content-length: 5 │ date: Fri, 06 Jun 2025 15:13:22 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ a,b,c""" └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] write │ @ ./strings/io.jl:248 [inlined] │ [5] write │ @ ./io.jl:689 [inlined] │ [6] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [7] write │ @ ./strings/io.jl:248 [inlined] │ [8] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [9] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#17#18"{Int64, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [10] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [11] invokelatest │ @ ./essentials.jl:889 [inlined] │ [12] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [13] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#17#18"{Int64, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ PUT /myaccount/mycontainer/blob HTTP/1.1 │ x-ms-blob-type: BlockBlob │ content-length: 5 │ date: Fri, 06 Jun 2025 15:13:22 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ a,b,c""" └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 [ Info: Server on 127.0.0.1:8081 closing ┌ Error: handle_connection handler error. │ │ =========================== │ HTTP Error message: │ │ ERROR: IOError: write: broken pipe (EPIPE) │ Stacktrace: │ [1] uv_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1066 │ [2] unsafe_write(s::Sockets.TCPSocket, p::Ptr{UInt8}, n::UInt64) │ @ Base ./stream.jl:1120 │ [3] unsafe_write │ @ ~/.julia/packages/HTTP/MIUdD/src/Connections.jl:132 [inlined] │ [4] write │ @ ./strings/io.jl:248 [inlined] │ [5] write │ @ ./io.jl:689 [inlined] │ [6] unsafe_write(http::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, p::Ptr{UInt8}, n::UInt64) │ @ HTTP.Streams ~/.julia/packages/HTTP/MIUdD/src/Streams.jl:95 │ [7] write │ @ ./strings/io.jl:248 [inlined] │ [8] write(io::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}, s::Base.CodeUnits{UInt8, String}) │ @ Base ./strings/basic.jl:793 │ [9] (::HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#17#18"{Int64, String, Base.RefValue{Int64}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Request, HTTP.Connections.Connection{Sockets.TCPSocket}}) │ @ HTTP.Handlers ~/.julia/packages/HTTP/MIUdD/src/Handlers.jl:61 │ [10] #invokelatest#2 │ @ ./essentials.jl:892 [inlined] │ [11] invokelatest │ @ ./essentials.jl:889 [inlined] │ [12] handle_connection(f::Function, c::HTTP.Connections.Connection{Sockets.TCPSocket}, listener::HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, readtimeout::Int64, access_log::Nothing, verbose::Bool) │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:469 │ [13] (::HTTP.Servers.var"#16#17"{HTTP.Handlers.var"#1#2"{Main.var"##BlobStorage retries#236".var"#17#18"{Int64, String, Base.RefValue{Int64}}}, HTTP.Servers.Listener{Nothing, Sockets.TCPServer}, Set{HTTP.Connections.Connection}, Int64, Nothing, ReentrantLock, Bool, Base.Semaphore, HTTP.Connections.Connection{Sockets.TCPSocket}})() │ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:401 │ request = │ HTTP.Messages.Request: │ """ │ PUT /myaccount/mycontainer/blob HTTP/1.1 │ x-ms-blob-type: BlockBlob │ content-length: 5 │ date: Fri, 06 Jun 2025 15:13:22 GMT │ x-ms-version: 2023-11-03 │ authorization: ****** │ accept: */* │ user-agent: object_store/0.11.2 │ host: 127.0.0.1:8081 │ │ a,b,c""" └ @ HTTP.Servers ~/.julia/packages/HTTP/MIUdD/src/Servers.jl:483 [ Info: Listening on: 127.0.0.1:8083, thread id: 2 [ Info: Server on 127.0.0.1:8083 closing [ Info: Listening on: 127.0.0.1:8083, thread id: 2 [ Info: Listening on: 127.0.0.1:8083, thread id: 2 [ Info: Server on 127.0.0.1:8083 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 1 [ Info: Server on 127.0.0.1:8083 closing [ Info: Server on 127.0.0.1:8081 closing [ Info: Listening on: 127.0.0.1:8081, thread id: 2 Error in testset "InvalidBlockList" on worker 30: Test Failed at /home/pkgeval/.julia/packages/RustyObjectStore/JF6aG/test/azure_blobs_exception_tests.jl:933 Expression: nrequests == 4 Evaluated: 5 == 4 Worker 30: [ Info: Server on 127.0.0.1:8081 closing Worker 30: 15:13:45 | maxrss 2.1% | mem 2.8% | START ( 7/20) test item "Basic BlobStorage usage" at test/basic_unified_tests.jl:686 Worker 30: 15:15:33 | maxrss 5.0% | mem 4.5% | DONE ( 7/20) test item "Basic BlobStorage usage" 107.6 secs (30.5% compile, 1.3% GC), 6.94 M allocs (1.865 GB) Worker 30: 15:15:40 | maxrss 5.0% | mem 4.5% | START ( 8/20) test item "Basic BlobStorage usage (anonymous read enabled)" at test/basic_unified_tests.jl:719 Worker 30: 15:15:48 | maxrss 5.0% | mem 4.6% | DONE ( 8/20) test item "Basic BlobStorage usage (anonymous read enabled)" 8.3 secs (21.8% compile, 2.8% GC), 839.70 K allocs (341.828 MB) Worker 30: 15:15:51 | maxrss 5.0% | mem 4.6% | START ( 9/20) test item "Basic AWS S3 usage" at test/basic_unified_tests.jl:744 Worker 30: 15:17:48 | maxrss 5.0% | mem 5.2% | DONE ( 9/20) test item "Basic AWS S3 usage" 116.6 secs (24.1% compile, 1.1% GC), 4.85 M allocs (1.719 GB) Worker 30: 15:17:55 | maxrss 5.0% | mem 5.2% | START (10/20) test item "Basic AWS S3 usage (anonymous read enabled)" at test/basic_unified_tests.jl:778 Worker 30: 15:18:01 | maxrss 5.0% | mem 5.4% | DONE (10/20) test item "Basic AWS S3 usage (anonymous read enabled)" 6.1 secs (14.2% compile, 3.1% GC), 824.13 K allocs (340.953 MB) Worker 30: 15:18:04 | maxrss 5.0% | mem 5.4% | START (11/20) test item "Basic Snowflake Stage usage: AWS, non-encrypted" at test/basic_unified_tests.jl:805 Worker 30: 15:20:26 | maxrss 5.0% | mem 5.5% | DONE (11/20) test item "Basic Snowflake Stage usage: AWS, non-encrypted" 142.4 secs (31.4% compile, 0.6% GC), 8.74 M allocs (1.769 GB) Worker 30: 15:20:33 | maxrss 5.0% | mem 5.5% | START (12/20) test item "Basic Snowflake Stage usage: AWS, encrypted" at test/basic_unified_tests.jl:822 Worker 30: 15:21:17 | maxrss 5.6% | mem 6.7% | DONE (12/20) test item "Basic Snowflake Stage usage: AWS, encrypted" 43.5 secs (16.3% compile, 2.0% GC), 4.06 M allocs (1.222 GB) Worker 30: 15:21:24 | maxrss 5.6% | mem 6.7% | START (13/20) test item "Basic Snowflake Stage usage: Azure, non-encrypted" at test/basic_unified_tests.jl:839 Worker 30: 15:23:02 | maxrss 5.7% | mem 5.9% | DONE (13/20) test item "Basic Snowflake Stage usage: Azure, non-encrypted" 98.2 secs (2.3% compile, 0.6% GC), 2.21 M allocs (1.082 GB) Worker 30: 15:23:02 | maxrss 5.7% | mem 5.9% | START (14/20) test item "Basic Snowflake Stage usage: Azure, encrypted" at test/basic_unified_tests.jl:856 Worker 30: 15:24:13 | maxrss 5.9% | mem 7.2% | DONE (14/20) test item "Basic Snowflake Stage usage: Azure, encrypted" 71.0 secs (9.9% compile, 0.4% GC), 3.52 M allocs (1.181 GB) Worker 30: 15:24:13 | maxrss 5.9% | mem 7.2% | START (15/20) test item "destroy_* functions do not panic" at test/destroy_test.jl:1 Worker 30: 15:24:13 | maxrss 5.9% | mem 7.2% | DONE (15/20) test item "destroy_* functions do not panic" <0.1 secs (73.8% compile), 3.34 K allocs (221.400 KB) Worker 30: 15:24:13 | maxrss 5.9% | mem 7.2% | START (16/20) test item "Using object_store_ffi_jll" at test/release_test.jl:4 Worker 30: 15:24:13 | maxrss 5.9% | mem 7.2% | DONE (16/20) test item "Using object_store_ffi_jll" <0.1 secs (<0.1% compile), 1.51 K allocs (109.720 KB) Worker 30: 15:24:13 | maxrss 5.9% | mem 7.2% | START (17/20) test item "Handle object_store_ffi panic" at test/rust_panic_test.jl:1 Worker 30: 15:24:19 | maxrss 5.9% | mem 7.3% | DONE (17/20) test item "Handle object_store_ffi panic" 5.2 secs (2.1% compile), 24.19 K allocs (1.831 MB) Worker 30: 15:24:19 | maxrss 5.9% | mem 7.3% | START (18/20) test item "SnowflakeConfig" at test/snowflake_api_tests.jl:1 Worker 30: 15:24:19 | maxrss 5.9% | mem 7.3% | DONE (18/20) test item "SnowflakeConfig" 0.3 secs (95.4% compile), 53.72 K allocs (4.111 MB) Worker 30: 15:24:19 | maxrss 5.9% | mem 7.3% | START (19/20) test item "Basic Stage exceptions" at test/snowflake_stage_exception_tests.jl:1 Worker 30: 15:24:40 | maxrss 5.9% | mem 7.3% | DONE (19/20) test item "Basic Stage exceptions" 20.7 secs (19.3% compile), 748.52 K allocs (58.479 MB) Worker 30: 15:24:43 | maxrss 5.9% | mem 7.3% | START (20/20) test item "Snowflake Stage retries" at test/snowflake_stage_exception_tests.jl:158 Worker 30: 15:26:40 | maxrss 6.1% | mem 7.5% | DONE (20/20) test item "Snowflake Stage retries" 116.7 secs (6.3% compile), 3.20 M allocs (267.947 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=30). Worker 30: [30] signal (15): Terminated in expression starting at none:1 [ Tests Completed: 20/20 test items were run. Test Summary: | Pass Fail Broken Total Time RustyObjectStore | 15233 1 8 15242 16m22.9s test | 15233 1 8 15242 test/aws_api_tests.jl | 3 3 test/aws_s3_exception_tests.jl | 163 2 165 test/azure_api_tests.jl | 5 5 test/azure_blobs_exception_tests.jl | 182 1 2 185 Basic BlobStorage exceptions | 41 41 31.1s BlobStorage retries | 141 1 2 144 51.8s 400: Bad Request | 10 10 2.9s 403: Forbidden | 10 10 2.1s 404: Not Found | 5 5 1.0s 405: Method Not Supported | 10 10 2.4s 409: Conflict | 10 10 1.4s 412: Precondition Failed | 10 10 1.5s 413: Content Too Large | 5 5 0.8s 429: Too Many Requests | 18 2 20 4.1s 502: Bad Gateway | 8 8 3.4s 503: Service Unavailable | 8 8 2.5s 504: Gateway Timeout | 8 8 2.8s Timeout | 8 8 10.3s TCP Closed | 8 8 0.6s TCP reset | 8 8 0.7s Incomplete GET body | 4 4 3.6s Incomplete GET body reset | 4 4 3.1s Incomplete GET body timeout | 4 4 4.2s Cancellation | 2 2 1.2s InvalidBlockList | 1 1 2 2.9s test/basic_unified_tests.jl | 14560 14560 test/destroy_test.jl | 2 2 test/release_test.jl | 1 1 test/rust_panic_test.jl | 1 1 test/snowflake_api_tests.jl | 3 3 test/snowflake_stage_exception_tests.jl | 313 4 317 ERROR: LoadError: Some tests did not pass: 15233 passed, 1 failed, 0 errored, 8 broken. in expression starting at /home/pkgeval/.julia/packages/RustyObjectStore/JF6aG/test/runtests.jl:4 Testing failed after 728.06s ERROR: LoadError: Package RustyObjectStore errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Types.jl:70 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:2034 [3] test @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:1915 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::Base.PipeEndpoint}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:444 [5] test(pkgs::Vector{Pkg.Types.PackageSpec}; io::Base.PipeEndpoint, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:159 [6] test @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:147 [inlined] [7] #test#74 @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:146 [inlined] [8] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 1054.11s: package has test failures