Package evaluation to test RAI on Julia 1.12.4 (0f21d93eaa*) started at 2026-01-27T01:39:11.217 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.12` Set-up completed after 9.6s ################################################################################ # Installation # Installing RAI... Resolving package versions... Installed Zstd_jll ──────────────────── v1.5.7+1 Installed TableTraits ───────────────── v1.0.1 Installed Scratch ───────────────────── v1.3.0 Installed LoggingExtras ─────────────── v1.2.0 Installed JSON3 ─────────────────────── v1.14.3 Installed Preferences ───────────────── v1.5.1 Installed RAI ───────────────────────── v0.2.9 Installed Arrow ─────────────────────── v2.8.1 Installed Mocking ───────────────────── v0.7.9 Installed BitFlags ──────────────────── v0.1.9 Installed SimpleBufferStream ────────── v1.2.0 Installed SentinelArrays ────────────── v1.4.9 Installed DataAPI ───────────────────── v1.16.0 Installed Parsers ───────────────────── v2.8.3 Installed Tables ────────────────────── v1.12.1 Installed ArrowTypes ────────────────── v2.3.0 Installed TimeZones ─────────────────── v1.22.2 Installed TZJData ───────────────────── v1.5.0+2025b Installed IteratorInterfaceExtensions ─ v1.0.0 Installed JLLWrappers ───────────────── v1.7.1 Installed ConcurrentUtilities ───────── v2.5.0 Installed DataValueInterfaces ───────── v1.0.0 Installed PooledArrays ──────────────── v1.4.3 Installed URIs ──────────────────────── v1.6.1 Installed InlineStrings ─────────────── v1.4.5 Installed PrecompileTools ───────────── v1.3.3 Installed EnumX ─────────────────────── v1.0.6 Installed OrderedCollections ────────── v1.8.1 Installed OpenSSL ───────────────────── v1.6.1 Installed TranscodingStreams ────────── v0.11.3 Installed StringViews ───────────────── v1.3.7 Installed BitIntegers ───────────────── v0.3.7 Installed HTTP ──────────────────────── v1.10.19 Installed MbedTLS ───────────────────── v1.1.9 Installed ProtoBuf ──────────────────── v1.2.0 Installed Lz4_jll ───────────────────── v1.10.1+0 Installed MbedTLS_jll ───────────────── v2.28.1010+0 Installed BufferedStreams ───────────── v1.2.2 Installed ExprTools ─────────────────── v0.1.10 Installed Compat ────────────────────── v4.18.1 Installed ConfParser ────────────────── v0.1.2 Installed CodecZstd ─────────────────── v0.8.7 Installed CodecZlib ─────────────────── v0.7.8 Installed TextWrap ──────────────────── v1.0.2 Installed CodecLz4 ──────────────────── v0.4.6 Installed StructTypes ───────────────── v1.11.0 Installed ArgParse ──────────────────── v1.2.0 Installed ExceptionUnwrapping ───────── v0.1.11 Installing 4 artifacts Installed artifact Lz4 239.7 KiB Installed artifact tzjdata 112.5 KiB Installed artifact Zstd 646.0 KiB Installed artifact MbedTLS 2.2 MiB Updating `~/.julia/environments/v1.12/Project.toml` [9c30249a] + RAI v0.2.9 Updating `~/.julia/environments/v1.12/Manifest.toml` [c7e460c6] + ArgParse v1.2.0 [69666777] + Arrow v2.8.1 [31f734f8] + ArrowTypes v2.3.0 [d1d4a3ce] + BitFlags v0.1.9 [c3b6d118] + BitIntegers v0.3.7 [e1450e63] + BufferedStreams v1.2.2 [5ba52731] + CodecLz4 v0.4.6 [944b1d66] + CodecZlib v0.7.8 [6b39b394] + CodecZstd v0.8.7 [34da2185] + Compat v4.18.1 [f0e56b4a] + ConcurrentUtilities v2.5.0 [88353bc9] + ConfParser v0.1.2 [9a962f9c] + DataAPI v1.16.0 [e2d170a0] + DataValueInterfaces v1.0.0 [4e289a0a] + EnumX v1.0.6 [460bff9d] + ExceptionUnwrapping v0.1.11 [e2ba6199] + ExprTools v0.1.10 [cd3eb016] + HTTP v1.10.19 [842dd82b] + InlineStrings v1.4.5 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.7.1 [0f8b85d8] + JSON3 v1.14.3 [e6f89c97] + LoggingExtras v1.2.0 [739be429] + MbedTLS v1.1.9 ⌅ [78c3b35d] + Mocking v0.7.9 [4d8831e6] + OpenSSL v1.6.1 [bac558e1] + OrderedCollections v1.8.1 [69de0a69] + Parsers v2.8.3 [2dfb63ee] + PooledArrays v1.4.3 [aea7be01] + PrecompileTools v1.3.3 [21216c6a] + Preferences v1.5.1 [3349acd9] + ProtoBuf v1.2.0 [9c30249a] + RAI v0.2.9 [6c6a2e73] + Scratch v1.3.0 [91c51154] + SentinelArrays v1.4.9 [777ac1f9] + SimpleBufferStream v1.2.0 [354b36f9] + StringViews v1.3.7 [856f2bd8] + StructTypes v1.11.0 [dc5dba14] + TZJData v1.5.0+2025b [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.12.1 [b718987f] + TextWrap v1.0.2 [f269a46b] + TimeZones v1.22.2 [3bb67fe8] + TranscodingStreams v0.11.3 [5c2747f8] + URIs v1.6.1 [5ced341a] + Lz4_jll v1.10.1+0 [c8ffd9c3] + MbedTLS_jll v2.28.1010+0 [3161d3a3] + Zstd_jll v1.5.7+1 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [9fa8497b] + Future v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.15.0+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.11.4 [458c3c95] + OpenSSL_jll v3.5.4+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850ede] + nghttp2_jll v1.64.0+1 [3f19e933] + p7zip_jll v17.7.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 9.74s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling packages... 4639.4 ms ✓ TestEnv 1 dependency successfully precompiled in 5 seconds. 26 already precompiled. Precompiling package dependencies... Precompiling packages... 4203.8 ms ✓ OrderedCollections 876.4 ms ✓ TextWrap 1133.6 ms ✓ StringViews 749.1 ms ✓ DataValueInterfaces 871.8 ms ✓ EnumX 952.7 ms ✓ ArrowTypes 1808.6 ms ✓ InlineStrings 1028.8 ms ✓ BufferedStreams 869.4 ms ✓ ExprTools 1273.3 ms ✓ URIs 1376.4 ms ✓ IteratorInterfaceExtensions 1244.0 ms ✓ SimpleBufferStream 1081.4 ms ✓ DataAPI 4144.1 ms ✓ BitIntegers 867.4 ms ✓ BitFlags 2270.0 ms ✓ ConcurrentUtilities 1276.2 ms ✓ TranscodingStreams 929.2 ms ✓ TZJData 903.8 ms ✓ ConfParser 2190.9 ms ✓ SentinelArrays 4604.9 ms ✓ StructTypes 885.9 ms ✓ Scratch 1123.6 ms ✓ LoggingExtras 4026.4 ms ✓ Compat 1122.6 ms ✓ Preferences 1599.8 ms ✓ ExceptionUnwrapping 1889.0 ms ✓ ArgParse 806.1 ms ✓ InlineStrings → ArrowTypesExt 10032.4 ms ✓ ProtoBuf 729.1 ms ✓ TableTraits 1020.8 ms ✓ PooledArrays 4668.2 ms ✓ OpenSSL 950.9 ms ✓ CodecZlib 2097.0 ms ✓ Mocking 872.5 ms ✓ PrecompileTools 1179.3 ms ✓ JLLWrappers 4635.0 ms ✓ Tables 10724.9 ms ✓ TimeZones 22173.4 ms ✓ Parsers 1428.9 ms ✓ MbedTLS_jll 2229.4 ms ✓ Zstd_jll 1853.0 ms ✓ Lz4_jll 17847.6 ms ✓ JSON3 957.8 ms ✓ InlineStrings → ParsersExt 2699.4 ms ✓ MbedTLS 2502.3 ms ✓ CodecZstd 2194.9 ms ✓ CodecLz4 1234.2 ms ✓ JSON3 → JSON3ArrowExt 34284.1 ms ✓ HTTP 17265.5 ms ✓ Arrow 13848.1 ms ✓ RAI 51 dependencies successfully precompiled in 204 seconds. 27 already precompiled. Precompilation completed after 221.58s ################################################################################ # Testing # Testing RAI Status `/tmp/jl_LsoR00/Project.toml` [c7e460c6] ArgParse v1.2.0 [69666777] Arrow v2.8.1 [88353bc9] ConfParser v0.1.2 [4e289a0a] EnumX v1.0.6 [460bff9d] ExceptionUnwrapping v0.1.11 [cd3eb016] HTTP v1.10.19 [0f8b85d8] JSON3 v1.14.3 ⌅ [78c3b35d] Mocking v0.7.9 [3349acd9] ProtoBuf v1.2.0 [9c30249a] RAI v0.2.9 [bd369af6] Tables v1.12.1 [ade2ca70] Dates v1.11.0 [fa267f1f] TOML v1.0.3 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 Status `/tmp/jl_LsoR00/Manifest.toml` [c7e460c6] ArgParse v1.2.0 [69666777] Arrow v2.8.1 [31f734f8] ArrowTypes v2.3.0 [d1d4a3ce] BitFlags v0.1.9 [c3b6d118] BitIntegers v0.3.7 [e1450e63] BufferedStreams v1.2.2 [5ba52731] CodecLz4 v0.4.6 [944b1d66] CodecZlib v0.7.8 [6b39b394] CodecZstd v0.8.7 [34da2185] Compat v4.18.1 [f0e56b4a] ConcurrentUtilities v2.5.0 [88353bc9] ConfParser v0.1.2 [9a962f9c] DataAPI v1.16.0 [e2d170a0] DataValueInterfaces v1.0.0 [4e289a0a] EnumX v1.0.6 [460bff9d] ExceptionUnwrapping v0.1.11 [e2ba6199] ExprTools v0.1.10 [cd3eb016] HTTP v1.10.19 [842dd82b] InlineStrings v1.4.5 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.1 [0f8b85d8] JSON3 v1.14.3 [e6f89c97] LoggingExtras v1.2.0 [739be429] MbedTLS v1.1.9 ⌅ [78c3b35d] Mocking v0.7.9 [4d8831e6] OpenSSL v1.6.1 [bac558e1] OrderedCollections v1.8.1 [69de0a69] Parsers v2.8.3 [2dfb63ee] PooledArrays v1.4.3 [aea7be01] PrecompileTools v1.3.3 [21216c6a] Preferences v1.5.1 [3349acd9] ProtoBuf v1.2.0 [9c30249a] RAI v0.2.9 [6c6a2e73] Scratch v1.3.0 [91c51154] SentinelArrays v1.4.9 [777ac1f9] SimpleBufferStream v1.2.0 [354b36f9] StringViews v1.3.7 [856f2bd8] StructTypes v1.11.0 [dc5dba14] TZJData v1.5.0+2025b [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.1 [b718987f] TextWrap v1.0.2 [f269a46b] TimeZones v1.22.2 [3bb67fe8] TranscodingStreams v0.11.3 [5c2747f8] URIs v1.6.1 [5ced341a] Lz4_jll v1.10.1+0 [c8ffd9c3] MbedTLS_jll v2.28.1010+0 [3161d3a3] Zstd_jll v1.5.7+1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [458c3c95] OpenSSL_jll v3.5.4+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.7.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Test Summary: | Total Time config.jl | 0 0.7s Test Summary: | Pass Total Time rest.jl | 5 5 36.5s [ Info: Mock sleep for 0.2 [ Info: Mock sleep for 0.2700000047683716 [ Info: Mock sleep for 0.34700000286102295 ┌ Error: Client-side error while executing transaction. │ transaction_id = "a3e3bc91-0a98-50ba-733c-0987e160eb7d" └ @ RAI ~/.julia/packages/RAI/wzieP/src/api.jl:136 ┌ Warning: SystemError("opening file \"/home/pkgeval/.rai/tokens.json\"", 2, nothing) └ @ RAI ~/.julia/packages/RAI/wzieP/src/rest.jl:141 read write access token to cache: Test Failed at /home/pkgeval/.julia/packages/RAI/wzieP/test/api.jl:311 Expression: cached_token === access_token Evaluated: nothing === (abc..., run:transaction, 3600, 1.660326591365e9) Stacktrace: [1] top-level scope @ ~/.julia/packages/RAI/wzieP/test/api.jl:302 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/RAI/wzieP/test/api.jl:311 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Test Summary: | Pass Fail Total Time api.jl | 26 1 27 1m08.4s wait_until_done polls correctly | 4 4 10.5s _poll_with_specified_overhead | 5 5 1.0s exec_async | 9 9 40.9s show_result | 2 2 1.9s error handling | 4 4 1.7s exec with fast-path response only makes one request | 1 1 0.1s hide client secrets in repl | 1 1 0.6s read write access token to cache | 1 1 6.2s RNG of the outermost testset: Random.Xoshiro(0x730161f5825c9e3d, 0xcaeda0636066395d, 0x3989264ac9d065b4, 0xe592b9a34397ba1a, 0x3a7b160c6dc75d8e) ERROR: LoadError: Some tests did not pass: 26 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/RAI/wzieP/test/runtests.jl:29 Testing failed after 129.82s ERROR: LoadError: Package RAI errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2535 [3] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2384 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:538 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:169 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [7] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:156 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 [10] include(mod::Module, _path::String) @ Base ./Base.jl:306 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:317 [12] _start() @ Base ./client.jl:550 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 395.41s: package has test failures