Package evaluation to test UniLM on Julia 1.12.7-DEV.42 (6f510b6086*) started at 2026-06-19T13:40:32.364 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.12` Set-up completed after 8.59s ################################################################################ # Installation # Installing UniLM... Resolving package versions... Updating `~/.julia/environments/v1.12/Project.toml` [2a65a866] + UniLM v0.6.0 Updating `~/.julia/environments/v1.12/Manifest.toml` [d1d4a3ce] + BitFlags v0.1.10 [944b1d66] + CodecZlib v0.7.8 [f0e56b4a] + ConcurrentUtilities v2.5.1 [460bff9d] + ExceptionUnwrapping v0.1.11 ⌅ [cd3eb016] + HTTP v1.11.0 [692b3bcd] + JLLWrappers v1.8.0 [682c06a0] + JSON v1.6.1 [e6f89c97] + LoggingExtras v1.2.0 [739be429] + MbedTLS v1.1.10 [4d8831e6] + OpenSSL v1.6.1 [69de0a69] + Parsers v2.8.6 [aea7be01] + PrecompileTools v1.3.4 [21216c6a] + Preferences v1.5.2 [777ac1f9] + SimpleBufferStream v1.2.0 [ec057cc2] + StructUtils v2.8.2 [3bb67fe8] + TranscodingStreams v0.11.3 [5c2747f8] + URIs v1.6.1 [2a65a866] + UniLM v0.6.0 [c8ffd9c3] + MbedTLS_jll v2.28.1010+0 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.3.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [14a3606d] + MozillaCACerts_jll v2025.11.4 [458c3c95] + OpenSSL_jll v3.5.6+0 [83775a58] + Zlib_jll v1.3.1+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 6.34s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompiling packages... 4484.6 ms ✓ UniLM 1 dependency successfully precompiled in 5 seconds. 61 already precompiled. 24 dependencies precompiled but different versions are currently loaded (ArgTools, Base64, Dates, Downloads, JuliaSyntaxHighlighting, LibCURL, LibCURL_jll, LibGit2, LibGit2_jll, LibSSH2_jll, Logging, Markdown, MozillaCACerts_jll, NetworkOptions, OpenSSL_jll, Pkg, Printf, StyledStrings, TOML, Tar, UUIDs, Zlib_jll, nghttp2_jll and p7zip_jll). Restart julia to access the new versions. Otherwise, 25 dependents of these packages may trigger further precompilation to work with the unexpected versions. Precompilation completed after 24.57s ################################################################################ # Testing # Testing UniLM Status `/tmp/jl_wrHuRk/Project.toml` [4c88cf16] Aqua v0.8.16 ⌅ [cd3eb016] HTTP v1.11.0 [c3a54625] JET v0.11.4 [682c06a0] JSON v1.6.1 [2a65a866] UniLM v0.6.0 [44cfe95a] Pkg v1.12.1 [6462fe0b] Sockets v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_wrHuRk/Manifest.toml` [4c88cf16] Aqua v0.8.16 [d1d4a3ce] BitFlags v0.1.10 [da1fd8a2] CodeTracking v3.0.2 [944b1d66] CodecZlib v0.7.8 [34da2185] Compat v4.18.1 [807dbc54] Compiler v0.1.1 [f0e56b4a] ConcurrentUtilities v2.5.1 [460bff9d] ExceptionUnwrapping v0.1.11 ⌅ [cd3eb016] HTTP v1.11.0 [c3a54625] JET v0.11.4 [692b3bcd] JLLWrappers v1.8.0 [682c06a0] JSON v1.6.1 [aa1ae85d] JuliaInterpreter v0.10.12 [70703baa] JuliaSyntax v1.0.2 [e6f89c97] LoggingExtras v1.2.0 ⌅ [6f1432cf] LoweredCodeUtils v3.5.3 [1914dd2f] MacroTools v0.5.16 [739be429] MbedTLS v1.1.10 [4d8831e6] OpenSSL v1.6.1 [bac558e1] OrderedCollections v2.0.0 [69de0a69] Parsers v2.8.6 [aea7be01] PrecompileTools v1.3.4 [21216c6a] Preferences v1.5.2 [295af30f] Revise v3.15.1 [777ac1f9] SimpleBufferStream v1.2.0 [ec057cc2] StructUtils v2.8.2 [3bb67fe8] TranscodingStreams v0.11.3 [5c2747f8] URIs v1.6.1 [2a65a866] UniLM v0.6.0 [c8ffd9c3] MbedTLS_jll v2.28.1010+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [8bf52ea8] CRC32c v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.1 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+0 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [458c3c95] OpenSSL_jll v3.5.6+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.7.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Precompiling packages... 8421.0 ms ✓ UniLM 1 dependency successfully precompiled in 9 seconds. 35 already precompiled. 35 dependencies precompiled but different versions are currently loaded (Base64, BitFlags, CodecZlib, ConcurrentUtilities, Dates, ExceptionUnwrapping, HTTP, InteractiveUtils, JLLWrappers, JSON, JuliaSyntaxHighlighting, Logging, LoggingExtras, Markdown, MbedTLS, MbedTLS_jll, MozillaCACerts_jll, NetworkOptions, OpenSSL, OpenSSL_jll, Parsers, PrecompileTools, Preferences, Printf, Serialization, SimpleBufferStream, StructUtils, StyledStrings, TOML, Test, TranscodingStreams, URIs, UUIDs, Unicode and Zlib_jll). Restart julia to access the new versions. Otherwise, 1 dependent of these packages may trigger further precompilation to work with the unexpected versions. ┌ Warning: Cannot add message Message("user", "hello", nothing, nothing, nothing, nothing, nothing) to conversation: Chat(UniLM.OPENAIServiceEndpoint, "gpt-5.2", Message[Message("system", "system prompt", nothing, nothing, nothing, nothing, nothing), Message("user", "hello", nothing, nothing, nothing, nothing, nothing)], true, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing) └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/api.jl:475 ┌ Warning: Cannot add message Message("system", "system prompt", nothing, nothing, nothing, nothing, nothing) to conversation: Chat(UniLM.OPENAIServiceEndpoint, "gpt-5.2", Message[Message("system", "system prompt", nothing, nothing, nothing, nothing, nothing), Message("user", "hello", nothing, nothing, nothing, nothing, nothing)], true, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing) └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/api.jl:475 ┌ Warning: Cannot remove last message from an empty conversation: Chat(UniLM.OPENAIServiceEndpoint, "gpt-5.2", Message[], true, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing) └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/api.jl:487 ┌ Warning: Cannot update chat with your message: chat history is disabled. └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/api.jl:505 ┌ Error: Request status: 401 └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:161 ┌ Error: Request status: 401 └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:161 ┌ Error: Request status: 401 └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:161 ┌ Error: Request status: 401 └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:161 ┌ Error: Request status: 401 └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:161 ┌ Error: Request status: 401 └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:259 [ Info: Listening on: 127.0.0.1:41479, thread id: 1 ┌ Warning: Request status: 500. └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:152 [ Info: Retrying... in 1s ┌ Warning: Request status: 503. └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:152 [ Info: Retrying... in 1s ┌ Warning: Request status: 503. └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:152 [ Info: Retrying... in 1s ┌ Error: Request status: 400 └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:161 ┌ Warning: Request status: 500. Retrying in 1s... └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/responses.jl:626 ┌ Warning: Request status: 503. Retrying in 1s... └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/responses.jl:626 ┌ Warning: Request status: 503. Retrying in 1s... └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/responses.jl:626 ┌ Warning: Request status: 500. Retrying in 1s... └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/images.jl:243 ┌ Warning: Request status: 503. Retrying in 1s... └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/images.jl:243 ┌ Warning: Request status: 503. Retrying in 1s... └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/images.jl:243 ┌ Error: Request status: 401 └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:259 WARNING: Method definition get_url(UniLM.Embeddings) in module UniLM at /home/pkgeval/.julia/packages/UniLM/8EtLH/src/requests.jl:5 overwritten in module Main at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/mock_server.jl:318. ┌ Warning: Request status: 500. Retrying... in 1s └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:250 ┌ Error: Max retries (30) exceeded for embedding request. └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:255 ┌ Warning: Request status: 503. Retrying... in 1s └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:250 ┌ Warning: Request status: 503. Retrying... in 1s └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:250 ┌ Error: Max retries (30) exceeded for embedding request. └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:255 WARNING: Method definition get_url(UniLM.Embeddings) in module Main at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/mock_server.jl:318 overwritten at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/mock_server.jl:341. ┌ Error: HTTP.Exceptions.ConnectError("http://127.0.0.1:1/v1/embeddings", CapturedException(Base.IOError("connect: connection refused (ECONNREFUSED)", -111), Any[(getconnection(::Type{TCPSocket}, host::SubString{String}, port::SubString{String}; keepalive::Bool, readtimeout::Int64, kw::Base.Pairs{Symbol, Union{Nothing, Integer}, Nothing, @NamedTuple{require_ssl_verification::Bool, iofunction::Nothing, decompress::Nothing, verbose::Int64, status_exception::Bool}}) at Connections.jl:527, 1), (getconnection at Connections.jl:504 [inlined], 1), (#13 at Connections.jl:463 [inlined], 1), (macro expansion at try_with_timeout.jl:92 [inlined], 1), ((::ConcurrentUtilities.var"#try_with_timeout##2#try_with_timeout##3"{Any, Channel{Any}, HTTP.Connections.var"#13#14"{TCPSocket, Bool, Bool, Base.Pairs{Symbol, Union{Nothing, Integer}, Nothing, @NamedTuple{readtimeout::Int64, iofunction::Nothing, decompress::Nothing, verbose::Int64, status_exception::Bool}}, SubString{String}, SubString{String}}, Timer})() at ConcurrentUtilities.jl:10, 1)])) └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:263 WARNING: Method definition get_url(UniLM.Embeddings) in module Main at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/mock_server.jl:341 overwritten at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/mock_server.jl:350. [ Info: Error: HTTP.Exceptions.ConnectError("http://127.0.0.1:1/v1/chat/completions", CapturedException(Base.IOError("connect: connection refused (ECONNREFUSED)", -111), Any[(getconnection(::Type{TCPSocket}, host::SubString{String}, port::SubString{String}; keepalive::Bool, readtimeout::Int64, kw::Base.Pairs{Symbol, Union{Nothing, Integer}, Nothing, @NamedTuple{require_ssl_verification::Bool, iofunction::Nothing, decompress::Nothing, verbose::Int64, status_exception::Bool}}) at Connections.jl:527, 1), (getconnection at Connections.jl:504 [inlined], 1), (#13 at Connections.jl:463 [inlined], 1), (macro expansion at try_with_timeout.jl:92 [inlined], 1), ((::ConcurrentUtilities.var"#try_with_timeout##2#try_with_timeout##3"{Any, Channel{Any}, HTTP.Connections.var"#13#14"{TCPSocket, Bool, Bool, Base.Pairs{Symbol, Union{Nothing, Integer}, Nothing, @NamedTuple{readtimeout::Int64, iofunction::Nothing, decompress::Nothing, verbose::Int64, status_exception::Bool}}, SubString{String}, SubString{String}}, Timer})() at ConcurrentUtilities.jl:10, 1)])) [ Info: Returning from chatrequest! [ Info: Server on 127.0.0.1:41479 closing [ Info: Error: KeyError("OPENAI_API_KEY") [ Info: Returning from chatrequest! regular conversation: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:8 Expression: cr isa LLMSuccess Evaluated: LLMCallError("KeyError(\"OPENAI_API_KEY\")", nothing, Chat(UniLM.OPENAIServiceEndpoint, "gpt-5.2", Message[Message("system", "Act as a helpful AI agent.", nothing, nothing, nothing, nothing, nothing), Message("user", "Please tell me a one-liner joke.", nothing, nothing, nothing, nothing, nothing)], true, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing)) isa LLMSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:2 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:8 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] regular conversation: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:1 Got exception outside of a @test FieldError: type LLMCallError has no field `message`, available fields: `error`, `status`, `self` Stacktrace: [1] getproperty(x::LLMCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:2 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:9 [inlined] [5] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [6] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:24 [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [8] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [12] top-level scope @ none:6 [13] eval(m::Module, e::Any) @ Core ./boot.jl:489 [14] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [15] _start() @ Base ./client.jl:550 [ Info: Error: KeyError("OPENAI_API_KEY") [ Info: Returning from chatrequest! regular conversation / kwargs with messages: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:25 Expression: cr isa LLMSuccess Evaluated: LLMCallError("KeyError(\"OPENAI_API_KEY\")", nothing, Chat(UniLM.OPENAIServiceEndpoint, "gpt-5.2", Message[Message("system", "Act as a helpful AI agent.", nothing, nothing, nothing, nothing, nothing), Message("user", "Say 'hello' and nothing else.", nothing, nothing, nothing, nothing, nothing)], true, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing)) isa LLMSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:19 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:25 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] regular conversation / kwargs with messages: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:18 Got exception outside of a @test FieldError: type LLMCallError has no field `message`, available fields: `error`, `status`, `self` Stacktrace: [1] getproperty(x::LLMCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:19 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:26 [inlined] [5] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [6] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:24 [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [8] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [12] top-level scope @ none:6 [13] eval(m::Module, e::Any) @ Core ./boot.jl:489 [14] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [15] _start() @ Base ./client.jl:550 [ Info: Error: KeyError("OPENAI_API_KEY") [ Info: Returning from chatrequest! regular conversation / kwargs / individual prompts: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:37 Expression: cr isa LLMSuccess Evaluated: LLMCallError("KeyError(\"OPENAI_API_KEY\")", nothing, Chat(UniLM.OPENAIServiceEndpoint, "gpt-5.2", Message[Message("system", "Act as a helpful AI agent.", nothing, nothing, nothing, nothing, nothing), Message("user", "Say 'hello' and nothing else.", nothing, nothing, nothing, nothing, nothing)], true, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing)) isa LLMSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:32 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:37 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] regular conversation / kwargs / individual prompts: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:31 Got exception outside of a @test FieldError: type LLMCallError has no field `message`, available fields: `error`, `status`, `self` Stacktrace: [1] getproperty(x::LLMCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:32 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:38 [inlined] [5] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [6] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:24 [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [8] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [12] top-level scope @ none:6 [13] eval(m::Module, e::Any) @ Core ./boot.jl:489 [14] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [15] _start() @ Base ./client.jl:550 [ Info: Error: KeyError("OPENAI_API_KEY") [ Info: Returning from chatrequest! kwargs with Message objects as prompts: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:48 Expression: cr isa LLMSuccess Evaluated: LLMCallError("KeyError(\"OPENAI_API_KEY\")", nothing, Chat(UniLM.OPENAIServiceEndpoint, "gpt-5.2", Message[Message("system", "You are helpful.", nothing, nothing, nothing, nothing, nothing), Message("user", "Say 'yes'.", nothing, nothing, nothing, nothing, nothing)], true, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing)) isa LLMSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:43 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:48 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] [ Info: Error: KeyError("OPENAI_API_KEY") [ Info: Returning from chatrequest! JSON_OBJECT: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:57 Expression: cr isa LLMSuccess Evaluated: LLMCallError("KeyError(\"OPENAI_API_KEY\")", nothing, Chat(UniLM.OPENAIServiceEndpoint, "gpt-5.2", Message[Message("system", "Act as a helpful AI agent. Always respond in JSON.", nothing, nothing, nothing, nothing, nothing), Message("user", "Tell me a joke in JSON format with keys 'setup' and 'punchline'.", nothing, nothing, nothing, nothing, nothing)], true, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, ResponseFormat("json_object", nothing), nothing, nothing, nothing, nothing)) isa LLMSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:52 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:57 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] JSON_OBJECT: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:51 Got exception outside of a @test FieldError: type LLMCallError has no field `message`, available fields: `error`, `status`, `self` Stacktrace: [1] getproperty(x::LLMCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:52 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:59 [inlined] [5] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [6] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:24 [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [8] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [12] top-level scope @ none:6 [13] eval(m::Module, e::Any) @ Core ./boot.jl:489 [14] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [15] _start() @ Base ./client.jl:550 [ Info: Error: KeyError("OPENAI_API_KEY") [ Info: Returning from chatrequest! JSON SCHEMA: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:83 Expression: cr isa LLMSuccess Evaluated: LLMCallError("KeyError(\"OPENAI_API_KEY\")", nothing, Chat(UniLM.OPENAIServiceEndpoint, "gpt-5.2", Message[Message("system", "Act as a helpful AI agent. Only answer in JSON.", nothing, nothing, nothing, nothing, nothing), Message("user", "What is the weather in New York?", nothing, nothing, nothing, nothing, nothing)], true, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, ResponseFormat("json_schema", UniLM.JsonSchemaAPI("get_current_weather", "Getting the current weather", Dict{String, Any}("properties" => Dict{String, Dict{String}}("location" => Dict("type" => "string", "description" => "The city and state, e.g. San Francisco, CA"), "unit" => Dict{String, Any}("type" => "string", "enum" => ["celsius", "fahrenheit"])), "additionalProperties" => false, "required" => ["location", "unit"], "type" => "object"))), nothing, nothing, nothing, nothing)) isa LLMSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:68 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:83 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] JSON SCHEMA: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:67 Got exception outside of a @test FieldError: type LLMCallError has no field `message`, available fields: `error`, `status`, `self` Stacktrace: [1] getproperty(x::LLMCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:68 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:85 [inlined] [5] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [6] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:24 [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [8] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [12] top-level scope @ none:6 [13] eval(m::Module, e::Any) @ Core ./boot.jl:489 [14] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [15] _start() @ Base ./client.jl:550 streaming: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:111 Expression: result isa LLMSuccess Evaluated: LLMCallError("KeyError(\"OPENAI_API_KEY\")", nothing, Chat(UniLM.OPENAIServiceEndpoint, "gpt-5.2", Message[Message("system", "Act as a helpful AI agent.", nothing, nothing, nothing, nothing, nothing), Message("user", "Say 'hello world' and nothing else.", nothing, nothing, nothing, nothing, nothing)], true, nothing, nothing, nothing, nothing, nothing, nothing, true, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing)) isa LLMSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:94 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:111 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] streaming: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:93 Got exception outside of a @test FieldError: type LLMCallError has no field `message`, available fields: `error`, `status`, `self` Stacktrace: [1] getproperty(x::LLMCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:94 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:112 [inlined] [5] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [6] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:24 [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [8] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [12] top-level scope @ none:6 [13] eval(m::Module, e::Any) @ Core ./boot.jl:489 [14] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [15] _start() @ Base ./client.jl:550 [ Info: Error: KeyError("OPENAI_API_KEY") [ Info: Returning from chatrequest! function call: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:143 Expression: cr isa LLMSuccess Evaluated: LLMCallError("KeyError(\"OPENAI_API_KEY\")", nothing, Chat(UniLM.OPENAIServiceEndpoint, "gpt-5.2", Message[Message("system", "Act as a helpful AI agent. Always use the provided tools.", nothing, nothing, nothing, nothing, nothing), Message("user", "What is the weather in New York?", nothing, nothing, nothing, nothing, nothing)], true, GPTTool[GPTTool("function", GPTFunctionSignature("get_current_weather", "Getting the current weather", Dict{String, Any}("properties" => Dict{String, Dict{String}}("location" => Dict("type" => "string", "description" => "The city and state, e.g. San Francisco, CA"), "unit" => Dict{String, Any}("type" => "string", "enum" => ["celsius", "fahrenheit"])), "required" => ["location"], "type" => "object")))], UniLM.GPTToolChoice("function", :get_current_weather), false, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing)) isa LLMSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:122 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:143 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] function call: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:121 Got exception outside of a @test FieldError: type LLMCallError has no field `message`, available fields: `error`, `status`, `self` Stacktrace: [1] getproperty(x::LLMCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:122 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:145 [inlined] [5] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [6] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:24 [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [8] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [12] top-level scope @ none:6 [13] eval(m::Module, e::Any) @ Core ./boot.jl:489 [14] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [15] _start() @ Base ./client.jl:550 ┌ Error: KeyError("OPENAI_API_KEY") └ @ UniLM ~/.julia/packages/UniLM/8EtLH/src/requests.jl:263 embedding: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:165 Expression: result isa Tuple Evaluated: nothing isa Tuple Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:160 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:165 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] embedding: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:166 Expression: !(all((x->begin #= /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:166 =# x == 0.0 end), emb.embeddings)) Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:160 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:166 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] [ Info: Error: KeyError("OPENAI_API_KEY") [ Info: Returning from chatrequest! conversation with temperature: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:176 Expression: cr isa LLMSuccess Evaluated: LLMCallError("KeyError(\"OPENAI_API_KEY\")", nothing, Chat(UniLM.OPENAIServiceEndpoint, "gpt-5.2", Message[Message("system", "You are a calculator.", nothing, nothing, nothing, nothing, nothing), Message("user", "What is 2+2? Answer with just the number.", nothing, nothing, nothing, nothing, nothing)], true, nothing, nothing, nothing, 0.0, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing)) isa LLMSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:171 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:176 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] conversation with temperature: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:177 Test threw exception Expression: occursin("4", cr.message.content) FieldError: type LLMCallError has no field `message`, available fields: `error`, `status`, `self` Stacktrace: [1] getproperty(x::LLMCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:171 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:177 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] [ Info: Error: KeyError("OPENAI_API_KEY") [ Info: Returning from chatrequest! chat with seed for reproducibility: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:186 Expression: cr isa LLMSuccess Evaluated: LLMCallError("KeyError(\"OPENAI_API_KEY\")", nothing, Chat(UniLM.OPENAIServiceEndpoint, "gpt-5.2", Message[Message("system", "You are a calculator.", nothing, nothing, nothing, nothing, nothing), Message("user", "What is 1+1? Answer with just the number.", nothing, nothing, nothing, nothing, nothing)], true, nothing, nothing, nothing, 0.0, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, nothing, 42)) isa LLMSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:181 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:186 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] chat with seed for reproducibility: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:187 Test threw exception Expression: occursin("2", cr.message.content) FieldError: type LLMCallError has no field `message`, available fields: `error`, `status`, `self` Stacktrace: [1] getproperty(x::LLMCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:181 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:187 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Responses API — basic text: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:194 Expression: r isa ResponseSuccess Evaluated: ResponseCallError("KeyError(\"OPENAI_API_KEY\")", nothing) isa ResponseSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:193 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:194 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Responses API — basic text: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:195 Test threw exception Expression: r.response.status == "completed" FieldError: type ResponseCallError has no field `response`, available fields: `error`, `status` Stacktrace: [1] getproperty(x::ResponseCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:193 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:195 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Responses API — basic text: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:197 Test threw exception Expression: !(isnothing(r.response.id)) FieldError: type ResponseCallError has no field `response`, available fields: `error`, `status` Stacktrace: [1] getproperty(x::ResponseCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:193 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:197 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] [6] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:197 [inlined] Responses API — basic text: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:198 Test threw exception Expression: !(isnothing(r.response.model)) FieldError: type ResponseCallError has no field `response`, available fields: `error`, `status` Stacktrace: [1] getproperty(x::ResponseCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:193 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:198 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] [6] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:198 [inlined] Responses API — basic text: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:199 Test threw exception Expression: !(isnothing(r.response.usage)) FieldError: type ResponseCallError has no field `response`, available fields: `error`, `status` Stacktrace: [1] getproperty(x::ResponseCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:193 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:199 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] [6] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:199 [inlined] Responses API — with instructions: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:207 Expression: r isa ResponseSuccess Evaluated: ResponseCallError("KeyError(\"OPENAI_API_KEY\")", nothing) isa ResponseSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:203 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:207 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Responses API — multi-turn: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:214 Expression: r1 isa ResponseSuccess Evaluated: ResponseCallError("KeyError(\"OPENAI_API_KEY\")", nothing) isa ResponseSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:213 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:214 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Responses API — multi-turn: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:215 Expression: occursin("42", output_text(r1)) Evaluated: occursin("42", "Error: KeyError(\"OPENAI_API_KEY\")") Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:213 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:215 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Responses API — multi-turn: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:212 Got exception outside of a @test FieldError: type ResponseCallError has no field `response`, available fields: `error`, `status` Stacktrace: [1] getproperty(x::ResponseCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:213 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:217 [inlined] [5] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [6] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:24 [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [8] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [12] top-level scope @ none:6 [13] eval(m::Module, e::Any) @ Core ./boot.jl:489 [14] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [15] _start() @ Base ./client.jl:550 Responses API — structured output (json_schema_format): Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:237 Expression: r isa ResponseSuccess Evaluated: ResponseCallError("KeyError(\"OPENAI_API_KEY\")", nothing) isa ResponseSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:223 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:237 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Responses API — structured output (json_schema_format): Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:222 Got exception outside of a @test ArgumentError: invalid JSON at byte position 1 (line 1) parsing type Any: InvalidJSON Error: KeyError("OPEN... ^ Stacktrace: [1] invalid(error::JSON.Error, buf::String, pos::Int64, T::Type) @ JSON ~/.julia/packages/JSON/gMdcG/src/JSON.jl:56 [2] _lazy(buf::String, pos::Int64, len::Int64, b::UInt8, opts::JSON.LazyOptions, isroot::Bool) @ JSON ~/.julia/packages/JSON/gMdcG/src/lazy.jl:248 [3] lazy(buf::String; isroot::Bool, kw::@Kwargs{}) @ JSON ~/.julia/packages/JSON/gMdcG/src/lazy.jl:121 [4] lazy @ ~/.julia/packages/JSON/gMdcG/src/lazy.jl:93 [inlined] [5] parse @ ~/.julia/packages/JSON/gMdcG/src/parse.jl:220 [inlined] [6] parse(buf::String) @ JSON ~/.julia/packages/JSON/gMdcG/src/parse.jl:220 [7] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:223 [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [9] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:239 [inlined] [10] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [11] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:24 [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [13] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [15] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [16] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [17] top-level scope @ none:6 [18] eval(m::Module, e::Any) @ Core ./boot.jl:489 [19] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [20] _start() @ Base ./client.jl:550 Responses API — function calling: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:262 Expression: r isa ResponseSuccess Evaluated: ResponseCallError("KeyError(\"OPENAI_API_KEY\")", nothing) isa ResponseSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:247 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:262 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Responses API — function calling: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:265 Expression: length(calls) >= 1 Evaluated: 0 >= 1 Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:247 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:265 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Responses API — function calling: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:266 Test threw exception Expression: (calls[1])["name"] == "get_temperature" BoundsError: attempt to access 0-element Vector{Dict{String, Any}} at index [1] Stacktrace: [1] throw_boundserror(A::Vector{Dict{String, Any}}, I::Tuple{Int64}) @ Base ./essentials.jl:15 [2] getindex(A::Vector{Dict{String, Any}}, i::Int64) @ Base ./essentials.jl:919 [3] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:247 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [5] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:266 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Responses API — function calling: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:246 Got exception outside of a @test BoundsError: attempt to access 0-element Vector{Dict{String, Any}} at index [1] Stacktrace: [1] throw_boundserror(A::Vector{Dict{String, Any}}, I::Tuple{Int64}) @ Base ./essentials.jl:15 [2] getindex(A::Vector{Dict{String, Any}}, i::Int64) @ Base ./essentials.jl:919 [3] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:247 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [5] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:268 [inlined] [6] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [7] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:24 [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [9] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [11] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [12] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [13] top-level scope @ none:6 [14] eval(m::Module, e::Any) @ Core ./boot.jl:489 [15] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [16] _start() @ Base ./client.jl:550 Responses API — web search: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:278 Expression: r isa ResponseSuccess Evaluated: ResponseCallError("KeyError(\"OPENAI_API_KEY\")", nothing) isa ResponseSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:274 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:278 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Responses API — web search: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:281 Expression: occursin(r"[Jj]ulia", text) Evaluated: occursin(r"[Jj]ulia", "Error: KeyError(\"OPENAI_API_KEY\")") Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:274 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:281 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Responses API — streaming: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:297 Expression: r isa ResponseSuccess Evaluated: ResponseCallError("KeyError(\"OPENAI_API_KEY\")", nothing) isa ResponseSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:285 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:297 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Responses API — streaming: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:299 Expression: !(isempty(chunks)) Evaluated: !(isempty(String[])) Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:285 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:299 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Image Generation — basic: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:310 Expression: r isa ImageSuccess Evaluated: ImageCallError("KeyError(\"OPENAI_API_KEY\")", nothing) isa ImageSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:305 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:310 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Image Generation — basic: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:311 Test threw exception Expression: !(isnothing(r.response)) FieldError: type ImageCallError has no field `response`, available fields: `error`, `status` Stacktrace: [1] getproperty(x::ImageCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:305 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:311 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] [6] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:311 [inlined] Image Generation — basic: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:312 Test threw exception Expression: length(r.response.data) >= 1 FieldError: type ImageCallError has no field `response`, available fields: `error`, `status` Stacktrace: [1] getproperty(x::ImageCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:305 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:312 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Image Generation — basic: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:313 Test threw exception Expression: !(isnothing((r.response.data[1]).b64_json)) FieldError: type ImageCallError has no field `response`, available fields: `error`, `status` Stacktrace: [1] getproperty(x::ImageCallError, f::Symbol) @ Base ./Base_compiler.jl:54 [2] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:305 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [4] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:313 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] [6] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:313 [inlined] Image Generation — image_data accessor: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:322 Expression: r isa ImageSuccess Evaluated: ImageCallError("KeyError(\"OPENAI_API_KEY\")", nothing) isa ImageSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:317 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:322 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Image Generation — image_data accessor: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:326 Expression: length(imgs) >= 1 Evaluated: 0 >= 1 Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:317 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:326 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Image Generation — image_data accessor: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:327 Test threw exception Expression: length(imgs[1]) > 100 BoundsError: attempt to access 0-element Vector{String} at index [1] Stacktrace: [1] throw_boundserror(A::Vector{String}, I::Tuple{Int64}) @ Base ./essentials.jl:15 [2] getindex(A::Vector{String}, i::Int64) @ Base ./essentials.jl:919 [3] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:317 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [5] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:327 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Image Generation — save_image: Test Failed at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:336 Expression: r isa ImageSuccess Evaluated: ImageCallError("KeyError(\"OPENAI_API_KEY\")", nothing) isa ImageSuccess Stacktrace: [1] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:331 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:336 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Image Generation — save_image: Error During Test at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/integration.jl:330 Got exception outside of a @test BoundsError: attempt to access 0-element Vector{String} at index [1] Stacktrace: [1] throw_boundserror(A::Vector{String}, I::Tuple{Int64}) @ Base ./essentials.jl:15 [2] getindex(A::Vector{String}, i::Int64) @ Base ./essentials.jl:919 [3] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:331 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [5] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/integration.jl:340 [inlined] [6] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [7] top-level scope @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:24 [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [9] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [11] macro expansion @ ~/.julia/packages/UniLM/8EtLH/test/runtests.jl:58 [inlined] [12] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [13] top-level scope @ none:6 [14] eval(m::Module, e::Any) @ Core ./boot.jl:489 [15] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [16] _start() @ Base ./client.jl:550 Test Summary: | Pass Fail Error Total Time UniLM.jl | 652 27 22 701 7m07.2s Aqua.jl quality checks | 10 10 56.8s Type Stability (JET.jl) | 1 1 3m15.5s api.jl | 237 237 22.6s requests.jl | 65 65 1m05.0s responses.jl | 195 195 21.4s images.jl | 68 68 4.4s mock server | 69 69 44.3s integration | 7 27 22 56 17.4s regular conversation | 1 1 2 7.9s regular conversation / kwargs with messages | 1 1 2 0.2s regular conversation / kwargs / individual prompts | 1 1 2 0.1s kwargs with Message objects as prompts | 1 1 0.4s JSON_OBJECT | 1 1 2 0.1s JSON SCHEMA | 1 1 2 2.4s streaming | 1 1 2 0.6s function call | 1 1 2 1.8s embedding | 2 2 4 0.3s conversation with temperature | 1 1 2 0.3s chat with seed for reproducibility | 1 1 2 0.1s Responses API — basic text | 1 1 4 6 0.1s Responses API — with instructions | 1 1 2 0.1s Responses API — multi-turn | 2 1 3 0.0s Responses API — structured output (json_schema_format) | 1 1 2 0.5s Responses API — function calling | 2 2 4 0.9s Responses API — web search | 1 2 3 0.6s Responses API — streaming | 1 2 3 0.5s Image Generation — basic | 1 3 4 0.1s Image Generation — image_data accessor | 1 2 1 4 0.0s Image Generation — save_image | 1 1 2 0.0s RNG of the outermost testset: Random.Xoshiro(0x7642d1cc0743f474, 0xbd9107f89f803290, 0xcec3ee7eaeb02467, 0x3bfc875b190fc2a3, 0x5cb145acfea3949c) ERROR: LoadError: Some tests did not pass: 652 passed, 27 failed, 22 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/UniLM/8EtLH/test/runtests.jl:23 Testing failed after 450.74s ERROR: LoadError: Package UniLM errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2538 [3] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2387 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:552 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:169 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [7] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:156 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 [10] include(mod::Module, _path::String) @ Base ./Base.jl:306 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:317 [12] _start() @ Base ./client.jl:550 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 526.75s: networking-related issues were detected