Package evaluation to test OpenAI on Julia 1.12.7-DEV.42 (6f510b6086*) started at 2026-06-19T18:07:21.811 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.12` Set-up completed after 7.98s ################################################################################ # Installation # Installing OpenAI... Resolving package versions... Updating `~/.julia/environments/v1.12/Project.toml` [e9f21f70] + OpenAI v0.13.0 Updating `~/.julia/environments/v1.12/Manifest.toml` [d1d4a3ce] + BitFlags v0.1.10 [944b1d66] + CodecZlib v0.7.8 [34da2185] + Compat v4.18.1 [f0e56b4a] + ConcurrentUtilities v2.5.1 [460bff9d] + ExceptionUnwrapping v0.1.11 [e2ba6199] + ExprTools v0.1.10 ⌅ [cd3eb016] + HTTP v1.11.0 [842dd82b] + InlineStrings v1.4.5 [692b3bcd] + JLLWrappers v1.8.0 [682c06a0] + JSON v1.6.1 [0f8b85d8] + JSON3 v1.14.3 [e6f89c97] + LoggingExtras v1.2.0 [6c6e2e6c] + MIMEs v1.1.0 [739be429] + MbedTLS v1.1.10 [78c3b35d] + Mocking v0.8.1 [e9f21f70] + OpenAI v0.13.0 [d5e62ea6] + OpenAPI v0.2.2 [4d8831e6] + OpenSSL v1.6.1 [69de0a69] + Parsers v2.8.6 [aea7be01] + PrecompileTools v1.3.4 [21216c6a] + Preferences v1.5.2 [6c6a2e73] + Scratch v1.3.0 [777ac1f9] + SimpleBufferStream v1.2.0 ⌅ [c1b9e933] + StreamCallbacks v0.6.2 [856f2bd8] + StructTypes v1.11.0 [ec057cc2] + StructUtils v2.8.2 [dc5dba14] + TZJData v1.5.0+2025b [f269a46b] + TimeZones v1.22.2 [3bb67fe8] + TranscodingStreams v0.11.3 [5c2747f8] + URIs v1.6.1 [c8ffd9c3] + MbedTLS_jll v2.28.1010+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.15.0+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.11.4 [458c3c95] + OpenSSL_jll v3.5.6+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850ede] + nghttp2_jll v1.64.0+1 [3f19e933] + p7zip_jll v17.7.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 5.87s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 20.03s ################################################################################ # Testing # Testing OpenAI Status `/tmp/jl_OGnb1q/Project.toml` ⌅ [cd3eb016] HTTP v1.11.0 [c3a54625] JET v0.11.4 [0f8b85d8] JSON3 v1.14.3 [e9f21f70] OpenAI v0.13.0 [d5e62ea6] OpenAPI v0.2.2 ⌅ [c1b9e933] StreamCallbacks v0.6.2 [f269a46b] TimeZones v1.22.2 [ade2ca70] Dates v1.11.0 [44cfe95a] Pkg v1.12.1 [6462fe0b] Sockets v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_OGnb1q/Manifest.toml` [d1d4a3ce] BitFlags v0.1.10 [da1fd8a2] CodeTracking v3.0.2 [944b1d66] CodecZlib v0.7.8 [34da2185] Compat v4.18.1 [807dbc54] Compiler v0.1.1 [f0e56b4a] ConcurrentUtilities v2.5.1 [460bff9d] ExceptionUnwrapping v0.1.11 [e2ba6199] ExprTools v0.1.10 ⌅ [cd3eb016] HTTP v1.11.0 [842dd82b] InlineStrings v1.4.5 [c3a54625] JET v0.11.4 [692b3bcd] JLLWrappers v1.8.0 [682c06a0] JSON v1.6.1 [0f8b85d8] JSON3 v1.14.3 [aa1ae85d] JuliaInterpreter v0.10.12 [70703baa] JuliaSyntax v1.0.2 [e6f89c97] LoggingExtras v1.2.0 ⌅ [6f1432cf] LoweredCodeUtils v3.5.3 [6c6e2e6c] MIMEs v1.1.0 [1914dd2f] MacroTools v0.5.16 [739be429] MbedTLS v1.1.10 [78c3b35d] Mocking v0.8.1 [e9f21f70] OpenAI v0.13.0 [d5e62ea6] OpenAPI v0.2.2 [4d8831e6] OpenSSL v1.6.1 [bac558e1] OrderedCollections v2.0.0 [69de0a69] Parsers v2.8.6 [aea7be01] PrecompileTools v1.3.4 [21216c6a] Preferences v1.5.2 [295af30f] Revise v3.15.1 [6c6a2e73] Scratch v1.3.0 [777ac1f9] SimpleBufferStream v1.2.0 ⌅ [c1b9e933] StreamCallbacks v0.6.2 [856f2bd8] StructTypes v1.11.0 [ec057cc2] StructUtils v2.8.2 [dc5dba14] TZJData v1.5.0+2025b [f269a46b] TimeZones v1.22.2 [3bb67fe8] TranscodingStreams v0.11.3 [5c2747f8] URIs v1.6.1 [c8ffd9c3] MbedTLS_jll v2.28.1010+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [8bf52ea8] CRC32c v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.1 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+0 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [458c3c95] OpenSSL_jll v3.5.6+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.7.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... generated OpenAPI client: Error During Test at /home/pkgeval/.julia/packages/OpenAI/kupl7/test/openapi_client.jl:1 Got exception outside of a @test KeyError: key "OPENAI_API_KEY" not found Stacktrace: [1] (::Base.var"#getindex##11#getindex##12")(k::String) @ Base ./env.jl:164 [2] access_env(onError::Base.var"#getindex##11#getindex##12", var::String) @ Base ./env.jl:60 [3] getindex(::Base.EnvDict, k::String) @ Base ./env.jl:164 [4] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/openapi_client.jl:2 [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [6] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/openapi_client.jl:13 [inlined] [7] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [8] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:23 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:27 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [12] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:27 [inlined] [13] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [14] top-level scope @ none:6 [15] eval(m::Module, e::Any) @ Core ./boot.jl:489 [16] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [17] _start() @ Base ./client.jl:550 models: Error During Test at /home/pkgeval/.julia/packages/OpenAI/kupl7/test/models.jl:1 Got exception outside of a @test KeyError: key "OPENAI_API_KEY" not found Stacktrace: [1] (::Base.var"#getindex##11#getindex##12")(k::String) @ Base ./env.jl:164 [2] access_env(onError::Base.var"#getindex##11#getindex##12", var::String) @ Base ./env.jl:60 [3] getindex(::Base.EnvDict, k::String) @ Base ./env.jl:164 [4] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/models.jl:2 [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [6] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/models.jl:2 [inlined] [7] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [8] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:23 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:30 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [12] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:30 [inlined] [13] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [14] top-level scope @ none:6 [15] eval(m::Module, e::Any) @ Core ./boot.jl:489 [16] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [17] _start() @ Base ./client.jl:550 chatcompletion: Error During Test at /home/pkgeval/.julia/packages/OpenAI/kupl7/test/chatcompletion.jl:1 Got exception outside of a @test KeyError: key "OPENAI_API_KEY" not found Stacktrace: [1] (::Base.var"#getindex##11#getindex##12")(k::String) @ Base ./env.jl:164 [2] access_env(onError::Base.var"#getindex##11#getindex##12", var::String) @ Base ./env.jl:60 [3] getindex(::Base.EnvDict, k::String) @ Base ./env.jl:164 [4] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/chatcompletion.jl:2 [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [6] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/chatcompletion.jl:2 [inlined] [7] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [8] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:23 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:33 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [12] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:33 [inlined] [13] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [14] top-level scope @ none:6 [15] eval(m::Module, e::Any) @ Core ./boot.jl:489 [16] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [17] _start() @ Base ./client.jl:550 chatcompletion - streaming: Error During Test at /home/pkgeval/.julia/packages/OpenAI/kupl7/test/chatcompletion.jl:24 Got exception outside of a @test KeyError: key "OPENAI_API_KEY" not found Stacktrace: [1] (::Base.var"#getindex##11#getindex##12")(k::String) @ Base ./env.jl:164 [2] access_env(onError::Base.var"#getindex##11#getindex##12", var::String) @ Base ./env.jl:60 [3] getindex(::Base.EnvDict, k::String) @ Base ./env.jl:164 [4] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/chatcompletion.jl:25 [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [6] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/chatcompletion.jl:26 [inlined] [7] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [8] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:23 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:33 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [12] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:33 [inlined] [13] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [14] top-level scope @ none:6 [15] eval(m::Module, e::Any) @ Core ./boot.jl:489 [16] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [17] _start() @ Base ./client.jl:550 completion: Error During Test at /home/pkgeval/.julia/packages/OpenAI/kupl7/test/completion.jl:1 Got exception outside of a @test KeyError: key "OPENAI_API_KEY" not found Stacktrace: [1] (::Base.var"#getindex##11#getindex##12")(k::String) @ Base ./env.jl:164 [2] access_env(onError::Base.var"#getindex##11#getindex##12", var::String) @ Base ./env.jl:60 [3] getindex(::Base.EnvDict, k::String) @ Base ./env.jl:164 [4] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/completion.jl:2 [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [6] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/completion.jl:2 [inlined] [7] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [8] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:23 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:36 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [12] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:36 [inlined] [13] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [14] top-level scope @ none:6 [15] eval(m::Module, e::Any) @ Core ./boot.jl:489 [16] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [17] _start() @ Base ./client.jl:550 single input string: Error During Test at /home/pkgeval/.julia/packages/OpenAI/kupl7/test/embeddings.jl:1 Got exception outside of a @test KeyError: key "OPENAI_API_KEY" not found Stacktrace: [1] (::Base.var"#getindex##11#getindex##12")(k::String) @ Base ./env.jl:164 [2] access_env(onError::Base.var"#getindex##11#getindex##12", var::String) @ Base ./env.jl:60 [3] getindex(::Base.EnvDict, k::String) @ Base ./env.jl:164 [4] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/embeddings.jl:2 [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [6] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/embeddings.jl:2 [inlined] [7] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [8] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:23 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:39 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [12] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:39 [inlined] [13] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [14] top-level scope @ none:6 [15] eval(m::Module, e::Any) @ Core ./boot.jl:489 [16] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [17] _start() @ Base ./client.jl:550 multiple input strings: Error During Test at /home/pkgeval/.julia/packages/OpenAI/kupl7/test/embeddings.jl:8 Got exception outside of a @test KeyError: key "OPENAI_API_KEY" not found Stacktrace: [1] (::Base.var"#getindex##11#getindex##12")(k::String) @ Base ./env.jl:164 [2] access_env(onError::Base.var"#getindex##11#getindex##12", var::String) @ Base ./env.jl:60 [3] getindex(::Base.EnvDict, k::String) @ Base ./env.jl:164 [4] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/embeddings.jl:9 [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [6] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/embeddings.jl:9 [inlined] [7] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [8] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:23 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:39 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [12] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:39 [inlined] [13] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [14] top-level scope @ none:6 [15] eval(m::Module, e::Any) @ Core ./boot.jl:489 [16] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [17] _start() @ Base ./client.jl:550 single input token array: Error During Test at /home/pkgeval/.julia/packages/OpenAI/kupl7/test/embeddings.jl:23 Got exception outside of a @test KeyError: key "OPENAI_API_KEY" not found Stacktrace: [1] (::Base.var"#getindex##11#getindex##12")(k::String) @ Base ./env.jl:164 [2] access_env(onError::Base.var"#getindex##11#getindex##12", var::String) @ Base ./env.jl:60 [3] getindex(::Base.EnvDict, k::String) @ Base ./env.jl:164 [4] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/embeddings.jl:24 [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [6] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/embeddings.jl:24 [inlined] [7] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [8] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:23 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:39 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [12] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:39 [inlined] [13] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [14] top-level scope @ none:6 [15] eval(m::Module, e::Any) @ Core ./boot.jl:489 [16] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [17] _start() @ Base ./client.jl:550 multiple input token arrays: Error During Test at /home/pkgeval/.julia/packages/OpenAI/kupl7/test/embeddings.jl:30 Got exception outside of a @test KeyError: key "OPENAI_API_KEY" not found Stacktrace: [1] (::Base.var"#getindex##11#getindex##12")(k::String) @ Base ./env.jl:164 [2] access_env(onError::Base.var"#getindex##11#getindex##12", var::String) @ Base ./env.jl:60 [3] getindex(::Base.EnvDict, k::String) @ Base ./env.jl:164 [4] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/embeddings.jl:31 [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [6] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/embeddings.jl:31 [inlined] [7] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [8] top-level scope @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:23 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [10] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:39 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [12] macro expansion @ ~/.julia/packages/OpenAI/kupl7/test/runtests.jl:39 [inlined] [13] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [14] top-level scope @ none:6 [15] eval(m::Module, e::Any) @ Core ./boot.jl:489 [16] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [17] _start() @ Base ./client.jl:550 [ Info: Listening on: 127.0.0.1:9178, thread id: 1 [ Info: Server on 127.0.0.1:9178 closing Test Summary: | Pass Error Total Time OpenAI.jl | 10 9 19 51.3s openapi_client | 6 1 7 4.5s generated OpenAPI client | 6 1 7 4.3s models | 1 1 0.0s models | 1 1 0.0s chatcompletion | 2 2 0.1s chatcompletion | 1 1 0.0s chatcompletion - streaming | 1 1 0.0s completion | 1 1 0.0s completion | 1 1 0.0s embeddings | 4 4 0.1s single input string | 1 1 0.0s multiple input strings | 1 1 0.0s single input token array | 1 1 0.0s multiple input token arrays | 1 1 0.0s streamcallbacks | 4 4 46.6s RNG of the outermost testset: Random.Xoshiro(0xb329c33c14a47440, 0xb9a22482cefdb6a6, 0x58997b0a55346662, 0x7f64c9cdb3e829ce, 0x16d11c9816fcbcbe) ERROR: LoadError: Some tests did not pass: 10 passed, 0 failed, 9 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/OpenAI/kupl7/test/runtests.jl:22 Testing failed after 94.34s ERROR: LoadError: Package OpenAI errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2538 [3] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2387 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:552 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:169 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [7] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:156 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 [10] include(mod::Module, _path::String) @ Base ./Base.jl:306 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:317 [12] _start() @ Base ./client.jl:550 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 143.74s: package tests unexpectedly errored