Package evaluation of PromptingTools on Julia 1.13.0-DEV.140 (fac1ce7906*) started at 2025-03-02T10:28:35.455 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 7.54s ################################################################################ # Installation # Installing PromptingTools... Resolving package versions... Updating `~/.julia/environments/v1.13/Project.toml` [670122d1] + PromptingTools v0.73.0 Updating `~/.julia/environments/v1.13/Manifest.toml` [1520ce14] + AbstractTrees v0.4.5 [d1d4a3ce] + BitFlags v0.1.9 [944b1d66] + CodecZlib v0.7.8 [f0e56b4a] + ConcurrentUtilities v2.5.0 [460bff9d] + ExceptionUnwrapping v0.1.11 [cd3eb016] + HTTP v1.10.15 [692b3bcd] + JLLWrappers v1.7.0 [0f8b85d8] + JSON3 v1.14.1 [e6f89c97] + LoggingExtras v1.1.0 [739be429] + MbedTLS v1.1.9 ⌅ [e9f21f70] + OpenAI v0.9.1 [4d8831e6] + OpenSSL v1.4.3 [69de0a69] + Parsers v2.8.1 [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [670122d1] + PromptingTools v0.73.0 [777ac1f9] + SimpleBufferStream v1.2.0 [c1b9e933] + StreamCallbacks v0.6.0 [856f2bd8] + StructTypes v1.11.0 [3bb67fe8] + TranscodingStreams v0.11.3 [5c2747f8] + URIs v1.5.1 [c8ffd9c3] + MbedTLS_jll v2.28.6+2 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.12.0 [de0858da] + Printf v1.11.0 [3fa0cd96] + REPL v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.11.1+1 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2024.12.31 [458c3c95] + OpenSSL_jll v3.0.16+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850ede] + nghttp2_jll v1.64.0+1 [3f19e933] + p7zip_jll v17.5.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 1.97s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 302.57s ################################################################################ # Testing # Testing PromptingTools Status `/tmp/jl_QhYvV9/Project.toml` [1520ce14] AbstractTrees v0.4.5 ⌅ [4c88cf16] Aqua v0.7.4 [22cc3f58] FlashRank v0.4.1 [cd3eb016] HTTP v1.10.15 [0f8b85d8] JSON3 v1.14.1 ⌅ [e9f21f70] OpenAI v0.9.1 [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [670122d1] PromptingTools v0.73.0 [fb8f903a] Snowball v0.1.1 [10745b16] Statistics v1.11.1 [c1b9e933] StreamCallbacks v0.6.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [44cfe95a] Pkg v1.12.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [2f01184e] SparseArrays v1.12.0 [8dfed614] Test v1.11.0 [4ec0a83e] Unicode v1.11.0 Status `/tmp/jl_QhYvV9/Manifest.toml` [1520ce14] AbstractTrees v0.4.5 ⌅ [4c88cf16] Aqua v0.7.4 [dce04be8] ArgCheck v2.4.0 [d1d4a3ce] BitFlags v0.1.9 [fa961155] CEnum v0.5.0 [944b1d66] CodecZlib v0.7.8 [34da2185] Compat v4.16.0 [f0e56b4a] ConcurrentUtilities v2.5.0 [124859b0] DataDeps v0.7.13 [864edb3b] DataStructures v0.18.20 [ffbed154] DocStringExtensions v0.9.3 [abbaa0e5] DoubleArrayTries v0.1.1 [460bff9d] ExceptionUnwrapping v0.1.11 [22cc3f58] FlashRank v0.4.1 [7693890a] HTML_Entities v1.0.1 [cd3eb016] HTTP v1.10.15 [692b3bcd] JLLWrappers v1.7.0 [682c06a0] JSON v0.21.4 [0f8b85d8] JSON3 v1.14.1 [8ef0a80b] Languages v0.4.6 [e6f89c97] LoggingExtras v1.1.0 [739be429] MbedTLS v1.1.9 [e034b28e] ONNXRunTime v1.3.1 [6fe1bfb0] OffsetArrays v1.15.0 ⌅ [e9f21f70] OpenAI v0.9.1 [4d8831e6] OpenSSL v1.4.3 [bac558e1] OrderedCollections v1.8.0 [69de0a69] Parsers v2.8.1 [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [670122d1] PromptingTools v0.73.0 [189a3867] Reexport v1.2.2 [05181044] RelocatableFolders v1.0.1 [6c6a2e73] Scratch v1.2.1 [777ac1f9] SimpleBufferStream v1.2.0 [fb8f903a] Snowball v0.1.1 [10745b16] Statistics v1.11.1 [9700d1a9] StrTables v1.0.1 [c1b9e933] StreamCallbacks v0.6.0 [354b36f9] StringViews v1.3.4 [856f2bd8] StructTypes v1.11.0 [3bb67fe8] TranscodingStreams v0.11.3 [5c2747f8] URIs v1.5.1 [796a5d58] WordTokenizers v0.5.6 [c8ffd9c3] MbedTLS_jll v2.28.6+2 [88f46535] Snowball_jll v2.2.0+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [4af54fe1] LazyArtifacts v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.12.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.11.1+1 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2024.12.31 [4536629a] OpenBLAS_jll v0.3.29+0 [458c3c95] OpenSSL_jll v3.0.16+0 [bea87d4a] SuiteSparse_jll v7.8.3+2 [83775a58] Zlib_jll v1.3.1+2 [8e850b90] libblastrampoline_jll v5.12.0+0 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.5.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... ┌ Warning: OPENAI_API_KEY variable not set! OpenAI models will not be available - set API key directly via `PromptingTools.OPENAI_API_KEY=`! └ @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/user_preferences.jl:189 Precompiling packages... 8796.2 ms ✓ Aqua 1 dependency successfully precompiled in 9 seconds. 30 already precompiled. ┌ Warning: OPENAI_API_KEY variable not set! OpenAI models will not be available - set API key directly via `PromptingTools.OPENAI_API_KEY=`! └ @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/user_preferences.jl:189 Skipping Base.active_repl Skipping Base.MainInclude.Distributed Skipping Base.MainInclude.InteractiveUtils ┌ Warning: `isbindingresolved(m::Module, var::Symbol)` is deprecated, use `true` instead. │ caller = walkmodules(f::Aqua.var"#undefined_exports##0#undefined_exports##1"{Vector{Symbol}}, x::Module) at exports.jl:5 └ @ Core ~/.julia/packages/Aqua/rmHe1/src/exports.jl:5 ┌ Warning: OPENAI_API_KEY variable not set! OpenAI models will not be available - set API key directly via `PromptingTools.OPENAI_API_KEY=`! └ @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/user_preferences.jl:189 Test Summary: | Pass Total Time Code quality (Aqua.jl) | 8 8 6m05.0s ┌ Warning: No matching messages found in memory, appending all └ @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/memory.jl:264 [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds [ Info: Preferences set; restart your Julia session for this change to take effect! [ Info: Preferences set; restart your Julia session for this change to take effect! [ Info: Preferences set; restart your Julia session for this change to take effect! [ Info: Preferences set; restart your Julia session for this change to take effect! [ Info: Preferences set; restart your Julia session for this change to take effect! [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds (Metadata: tool_calls) [ Info: Tokens: 3 in 0.0 seconds (Metadata: tool_calls) [ Info: Tokens: 2 in 0.0 seconds [ Info: All requests paused until 2025-03-02T10:43:24.428 (0.2s) [ Info: Retry layer enabled with max_retries=10, base_delay=3.0, status_codes=[429, 503] [ Info: Retry layer disabled and removed from the request layer stack [ Info: Retry layer enabled with max_retries=10, base_delay=3.0, status_codes=[429, 503] [ Info: Retry layer disabled and removed from the request layer stack ┌ Warning: Rate limit hit (429). Pausing all requests for 0.1 seconds (attempt 1/3) from headers. │ Headers: │ retry-after: 0.1 │ └ @ PromptingTools.CustomRetryLayer ~/.julia/packages/PromptingTools/wvgCI/src/retry_layer.jl:292 [ Info: All requests paused until 2025-03-02T10:43:26.733 (0.1s) ┌ Warning: Rate limit hit (429). Pausing all requests for 0.1 seconds (attempt 2/3) from headers. │ Headers: │ retry-after: 0.1 │ └ @ PromptingTools.CustomRetryLayer ~/.julia/packages/PromptingTools/wvgCI/src/retry_layer.jl:292 [ Info: All requests paused until 2025-03-02T10:43:26.834 (0.1s) ┌ Warning: Unexpected message type: DataMessage{Matrix{Float64}}. Skipping. └ @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/llm_shared.jl:85 ┌ Warning: Unexpected message type: DataMessage{Matrix{Float64}}. Skipping. └ @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/llm_shared.jl:85 OpenAI.create_chat: Error During Test at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_openai.jl:349 Got exception outside of a @test ArgumentError: api_key cannot be empty Stacktrace: [1] auth_header @ ~/.julia/packages/OpenAI/eRtbq/src/OpenAI.jl:40 [inlined] [2] auth_header @ ~/.julia/packages/PromptingTools/wvgCI/src/llm_openai_schema_defs.jl:19 [inlined] [3] _request(api::String, provider::CustomProvider, api_key::String; method::String, query::Nothing, http_kwargs::@NamedTuple{retry_non_idempotent::Bool, retries::Int64, readtimeout::Int64}, streamcallback::Nothing, additional_headers::Vector{Pair{String, String}}, kwargs::@Kwargs{model::String, messages::Vector{Dict{String, Any}}}) @ OpenAI ~/.julia/packages/OpenAI/eRtbq/src/OpenAI.jl:158 [4] _request (repeats 2 times) @ ~/.julia/packages/OpenAI/eRtbq/src/OpenAI.jl:140 [inlined] [5] #openai_request#19 @ ~/.julia/packages/OpenAI/eRtbq/src/OpenAI.jl:219 [inlined] [6] openai_request @ ~/.julia/packages/OpenAI/eRtbq/src/OpenAI.jl:213 [inlined] [7] #create_chat#24 @ ~/.julia/packages/OpenAI/eRtbq/src/OpenAI.jl:382 [inlined] [8] create_chat @ ~/.julia/packages/OpenAI/eRtbq/src/OpenAI.jl:376 [inlined] [9] #create_chat#301 @ ~/.julia/packages/PromptingTools/wvgCI/src/llm_openai_schema_defs.jl:98 [inlined] [10] create_chat @ ~/.julia/packages/PromptingTools/wvgCI/src/llm_openai_schema_defs.jl:75 [inlined] [11] macro expansion @ ./timing.jl:461 [inlined] [12] aigenerate(prompt_schema::CustomOpenAISchema, prompt::String; verbose::Bool, api_key::String, model::String, return_all::Bool, dry_run::Bool, conversation::Vector{AbstractMessage}, streamcallback::Nothing, no_system_message::Bool, name_user::Nothing, name_assistant::Nothing, http_kwargs::@NamedTuple{retry_non_idempotent::Bool, retries::Int64, readtimeout::Int64}, api_kwargs::@NamedTuple{url::String}, kwargs::@Kwargs{}) @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/llm_openai.jl:351 [13] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/llm_openai.jl:351 [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [15] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/llm_openai.jl:372 [inlined] [16] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [17] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/runtests.jl:20 [18] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [19] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/runtests.jl:30 [inlined] [20] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [21] top-level scope @ none:6 [22] eval(m::Module, e::Any) @ Core ./boot.jl:488 [23] exec_options(opts::Base.JLOptions) @ Base ./client.jl:294 [24] _start() @ Base ./client.jl:560 OpenAI.create_embeddings: Error During Test at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_openai.jl:388 Got exception outside of a @test IOError: listen: address already in use (EADDRINUSE) Stacktrace: [1] uv_error @ ./libuv.jl:106 [inlined] [2] listen(sock::Sockets.TCPServer; backlog::Int64) @ Sockets /opt/julia/share/julia/stdlib/v1.13/Sockets/src/Sockets.jl:638 [3] listen @ /opt/julia/share/julia/stdlib/v1.13/Sockets/src/Sockets.jl:637 [inlined] [4] #listen#8 @ /opt/julia/share/julia/stdlib/v1.13/Sockets/src/Sockets.jl:631 [inlined] [5] listen @ /opt/julia/share/julia/stdlib/v1.13/Sockets/src/Sockets.jl:628 [inlined] [6] HTTP.Servers.Listener(addr::Sockets.InetAddr{Sockets.IPv4}, host::String, port::String; sslconfig::Nothing, reuseaddr::Bool, backlog::Int64, server::Nothing, listenany::Bool, kw::@Kwargs{verbose::Int64}) @ HTTP.Servers ~/.julia/packages/HTTP/4AUPl/src/Servers.jl:69 [7] Listener @ ~/.julia/packages/HTTP/4AUPl/src/Servers.jl:39 [inlined] [8] Listener @ ~/.julia/packages/HTTP/4AUPl/src/Servers.jl:74 [inlined] [9] Listener @ ~/.julia/packages/HTTP/4AUPl/src/Servers.jl:75 [inlined] [10] listen! @ ~/.julia/packages/HTTP/4AUPl/src/Servers.jl:326 [inlined] [11] #serve!#4 @ ~/.julia/packages/HTTP/4AUPl/src/Handlers.jl:140 [inlined] [12] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/llm_openai.jl:390 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [14] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/llm_openai.jl:391 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [16] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/runtests.jl:20 [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [18] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/runtests.jl:30 [inlined] [19] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [20] top-level scope @ none:6 [21] eval(m::Module, e::Any) @ Core ./boot.jl:488 [22] exec_options(opts::Base.JLOptions) @ Base ./client.jl:294 [23] _start() @ Base ./client.jl:560 [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds [ Info: Tokens: 2 @ Cost: $0.0 in 0.0 seconds [ Info: Tokens: 4 @ Cost: $0.0001 in 0.0 seconds [ Info: Tokens: 4 @ Cost: $0.0001 in 0.0 seconds [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds WARNING: Method definition (::Type{Main.RandomType1235})(Int64) in module Main at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_openai.jl:482 overwritten at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_openai.jl:923. WARNING: Method definition (::Type{Main.RandomType1235})(Any) in module Main at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_openai.jl:482 overwritten at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_openai.jl:923. [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds (Metadata: log_prob, tool_calls, reasoning_content) [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds (Metadata: log_prob, tool_calls, reasoning_content) [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds (Metadata: log_prob, tool_calls, reasoning_content) [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds (Metadata: log_prob, tool_calls, reasoning_content) [ Info: Tokens: 20 @ Cost: $0.0008 in 0.0 seconds [ Info: Tokens: 20 @ Cost: $0.0008 in 0.0 seconds [ Info: Tokens: 18 @ Cost: $0.0006 in 0.0 seconds [ Info: Tokens: 20 @ Cost: $0.0008 in 0.0 seconds (Metadata: tool_calls, reasoning_content) [ Info: Tokens: 30 @ Cost: $0.0012 in 0.0 seconds (Metadata: tool_calls) [ Info: Tokens: 25 @ Cost: $0.001 in 0.0 seconds [ Info: Tokens: 20 @ Cost: $0.0008 in 0.0 seconds (Metadata: tool_calls, reasoning_content) [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds (Metadata: log_prob, reasoning_content) [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds [ Info: Tokens: 0 @ Cost: $0.04 in 0.0 seconds [ Info: Tokens: 0 in 0.0 seconds ollama_api-echo: Error During Test at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_ollama_managed.jl:64 Got exception outside of a @test HTTP.ConnectError for url = `http://localhost:2285/api/generate`: IOError: connect: connection refused (ECONNREFUSED) Stacktrace: [1] getconnection(::Type{Sockets.TCPSocket}, host::SubString{String}, port::SubString{String}; keepalive::Bool, readtimeout::Int64, kw::@Kwargs{require_ssl_verification::Bool, iofunction::Nothing, decompress::Nothing, verbose::Int64}) @ HTTP.Connections ~/.julia/packages/HTTP/4AUPl/src/Connections.jl:531 [2] getconnection @ ~/.julia/packages/HTTP/4AUPl/src/Connections.jl:508 [inlined] [3] #13 @ ~/.julia/packages/HTTP/4AUPl/src/Connections.jl:467 [inlined] [4] macro expansion @ ~/.julia/packages/ConcurrentUtilities/ofY4K/src/try_with_timeout.jl:92 [inlined] [5] (::ConcurrentUtilities.var"#try_with_timeout##2#try_with_timeout##3"{Any, Channel{Any}, HTTP.Connections.var"#13#14"{Sockets.TCPSocket, Bool, Bool, @Kwargs{readtimeout::Int64, iofunction::Nothing, decompress::Nothing, verbose::Int64}, SubString{String}, SubString{String}}, Timer})() @ ConcurrentUtilities ~/.julia/packages/ConcurrentUtilities/ofY4K/src/ConcurrentUtilities.jl:10 Stacktrace: [1] (::HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}})(req::HTTP.Messages.Request; proxy::Nothing, socket_type::Type, socket_type_tls::Nothing, readtimeout::Int64, connect_timeout::Int64, logerrors::Bool, logtag::Nothing, closeimmediately::Bool, kw::@Kwargs{iofunction::Nothing, decompress::Nothing, verbose::Int64}) @ HTTP.ConnectionRequest ~/.julia/packages/HTTP/4AUPl/src/clientlayers/ConnectionRequest.jl:88 [2] connections @ ~/.julia/packages/HTTP/4AUPl/src/clientlayers/ConnectionRequest.jl:60 [inlined] [3] (::Base.var"#47#48"{Base.var"#49#50"{ExponentialBackOff, HTTP.RetryRequest.var"#retrylayer##2#retrylayer##3"{Int64, typeof(HTTP.RetryRequest.FALSE), HTTP.Messages.Request, Base.RefValue{Int64}}, HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}}}})(args::HTTP.Messages.Request; kwargs::@Kwargs{iofunction::Nothing, decompress::Nothing, verbose::Int64}) @ Base ./error.jl:310 [4] (::HTTP.RetryRequest.var"#manageretries#retrylayer##0"{HTTP.RetryRequest.var"#manageretries#1#retrylayer##1"{HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}}}})(req::HTTP.Messages.Request; retry::Bool, retries::Int64, retry_delays::ExponentialBackOff, retry_check::Function, retry_non_idempotent::Bool, kw::@Kwargs{iofunction::Nothing, decompress::Nothing, verbose::Int64}) @ HTTP.RetryRequest ~/.julia/packages/HTTP/4AUPl/src/clientlayers/RetryRequest.jl:75 [5] manageretries @ ~/.julia/packages/HTTP/4AUPl/src/clientlayers/RetryRequest.jl:30 [inlined] [6] (::HTTP.CookieRequest.var"#managecookies#cookielayer##0"{HTTP.CookieRequest.var"#managecookies#1#cookielayer##1"{HTTP.RetryRequest.var"#manageretries#retrylayer##0"{HTTP.RetryRequest.var"#manageretries#1#retrylayer##1"{HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}}}}}})(req::HTTP.Messages.Request; cookies::Bool, cookiejar::HTTP.Cookies.CookieJar, kw::@Kwargs{iofunction::Nothing, decompress::Nothing, verbose::Int64}) @ HTTP.CookieRequest ~/.julia/packages/HTTP/4AUPl/src/clientlayers/CookieRequest.jl:42 [7] managecookies @ ~/.julia/packages/HTTP/4AUPl/src/clientlayers/CookieRequest.jl:19 [inlined] [8] (::HTTP.HeadersRequest.var"#defaultheaders#headerslayer##0"{HTTP.HeadersRequest.var"#defaultheaders#1#headerslayer##1"{HTTP.CookieRequest.var"#managecookies#cookielayer##0"{HTTP.CookieRequest.var"#managecookies#1#cookielayer##1"{HTTP.RetryRequest.var"#manageretries#retrylayer##0"{HTTP.RetryRequest.var"#manageretries#1#retrylayer##1"{HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}}}}}}}})(req::HTTP.Messages.Request; iofunction::Nothing, decompress::Nothing, basicauth::Bool, detect_content_type::Bool, canonicalize_headers::Bool, kw::@Kwargs{verbose::Int64}) @ HTTP.HeadersRequest ~/.julia/packages/HTTP/4AUPl/src/clientlayers/HeadersRequest.jl:71 [9] defaultheaders @ ~/.julia/packages/HTTP/4AUPl/src/clientlayers/HeadersRequest.jl:14 [inlined] [10] (::HTTP.RedirectRequest.var"#redirects#redirectlayer##0"{HTTP.RedirectRequest.var"#redirects#1#redirectlayer##1"{HTTP.HeadersRequest.var"#defaultheaders#headerslayer##0"{HTTP.HeadersRequest.var"#defaultheaders#1#headerslayer##1"{HTTP.CookieRequest.var"#managecookies#cookielayer##0"{HTTP.CookieRequest.var"#managecookies#1#cookielayer##1"{HTTP.RetryRequest.var"#manageretries#retrylayer##0"{HTTP.RetryRequest.var"#manageretries#1#retrylayer##1"{HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}}}}}}}}}})(req::HTTP.Messages.Request; redirect::Bool, redirect_limit::Int64, redirect_method::Nothing, forwardheaders::Bool, response_stream::Nothing, kw::@Kwargs{verbose::Int64}) @ HTTP.RedirectRequest ~/.julia/packages/HTTP/4AUPl/src/clientlayers/RedirectRequest.jl:25 [11] redirects @ ~/.julia/packages/HTTP/4AUPl/src/clientlayers/RedirectRequest.jl:14 [inlined] [12] (::HTTP.MessageRequest.var"#makerequest#messagelayer##0"{HTTP.MessageRequest.var"#makerequest#1#messagelayer##1"{HTTP.RedirectRequest.var"#redirects#redirectlayer##0"{HTTP.RedirectRequest.var"#redirects#1#redirectlayer##1"{HTTP.HeadersRequest.var"#defaultheaders#headerslayer##0"{HTTP.HeadersRequest.var"#defaultheaders#1#headerslayer##1"{HTTP.CookieRequest.var"#managecookies#cookielayer##0"{HTTP.CookieRequest.var"#managecookies#1#cookielayer##1"{HTTP.RetryRequest.var"#manageretries#retrylayer##0"{HTTP.RetryRequest.var"#manageretries#1#retrylayer##1"{HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}}}}}}}}}}}})(method::String, url::URIs.URI, headers::Vector{Any}, body::String; copyheaders::Bool, response_stream::Nothing, http_version::HTTP.Strings.HTTPVersion, verbose::Int64, kw::@Kwargs{}) @ HTTP.MessageRequest ~/.julia/packages/HTTP/4AUPl/src/clientlayers/MessageRequest.jl:35 [13] makerequest @ ~/.julia/packages/HTTP/4AUPl/src/clientlayers/MessageRequest.jl:24 [inlined] [14] request(stack::HTTP.MessageRequest.var"#makerequest#messagelayer##0"{HTTP.MessageRequest.var"#makerequest#1#messagelayer##1"{HTTP.RedirectRequest.var"#redirects#redirectlayer##0"{HTTP.RedirectRequest.var"#redirects#1#redirectlayer##1"{HTTP.HeadersRequest.var"#defaultheaders#headerslayer##0"{HTTP.HeadersRequest.var"#defaultheaders#1#headerslayer##1"{HTTP.CookieRequest.var"#managecookies#cookielayer##0"{HTTP.CookieRequest.var"#managecookies#1#cookielayer##1"{HTTP.RetryRequest.var"#manageretries#retrylayer##0"{HTTP.RetryRequest.var"#manageretries#1#retrylayer##1"{HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}}}}}}}}}}}}, method::String, url::String, h::Vector{Any}, b::String, q::Nothing; headers::Vector{Any}, body::String, query::Nothing, kw::@Kwargs{}) @ HTTP ~/.julia/packages/HTTP/4AUPl/src/HTTP.jl:457 [15] request(stack::Function, method::String, url::String, h::Vector{Any}, b::String, q::Nothing) @ HTTP ~/.julia/packages/HTTP/4AUPl/src/HTTP.jl:455 [16] #request#21 @ ~/.julia/packages/HTTP/4AUPl/src/HTTP.jl:315 [inlined] [17] request(method::String, url::String, h::Vector{Any}, b::String) @ HTTP ~/.julia/packages/HTTP/4AUPl/src/HTTP.jl:313 [18] post(::String, ::Vararg{Any}; kw::@Kwargs{}) @ HTTP ~/.julia/packages/HTTP/4AUPl/src/HTTP.jl:532 [19] post @ ~/.julia/packages/HTTP/4AUPl/src/HTTP.jl:532 [inlined] [20] ollama_api(prompt_schema::OllamaManagedSchema, prompt::String; system::String, messages::Vector{Dict{String, Any}}, endpoint::String, model::String, http_kwargs::@NamedTuple{}, streamcallback::Nothing, stream::Bool, url::String, port::Int64, kwargs::@Kwargs{}) @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/llm_ollama_managed.jl:121 [21] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/llm_ollama_managed.jl:66 [22] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [23] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/llm_ollama_managed.jl:95 [inlined] [24] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [25] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/runtests.jl:20 [26] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [27] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/runtests.jl:31 [inlined] [28] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [29] top-level scope @ none:6 [30] eval(m::Module, e::Any) @ Core ./boot.jl:488 [31] exec_options(opts::Base.JLOptions) @ Base ./client.jl:294 [32] _start() @ Base ./client.jl:560 caused by: IOError: connect: connection refused (ECONNREFUSED) Stacktrace: [1] getconnection(::Type{Sockets.TCPSocket}, host::SubString{String}, port::SubString{String}; keepalive::Bool, readtimeout::Int64, kw::@Kwargs{require_ssl_verification::Bool, iofunction::Nothing, decompress::Nothing, verbose::Int64}) @ HTTP.Connections ~/.julia/packages/HTTP/4AUPl/src/Connections.jl:531 [2] getconnection @ ~/.julia/packages/HTTP/4AUPl/src/Connections.jl:508 [inlined] [3] #13 @ ~/.julia/packages/HTTP/4AUPl/src/Connections.jl:467 [inlined] [4] macro expansion @ ~/.julia/packages/ConcurrentUtilities/ofY4K/src/try_with_timeout.jl:92 [inlined] [5] (::ConcurrentUtilities.var"#try_with_timeout##2#try_with_timeout##3"{Any, Channel{Any}, HTTP.Connections.var"#13#14"{Sockets.TCPSocket, Bool, Bool, @Kwargs{readtimeout::Int64, iofunction::Nothing, decompress::Nothing, verbose::Int64}, SubString{String}, SubString{String}}, Timer})() @ ConcurrentUtilities ~/.julia/packages/ConcurrentUtilities/ofY4K/src/ConcurrentUtilities.jl:10 Stacktrace: [1] try_yieldto(undo::typeof(Base.ensure_rescheduled)) @ Base ./task.jl:1128 [2] wait() @ Base ./task.jl:1200 [3] wait(c::Base.GenericCondition{ReentrantLock}; first::Bool) @ Base ./condition.jl:141 [4] wait @ ./condition.jl:136 [inlined] [5] take_unbuffered(c::Channel{Any}) @ Base ./channels.jl:549 [6] take! @ ./channels.jl:526 [inlined] [7] try_with_timeout(f::Function, timeout::Int64, ::Type{Any}) @ ConcurrentUtilities ~/.julia/packages/ConcurrentUtilities/ofY4K/src/try_with_timeout.jl:99 [8] try_with_timeout @ ~/.julia/packages/ConcurrentUtilities/ofY4K/src/try_with_timeout.jl:77 [inlined] [9] (::HTTP.Connections.var"#11#12"{Sockets.TCPSocket, Int64, Int64, Bool, Bool, @Kwargs{readtimeout::Int64, iofunction::Nothing, decompress::Nothing, verbose::Int64}, SubString{String}, SubString{String}})() @ HTTP.Connections ~/.julia/packages/HTTP/4AUPl/src/Connections.jl:464 [10] acquire(f::HTTP.Connections.var"#11#12"{Sockets.TCPSocket, Int64, Int64, Bool, Bool, @Kwargs{readtimeout::Int64, iofunction::Nothing, decompress::Nothing, verbose::Int64}, SubString{String}, SubString{String}}, pool::ConcurrentUtilities.Pools.Pool{Tuple{AbstractString, AbstractString, Bool, Bool, Bool}, HTTP.Connections.Connection{Sockets.TCPSocket}}, key::Tuple{SubString{String}, SubString{String}, Bool, Bool, Bool}; forcenew::Bool, isvalid::HTTP.Connections.var"#15#16"{Int64}) @ ConcurrentUtilities.Pools ~/.julia/packages/ConcurrentUtilities/ofY4K/src/pools.jl:159 [11] acquire @ ~/.julia/packages/ConcurrentUtilities/ofY4K/src/pools.jl:140 [inlined] [12] #newconnection#7 @ ~/.julia/packages/HTTP/4AUPl/src/Connections.jl:459 [inlined] [13] (::HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}})(req::HTTP.Messages.Request; proxy::Nothing, socket_type::Type, socket_type_tls::Nothing, readtimeout::Int64, connect_timeout::Int64, logerrors::Bool, logtag::Nothing, closeimmediately::Bool, kw::@Kwargs{iofunction::Nothing, decompress::Nothing, verbose::Int64}) @ HTTP.ConnectionRequest ~/.julia/packages/HTTP/4AUPl/src/clientlayers/ConnectionRequest.jl:82 [14] connections @ ~/.julia/packages/HTTP/4AUPl/src/clientlayers/ConnectionRequest.jl:60 [inlined] [15] (::Base.var"#47#48"{Base.var"#49#50"{ExponentialBackOff, HTTP.RetryRequest.var"#retrylayer##2#retrylayer##3"{Int64, typeof(HTTP.RetryRequest.FALSE), HTTP.Messages.Request, Base.RefValue{Int64}}, HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}}}})(args::HTTP.Messages.Request; kwargs::@Kwargs{iofunction::Nothing, decompress::Nothing, verbose::Int64}) @ Base ./error.jl:310 [16] (::HTTP.RetryRequest.var"#manageretries#retrylayer##0"{HTTP.RetryRequest.var"#manageretries#1#retrylayer##1"{HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}}}})(req::HTTP.Messages.Request; retry::Bool, retries::Int64, retry_delays::ExponentialBackOff, retry_check::Function, retry_non_idempotent::Bool, kw::@Kwargs{iofunction::Nothing, decompress::Nothing, verbose::Int64}) @ HTTP.RetryRequest ~/.julia/packages/HTTP/4AUPl/src/clientlayers/RetryRequest.jl:75 [17] manageretries @ ~/.julia/packages/HTTP/4AUPl/src/clientlayers/RetryRequest.jl:30 [inlined] [18] (::HTTP.CookieRequest.var"#managecookies#cookielayer##0"{HTTP.CookieRequest.var"#managecookies#1#cookielayer##1"{HTTP.RetryRequest.var"#manageretries#retrylayer##0"{HTTP.RetryRequest.var"#manageretries#1#retrylayer##1"{HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}}}}}})(req::HTTP.Messages.Request; cookies::Bool, cookiejar::HTTP.Cookies.CookieJar, kw::@Kwargs{iofunction::Nothing, decompress::Nothing, verbose::Int64}) @ HTTP.CookieRequest ~/.julia/packages/HTTP/4AUPl/src/clientlayers/CookieRequest.jl:42 [19] managecookies @ ~/.julia/packages/HTTP/4AUPl/src/clientlayers/CookieRequest.jl:19 [inlined] [20] (::HTTP.HeadersRequest.var"#defaultheaders#headerslayer##0"{HTTP.HeadersRequest.var"#defaultheaders#1#headerslayer##1"{HTTP.CookieRequest.var"#managecookies#cookielayer##0"{HTTP.CookieRequest.var"#managecookies#1#cookielayer##1"{HTTP.RetryRequest.var"#manageretries#retrylayer##0"{HTTP.RetryRequest.var"#manageretries#1#retrylayer##1"{HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}}}}}}}})(req::HTTP.Messages.Request; iofunction::Nothing, decompress::Nothing, basicauth::Bool, detect_content_type::Bool, canonicalize_headers::Bool, kw::@Kwargs{verbose::Int64}) @ HTTP.HeadersRequest ~/.julia/packages/HTTP/4AUPl/src/clientlayers/HeadersRequest.jl:71 [21] defaultheaders @ ~/.julia/packages/HTTP/4AUPl/src/clientlayers/HeadersRequest.jl:14 [inlined] [22] (::HTTP.RedirectRequest.var"#redirects#redirectlayer##0"{HTTP.RedirectRequest.var"#redirects#1#redirectlayer##1"{HTTP.HeadersRequest.var"#defaultheaders#headerslayer##0"{HTTP.HeadersRequest.var"#defaultheaders#1#headerslayer##1"{HTTP.CookieRequest.var"#managecookies#cookielayer##0"{HTTP.CookieRequest.var"#managecookies#1#cookielayer##1"{HTTP.RetryRequest.var"#manageretries#retrylayer##0"{HTTP.RetryRequest.var"#manageretries#1#retrylayer##1"{HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}}}}}}}}}})(req::HTTP.Messages.Request; redirect::Bool, redirect_limit::Int64, redirect_method::Nothing, forwardheaders::Bool, response_stream::Nothing, kw::@Kwargs{verbose::Int64}) @ HTTP.RedirectRequest ~/.julia/packages/HTTP/4AUPl/src/clientlayers/RedirectRequest.jl:25 [23] redirects @ ~/.julia/packages/HTTP/4AUPl/src/clientlayers/RedirectRequest.jl:14 [inlined] [24] (::HTTP.MessageRequest.var"#makerequest#messagelayer##0"{HTTP.MessageRequest.var"#makerequest#1#messagelayer##1"{HTTP.RedirectRequest.var"#redirects#redirectlayer##0"{HTTP.RedirectRequest.var"#redirects#1#redirectlayer##1"{HTTP.HeadersRequest.var"#defaultheaders#headerslayer##0"{HTTP.HeadersRequest.var"#defaultheaders#1#headerslayer##1"{HTTP.CookieRequest.var"#managecookies#cookielayer##0"{HTTP.CookieRequest.var"#managecookies#1#cookielayer##1"{HTTP.RetryRequest.var"#manageretries#retrylayer##0"{HTTP.RetryRequest.var"#manageretries#1#retrylayer##1"{HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}}}}}}}}}}}})(method::String, url::URIs.URI, headers::Vector{Any}, body::String; copyheaders::Bool, response_stream::Nothing, http_version::HTTP.Strings.HTTPVersion, verbose::Int64, kw::@Kwargs{}) @ HTTP.MessageRequest ~/.julia/packages/HTTP/4AUPl/src/clientlayers/MessageRequest.jl:35 [25] makerequest @ ~/.julia/packages/HTTP/4AUPl/src/clientlayers/MessageRequest.jl:24 [inlined] [26] request(stack::HTTP.MessageRequest.var"#makerequest#messagelayer##0"{HTTP.MessageRequest.var"#makerequest#1#messagelayer##1"{HTTP.RedirectRequest.var"#redirects#redirectlayer##0"{HTTP.RedirectRequest.var"#redirects#1#redirectlayer##1"{HTTP.HeadersRequest.var"#defaultheaders#headerslayer##0"{HTTP.HeadersRequest.var"#defaultheaders#1#headerslayer##1"{HTTP.CookieRequest.var"#managecookies#cookielayer##0"{HTTP.CookieRequest.var"#managecookies#1#cookielayer##1"{HTTP.RetryRequest.var"#manageretries#retrylayer##0"{HTTP.RetryRequest.var"#manageretries#1#retrylayer##1"{HTTP.ConnectionRequest.var"#connections#connectionlayer##0"{HTTP.ConnectionRequest.var"#connections#1#connectionlayer##1"{HTTP.TimeoutRequest.var"#timeouts#timeoutlayer##0"{HTTP.TimeoutRequest.var"#timeouts#1#timeoutlayer##1"{HTTP.ExceptionRequest.var"#exceptions#exceptionlayer##0"{HTTP.ExceptionRequest.var"#exceptions#1#exceptionlayer##1"{typeof(HTTP.StreamRequest.streamlayer)}}}}}}}}}}}}}}}}, method::String, url::String, h::Vector{Any}, b::String, q::Nothing; headers::Vector{Any}, body::String, query::Nothing, kw::@Kwargs{}) @ HTTP ~/.julia/packages/HTTP/4AUPl/src/HTTP.jl:457 [27] request(stack::Function, method::String, url::String, h::Vector{Any}, b::String, q::Nothing) @ HTTP ~/.julia/packages/HTTP/4AUPl/src/HTTP.jl:455 [28] #request#21 @ ~/.julia/packages/HTTP/4AUPl/src/HTTP.jl:315 [inlined] [29] request(method::String, url::String, h::Vector{Any}, b::String) @ HTTP ~/.julia/packages/HTTP/4AUPl/src/HTTP.jl:313 [30] post(::String, ::Vararg{Any}; kw::@Kwargs{}) @ HTTP ~/.julia/packages/HTTP/4AUPl/src/HTTP.jl:532 [31] post @ ~/.julia/packages/HTTP/4AUPl/src/HTTP.jl:532 [inlined] [32] ollama_api(prompt_schema::OllamaManagedSchema, prompt::String; system::String, messages::Vector{Dict{String, Any}}, endpoint::String, model::String, http_kwargs::@NamedTuple{}, streamcallback::Nothing, stream::Bool, url::String, port::Int64, kwargs::@Kwargs{}) @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/llm_ollama_managed.jl:121 [33] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/llm_ollama_managed.jl:66 [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [35] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/llm_ollama_managed.jl:95 [inlined] [36] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [37] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/runtests.jl:20 [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [39] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/runtests.jl:31 [inlined] [40] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [41] top-level scope @ none:6 [42] eval(m::Module, e::Any) @ Core ./boot.jl:488 [43] exec_options(opts::Base.JLOptions) @ Base ./client.jl:294 [44] _start() @ Base ./client.jl:560 [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 0 in 0.0 seconds [ Info: Tokens: 0 in 0.0 seconds [ Info: Tokens: 0 in 0.0 seconds [ Info: Tokens: 0 in 0.0 seconds [ Info: Tokens: 0 in 0.0 seconds ┌ Info: Matrix{Float64} └ size(msg.content) = (16, 2) [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds [ Info: Tokens: 0 in 0.0 seconds [ Info: Tokens: 0 in 0.0 seconds [ Info: Tokens: 0 in 0.0 seconds [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds ┌ Warning: Unexpected message type: DataMessage{Matrix{Float64}}. Skipping. └ @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/llm_shared.jl:85 [ Info: Tokens: 89 in 0.0 seconds [ Info: Tokens: 89 in 0.0 seconds GoogleOpenAISchema: Error During Test at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_openai_schema_def.jl:4 Got exception outside of a @test IOError: listen: address already in use (EADDRINUSE) Stacktrace: [1] uv_error @ ./libuv.jl:106 [inlined] [2] listen(sock::Sockets.TCPServer; backlog::Int64) @ Sockets /opt/julia/share/julia/stdlib/v1.13/Sockets/src/Sockets.jl:638 [3] listen @ /opt/julia/share/julia/stdlib/v1.13/Sockets/src/Sockets.jl:637 [inlined] [4] #listen#8 @ /opt/julia/share/julia/stdlib/v1.13/Sockets/src/Sockets.jl:631 [inlined] [5] listen @ /opt/julia/share/julia/stdlib/v1.13/Sockets/src/Sockets.jl:628 [inlined] [6] HTTP.Servers.Listener(addr::Sockets.InetAddr{Sockets.IPv4}, host::String, port::String; sslconfig::Nothing, reuseaddr::Bool, backlog::Int64, server::Nothing, listenany::Bool, kw::@Kwargs{verbose::Int64}) @ HTTP.Servers ~/.julia/packages/HTTP/4AUPl/src/Servers.jl:69 [7] Listener @ ~/.julia/packages/HTTP/4AUPl/src/Servers.jl:39 [inlined] [8] Listener @ ~/.julia/packages/HTTP/4AUPl/src/Servers.jl:74 [inlined] [9] Listener @ ~/.julia/packages/HTTP/4AUPl/src/Servers.jl:75 [inlined] [10] listen! @ ~/.julia/packages/HTTP/4AUPl/src/Servers.jl:326 [inlined] [11] #serve!#4 @ ~/.julia/packages/HTTP/4AUPl/src/Handlers.jl:140 [inlined] [12] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/llm_openai_schema_def.jl:6 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [14] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/llm_openai_schema_def.jl:12 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [16] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/runtests.jl:20 [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [18] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/runtests.jl:34 [inlined] [19] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [20] top-level scope @ none:6 [21] eval(m::Module, e::Any) @ Core ./boot.jl:488 [22] exec_options(opts::Base.JLOptions) @ Base ./client.jl:294 [23] _start() @ Base ./client.jl:560 ┌ Warning: Unexpected message type: DataMessage{Matrix{Float64}}. Skipping. └ @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/llm_shared.jl:85 [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds [ Info: Tokens: 9 @ Cost: $0.0001 in 0.0 seconds [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds (Metadata: cache_creation_input_tokens => 1, Other keys: cache_read_input_tokens) [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds ┌ Warning: There was an error parsing the response: MethodError(convert, (String, nothing), 0x000000000000a03a). Using the raw response instead. └ @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/extraction.jl:778 [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds ┌ Warning: No tool_use found in the response. Returning the raw text instead. └ @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/llm_anthropic.jl:759 [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds (Metadata: cache_creation_input_tokens => 1, Other keys: cache_read_input_tokens) WARNING: Method definition (::Type{Main.WeatherTool})(String, String) in module Main at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_openai.jl:1075 overwritten at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_anthropic.jl:700. WARNING: Method definition (::Type{Main.WeatherTool})(Any, Any) in module Main at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_openai.jl:1075 overwritten at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_anthropic.jl:700. [ Info: Tokens: 20 @ Cost: $0.0 in 0.0 seconds (Metadata: tool_calls, content) [ Info: Tokens: 30 @ Cost: $0.0001 in 0.0 seconds (Metadata: tool_calls, content) [ Info: Tokens: 20 @ Cost: $0.0 in 0.0 seconds (Metadata: tool_calls, content) [ Info: Tokens: 25 @ Cost: $0.0001 in 0.0 seconds (Metadata: cache_creation_input_tokens => 1, Other keys: cache_read_input_tokens, tool_calls, content) [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 2 @ Cost: $0.0 in 0.0 seconds [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds WARNING: Method definition (::Type{Main.RandomType1235})(Int64) in module Main at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_openai.jl:923 overwritten at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_tracer.jl:244. WARNING: Method definition (::Type{Main.RandomType1235})(Any) in module Main at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_openai.jl:923 overwritten at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/llm_tracer.jl:244. [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds (Metadata: log_prob, tool_calls) [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds (Metadata: log_prob, tool_calls) ┌ Warning: Detected keyword arguments in calculator: "operation". They are not supported in tool encoding and will be ignored. └ @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/extraction.jl:260 [ Info: Tokens: 10 @ Cost: $0.0004 in 0.0 seconds (Metadata: log_prob, tool_calls) ┌ Warning: Detected keyword arguments in calculator: "operation". They are not supported in tool encoding and will be ignored. └ @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/extraction.jl:260 [ Info: Tokens: 10 @ Cost: $0.0 in 0.0 seconds (Metadata: log_prob, tool_calls) [ Info: Tokens: 3 @ Cost: $0.0001 in 0.0 seconds (Metadata: log_prob) [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds (Metadata: log_prob) [ Info: Tokens: 0 @ Cost: $0.04 in 0.0 seconds [ Info: Tokens: 0 @ Cost: $0.04 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds [ Info: Tokens: 3 in 0.0 seconds ┌ Warning: Model `echo0` already registered! It will be overwritten. └ @ PromptingTools ~/.julia/packages/PromptingTools/wvgCI/src/user_preferences.jl:367 [ Info: Tokens: 3 in 0.0 seconds [ Info: AIMessage> Hello! [ Info: Tokens: 3 in 0.0 seconds [ Info: AIMessage> Hello! [ Info: 52 [ Info: 52 load_templates!: Error During Test at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/templates.jl:37 Got exception outside of a @test invalid assignment to constant PromptingTools.TEMPLATE_PATH. This redefinition may be permitted using the `const` keyword. Stacktrace: [1] setproperty! @ ./Base_compiler.jl:72 [inlined] [2] setproperty!(x::Module, f::Symbol, v::Vector{String}) @ Base ./Base_compiler.jl:70 [3] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/templates.jl:38 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [5] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/templates.jl:39 [inlined] [6] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [7] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/runtests.jl:20 [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [9] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/runtests.jl:39 [inlined] [10] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [11] top-level scope @ none:6 [12] eval(m::Module, e::Any) @ Core ./boot.jl:488 [13] exec_options(opts::Base.JLOptions) @ Base ./client.jl:294 [14] _start() @ Base ./client.jl:560 [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds [ Info: Tokens: 3 @ Cost: $0.0 in 0.0 seconds eval!: Error During Test at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/code_eval.jl:17 Test threw exception Expression: cb.output.a == 1 UndefVarError: `a` not defined in `Main.SafeMod365` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:48 [2] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/code_eval.jl:7 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [4] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/code_eval.jl:17 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:676 [inlined] WARNING: Imported binding Base.splitx was undeclared at import time during import to SafeMod370. Hello AICode constructors: Error During Test at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/code_eval.jl:257 Test threw exception Expression: cb.output.a == 1 UndefVarError: `a` not defined in `Main.SafeMod381` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:48 [2] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/code_eval.jl:248 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [4] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/code_eval.jl:257 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:676 [inlined] AICode constructors: Error During Test at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/code_eval.jl:287 Test threw exception Expression: cb.output.b == 2 UndefVarError: `b` not defined in `Main.SafeMod382` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:48 [2] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/code_eval.jl:248 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [4] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/code_eval.jl:287 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:676 [inlined] AICode constructors: Error During Test at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/code_eval.jl:306 Test threw exception Expression: cb.output.b == 2 UndefVarError: `b` not defined in `Main.SafeMod383` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:48 [2] top-level scope @ ~/.julia/packages/PromptingTools/wvgCI/test/code_eval.jl:248 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1771 [inlined] [4] macro expansion @ ~/.julia/packages/PromptingTools/wvgCI/test/code_eval.jl:306 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:676 [inlined] Hello world! Test Summary: | Pass Error Broken Total Time PromptingTools.jl | 1724 9 7 1740 6m54.9s replace_words | 4 4 0.1s recursive_splitter | 28 28 1.1s wrap_string | 8 1 9 1.0s length_longest_common_subsequence | 8 8 0.2s distance_longest_common_subsequence | 6 1 7 0.3s extract_handlebar_variables | 4 4 0.1s call_cost | 10 10 0.8s call_cost_alternative | 4 4 0.2s report_stats | 4 4 1.2s _string_to_vector | 2 2 0.0s _encode_local_image | 8 8 0.6s extract_image_attributes | 7 7 0.1s push_conversation!,resize_conversation! | 8 8 0.8s @timeout | 3 3 2.2s preview | 1 1 0.8s pprint | 3 3 0.2s auth_header | 4 4 0.5s unique_permutation | 18 18 3.7s Message constructors | 34 34 0.5s AnnotationMessage | 17 17 0.9s UserMessageWithImages | 11 11 0.2s attach_images_to_user_message | 13 13 0.6s last_message,last_output,tool_calls | 11 11 0.9s show,pprint | 40 40 1.4s TracerMessage,TracerMessageLike | 35 35 4.4s Annotation Message Rendering | 16 16 9.2s annotate! | 18 18 1.2s batch_start_index | 17 17 0.0s ConversationMemory-type | 13 13 0.3s get_last | 11 11 3.3s ConversationMemory-append! | 4 4 1.1s ConversationMemory-aigenerate | 4 4 2.6s ToolErrors | 6 6 0.1s Tool-constructor | 26 26 4.5s is_concrete_type | 2 2 0.0s is_not_union_type | 2 2 0.0s to_json_type | 15 15 0.1s has_null_type | 6 6 0.1s is_required_field | 6 6 0.0s remove_null_type | 6 6 0.0s extract_docstring | 5 1 6 0.3s get_arg_names,get_arg_types | 12 12 0.4s to_json_schema | 84 1 85 35.8s to_json_schema-MaybeExtract | 11 11 0.5s to_json_schema-ItemsExtract | 10 10 0.2s is_hidden_field | 14 14 0.4s set_properties_strict! | 14 14 0.9s generate_struct | 9 9 1.1s update_field_descriptions! | 7 7 0.6s remove_field! | 11 11 1.5s tool_call_signature | 101 101 5.8s parse_tool | 12 12 32.0s execute_tool | 17 17 3.1s set_preferences! | 10 10 1.1s ModelSpec | 13 13 0.1s ModelRegistry | 17 17 0.4s ai* default schema | 9 9 13.8s isextracted | 3 3 0.0s configure_callback! | 12 12 0.3s CustomRetryLayer | 14 14 2.9s extract_retry_after | 14 14 0.0s parse_time_string | 27 27 0.0s render-NoSchema | 27 1 28 3.2s finalize_outputs | 6 6 0.9s render-OpenAI | 23 2 25 5.4s render-tools | 15 15 1.1s OpenAI.build_url,OpenAI.auth_header | 2 2 0.1s OpenAI.create_chat | 1 1 3.1s OpenAI.create_embeddings | 1 1 0.9s response_to_message | 43 43 7.7s aigenerate-OpenAI | 9 9 1.0s aiembed-OpenAI | 9 9 1.3s pick_tokenizer | 11 11 0.1s encode_choices | 18 18 0.8s decode_choices | 9 9 0.6s aiclassify-OpenAI | 3 3 1.4s aiextract-OpenAI | 22 22 18.5s aitools-OpenAI | 32 32 1.8s aiscan-OpenAI | 5 5 1.3s aiimage-OpenAI | 10 10 2.2s render-ollama | 17 17 2.3s ollama_api-echo | 5 1 6 13.2s aigenerate-ollama | 17 17 1.4s aiembed-ollama | 12 12 1.5s not implemented ai* functions | 4 4 0.0s render-Ollama | 5 5 0.4s ollama_api-echo | 3 3 0.2s aigenerate-OllamaSchema | 8 8 0.8s aiscan-OllamaSchema | 3 3 0.2s not implemented ai* functions | 3 3 0.0s render-Google | 11 11 0.9s aigenerate-Google | 8 8 0.9s not implemented ai* functions | 6 6 0.1s GoogleOpenAISchema | 1 1 0.4s render-Anthropic | 27 27 4.0s render-tools for Anthropic | 29 29 0.8s anthropic_extra_headers | 13 13 0.5s anthropic_api | 4 4 5.8s aigenerate-Anthropic | 19 19 3.7s aiextract-Anthropic | 9 9 7.3s aitools-Anthropic | 34 34 1.7s not implemented ai* functions | 4 4 0.0s render-ShareGPT | 3 3 0.7s not implemented ai* functions | 7 7 0.1s role4render-Tracer | 10 10 0.2s render-Tracer | 3 3 0.0s initialize_tracer | 12 12 0.4s finalize_tracer | 23 23 4.2s aigenerate-Tracer | 21 21 10.9s aiembed-Tracer | 2 2 0.2s aiclassify-Tracer | 3 3 1.4s aiextract-OpenAI | 5 5 4.6s aitools-Tracer | 10 10 0.9s aiscan-Tracer | 5 5 0.8s aiimage-Tracer | 3 3 0.8s ai_str,ai!_str | 6 6 1.3s aai_str,aai!_str | 5 5 0.5s Template rendering | 3 3 0.0s Templates - search | 6 6 0.4s load_templates! | 1 1 1.8s create_template | 12 12 0.4s load_templates!-filtering | 2 2 0.7s Templates - Echo aigenerate call | 3 3 2.4s Serialization - Messages | 2 2 34.9s Serialization - Templates | 5 5 0.4s Serialization - Messages | 1 1 2.5s Serialization - TracerMessage | 4 4 27.2s is_julia_code | 9 9 0.1s extract_imports tests | 5 5 0.7s detect_missing_packages | 4 4 16.8s detect_pkg_operation | 5 5 0.0s remove_unsafe_lines | 4 4 0.2s has_julia_prompt | 5 5 0.0s remove_julia_prompt | 5 5 0.1s escape_interpolation | 2 2 0.0s find_subsequence_positions | 6 6 0.1s extract_code_blocks | 9 9 1.3s extract_code_blocks_fallback | 8 8 0.2s extract_function_name | 6 6 0.0s extract_function_names | 3 3 0.1s detect_base_main_overrides | 4 4 0.4s extract_testset_name | 5 5 0.0s extract_package_name_from_argerror | 4 4 0.0s extract_stacktrace_lines | 6 6 0.1s is_julia_expr | 10 10 0.0s remove_macro_expr! | 4 4 0.2s remove_all_tests_from_expr! | 1 1 0.0s remove_test_items_from_expr! | 1 1 0.0s extract_module_name | 4 4 0.5s isparsed, isparseerror | 10 10 1.4s eval! | 22 1 23 3.0s eval! kwargs | 45 45 33.2s AICode constructors | 21 3 24 3.8s AICode-methods | 6 6 0.5s RNG of the outermost testset: Xoshiro(0x018f6c9e97bf0336, 0xfb5be3e70f7fa393, 0x4088bfe75f878788, 0x835c5df01f784e1e, 0xcdd56969802db669) ERROR: LoadError: Some tests did not pass: 1724 passed, 0 failed, 9 errored, 7 broken. in expression starting at /home/pkgeval/.julia/packages/PromptingTools/wvgCI/test/runtests.jl:19 Testing failed after 822.67s ERROR: LoadError: Package PromptingTools errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:2386 [3] test @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:2241 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:486 [5] test(pkgs::Vector{Pkg.Types.PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:164 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:152 [7] test @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:152 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:151 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 [10] include(mod::Module, _path::String) @ Base ./Base.jl:306 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:328 [12] _start() @ Base ./client.jl:560 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 1197.06s: networking-related issues were detected