Package evaluation to test TestPicker on Julia 1.14.0-DEV.1584 (ac5fadde9b*) started at 2026-01-18T15:00:57.009 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.14` Set-up completed after 11.63s ################################################################################ # Installation # Installing TestPicker... Resolving package versions... Updating `~/.julia/environments/v1.14/Project.toml` [a64165b9] + TestPicker v2.2.0 Updating `~/.julia/environments/v1.14/Manifest.toml` [da1fd8a2] + CodeTracking v3.0.0 [807dbc54] + Compiler v0.1.1 [692b3bcd] + JLLWrappers v1.7.1 [aa1ae85d] + JuliaInterpreter v0.10.9 [70703baa] + JuliaSyntax v1.0.2 [6f1432cf] + LoweredCodeUtils v3.5.0 [bac558e1] + OrderedCollections v1.8.1 [aea7be01] + PrecompileTools v1.3.3 [21216c6a] + Preferences v1.5.1 [295af30f] + Revise v3.13.1 [1e6cf692] + TestEnv v1.103.2 [a64165b9] + TestPicker v2.2.0 [e1736374] + bat_jll v13.0.0+0 [214eeab7] + fzf_jll v0.61.1+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.13.0 [b27032c2] + LibCURL v1.0.0 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.14.0 [de0858da] + Printf v1.11.0 [3fa0cd96] + REPL v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.0.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.13.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.18.0+0 [e37daf67] + LibGit2_jll v1.9.2+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.12.2 [458c3c95] + OpenSSL_jll v3.5.4+0 [efcefdf7] + PCRE2_jll v10.47.0+0 [83775a58] + Zlib_jll v1.3.1+2 [3161d3a3] + Zstd_jll v1.5.7+1 [8e850ede] + nghttp2_jll v1.68.0+1 [3f19e933] + p7zip_jll v17.7.0+0 Installation completed after 2.12s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompiling packages... 1685.8 ms ✓ bat_jll 40556.2 ms ✓ TestPicker 2 dependencies successfully precompiled in 43 seconds. 51 already precompiled. Precompilation completed after 60.71s ################################################################################ # Testing # Testing TestPicker Status `/tmp/jl_HvZFp3/Project.toml` [70703baa] JuliaSyntax v1.0.2 [1bc83da4] SafeTestsets v0.1.0 [98bfdc55] TerminalRegressionTests v0.2.2 [a64165b9] TestPicker v2.2.0 [44cfe95a] Pkg v1.14.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_HvZFp3/Manifest.toml` [da1fd8a2] CodeTracking v3.0.0 ⌅ [3da002f7] ColorTypes v0.11.5 [807dbc54] Compiler v0.1.1 [ab62b9b5] DeepDiffs v1.2.0 [53c48c17] FixedPointNumbers v0.8.5 [692b3bcd] JLLWrappers v1.7.1 [aa1ae85d] JuliaInterpreter v0.10.9 [70703baa] JuliaSyntax v1.0.2 [6f1432cf] LoweredCodeUtils v3.5.0 [bac558e1] OrderedCollections v1.8.1 [aea7be01] PrecompileTools v1.3.3 [21216c6a] Preferences v1.5.1 [295af30f] Revise v3.13.1 [1bc83da4] SafeTestsets v0.1.0 [10745b16] Statistics v1.11.1 [98bfdc55] TerminalRegressionTests v0.2.2 [1e6cf692] TestEnv v1.103.2 [a64165b9] TestPicker v2.2.0 [7774df62] VT100 v0.3.4 [e1736374] bat_jll v13.0.0+0 [214eeab7] fzf_jll v0.61.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0 [b27032c2] LibCURL v1.0.0 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.13.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.14.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.0.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.13.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.18.0+0 [e37daf67] LibGit2_jll v1.9.2+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.12.2 [4536629a] OpenBLAS_jll v0.3.29+0 [458c3c95] OpenSSL_jll v3.5.4+0 [efcefdf7] PCRE2_jll v10.47.0+0 [83775a58] Zlib_jll v1.3.1+2 [3161d3a3] Zstd_jll v1.5.7+1 [8e850b90] libblastrampoline_jll v5.15.0+0 [8e850ede] nghttp2_jll v1.68.0+1 [3f19e933] p7zip_jll v17.7.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... ┌ Warning: The call to compilecache failed to create a usable precompiled cache file for TestPicker [a64165b9-4409-4de6-85cd-a4e0953bae44] │ exception = Required dependency Base.PkgId(Base.UUID("bac558e1-5e72-5ebc-8fee-abe8a469f55d"), "OrderedCollections") failed to load from a cache file. └ @ Base loading.jl:2949 WARNING: Detected access to binding `TestPicker.TestBlockInterface` in a world prior to its definition world. Julia 1.12 has introduced more strict world age semantics for global bindings. !!! This code may malfunction under Revise. !!! This code will error in future versions of Julia. Hint: Add an appropriate `invokelatest` around the access to this binding. To make this warning an error, and hence obtain a stack trace, use `julia --depwarn=error`. WARNING: Detected access to binding `TestPicker.add_interface!` in a world prior to its definition world. Julia 1.12 has introduced more strict world age semantics for global bindings. !!! This code may malfunction under Revise. !!! This code will error in future versions of Julia. Hint: Add an appropriate `invokelatest` around the access to this binding. To make this warning an error, and hence obtain a stack trace, use `julia --depwarn=error`. WARNING: Detected access to binding `TestPicker.clear_testenv_cache` in a world prior to its definition world. Julia 1.12 has introduced more strict world age semantics for global bindings. !!! This code may malfunction under Revise. !!! This code will error in future versions of Julia. Hint: Add an appropriate `invokelatest` around the access to this binding. To make this warning an error, and hence obtain a stack trace, use `julia --depwarn=error`. WARNING: Detected access to binding `TestPicker.replace_interface!` in a world prior to its definition world. Julia 1.12 has introduced more strict world age semantics for global bindings. !!! This code may malfunction under Revise. !!! This code will error in future versions of Julia. Hint: Add an appropriate `invokelatest` around the access to this binding. To make this warning an error, and hence obtain a stack trace, use `julia --depwarn=error`. [ Info: Executing test file eval.jl [ Info: Executing testblock error from eval.jl:2 [ Info: Executing testblock foo from eval.jl:10 Test Summary: | Pass Total Time eval | 3 3 1m42.9s Updating `~/.julia/packages/TestPicker/UfVN1/Project.toml` [70703baa] + JuliaSyntax v1.0.2 [aea7be01] + PrecompileTools v1.3.3 [295af30f] + Revise v3.13.1 [1e6cf692] + TestEnv v1.103.2 [e1736374] + bat_jll v13.0.0+0 [214eeab7] + fzf_jll v0.61.1+0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [44cfe95a] ~ Pkg ⇒ v1.14.0 [3fa0cd96] ~ REPL ⇒ v1.11.0 [8dfed614] ~ Test ⇒ v1.11.0 Updating `~/.julia/packages/TestPicker/UfVN1/Manifest.toml` [da1fd8a2] + CodeTracking v3.0.0 [807dbc54] + Compiler v0.1.1 [692b3bcd] + JLLWrappers v1.7.1 [aa1ae85d] + JuliaInterpreter v0.10.9 [70703baa] + JuliaSyntax v1.0.2 [6f1432cf] + LoweredCodeUtils v3.5.0 [bac558e1] + OrderedCollections v1.8.1 [aea7be01] + PrecompileTools v1.3.3 [21216c6a] + Preferences v1.5.1 [295af30f] + Revise v3.13.1 [1e6cf692] + TestEnv v1.103.2 [e1736374] + bat_jll v13.0.0+0 [214eeab7] + fzf_jll v0.61.1+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.13.0 [b27032c2] + LibCURL v1.0.0 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] ~ Pkg ⇒ v1.14.0 [de0858da] + Printf v1.11.0 [3fa0cd96] ~ REPL ⇒ v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.0.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.13.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.18.0+0 [e37daf67] + LibGit2_jll v1.9.2+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.12.2 [458c3c95] + OpenSSL_jll v3.5.4+0 [efcefdf7] + PCRE2_jll v10.47.0+0 [83775a58] + Zlib_jll v1.3.1+2 [3161d3a3] + Zstd_jll v1.5.7+1 [8e850ede] + nghttp2_jll v1.68.0+1 [3f19e933] + p7zip_jll v17.7.0+0 [ Info: Executing test file /home/pkgeval/.julia/packages/TestPicker/UfVN1/test/sandbox/test-a.jl Test Summary: | Pass Total Time testfile | 20 20 1m00.0s Test Summary: | Pass Total Time testblockinterface | 26 26 1.0s [ Info: Executing testblock "I am a testset" from sandbox/test-a.jl:3 Test Summary: | Pass Total Time testblock | 28 28 5.3s Building the REPL mode: Error During Test at /home/pkgeval/.julia/packages/TestPicker/UfVN1/test/repl.jl:18 Got exception outside of a @test UndefVarError: `setup_search_keymap` not defined in `REPL.LineEdit` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty @ ./Base_compiler.jl:50 [inlined] [2] create_repl_test_mode(repl::REPL.LineEditREPL, main::REPL.LineEdit.Prompt) @ TestPicker ~/.julia/packages/TestPicker/UfVN1/src/repl.jl:130 [3] top-level scope @ ~/.julia/packages/TestPicker/UfVN1/test/repl.jl:19 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2243 [inlined] [5] macro expansion @ ~/.julia/packages/TestPicker/UfVN1/test/repl.jl:23 [inlined] [6] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [7] top-level scope @ ~/.julia/packages/SafeTestsets/raUNr/src/SafeTestsets.jl:16 [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2243 [inlined] [9] macro expansion @ ~/.julia/packages/TestPicker/UfVN1/test/runtests.jl:16 [inlined] [10] eval(m::Module, e::Any) @ Core ./boot.jl:489 [11] top-level scope @ ~/.julia/packages/TestPicker/UfVN1/test/runtests.jl:28 [12] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [13] top-level scope @ none:6 [14] eval(m::Module, e::Any) @ Core ./boot.jl:489 [15] exec_options(opts::Base.JLOptions) @ Base ./client.jl:310 [16] _start() @ Base ./client.jl:585 ┌ Error: No test evaluated yet (reset with every session). └ @ TestPicker ~/.julia/packages/TestPicker/UfVN1/src/repl.jl:170 Test Summary: | Pass Error Total Time repl | 19 1 20 6.8s Building the REPL mode | 1 1 5.6s Identify query | 9 9 0.3s Help documentation | 10 10 0.8s RNG of the outermost testset: Random.Xoshiro(0x798e8a0603137b22, 0x0425cc8a6397ab2f, 0xb55428b851ee4624, 0xe33843235a71d3fb, 0x472e9136409ea740) ERROR: LoadError: Some tests did not pass: 19 passed, 0 failed, 1 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/TestPicker/UfVN1/test/runtests.jl:15 Testing failed after 191.76s ERROR: LoadError: Package TestPicker errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:3122 [3] test @ /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:2987 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:572 [5] kwcall(::@NamedTuple{julia_args::Cmd, io::IOContext{IO}}, ::typeof(Pkg.API.test), ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:548 [6] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:172 [7] kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(Pkg.API.test), pkgs::Vector{PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:161 [8] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [9] test @ /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [inlined] [10] kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(Pkg.API.test), pkg::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:159 [11] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:237 [12] include(mod::Module, _path::String) @ Base ./Base.jl:309 [13] exec_options(opts::Base.JLOptions) @ Base ./client.jl:344 [14] _start() @ Base ./client.jl:585 in expression starting at /PkgEval.jl/scripts/evaluate.jl:228 PkgEval failed after 284.86s: package tests unexpectedly errored