Package evaluation to test SciMLBenchmarks on Julia 1.14.0-DEV.3128 (f573e2bf71*) started at 2026-09-06T17:24:47.187 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.14` Set-up completed after 16.26s ################################################################################ # Installation # Installing SciMLBenchmarks... Resolving package versions... Updating `~/.julia/environments/v1.14/Project.toml` [31c91b34] + SciMLBenchmarks v0.2.0 Updating `~/.julia/environments/v1.14/Manifest.toml` [9a962f9c] + DataAPI v1.16.0 [e2d170a0] + DataValueInterfaces v1.0.0 [ffbed154] + DocStringExtensions v0.9.5 ⌅ [eafb193a] + Highlights v0.5.3 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.8.0 ⌅ [682c06a0] + JSON v0.21.4 [ffc61752] + Mustache v1.0.21 [bac558e1] + OrderedCollections v2.0.1 ⌅ [69de0a69] + Parsers v2.8.8 [aea7be01] + PrecompileTools v1.3.4 [21216c6a] + Preferences v1.5.2 [05181044] + RelocatableFolders v1.0.1 [ae029012] + Requires v1.3.1 [31c91b34] + SciMLBenchmarks v0.2.0 [6c6a2e73] + Scratch v1.3.0 [69024149] + StringEncodings v0.3.7 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.14.0 [44d3d7a6] + Weave v0.10.12 [ddb6d928] + YAML v0.4.16 [94ce4f54] + Libiconv_jll v1.18.0+0 [0dad84c5] + ArgTools v1.2.0 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.13.0 [b27032c2] + LibCURL v1.0.0 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.14.0 [de0858da] + Printf v1.11.0 [3fa0cd96] + REPL v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.13.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.13.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.5.7+0 [deac9b47] + LibCURL_jll v8.21.0+0 [e37daf67] + LibGit2_jll v1.9.7+0 [29816b5a] + LibSSH2_jll v1.11.104+0 [14a3606d] + MozillaCACerts_jll v2026.8.13 [458c3c95] + OpenSSL_jll v3.5.8+0 [efcefdf7] + PCRE2_jll v10.48.0+0 [83775a58] + Zlib_jll v1.3.2+0 [3161d3a3] + Zstd_jll v1.5.7+1 [8e850ede] + nghttp2_jll v1.70.0+0 [3f19e933] + p7zip_jll v17.8.2+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 5.26s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompiling project... 9.7 s ✓ SciMLTesting 18.3 s ✓ IJulia 13.4 s ✓ SciMLBenchmarks 120.5 s ✓ Plots 4.0 s ✓ GR → IJuliaExt 7.0 s ✓ SciMLBenchmarks → SciMLBenchmarksIJuliaExt 13.6 s ✓ Plots → IJuliaExt 7 dependencies successfully precompiled in 189 seconds. 183 already precompiled. Precompilation completed after 206.27s ################################################################################ # Testing # Testing SciMLBenchmarks Status `/tmp/jl_Qxv5HQ/Project.toml` [7073ff75] IJulia v1.34.4 [91a5bcdd] Plots v1.41.7 [aea7be01] PrecompileTools v1.3.4 [1bc83da4] SafeTestsets v0.1.0 [31c91b34] SciMLBenchmarks v0.2.0 [09d9d899] SciMLTesting v2.13.0 [44d3d7a6] Weave v0.10.12 [b77e0a4c] InteractiveUtils v1.11.0 [d6f4376e] Markdown v1.11.0 [44cfe95a] Pkg v1.14.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_Qxv5HQ/Manifest.toml` [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.16 [35d6a980] ColorSchemes v3.31.0 [3da002f7] ColorTypes v0.12.1 [c3611d14] ColorVectorSpace v0.11.0 [5ae59095] Colors v0.13.1 [34da2185] Compat v4.18.1 [8f4d0f93] Conda v1.10.3 [d38c429a] Contour v0.6.3 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.19.6 [e2d170a0] DataValueInterfaces v1.0.0 [8bb1440f] DelimitedFiles v1.9.1 [ffbed154] DocStringExtensions v0.9.5 [7d51a73a] ExplicitImports v1.15.0 [c87230d0] FFMPEG v0.4.5 ⌅ [53c48c17] FixedPointNumbers v0.8.6 [1fa38f19] Format v1.3.7 [28b8d3ca] GR v0.73.27 ⌅ [eafb193a] Highlights v0.5.3 [7073ff75] IJulia v1.34.4 [92d709cd] IrrationalConstants v0.2.6 [82899510] IteratorInterfaceExtensions v1.0.0 [1019f520] JLFzf v0.1.11 [692b3bcd] JLLWrappers v1.8.0 ⌅ [682c06a0] JSON v0.21.4 [b964fa9f] LaTeXStrings v1.4.1 [23fbe1c1] Latexify v0.16.12 [2ab3a3ac] LogExpFunctions v1.0.1 [1914dd2f] MacroTools v0.5.16 [442fdcdd] Measures v0.3.3 [e1d29d7a] Missings v1.2.0 [ffc61752] Mustache v1.0.21 [77ba4419] NaNMath v1.1.4 [bac558e1] OrderedCollections v2.0.1 ⌅ [69de0a69] Parsers v2.8.8 [ccf2f8ad] PlotThemes v3.3.0 [995b91a9] PlotUtils v1.4.4 [91a5bcdd] Plots v1.41.7 [aea7be01] PrecompileTools v1.3.4 [21216c6a] Preferences v1.5.2 [43287f4e] PtrArrays v1.4.0 [3cdcf5f2] RecipesBase v1.3.4 [01d81517] RecipesPipeline v0.6.12 [189a3867] Reexport v1.2.2 [05181044] RelocatableFolders v1.0.1 [ae029012] Requires v1.3.1 [1bc83da4] SafeTestsets v0.1.0 [31c91b34] SciMLBenchmarks v0.2.0 [09d9d899] SciMLTesting v2.13.0 [6c6a2e73] Scratch v1.3.0 [992d4aef] Showoff v1.1.1 [a2af1166] SortingAlgorithms v1.2.3 [860ef19b] StableRNGs v1.0.4 [10745b16] Statistics v1.11.5 [82ae8749] StatsAPI v1.8.0 [2913bbd2] StatsBase v0.34.13 [69024149] StringEncodings v0.3.7 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.14.0 [62fd8b95] TensorCore v0.1.1 [1cfade01] UnicodeFun v0.4.1 [41fe7b60] Unzip v0.2.0 [81def892] VersionParsing v1.3.0 [44d3d7a6] Weave v0.10.12 [ddb6d928] YAML v0.4.16 [c2297ded] ZMQ v1.5.1 [6e34b625] Bzip2_jll v1.0.9+0 [83423d85] Cairo_jll v1.18.7+0 [ee1fde0b] Dbus_jll v1.16.2+0 [2702e6a9] EpollShim_jll v0.0.20230411+1 [2e619515] Expat_jll v2.8.3+0 ⌅ [b22a6f82] FFMPEG_jll v8.1.2+0 [a3f928ae] Fontconfig_jll v2.17.1+0 [d7e528f0] FreeType2_jll v2.14.3+1 [559328eb] FriBidi_jll v1.0.17+0 [0656b61e] GLFW_jll v3.5.1+0 [d2c73de3] GR_jll v0.73.27+0 ⌅ [b0724c58] GettextRuntime_jll v0.22.4+0 [61579ee1] Ghostscript_jll v9.55.1+0 [7746bdde] Glib_jll v2.88.3+0 [3b182d85] Graphite2_jll v1.3.16+0 [2e76f6c2] HarfBuzz_jll v100.14003.0+0 [aacddb02] JpegTurbo_jll v3.2.0+1 [c1c5ebd0] LAME_jll v3.100.3+0 [88015f11] LERC_jll v4.1.0+0 [1d63c593] LLVMOpenMP_jll v22.1.7+0 ⌅ [e9f186c6] Libffi_jll v3.4.7+0 [7e76a0d4] Libglvnd_jll v1.7.1+1 [94ce4f54] Libiconv_jll v1.18.0+0 [4b2f31a3] Libmount_jll v2.42.0+0 [89763e89] Libtiff_jll v4.7.3+0 [38a345b3] Libuuid_jll v2.42.0+0 [e7412a2a] Ogg_jll v1.3.6+0 [91d4177d] Opus_jll v1.6.1+0 [36c8627f] Pango_jll v1.58.2+0 [30392449] Pixman_jll v0.46.4+0 [c0090381] Qt6Base_jll v6.10.2+2 [629bc702] Qt6Declarative_jll v6.10.2+2 [ce943373] Qt6ShaderTools_jll v6.10.2+1 [6de9746b] Qt6Svg_jll v6.10.2+0 [e99dba38] Qt6Wayland_jll v6.10.2+1 [a44049a8] Vulkan_Loader_jll v1.3.243+0 [a2964d1f] Wayland_jll v1.24.0+0 [ffd25f8a] XZ_jll v5.8.3+0 [f67eecfb] Xorg_libICE_jll v1.1.2+0 [c834827a] Xorg_libSM_jll v1.2.6+0 [4f6342f7] Xorg_libX11_jll v1.8.13+0 [0c0b7dd1] Xorg_libXau_jll v1.0.13+0 [935fb764] Xorg_libXcursor_jll v1.2.4+0 [a3789734] Xorg_libXdmcp_jll v1.1.6+0 [1082639a] Xorg_libXext_jll v1.3.8+0 [d091e8ba] Xorg_libXfixes_jll v6.0.2+0 [a51aa0fd] Xorg_libXi_jll v1.8.4+0 [d1454406] Xorg_libXinerama_jll v1.1.7+0 [ec84b674] Xorg_libXrandr_jll v1.5.6+0 [ea2f1a96] Xorg_libXrender_jll v0.9.12+0 [a65dc6b1] Xorg_libpciaccess_jll v0.19.0+0 [c7cfdc94] Xorg_libxcb_jll v1.17.1+0 [cc61e674] Xorg_libxkbfile_jll v1.2.0+0 [e920d4aa] Xorg_xcb_util_cursor_jll v0.1.6+0 [12413925] Xorg_xcb_util_image_jll v0.4.1+0 [2def613f] Xorg_xcb_util_jll v0.4.1+0 [975044d2] Xorg_xcb_util_keysyms_jll v0.4.1+0 [0d47668e] Xorg_xcb_util_renderutil_jll v0.3.10+0 [c22f9ab0] Xorg_xcb_util_wm_jll v0.4.2+0 [35661453] Xorg_xkbcomp_jll v1.4.7+0 [33bec58e] Xorg_xkeyboard_config_jll v2.47.0+2 [c5fb5394] Xorg_xtrans_jll v1.6.0+0 [8f1865be] ZeroMQ_jll v4.3.6+0 [35ca27e7] eudev_jll v3.2.14+0 ⌅ [214eeab7] fzf_jll v0.61.1+0 [a4ae2306] libaom_jll v3.14.1+0 [0ac62f75] libass_jll v0.17.5+0 [1183f4f0] libdecor_jll v0.2.2+0 [8e53e030] libdrm_jll v2.4.134+0 [2db6ffa8] libevdev_jll v1.13.4+0 [f638f0a6] libfdk_aac_jll v2.0.4+0 [36db933b] libinput_jll v1.28.1+0 [b53b4c65] libpng_jll v1.6.58+0 [a9144af2] libsodium_jll v1.0.21+0 [9a156e7d] libva_jll v2.23.0+0 [f27f6e37] libvorbis_jll v1.3.8+0 [009596ad] mtdev_jll v1.1.7+0 ⌅ [1270edf5] x264_jll v10164.0.1+0 [dfaa095f] x265_jll v4.1.0+0 [d8fb68d0] xkbcommon_jll v1.13.0+0 [0dad84c5] ArgTools v1.2.0 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0 [b27032c2] LibCURL v1.0.0 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.14.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.14.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.13.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.13.0 [f489334b] StyledStrings v1.13.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.5.7+0 [deac9b47] LibCURL_jll v8.21.0+0 [e37daf67] LibGit2_jll v1.9.7+0 [29816b5a] LibSSH2_jll v1.11.104+0 [14a3606d] MozillaCACerts_jll v2026.8.13 [4536629a] OpenBLAS_jll v0.3.34+0 [05823500] OpenLibm_jll v0.8.8+0 [458c3c95] OpenSSL_jll v3.5.8+0 [efcefdf7] PCRE2_jll v10.48.0+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [83775a58] Zlib_jll v1.3.2+0 [3161d3a3] Zstd_jll v1.5.7+1 [8e850b90] libblastrampoline_jll v5.15.0+0 [8e850ede] nghttp2_jll v1.70.0+0 [3f19e933] p7zip_jll v17.8.2+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... [ Info: Weaving /home/pkgeval/.julia/packages/SciMLBenchmarks/3uXjy/benchmarks/Testing/test.jmd ┌ Info: Instantiating └ folder = "/home/pkgeval/.julia/packages/SciMLBenchmarks/3uXjy/benchmarks/Testing" Activating project at `~/.julia/packages/SciMLBenchmarks/3uXjy/benchmarks/Testing` Warning Some loaded packages differ from the active environment, which may affect reproducibility and trigger recompilation: SciMLBenchmarks: loaded v0.2.0, environment specifies v0.1.3 Parsers: loaded v2.8.8, environment specifies v2.8.6 Tables: loaded v1.14.0, environment specifies v1.13.0 OpenSSL_jll: loaded v3.5.8+0, environment specifies v3.5.7+0 OrderedCollections: loaded v2.0.1, environment specifies v1.8.2 Zstd_jll (v1.5.7+1) loaded: /opt/julia/share/julia/stdlib/v1.14/Zstd_jll/src/Zstd_jll.jl environment: /home/pkgeval/.julia/packages/Zstd_jll/YX1LN/src/Zstd_jll.jl PrecompileTools: loaded v1.3.4, environment specifies v1.2.1 ┌ Warning: The active manifest file has dependencies that were resolved with a different julia version (1.10.11). Unexpected behavior may occur. └ @ ~/.julia/packages/SciMLBenchmarks/3uXjy/benchmarks/Testing/Manifest.toml:0 ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:1353 ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:1353 weave_file: Error During Test at /home/pkgeval/.julia/packages/SciMLBenchmarks/3uXjy/test/core.jl:36 Got exception outside of a @test Failed to find path for package MbedTLS_jll Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Types.jl:68 [2] build_versions(ctx::Pkg.Types.Context, uuids::Set{Base.UUID}; verbose::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:1979 [3] build(ctx::Pkg.Types.Context, uuids::Set{Base.UUID}, verbose::Bool; allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:1891 [4] build(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; verbose::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:1196 [5] build(pkgs::Vector{Pkg.Types.PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:172 [6] build(pkgs::Vector{Pkg.Types.PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:161 [7] build(; name::Nothing, uuid::Nothing, version::Nothing, url::Nothing, rev::Nothing, path::Nothing, mode::Pkg.Types.PackageMode, subdir::Nothing, kwargs::@Kwargs{}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:189 [8] build() @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:178 [inlined] [9] weave_file(folder::String, file::String, build_list::Tuple{Symbol, Symbol}) @ SciMLBenchmarks ~/.julia/packages/SciMLBenchmarks/3uXjy/src/SciMLBenchmarks.jl:45 [10] weave_file(folder::String, file::String) @ SciMLBenchmarks ~/.julia/packages/SciMLBenchmarks/3uXjy/src/SciMLBenchmarks.jl:35 [11] top-level scope @ ~/.julia/packages/SciMLBenchmarks/3uXjy/test/core.jl:37 [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2247 [inlined] [13] macro expansion @ ~/.julia/packages/SciMLBenchmarks/3uXjy/test/core.jl:38 [inlined] Test Summary: | Pass Error Total Time Core | 8 1 9 47.8s IJulia extension | 4 4 2.1s benchmark priority | 3 3 0.6s subprocess | 1 1 0.9s weave_file | 1 1 43.0s RNG of the outermost testset: Random.Xoshiro(0x707679ff834e82e4, 0x3a02d1d188bfe83d, 0xec3477efa6e77315, 0x519de3cac254971e, 0xf6d681adb0639cd6) ERROR: LoadError: Some tests did not pass: 8 passed, 0 failed, 1 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/SciMLBenchmarks/3uXjy/test/runtests.jl:3 Testing failed after 74.74s ERROR: LoadError: Package SciMLBenchmarks errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:3298 [3] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:587 [4] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:172 [5] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [6] test(pkg::String; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:159 [inlined] [7] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 364.84s: package tests unexpectedly errored