Package evaluation of Experimenter on Julia 1.12.0-DEV.2153 (83dcbd426d*) started at 2025-03-31T11:10:03.372 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 8.83s ################################################################################ # Installation # Installing Experimenter... Resolving package versions... Installed Crayons ───────────────────── v4.1.1 Installed SentinelArrays ────────────── v1.4.8 Installed SQLite_jll ────────────────── v3.48.0+0 Installed Parsers ───────────────────── v2.8.1 Installed TableTraits ───────────────── v1.0.1 Installed Preferences ───────────────── v1.4.3 Installed DataAPI ───────────────────── v1.16.0 Installed JLLWrappers ───────────────── v1.7.0 Installed PooledArrays ──────────────── v1.4.3 Installed InlineStrings ─────────────── v1.4.3 Installed Tables ────────────────────── v1.12.0 Installed PrettyTables ──────────────── v2.4.0 Installed DataValueInterfaces ───────── v1.0.0 Installed IteratorInterfaceExtensions ─ v1.0.0 Installed LaTeXStrings ──────────────── v1.4.0 Installed PrecompileTools ───────────── v1.3.0 Installed SQLite ────────────────────── v1.6.1 Installed OrderedCollections ────────── v1.8.0 Installed InvertedIndices ───────────── v1.3.1 Installed Reexport ──────────────────── v1.2.2 Installed WeakRefStrings ────────────── v1.4.2 Installed Statistics ────────────────── v1.11.1 Installed DataStructures ────────────── v0.18.22 Installed ProgressBars ──────────────── v1.5.1 Installed Experimenter ──────────────── v0.1.4 Installed SafeTestsets ──────────────── v0.0.1 Installed Compat ────────────────────── v4.16.0 Installed PackageExtensionCompat ────── v1.0.2 Installed DBInterface ───────────────── v2.6.1 Installed DataFrames ────────────────── v1.7.0 Installed Missings ──────────────────── v1.2.0 Installed StringManipulation ────────── v0.4.1 Installed SortingAlgorithms ─────────── v1.2.1 Installing 1 artifacts Installed artifact SQLite 5.0 MiB Updating `~/.julia/environments/v1.12/Project.toml` [6aee034a] + Experimenter v0.1.4 Updating `~/.julia/environments/v1.12/Manifest.toml` [34da2185] + Compat v4.16.0 [a8cc5b0e] + Crayons v4.1.1 [a10d1c49] + DBInterface v2.6.1 [9a962f9c] + DataAPI v1.16.0 [a93c6f00] + DataFrames v1.7.0 [864edb3b] + DataStructures v0.18.22 [e2d170a0] + DataValueInterfaces v1.0.0 [6aee034a] + Experimenter v0.1.4 [842dd82b] + InlineStrings v1.4.3 [41ab1584] + InvertedIndices v1.3.1 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.7.0 [b964fa9f] + LaTeXStrings v1.4.0 [e1d29d7a] + Missings v1.2.0 [bac558e1] + OrderedCollections v1.8.0 [65ce6f38] + PackageExtensionCompat v1.0.2 [69de0a69] + Parsers v2.8.1 [2dfb63ee] + PooledArrays v1.4.3 [aea7be01] + PrecompileTools v1.3.0 [21216c6a] + Preferences v1.4.3 [08abe8d2] + PrettyTables v2.4.0 [49802e3a] + ProgressBars v1.5.1 [189a3867] + Reexport v1.2.2 [0aa819cd] + SQLite v1.6.1 ⌅ [1bc83da4] + SafeTestsets v0.0.1 [91c51154] + SentinelArrays v1.4.8 [a2af1166] + SortingAlgorithms v1.2.1 [10745b16] + Statistics v1.11.1 [892a3eda] + StringManipulation v0.4.1 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.12.0 [ea10d353] + WeakRefStrings v1.4.2 [76ed43ae] + SQLite_jll v3.48.0+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [9fa8497b] + Future v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.12.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.12.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.11.1+1 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2024.12.31 [4536629a] + OpenBLAS_jll v0.3.29+0 [458c3c95] + OpenSSL_jll v3.0.16+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850b90] + libblastrampoline_jll v5.12.0+0 [8e850ede] + nghttp2_jll v1.64.0+1 [3f19e933] + p7zip_jll v17.5.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 5.63s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling packages... 6569.5 ms ✓ TestEnv 1 dependency successfully precompiled in 9 seconds. 25 already precompiled. Precompiling package dependencies... Precompilation completed after 254.4s ################################################################################ # Testing # Testing Experimenter Status `/tmp/jl_NXqRsg/Project.toml` [a93c6f00] DataFrames v1.7.0 [6aee034a] Experimenter v0.1.4 [65ce6f38] PackageExtensionCompat v1.0.2 [49802e3a] ProgressBars v1.5.1 [0aa819cd] SQLite v1.6.1 ⌅ [1bc83da4] SafeTestsets v0.0.1 [8ba89e20] Distributed v1.11.0 [56ddb016] Logging v1.11.0 [44cfe95a] Pkg v1.12.0 [9a3f8284] Random v1.11.0 [9e88b42a] Serialization v1.11.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 Status `/tmp/jl_NXqRsg/Manifest.toml` [34da2185] Compat v4.16.0 [a8cc5b0e] Crayons v4.1.1 [a10d1c49] DBInterface v2.6.1 [9a962f9c] DataAPI v1.16.0 [a93c6f00] DataFrames v1.7.0 [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [6aee034a] Experimenter v0.1.4 [842dd82b] InlineStrings v1.4.3 [41ab1584] InvertedIndices v1.3.1 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.0 [b964fa9f] LaTeXStrings v1.4.0 [e1d29d7a] Missings v1.2.0 [bac558e1] OrderedCollections v1.8.0 [65ce6f38] PackageExtensionCompat v1.0.2 [69de0a69] Parsers v2.8.1 [2dfb63ee] PooledArrays v1.4.3 [aea7be01] PrecompileTools v1.3.0 [21216c6a] Preferences v1.4.3 [08abe8d2] PrettyTables v2.4.0 [49802e3a] ProgressBars v1.5.1 [189a3867] Reexport v1.2.2 [0aa819cd] SQLite v1.6.1 ⌅ [1bc83da4] SafeTestsets v0.0.1 [91c51154] SentinelArrays v1.4.8 [a2af1166] SortingAlgorithms v1.2.1 [10745b16] Statistics v1.11.1 [892a3eda] StringManipulation v0.4.1 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.0 [ea10d353] WeakRefStrings v1.4.2 [76ed43ae] SQLite_jll v3.48.0+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.11.1+1 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2024.12.31 [4536629a] OpenBLAS_jll v0.3.29+0 [458c3c95] OpenSSL_jll v3.0.16+0 [83775a58] Zlib_jll v1.3.1+2 [8e850b90] libblastrampoline_jll v5.12.0+0 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.5.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Test Summary: | Pass Total Time Experimenter.jl | 23 23 39.6s Local running: Error During Test at /home/pkgeval/.julia/packages/Experimenter/wQxhv/test/runner.jl:47 Got exception outside of a @test MethodError: no method matching run_experiment(::Dict{Symbol, Any}, ::Base.UUID) The applicable method may be too new: running in world age 40773, while current world is 40789. Closest candidates are: run_experiment(::Any, ::Any) (method too new to be called from this world context.) @ Main ~/.julia/packages/Experimenter/wQxhv/test/trial_functions.jl:24 Stacktrace: [1] execute_trial(function_name::String, trial::Trial) @ Experimenter ~/.julia/packages/Experimenter/wQxhv/src/runner.jl:163 [2] run_trials(runner::Experimenter.Runner, trials::Vector{Trial}; use_progress::Bool) @ Experimenter ~/.julia/packages/Experimenter/wQxhv/src/runner.jl:304 [3] top-level scope @ ~/.julia/packages/Experimenter/wQxhv/test/runner.jl:1881 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1860 [inlined] [5] macro expansion @ ~/.julia/packages/Experimenter/wQxhv/test/runner.jl:52 [inlined] [6] macro expansion @ ~/.julia/packages/Experimenter/wQxhv/src/runner.jl:98 [inlined] [7] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:304 [8] top-level scope @ ~/.julia/packages/SafeTestsets/A83XK/src/SafeTestsets.jl:25 [9] macro expansion @ ~/.julia/packages/Experimenter/wQxhv/test/runtests.jl:7 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1771 [inlined] [11] macro expansion @ ~/.julia/packages/Experimenter/wQxhv/test/runtests.jl:7 [inlined] [12] eval(m::Module, e::Any) @ Core ./boot.jl:489 [13] top-level scope @ ~/.julia/packages/Experimenter/wQxhv/test/runtests.jl:23 [14] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:304 [15] top-level scope @ none:6 [16] eval(m::Module, e::Any) @ Core ./boot.jl:489 [17] exec_options(opts::Base.JLOptions) @ Base ./client.jl:294 [18] _start() @ Base ./client.jl:560 WARNING: Method definition init_store(Any) in module Main at /home/pkgeval/.julia/packages/Experimenter/wQxhv/test/trial_functions.jl:5 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition run_experiment_with_store(Any, Any) in module Main at /home/pkgeval/.julia/packages/Experimenter/wQxhv/test/trial_functions.jl:13 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition run_experiment(Any, Any) in module Main at /home/pkgeval/.julia/packages/Experimenter/wQxhv/test/trial_functions.jl:24 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition run_restore_experiment(Any, Any) in module Main at /home/pkgeval/.julia/packages/Experimenter/wQxhv/test/trial_functions.jl:34 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition run_heterogeneous_experiment(Any, Any) in module Main at /home/pkgeval/.julia/packages/Experimenter/wQxhv/test/trial_functions.jl:55 overwritten on the same line (check for duplicate calls to `include`). From worker 3: Activating project at `/tmp/jl_NXqRsg` From worker 2: Activating project at `/tmp/jl_NXqRsg` WARNING: Method definition init_store(Any) in module Main at /home/pkgeval/.julia/packages/Experimenter/wQxhv/test/trial_functions.jl:5 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition run_experiment_with_store(Any, Any) in module Main at /home/pkgeval/.julia/packages/Experimenter/wQxhv/test/trial_functions.jl:13 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition run_experiment(Any, Any) in module Main at /home/pkgeval/.julia/packages/Experimenter/wQxhv/test/trial_functions.jl:24 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition run_restore_experiment(Any, Any) in module Main at /home/pkgeval/.julia/packages/Experimenter/wQxhv/test/trial_functions.jl:34 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition run_heterogeneous_experiment(Any, Any) in module Main at /home/pkgeval/.julia/packages/Experimenter/wQxhv/test/trial_functions.jl:55 overwritten on the same line (check for duplicate calls to `include`). Test Summary: | Pass Error Total Time Runner | 16 1 17 2m06.3s Local running | 1 1 16.7s Local running | 8 8 1.2s Distributed Running | 8 8 1m46.9s Heterogeneous Running | 0 0.0s RNG of the outermost testset: Random.Xoshiro(0xd153ab180789277f, 0xcbfe5a5b7efdb664, 0x04e4cc9a7aa6e755, 0x0631a116ccc263ba, 0x792220ce8315896a) ERROR: LoadError: Some tests did not pass: 16 passed, 0 failed, 1 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/Experimenter/wQxhv/test/runtests.jl:6 Testing failed after 177.36s ERROR: LoadError: Package Experimenter errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2365 [3] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2220 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:486 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:164 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:152 [7] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:152 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:151 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 [10] include(mod::Module, _path::String) @ Base ./Base.jl:303 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:328 [12] _start() @ Base ./client.jl:560 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 465.58s: package tests unexpectedly errored