Package evaluation to test MLJModelInterface on Julia 1.14.0-DEV.1555 (0c48c4942b*) started at 2026-01-13T18:44:18.773 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.14` Set-up completed after 9.92s ################################################################################ # Installation # Installing MLJModelInterface... Resolving package versions... Updating `~/.julia/environments/v1.14/Project.toml` [e80e1ace] + MLJModelInterface v1.12.1 Updating `~/.julia/environments/v1.14/Manifest.toml` [e80e1ace] + MLJModelInterface v1.12.1 [30f210dd] + ScientificTypesBase v3.0.0 [64bff920] + StatisticalTraits v3.5.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.13.0 [d6f4376e] + Markdown v1.11.0 [de0858da] + Printf v1.11.0 [3fa0cd96] + REPL v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.0.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.13.0 [4ec0a83e] + Unicode v1.11.0 Installation completed after 3.89s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompiling packages... 4904.7 ms ✓ StatsBase 3188.4 ms ✓ MLJModelInterface 3265.3 ms ✓ CategoricalArrays 1617.8 ms ✓ PDMats → StatsBaseExt 1408.5 ms ✓ CategoricalArrays → CategoricalArraysSentinelArraysExt 1681.3 ms ✓ CategoricalArrays → CategoricalArraysStatsBaseExt 10224.4 ms ✓ Distributions 3919.9 ms ✓ Distributions → DistributionsTestExt 6832.3 ms ✓ ScientificTypes 9 dependencies successfully precompiled in 39 seconds. 90 already precompiled. Precompilation completed after 56.95s ################################################################################ # Testing # Testing MLJModelInterface Status `/tmp/jl_j9SOmj/Project.toml` [4c88cf16] Aqua v0.8.14 [324d7699] CategoricalArrays v1.0.2 [a93c6f00] DataFrames v1.8.1 [b4f34e82] Distances v0.10.12 [e80e1ace] MLJModelInterface v1.12.1 [bac558e1] OrderedCollections v1.8.1 [321657f4] ScientificTypes v3.1.2 [30f210dd] ScientificTypesBase v3.0.0 [64bff920] StatisticalTraits v3.5.0 [bd369af6] Tables v1.12.1 [b77e0a4c] InteractiveUtils v1.11.0 [d6f4376e] Markdown v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_j9SOmj/Manifest.toml` [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.14 [324d7699] CategoricalArrays v1.0.2 [3da002f7] ColorTypes v0.12.1 [34da2185] Compat v4.18.1 [a8cc5b0e] Crayons v4.1.1 [9a962f9c] DataAPI v1.16.0 [a93c6f00] DataFrames v1.8.1 [864edb3b] DataStructures v0.19.3 [e2d170a0] DataValueInterfaces v1.0.0 [b4f34e82] Distances v0.10.12 [31c24e10] Distributions v0.25.123 [ffbed154] DocStringExtensions v0.9.5 [1a297f60] FillArrays v1.15.0 [53c48c17] FixedPointNumbers v0.8.5 [34004b35] HypergeometricFunctions v0.3.28 [842dd82b] InlineStrings v1.4.5 [41ab1584] InvertedIndices v1.3.1 [92d709cd] IrrationalConstants v0.2.6 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.1 [b964fa9f] LaTeXStrings v1.4.0 [2ab3a3ac] LogExpFunctions v0.3.29 [e80e1ace] MLJModelInterface v1.12.1 [e1d29d7a] Missings v1.2.0 [bac558e1] OrderedCollections v1.8.1 [90014a1f] PDMats v0.11.37 [2dfb63ee] PooledArrays v1.4.3 [aea7be01] PrecompileTools v1.3.3 [21216c6a] Preferences v1.5.1 [08abe8d2] PrettyTables v3.1.2 [43287f4e] PtrArrays v1.3.0 [1fd47b50] QuadGK v2.11.2 [189a3867] Reexport v1.2.2 [ae029012] Requires v1.3.1 [79098fc4] Rmath v0.9.0 [321657f4] ScientificTypes v3.1.2 [30f210dd] ScientificTypesBase v3.0.0 [91c51154] SentinelArrays v1.4.9 [a2af1166] SortingAlgorithms v1.2.2 [276daf66] SpecialFunctions v2.6.1 [64bff920] StatisticalTraits v3.5.0 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.8.0 [2913bbd2] StatsBase v0.34.10 [4c63d2b9] StatsFuns v1.5.2 [892a3eda] StringManipulation v0.4.2 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.1 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [f50d1b31] Rmath_jll v0.5.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0 [b27032c2] LibCURL v1.0.0 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.13.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.14.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.0.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.13.0 [f489334b] StyledStrings v1.13.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.18.0+0 [e37daf67] LibGit2_jll v1.9.2+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.12.2 [4536629a] OpenBLAS_jll v0.3.29+0 [05823500] OpenLibm_jll v0.8.7+0 [458c3c95] OpenSSL_jll v3.5.4+0 [efcefdf7] PCRE2_jll v10.47.0+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [83775a58] Zlib_jll v1.3.1+2 [3161d3a3] Zstd_jll v1.5.7+1 [8e850b90] libblastrampoline_jll v5.15.0+0 [8e850ede] nghttp2_jll v1.68.0+1 [3f19e933] p7zip_jll v17.7.0+0 Testing Running tests... Test Summary: | Pass Total Time mode.jl | 10 10 6.5s Test Summary: | Pass Total Time parameter_inspection.jl | 3 3 4.1s Test Summary: | Pass Total Time data_utils.jl | 95 95 30.2s synthisise_docstring: Test Failed at /home/pkgeval/.julia/packages/MLJModelInterface/EmxvJ/test/metadata_utils.jl:75 Expression: synthetic == comparison Evaluated: ``` FooClassifier ``` A model type for constructing a foo classifier, based on [FooClassifierPkg.jl](http://existentialcomics.com/), and implementing the MLJ model interface. From MLJ, the type can be imported using ``` FooClassifier = @load FooClassifier pkg=FooClassifierPkg ``` Do `model = FooClassifier()` to construct an instance with default hyper-parameters. Provide keyword arguments to override hyper-parameter defaults, as in `FooClassifier(a=...)`. # Hyper-parameters * `a = 0` * `b = missing` == ``` FooClassifier ``` A model type for constructing a foo classifier, based on [FooClassifierPkg.jl](http://existentialcomics.com/), and implementing the MLJ model interface. From MLJ, the type can be imported using ``` FooClassifier = @load FooClassifier pkg=FooClassifierPkg ``` Do `model = FooClassifier()` to construct an instance with default hyper-parameters. Provide keyword arguments to override hyper-parameter defaults, as in `FooClassifier(a=...)`. # Hyper-parameters * `a = 0` * `b = missing` Stacktrace: [1] top-level scope @ ~/.julia/packages/MLJModelInterface/EmxvJ/test/metadata_utils.jl:75 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2156 [inlined] [3] macro expansion @ ~/.julia/packages/MLJModelInterface/EmxvJ/test/metadata_utils.jl:75 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:773 [inlined] doc_header(ModelType): Test Failed at /home/pkgeval/.julia/packages/MLJModelInterface/EmxvJ/test/metadata_utils.jl:175 Expression: string(header) == string(comparison) Evaluated: "```\nFooRegressor\n```\n\nA model type for constructing a foo regressor, based on\n[FooRegressorPkg.jl](http://existentialcomics.com/), and implementing the MLJ\nmodel interface.\n\nFrom MLJ, the type can be imported using\n\n```\nFooRegressor = @load FooRegressor pkg=FooRegressorPkg\n```\n\nDo `model = FooRegressor()` to construct an instance with default hyper-parameters. Provide keyword arguments to override hyper-parameter defaults, as in\n`FooRegressor(a=...)`.\n" == "```\nFooRegressor\n```\n\nA model type for constructing a foo regressor, based on\n[FooRegressorPkg.jl](http://existentialcomics.com/), and implementing the MLJ model\ninterface.\n\nFrom MLJ, the type can be imported using\n\n```\nFooRegressor = @load FooRegressor pkg=FooRegressorPkg\n```\n\nDo `model = FooRegressor()` to construct an instance with default hyper-parameters.\nProvide keyword arguments to override hyper-parameter\ndefaults, as in `FooRegressor(a=...)`.\n" Stacktrace: [1] top-level scope @ ~/.julia/packages/MLJModelInterface/EmxvJ/test/metadata_utils.jl:153 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2156 [inlined] [3] macro expansion @ ~/.julia/packages/MLJModelInterface/EmxvJ/test/metadata_utils.jl:175 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:773 [inlined] doc_header(ModelType, augment=true): Test Failed at /home/pkgeval/.julia/packages/MLJModelInterface/EmxvJ/test/metadata_utils.jl:227 Expression: string(header) == string(comparison) Evaluated: "From MLJ, the `FooRegressor2` type can be imported using\n\n```\nFooRegressor2 = @load FooRegressor2 pkg=FooRegressor2Pkg\n```\n\nDo `model = FooRegressor2()` to construct an instance with default hyper-parameters. Provide keyword arguments to override hyper-parameter defaults, as in\n`FooRegressor2(a=...)`.\n" == "From MLJ, the `FooRegressor2` type can be imported using\n\n```\nFooRegressor2 = @load FooRegressor2 pkg=FooRegressor2Pkg\n```\n\nDo `model = FooRegressor2()` to construct an instance with default hyper-parameters.\nProvide keyword arguments to override hyper-parameter\ndefaults, as in `FooRegressor2(a=...)`.\n" Stacktrace: [1] top-level scope @ ~/.julia/packages/MLJModelInterface/EmxvJ/test/metadata_utils.jl:213 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2156 [inlined] [3] macro expansion @ ~/.julia/packages/MLJModelInterface/EmxvJ/test/metadata_utils.jl:227 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:773 [inlined] Test Summary: | Pass Fail Total Time metadata_utils.jl | 27 3 30 14.5s synthisise_docstring | 1 1 2 8.5s metadata | 24 24 0.1s doc_header(ModelType) | 1 1 0.0s document string | 1 1 0.0s doc_header(ModelType, augment=true) | 1 1 0.0s document string | 1 1 0.0s RNG of the outermost testset: Random.Xoshiro(0xfaa0da98096579f3, 0xaf0ab7f672f37704, 0xa3d9330c9febc62e, 0xe0af59d848723e86, 0x5fca76a47cfa738f) ERROR: LoadError: Some tests did not pass: 27 passed, 3 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/MLJModelInterface/EmxvJ/test/runtests.jl:27 Testing failed after 241.27s ERROR: LoadError: Package MLJModelInterface errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:3122 [3] test @ /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:2987 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:572 [5] kwcall(::@NamedTuple{julia_args::Cmd, io::IOContext{IO}}, ::typeof(Pkg.API.test), ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:548 [6] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:172 [7] kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(Pkg.API.test), pkgs::Vector{PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:161 [8] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [9] test @ /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [inlined] [10] kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(Pkg.API.test), pkg::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:159 [11] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:237 [12] include(mod::Module, _path::String) @ Base ./Base.jl:309 [13] exec_options(opts::Base.JLOptions) @ Base ./client.jl:344 [14] _start() @ Base ./client.jl:585 in expression starting at /PkgEval.jl/scripts/evaluate.jl:228 PkgEval failed after 329.67s: package has test failures