Package evaluation of CalibrationErrors on Julia 1.12.0-rc1.2 (995ff9db19*) started at 2025-07-14T19:51:34.784 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 8.64s ################################################################################ # Installation # Installing CalibrationErrors... Resolving package versions... Updating `~/.julia/environments/v1.12/Project.toml` [33913031] + CalibrationErrors v0.6.4 Updating `~/.julia/environments/v1.12/Manifest.toml` [14f7f29c] + AMD v0.5.3 [66dad0bd] + AliasTables v1.1.3 [6e4b80f9] + BenchmarkTools v1.6.0 [33913031] + CalibrationErrors v0.6.4 [d360d2e6] + ChainRulesCore v1.25.2 [523fee87] + CodecBzip2 v0.8.5 [944b1d66] + CodecZlib v0.7.8 [bbf7d656] + CommonSubexpressions v0.3.1 [34da2185] + Compat v4.17.0 [a33af91c] + CompositionsBase v0.1.2 [187b0558] + ConstructionBase v1.6.0 [9a962f9c] + DataAPI v1.16.0 [864edb3b] + DataStructures v0.18.22 [163ba53b] + DiffResults v1.1.0 [b552c78f] + DiffRules v1.15.1 [b4f34e82] + Distances v0.10.12 [31c24e10] + Distributions v0.25.120 [ffbed154] + DocStringExtensions v0.9.5 [24df6009] + ExactOptimalTransport v0.2.5 [e2ba6199] + ExprTools v0.1.10 [9aa1b823] + FastClosures v0.3.2 [1a297f60] + FillArrays v1.13.0 [f6369f11] + ForwardDiff v1.0.1 [d9f16b24] + Functors v0.5.2 [34004b35] + HypergeometricFunctions v0.3.28 [92d709cd] + IrrationalConstants v0.2.4 [692b3bcd] + JLLWrappers v1.7.0 [682c06a0] + JSON v0.21.4 [0f8b85d8] + JSON3 v1.14.3 [ec8451be] + KernelFunctions v0.10.65 ⌅ [ba0b0d4f] + Krylov v0.9.10 [40e66cde] + LDLFactorizations v0.10.1 [5c8ed15e] + LinearOperators v2.10.0 [2ab3a3ac] + LogExpFunctions v0.3.29 [1914dd2f] + MacroTools v0.5.16 [b8f27783] + MathOptInterface v1.42.0 [e1d29d7a] + Missings v1.2.0 [d8a4904e] + MutableArithmetics v1.6.4 [77ba4419] + NaNMath v1.1.3 [bac558e1] + OrderedCollections v1.8.1 [90014a1f] + PDMats v0.11.35 [69de0a69] + Parsers v2.8.3 [aea7be01] + PrecompileTools v1.3.2 [21216c6a] + Preferences v1.4.3 [43287f4e] + PtrArrays v1.3.0 [10f199a5] + QPSReader v0.2.1 [1fd47b50] + QuadGK v2.11.2 [189a3867] + Reexport v1.2.2 [ae029012] + Requires v1.3.1 [79098fc4] + Rmath v0.8.0 [ce78b400] + SimpleUnPack v1.1.0 [a2af1166] + SortingAlgorithms v1.2.1 [276daf66] + SpecialFunctions v2.5.1 [1e83bf80] + StaticArraysCore v1.4.3 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.7.1 [2913bbd2] + StatsBase v0.34.5 [4c63d2b9] + StatsFuns v1.5.0 [856f2bd8] + StructTypes v1.11.0 [62fd8b95] + TensorCore v0.1.1 [a759f4b9] + TimerOutputs v0.5.29 [3bb67fe8] + TranscodingStreams v0.11.3 [6dd1b50a] + Tulip v0.9.7 [700de1a5] + ZygoteRules v0.2.7 [6e34b625] + Bzip2_jll v1.0.9+0 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [f50d1b31] + Rmath_jll v0.5.1+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.12.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.13.0 [de0858da] + Printf v1.11.0 [9abbd945] + Profile v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [2f01184e] + SparseArrays v1.12.0 [f489334b] + StyledStrings v1.11.0 [4607b0f0] + SuiteSparse [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.11.1+1 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.5.20 [4536629a] + OpenBLAS_jll v0.3.29+0 [05823500] + OpenLibm_jll v0.8.5+0 [458c3c95] + OpenSSL_jll v3.5.1+0 [bea87d4a] + SuiteSparse_jll v7.8.3+2 [83775a58] + Zlib_jll v1.3.1+2 [8e850b90] + libblastrampoline_jll v5.13.1+0 [8e850ede] + nghttp2_jll v1.64.0+1 [3f19e933] + p7zip_jll v17.5.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 4.24s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 195.91s ################################################################################ # Testing # Testing CalibrationErrors Status `/tmp/jl_iVOeOm/Project.toml` ⌅ [4c88cf16] Aqua v0.6.7 [33913031] CalibrationErrors v0.6.4 [864edb3b] DataStructures v0.18.22 [b4f34e82] Distances v0.10.12 [31c24e10] Distributions v0.25.120 [24df6009] ExactOptimalTransport v0.2.5 [ec8451be] KernelFunctions v0.10.65 [90014a1f] PDMats v0.11.35 [189a3867] Reexport v1.2.2 [ce78b400] SimpleUnPack v1.1.0 [10745b16] Statistics v1.11.1 [2913bbd2] StatsBase v0.34.5 [6dd1b50a] Tulip v0.9.7 [37e2e46d] LinearAlgebra v1.12.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_iVOeOm/Manifest.toml` [14f7f29c] AMD v0.5.3 [66dad0bd] AliasTables v1.1.3 ⌅ [4c88cf16] Aqua v0.6.7 [6e4b80f9] BenchmarkTools v1.6.0 [33913031] CalibrationErrors v0.6.4 [d360d2e6] ChainRulesCore v1.25.2 [523fee87] CodecBzip2 v0.8.5 [944b1d66] CodecZlib v0.7.8 [bbf7d656] CommonSubexpressions v0.3.1 [34da2185] Compat v4.17.0 [a33af91c] CompositionsBase v0.1.2 [187b0558] ConstructionBase v1.6.0 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.18.22 [163ba53b] DiffResults v1.1.0 [b552c78f] DiffRules v1.15.1 [b4f34e82] Distances v0.10.12 [31c24e10] Distributions v0.25.120 [ffbed154] DocStringExtensions v0.9.5 [24df6009] ExactOptimalTransport v0.2.5 [e2ba6199] ExprTools v0.1.10 [9aa1b823] FastClosures v0.3.2 [1a297f60] FillArrays v1.13.0 [f6369f11] ForwardDiff v1.0.1 [d9f16b24] Functors v0.5.2 [34004b35] HypergeometricFunctions v0.3.28 [92d709cd] IrrationalConstants v0.2.4 [692b3bcd] JLLWrappers v1.7.0 [682c06a0] JSON v0.21.4 [0f8b85d8] JSON3 v1.14.3 [ec8451be] KernelFunctions v0.10.65 ⌅ [ba0b0d4f] Krylov v0.9.10 [40e66cde] LDLFactorizations v0.10.1 [5c8ed15e] LinearOperators v2.10.0 [2ab3a3ac] LogExpFunctions v0.3.29 [1914dd2f] MacroTools v0.5.16 [b8f27783] MathOptInterface v1.42.0 [e1d29d7a] Missings v1.2.0 [d8a4904e] MutableArithmetics v1.6.4 [77ba4419] NaNMath v1.1.3 [bac558e1] OrderedCollections v1.8.1 [90014a1f] PDMats v0.11.35 [69de0a69] Parsers v2.8.3 [aea7be01] PrecompileTools v1.3.2 [21216c6a] Preferences v1.4.3 [43287f4e] PtrArrays v1.3.0 [10f199a5] QPSReader v0.2.1 [1fd47b50] QuadGK v2.11.2 [189a3867] Reexport v1.2.2 [ae029012] Requires v1.3.1 [79098fc4] Rmath v0.8.0 [ce78b400] SimpleUnPack v1.1.0 [a2af1166] SortingAlgorithms v1.2.1 [276daf66] SpecialFunctions v2.5.1 [1e83bf80] StaticArraysCore v1.4.3 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.7.1 [2913bbd2] StatsBase v0.34.5 [4c63d2b9] StatsFuns v1.5.0 [856f2bd8] StructTypes v1.11.0 [62fd8b95] TensorCore v0.1.1 [a759f4b9] TimerOutputs v0.5.29 [3bb67fe8] TranscodingStreams v0.11.3 [6dd1b50a] Tulip v0.9.7 [700de1a5] ZygoteRules v0.2.7 [6e34b625] Bzip2_jll v1.0.9+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [f50d1b31] Rmath_jll v0.5.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [2f01184e] SparseArrays v1.12.0 [f489334b] StyledStrings v1.11.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.11.1+1 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [4536629a] OpenBLAS_jll v0.3.29+0 [05823500] OpenLibm_jll v0.8.5+0 [458c3c95] OpenSSL_jll v3.5.1+0 [bea87d4a] SuiteSparse_jll v7.8.3+2 [83775a58] Zlib_jll v1.3.1+2 [8e850b90] libblastrampoline_jll v5.13.1+0 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.5.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... ┌ Warning: `isbindingresolved(m::Module, var::Symbol)` is deprecated, use `true` instead. │ caller = walkmodules(f::Aqua.var"#undefined_exports##0#undefined_exports##1"{Vector{Symbol}}, x::Module) at exports.jl:5 └ @ Core ~/.julia/packages/Aqua/zpdNP/src/exports.jl:5 Base.PkgId(Base.UUID("33913031-fe46-5864-950f-100836f47845"), "CalibrationErrors"): Test Failed at /home/pkgeval/.julia/packages/Aqua/zpdNP/src/deps_compat.jl:16 Expression: result ⊜ true Evaluated: ⟪result: 😭 FAILED: Base.PkgId(Base.UUID("33913031-fe46-5864-950f-100836f47845"), "CalibrationErrors") `/home/pkgeval/.julia/packages/CalibrationErrors/fMmNl/Project.toml` does not specify `compat` for: Statistics ⟫ ⊜ true Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/Aqua/zpdNP/src/deps_compat.jl:16 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [4] test_deps_compat(packages::Module; kwargs::@Kwargs{}) @ Aqua ~/.julia/packages/Aqua/zpdNP/src/deps_compat.jl:14 ┌ Warning: `isbindingresolved(m::Module, var::Symbol)` is deprecated, use `true` instead. │ caller = walkmodules(f::Aqua.Piracy.var"#3#4"{Bool, IdSet{Any}, Vector{Method}}, x::Module) at exports.jl:5 └ @ Core ~/.julia/packages/Aqua/zpdNP/src/exports.jl:5 ┌ Warning: `pairwise!(r::AbstractMatrix, dist::PreMetric, a, b)` is deprecated, use `pairwise!(dist, r, a, b)` instead. │ caller = top-level scope at wasserstein.jl:2 └ @ Core ~/.julia/packages/CalibrationErrors/fMmNl/test/distances/wasserstein.jl:2 ┌ Warning: `pairwise!(r::AbstractMatrix, dist::PreMetric, a, b)` is deprecated, use `pairwise!(dist, r, a, b)` instead. │ caller = top-level scope at wasserstein.jl:2 └ @ Core ~/.julia/packages/CalibrationErrors/fMmNl/test/distances/wasserstein.jl:2 WARNING: Method definition (::Type{Main.WhiteKernel2})() in module Main at /home/pkgeval/.julia/packages/CalibrationErrors/fMmNl/test/skce.jl:3 overwritten at /home/pkgeval/.julia/packages/CalibrationErrors/fMmNl/test/ucme.jl:83. WARNING: Method definition WhiteKernel2(Any, Any) in module Main at /home/pkgeval/.julia/packages/CalibrationErrors/fMmNl/test/skce.jl:4 overwritten at /home/pkgeval/.julia/packages/CalibrationErrors/fMmNl/test/ucme.jl:84. WARNING: Method definition (::Type{Main.TensorProduct2{K1, K2} where K2 where K1})(K1, K2) where {K1<:KernelFunctions.Kernel, K2<:KernelFunctions.Kernel} in module Main at /home/pkgeval/.julia/packages/CalibrationErrors/fMmNl/test/skce.jl:8 overwritten at /home/pkgeval/.julia/packages/CalibrationErrors/fMmNl/test/ucme.jl:88. WARNING: Method definition (::Type{Main.TensorProduct2{K1<:KernelFunctions.Kernel, K2<:KernelFunctions.Kernel}})(Any, Any) in module Main at /home/pkgeval/.julia/packages/CalibrationErrors/fMmNl/test/skce.jl:8 overwritten at /home/pkgeval/.julia/packages/CalibrationErrors/fMmNl/test/ucme.jl:88. WARNING: Method definition (::Main.TensorProduct2{K1<:KernelFunctions.Kernel, K2<:KernelFunctions.Kernel})(Any, Any) in module Main at /home/pkgeval/.julia/packages/CalibrationErrors/fMmNl/test/skce.jl:11 overwritten at /home/pkgeval/.julia/packages/CalibrationErrors/fMmNl/test/ucme.jl:91. Test Summary: | Pass Fail Total Time CalibrationErrors | 36694 1 36695 5m48.9s General | 8 1 9 1m16.4s Aqua | 8 1 9 1m16.4s Method ambiguity | 0 0.0s Unbound type parameters | 1 1 0.1s Undefined exports | 1 1 3.5s Compare Project.toml and test/Project.toml | 1 1 0.1s Stale dependencies | 1 1 24.3s Compat bounds | 1 1 8.8s Base.PkgId(Base.UUID("33913031-fe46-5864-950f-100836f47845"), "CalibrationErrors") | 1 1 5.6s Project.toml formatting | 2 2 0.9s Piracy | 1 1 0.4s binning | 28320 28320 57.7s distances | 72 72 2m35.8s ECE | 16 16 14.3s SKCE | 8102 8102 12.1s UCME | 59 59 4.2s distributions | 117 117 28.3s RNG of the outermost testset: Xoshiro(0x9951797c85a704f1, 0xb9d66be14dfba82b, 0xb170153285fd9556, 0xe90a07f7bdd1fd77, 0x9d4b5ee33e4bd661) ERROR: LoadError: Some tests did not pass: 36694 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/CalibrationErrors/fMmNl/test/runtests.jl:17 Testing failed after 379.0s ERROR: LoadError: Package CalibrationErrors errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2458 [3] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2313 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:511 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:164 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:152 [7] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:152 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:151 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 [10] include(mod::Module, _path::String) @ Base ./Base.jl:305 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:321 [12] _start() @ Base ./client.jl:554 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 608.05s: package has test failures