Package evaluation of CalibrationTests on Julia 1.11.4 (a71dd056e0*) started at 2025-04-08T17:16:21.123 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 8.34s ################################################################################ # Installation # Installing CalibrationTests... Resolving package versions... Updating `~/.julia/environments/v1.11/Project.toml` [2818745e] + CalibrationTests v0.6.3 Updating `~/.julia/environments/v1.11/Manifest.toml` [14f7f29c] + AMD v0.5.3 [7d9f7c33] + Accessors v0.1.42 [66dad0bd] + AliasTables v1.1.3 [6e4b80f9] + BenchmarkTools v1.6.0 [33913031] + CalibrationErrors v0.6.4 [2818745e] + CalibrationTests v0.6.3 [d360d2e6] + ChainRulesCore v1.25.1 [523fee87] + CodecBzip2 v0.8.5 [944b1d66] + CodecZlib v0.7.8 [861a8166] + Combinatorics v1.0.2 [38540f10] + CommonSolve v0.2.4 [bbf7d656] + CommonSubexpressions v0.3.1 [34da2185] + Compat v4.16.0 [a33af91c] + CompositionsBase v0.1.2 [4937dc1f] + ConsistencyResampling v0.3.3 [187b0558] + ConstructionBase v1.5.8 [9a962f9c] + DataAPI v1.16.0 [864edb3b] + DataStructures v0.18.22 [e2d170a0] + DataValueInterfaces v1.0.0 [163ba53b] + DiffResults v1.1.0 [b552c78f] + DiffRules v1.15.1 [b4f34e82] + Distances v0.10.12 [31c24e10] + Distributions v0.25.118 [ffbed154] + DocStringExtensions v0.9.4 [24df6009] + ExactOptimalTransport v0.2.5 [e2ba6199] + ExprTools v0.1.10 [9aa1b823] + FastClosures v0.3.2 [1a297f60] + FillArrays v1.13.0 [f6369f11] + ForwardDiff v1.0.1 [d9f16b24] + Functors v0.5.2 [34004b35] + HypergeometricFunctions v0.3.28 [09f84164] + HypothesisTests v0.11.5 [3587e190] + InverseFunctions v0.1.17 [92d709cd] + IrrationalConstants v0.2.4 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.7.0 [682c06a0] + JSON v0.21.4 [0f8b85d8] + JSON3 v1.14.2 [ec8451be] + KernelFunctions v0.10.65 [ba0b0d4f] + Krylov v0.9.10 [40e66cde] + LDLFactorizations v0.10.1 [5c8ed15e] + LinearOperators v2.9.0 [2ab3a3ac] + LogExpFunctions v0.3.29 [1914dd2f] + MacroTools v0.5.15 [b8f27783] + MathOptInterface v1.38.1 [e1d29d7a] + Missings v1.2.0 [d8a4904e] + MutableArithmetics v1.6.4 [77ba4419] + NaNMath v1.1.3 [bac558e1] + OrderedCollections v1.8.0 [90014a1f] + PDMats v0.11.33 [69de0a69] + Parsers v2.8.1 ⌅ [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [43287f4e] + PtrArrays v1.3.0 [10f199a5] + QPSReader v0.2.1 [1fd47b50] + QuadGK v2.11.2 [189a3867] + Reexport v1.2.2 [ae029012] + Requires v1.3.1 [79098fc4] + Rmath v0.8.0 [f2b01f46] + Roots v2.2.7 [ce78b400] + SimpleUnPack v1.1.0 [a2af1166] + SortingAlgorithms v1.2.1 [276daf66] + SpecialFunctions v2.5.0 [1e83bf80] + StaticArraysCore v1.4.3 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.7.0 [2913bbd2] + StatsBase v0.34.4 [4c63d2b9] + StatsFuns v1.4.0 ⌅ [09ab397b] + StructArrays v0.6.21 [856f2bd8] + StructTypes v1.11.0 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.12.0 [62fd8b95] + TensorCore v0.1.1 [a759f4b9] + TimerOutputs v0.5.28 [3bb67fe8] + TranscodingStreams v0.11.3 [6dd1b50a] + Tulip v0.9.6 [700de1a5] + ZygoteRules v0.2.7 [6e34b625] + Bzip2_jll v1.0.9+0 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [f50d1b31] + Rmath_jll v0.5.1+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9abbd945] + Profile v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [2f01184e] + SparseArrays v1.11.0 [4607b0f0] + SuiteSparse [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [4536629a] + OpenBLAS_jll v0.3.27+1 [05823500] + OpenLibm_jll v0.8.5+0 [bea87d4a] + SuiteSparse_jll v7.7.0+0 [83775a58] + Zlib_jll v1.2.13+1 [8e850b90] + libblastrampoline_jll v5.11.0+0 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 4.31s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 192.48s ################################################################################ # Testing # Testing CalibrationTests Status `/tmp/jl_TkwkgO/Project.toml` [4c88cf16] Aqua v0.8.11 [33913031] CalibrationErrors v0.6.4 [2818745e] CalibrationTests v0.6.3 [4937dc1f] ConsistencyResampling v0.3.3 [31c24e10] Distributions v0.25.118 [09f84164] HypothesisTests v0.11.5 [ec8451be] KernelFunctions v0.10.65 [189a3867] Reexport v1.2.2 [860ef19b] StableRNGs v1.0.2 [10745b16] Statistics v1.11.1 [2913bbd2] StatsBase v0.34.4 [4c63d2b9] StatsFuns v1.4.0 ⌅ [09ab397b] StructArrays v0.6.21 [37e2e46d] LinearAlgebra v1.11.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_TkwkgO/Manifest.toml` [14f7f29c] AMD v0.5.3 [7d9f7c33] Accessors v0.1.42 [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.11 [6e4b80f9] BenchmarkTools v1.6.0 [33913031] CalibrationErrors v0.6.4 [2818745e] CalibrationTests v0.6.3 [d360d2e6] ChainRulesCore v1.25.1 [523fee87] CodecBzip2 v0.8.5 [944b1d66] CodecZlib v0.7.8 [861a8166] Combinatorics v1.0.2 [38540f10] CommonSolve v0.2.4 [bbf7d656] CommonSubexpressions v0.3.1 [34da2185] Compat v4.16.0 [a33af91c] CompositionsBase v0.1.2 [4937dc1f] ConsistencyResampling v0.3.3 [187b0558] ConstructionBase v1.5.8 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [163ba53b] DiffResults v1.1.0 [b552c78f] DiffRules v1.15.1 [b4f34e82] Distances v0.10.12 [31c24e10] Distributions v0.25.118 [ffbed154] DocStringExtensions v0.9.4 [24df6009] ExactOptimalTransport v0.2.5 [e2ba6199] ExprTools v0.1.10 [9aa1b823] FastClosures v0.3.2 [1a297f60] FillArrays v1.13.0 [f6369f11] ForwardDiff v1.0.1 [d9f16b24] Functors v0.5.2 [34004b35] HypergeometricFunctions v0.3.28 [09f84164] HypothesisTests v0.11.5 [3587e190] InverseFunctions v0.1.17 [92d709cd] IrrationalConstants v0.2.4 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.0 [682c06a0] JSON v0.21.4 [0f8b85d8] JSON3 v1.14.2 [ec8451be] KernelFunctions v0.10.65 [ba0b0d4f] Krylov v0.9.10 [40e66cde] LDLFactorizations v0.10.1 [5c8ed15e] LinearOperators v2.9.0 [2ab3a3ac] LogExpFunctions v0.3.29 [1914dd2f] MacroTools v0.5.15 [b8f27783] MathOptInterface v1.38.1 [e1d29d7a] Missings v1.2.0 [d8a4904e] MutableArithmetics v1.6.4 [77ba4419] NaNMath v1.1.3 [bac558e1] OrderedCollections v1.8.0 [90014a1f] PDMats v0.11.33 [69de0a69] Parsers v2.8.1 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [43287f4e] PtrArrays v1.3.0 [10f199a5] QPSReader v0.2.1 [1fd47b50] QuadGK v2.11.2 [189a3867] Reexport v1.2.2 [ae029012] Requires v1.3.1 [79098fc4] Rmath v0.8.0 [f2b01f46] Roots v2.2.7 [ce78b400] SimpleUnPack v1.1.0 [a2af1166] SortingAlgorithms v1.2.1 [276daf66] SpecialFunctions v2.5.0 [860ef19b] StableRNGs v1.0.2 [1e83bf80] StaticArraysCore v1.4.3 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.7.0 [2913bbd2] StatsBase v0.34.4 [4c63d2b9] StatsFuns v1.4.0 ⌅ [09ab397b] StructArrays v0.6.21 [856f2bd8] StructTypes v1.11.0 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.0 [62fd8b95] TensorCore v0.1.1 [a759f4b9] TimerOutputs v0.5.28 [3bb67fe8] TranscodingStreams v0.11.3 [6dd1b50a] Tulip v0.9.6 [700de1a5] ZygoteRules v0.2.7 [6e34b625] Bzip2_jll v1.0.9+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [f50d1b31] Rmath_jll v0.5.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [2f01184e] SparseArrays v1.11.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [05823500] OpenLibm_jll v0.8.5+0 [bea87d4a] SuiteSparse_jll v7.7.0+0 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Aqua: Error During Test at /home/pkgeval/.julia/packages/CalibrationTests/Y6T40/test/aqua.jl:1 Got exception outside of a @test MethodError: no method matching test_all(::Module; ambiguities::Bool, project_toml_formatting::Bool) This error has been manually thrown, explicitly, so the method may exist but be intentionally marked as unimplemented. Closest candidates are: test_all(::Module; ambiguities, unbound_args, undefined_exports, project_extras, stale_deps, deps_compat, piracies, persistent_tasks) got unsupported keyword argument "project_toml_formatting" @ Aqua ~/.julia/packages/Aqua/epbUr/src/Aqua.jl:56 Stacktrace: [1] kwerr(::@NamedTuple{ambiguities::Bool, project_toml_formatting::Bool}, ::Function, ::Module) @ Base ./error.jl:165 [2] macro expansion @ ~/.julia/packages/CalibrationTests/Y6T40/test/aqua.jl:6 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] top-level scope @ ~/.julia/packages/CalibrationTests/Y6T40/test/aqua.jl:6 [5] include(fname::String) @ Main ./sysimg.jl:38 [6] macro expansion @ ~/.julia/packages/CalibrationTests/Y6T40/test/runtests.jl:16 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [8] macro expansion @ ~/.julia/packages/CalibrationTests/Y6T40/test/runtests.jl:16 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [10] top-level scope @ ~/.julia/packages/CalibrationTests/Y6T40/test/runtests.jl:15 [11] include(fname::String) @ Main ./sysimg.jl:38 [12] top-level scope @ none:6 [13] eval @ ./boot.jl:430 [inlined] [14] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [15] _start() @ Base ./client.jl:531 ┌ Warning: make_alias_table! is both internal and deprecated, use AliasTables.jl instead │ caller = ConsistencyResampling.AliasSampler(prediction::Vector{Float64}, floatsampler::Random.SamplerTrivial{Random.CloseOpen01{Float64}, Float64}, integersampler::Random.SamplerRangeNDL{UInt64, Int64}) at alias.jl:20 └ @ ConsistencyResampling ~/.julia/packages/ConsistencyResampling/J3kOH/src/alias.jl:20 Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.000345007 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.8020 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.201236 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000275148 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.8210 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.202138 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.0170757 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9530 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.195014 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.00448471 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9130 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198381 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.00117915 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.1900 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198981 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000727427 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2010 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.19987 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.000345007 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 1.0000 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.201236 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2821 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000275148 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 1.0000 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.202138 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-08 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.0170757 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9909 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.195014 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.3047 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.00448471 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9994 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198381 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2923 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.00117915 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 1.0000 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198981 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2902 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000727427 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 1.0000 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.19987 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2870 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.0170757 95% confidence interval: (0.0, Inf) Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9716 Details: number of observations per block: 2 number of blocks of observations: 250 z-statistic: -1.90451 standard error of evaluations of pairs of observations: 0.00896593 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.195014 95% confidence interval: (0.1645, Inf) Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-25 Details: number of observations per block: 2 number of blocks of observations: 250 z-statistic: 10.5046 standard error of evaluations of pairs of observations: 0.0185646 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.00448471 95% confidence interval: (0.0, Inf) Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9710 Details: number of observations per block: 10 number of blocks of observations: 50 z-statistic: -1.89579 standard error of evaluations of pairs of observations: 0.00236562 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198381 95% confidence interval: (0.1755, Inf) Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-45 Details: number of observations per block: 10 number of blocks of observations: 50 z-statistic: 14.2913 standard error of evaluations of pairs of observations: 0.0138813 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.00117915 95% confidence interval: (0.0, Inf) Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2324 Details: number of observations per block: 50 number of blocks of observations: 10 z-statistic: 0.73094 standard error of evaluations of pairs of observations: 0.0016132 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198981 95% confidence interval: (0.183, Inf) Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-92 Details: number of observations per block: 50 number of blocks of observations: 10 z-statistic: 20.4845 standard error of evaluations of pairs of observations: 0.00971375 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000727427 95% confidence interval: (0.0, Inf) Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2779 Details: number of observations per block: 100 number of blocks of observations: 5 z-statistic: 0.588951 standard error of evaluations of pairs of observations: 0.00123512 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.19987 95% confidence interval: (0.1881, Inf) Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: number of observations per block: 100 number of blocks of observations: 5 z-statistic: 27.8717 standard error of evaluations of pairs of observations: 0.00717106 Asymptotic SKCE test -------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.000345007 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.8260 Details: test statistic: -0.0006208465603674856 Asymptotic SKCE test -------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.201236 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: test statistic: -0.0004979008922686926 Asymptotic CME test ------------------- Population details: parameter of interest: Mean vector value under h_0: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0] point estimate: [0.000286133, -0.00484939, -0.000258507, 0.000255976, 0.00824945, 0.00105589, 0.00804896, 0.0068479, 0.000920529, 0.00731591] Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.1251 Details: number of observations: 500 number of test locations: 10 UCME estimate: 2.58949e-5 test statistic: 15.1965 Asymptotic CME test ------------------- Population details: parameter of interest: Mean vector value under h_0: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0] point estimate: [0.208427, -0.184933, -0.210616, 0.200109, 0.130239, 0.233877, 0.135295, 0.170037, -0.247142, 0.104442] Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: number of observations: 500 number of test locations: 10 UCME estimate: 0.035291 test statistic: 5757.34 Consistency test with ECE (2 classes) Consistency test with ECE (5 classes) Consistency test with ECE (10 classes) Consistency test with the linear SKCE estimator (2 classes) Consistency test with the linear SKCE estimator (5 classes) Consistency test with the linear SKCE estimator (10 classes) Consistency test with the linear SKCE estimator (2 classes) Consistency test with the linear SKCE estimator (5 classes) Consistency test with the linear SKCE estimator (10 classes) Test Summary: | Pass Error Total Time CalibrationTests | 2294 1 2295 4m23.9s General | 1 1 7.4s Aqua | 1 1 7.4s Binary trend | 36 36 2m01.3s Consistency test | 18 18 1m33.2s SKCE | 2128 2128 19.9s Asymptotic CME | 112 112 22.0s ERROR: LoadError: Some tests did not pass: 2294 passed, 0 failed, 1 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/CalibrationTests/Y6T40/test/runtests.jl:14 Testing failed after 284.67s ERROR: LoadError: Package CalibrationTests errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:2124 [3] test @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:2007 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:481 [5] test(pkgs::Vector{Pkg.Types.PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:159 [6] test @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:147 [inlined] [7] #test#74 @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:146 [inlined] [8] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 504.19s: package tests unexpectedly errored