Package evaluation of CalibrationTests on Julia 1.13.0-DEV.790 (77b90b9e62*) started at 2025-07-01T09:25:48.819 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 8.13s ################################################################################ # Installation # Installing CalibrationTests... Resolving package versions... Updating `~/.julia/environments/v1.13/Project.toml` [2818745e] + CalibrationTests v0.6.3 Updating `~/.julia/environments/v1.13/Manifest.toml` [14f7f29c] + AMD v0.5.3 [7d9f7c33] + Accessors v0.1.42 [66dad0bd] + AliasTables v1.1.3 [6e4b80f9] + BenchmarkTools v1.6.0 [33913031] + CalibrationErrors v0.6.4 [2818745e] + CalibrationTests v0.6.3 [d360d2e6] + ChainRulesCore v1.25.2 [523fee87] + CodecBzip2 v0.8.5 [944b1d66] + CodecZlib v0.7.8 [861a8166] + Combinatorics v1.0.3 [38540f10] + CommonSolve v0.2.4 [bbf7d656] + CommonSubexpressions v0.3.1 [34da2185] + Compat v4.16.0 [a33af91c] + CompositionsBase v0.1.2 [4937dc1f] + ConsistencyResampling v0.3.3 [187b0558] + ConstructionBase v1.6.0 [9a962f9c] + DataAPI v1.16.0 [864edb3b] + DataStructures v0.18.22 [e2d170a0] + DataValueInterfaces v1.0.0 [163ba53b] + DiffResults v1.1.0 [b552c78f] + DiffRules v1.15.1 [b4f34e82] + Distances v0.10.12 [31c24e10] + Distributions v0.25.120 [ffbed154] + DocStringExtensions v0.9.5 [24df6009] + ExactOptimalTransport v0.2.5 [e2ba6199] + ExprTools v0.1.10 [9aa1b823] + FastClosures v0.3.2 [1a297f60] + FillArrays v1.13.0 [f6369f11] + ForwardDiff v1.0.1 [d9f16b24] + Functors v0.5.2 [34004b35] + HypergeometricFunctions v0.3.28 [09f84164] + HypothesisTests v0.11.5 [3587e190] + InverseFunctions v0.1.17 [92d709cd] + IrrationalConstants v0.2.4 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.7.0 [682c06a0] + JSON v0.21.4 [0f8b85d8] + JSON3 v1.14.3 [ec8451be] + KernelFunctions v0.10.65 ⌅ [ba0b0d4f] + Krylov v0.9.10 [40e66cde] + LDLFactorizations v0.10.1 [5c8ed15e] + LinearOperators v2.10.0 [2ab3a3ac] + LogExpFunctions v0.3.29 [1914dd2f] + MacroTools v0.5.16 [b8f27783] + MathOptInterface v1.41.0 [e1d29d7a] + Missings v1.2.0 [d8a4904e] + MutableArithmetics v1.6.4 [77ba4419] + NaNMath v1.1.3 [bac558e1] + OrderedCollections v1.8.1 [90014a1f] + PDMats v0.11.35 [69de0a69] + Parsers v2.8.3 [aea7be01] + PrecompileTools v1.3.2 [21216c6a] + Preferences v1.4.3 [43287f4e] + PtrArrays v1.3.0 [10f199a5] + QPSReader v0.2.1 [1fd47b50] + QuadGK v2.11.2 [189a3867] + Reexport v1.2.2 [ae029012] + Requires v1.3.1 [79098fc4] + Rmath v0.8.0 [f2b01f46] + Roots v2.2.8 [ce78b400] + SimpleUnPack v1.1.0 [a2af1166] + SortingAlgorithms v1.2.1 [276daf66] + SpecialFunctions v2.5.1 [1e83bf80] + StaticArraysCore v1.4.3 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.7.1 [2913bbd2] + StatsBase v0.34.5 [4c63d2b9] + StatsFuns v1.5.0 ⌅ [09ab397b] + StructArrays v0.6.21 [856f2bd8] + StructTypes v1.11.0 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.12.1 [62fd8b95] + TensorCore v0.1.1 [a759f4b9] + TimerOutputs v0.5.29 [3bb67fe8] + TranscodingStreams v0.11.3 [6dd1b50a] + Tulip v0.9.7 [700de1a5] + ZygoteRules v0.2.7 [6e34b625] + Bzip2_jll v1.0.9+0 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [f50d1b31] + Rmath_jll v0.5.1+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.12.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.13.0 [de0858da] + Printf v1.11.0 [9abbd945] + Profile v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [2f01184e] + SparseArrays v1.12.0 [f489334b] + StyledStrings v1.11.0 [4607b0f0] + SuiteSparse [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.5.20 [4536629a] + OpenBLAS_jll v0.3.29+0 [05823500] + OpenLibm_jll v0.8.5+0 [458c3c95] + OpenSSL_jll v3.5.0+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [bea87d4a] + SuiteSparse_jll v7.10.1+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850b90] + libblastrampoline_jll v5.13.1+0 [8e850ede] + nghttp2_jll v1.65.0+0 [3f19e933] + p7zip_jll v17.5.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 4.36s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 235.7s ################################################################################ # Testing # Testing CalibrationTests Status `/tmp/jl_ObncQx/Project.toml` [4c88cf16] Aqua v0.8.13 [33913031] CalibrationErrors v0.6.4 [2818745e] CalibrationTests v0.6.3 [4937dc1f] ConsistencyResampling v0.3.3 [31c24e10] Distributions v0.25.120 [09f84164] HypothesisTests v0.11.5 [ec8451be] KernelFunctions v0.10.65 [189a3867] Reexport v1.2.2 [860ef19b] StableRNGs v1.0.3 [10745b16] Statistics v1.11.1 [2913bbd2] StatsBase v0.34.5 [4c63d2b9] StatsFuns v1.5.0 ⌅ [09ab397b] StructArrays v0.6.21 [37e2e46d] LinearAlgebra v1.12.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_ObncQx/Manifest.toml` [14f7f29c] AMD v0.5.3 [7d9f7c33] Accessors v0.1.42 [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.13 [6e4b80f9] BenchmarkTools v1.6.0 [33913031] CalibrationErrors v0.6.4 [2818745e] CalibrationTests v0.6.3 [d360d2e6] ChainRulesCore v1.25.2 [523fee87] CodecBzip2 v0.8.5 [944b1d66] CodecZlib v0.7.8 [861a8166] Combinatorics v1.0.3 [38540f10] CommonSolve v0.2.4 [bbf7d656] CommonSubexpressions v0.3.1 [34da2185] Compat v4.16.0 [a33af91c] CompositionsBase v0.1.2 [4937dc1f] ConsistencyResampling v0.3.3 [187b0558] ConstructionBase v1.6.0 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [163ba53b] DiffResults v1.1.0 [b552c78f] DiffRules v1.15.1 [b4f34e82] Distances v0.10.12 [31c24e10] Distributions v0.25.120 [ffbed154] DocStringExtensions v0.9.5 [24df6009] ExactOptimalTransport v0.2.5 [e2ba6199] ExprTools v0.1.10 [9aa1b823] FastClosures v0.3.2 [1a297f60] FillArrays v1.13.0 [f6369f11] ForwardDiff v1.0.1 [d9f16b24] Functors v0.5.2 [34004b35] HypergeometricFunctions v0.3.28 [09f84164] HypothesisTests v0.11.5 [3587e190] InverseFunctions v0.1.17 [92d709cd] IrrationalConstants v0.2.4 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.0 [682c06a0] JSON v0.21.4 [0f8b85d8] JSON3 v1.14.3 [ec8451be] KernelFunctions v0.10.65 ⌅ [ba0b0d4f] Krylov v0.9.10 [40e66cde] LDLFactorizations v0.10.1 [5c8ed15e] LinearOperators v2.10.0 [2ab3a3ac] LogExpFunctions v0.3.29 [1914dd2f] MacroTools v0.5.16 [b8f27783] MathOptInterface v1.41.0 [e1d29d7a] Missings v1.2.0 [d8a4904e] MutableArithmetics v1.6.4 [77ba4419] NaNMath v1.1.3 [bac558e1] OrderedCollections v1.8.1 [90014a1f] PDMats v0.11.35 [69de0a69] Parsers v2.8.3 [aea7be01] PrecompileTools v1.3.2 [21216c6a] Preferences v1.4.3 [43287f4e] PtrArrays v1.3.0 [10f199a5] QPSReader v0.2.1 [1fd47b50] QuadGK v2.11.2 [189a3867] Reexport v1.2.2 [ae029012] Requires v1.3.1 [79098fc4] Rmath v0.8.0 [f2b01f46] Roots v2.2.8 [ce78b400] SimpleUnPack v1.1.0 [a2af1166] SortingAlgorithms v1.2.1 [276daf66] SpecialFunctions v2.5.1 [860ef19b] StableRNGs v1.0.3 [1e83bf80] StaticArraysCore v1.4.3 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.7.1 [2913bbd2] StatsBase v0.34.5 [4c63d2b9] StatsFuns v1.5.0 ⌅ [09ab397b] StructArrays v0.6.21 [856f2bd8] StructTypes v1.11.0 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.1 [62fd8b95] TensorCore v0.1.1 [a759f4b9] TimerOutputs v0.5.29 [3bb67fe8] TranscodingStreams v0.11.3 [6dd1b50a] Tulip v0.9.7 [700de1a5] ZygoteRules v0.2.7 [6e34b625] Bzip2_jll v1.0.9+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [f50d1b31] Rmath_jll v0.5.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [2f01184e] SparseArrays v1.12.0 [f489334b] StyledStrings v1.11.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [4536629a] OpenBLAS_jll v0.3.29+0 [05823500] OpenLibm_jll v0.8.5+0 [458c3c95] OpenSSL_jll v3.5.0+0 [efcefdf7] PCRE2_jll v10.45.0+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [83775a58] Zlib_jll v1.3.1+2 [8e850b90] libblastrampoline_jll v5.13.1+0 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Aqua: Error During Test at /home/pkgeval/.julia/packages/CalibrationTests/Y6T40/test/aqua.jl:1 Got exception outside of a @test MethodError: no method matching test_all(::Module; ambiguities::Bool, project_toml_formatting::Bool) This method does not support all of the given keyword arguments (and may not support any). Closest candidates are: test_all(::Module; ambiguities, unbound_args, undefined_exports, project_extras, stale_deps, deps_compat, piracies, persistent_tasks, undocumented_names) got unsupported keyword argument "project_toml_formatting" @ Aqua ~/.julia/packages/Aqua/1UuaV/src/Aqua.jl:59 Stacktrace: [1] kwerr(::@NamedTuple{ambiguities::Bool, project_toml_formatting::Bool}, ::Function, ::Module) @ Base ./error.jl:175 [2] top-level scope @ ~/.julia/packages/CalibrationTests/Y6T40/test/aqua.jl:6 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [4] macro expansion @ ~/.julia/packages/CalibrationTests/Y6T40/test/aqua.jl:6 [inlined] [5] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [6] top-level scope @ ~/.julia/packages/CalibrationTests/Y6T40/test/runtests.jl:15 [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [8] macro expansion @ ~/.julia/packages/CalibrationTests/Y6T40/test/runtests.jl:16 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [10] macro expansion @ ~/.julia/packages/CalibrationTests/Y6T40/test/runtests.jl:16 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [12] top-level scope @ none:6 [13] eval(m::Module, e::Any) @ Core ./boot.jl:489 [14] exec_options(opts::Base.JLOptions) @ Base ./client.jl:290 [15] _start() @ Base ./client.jl:557 ┌ Warning: make_alias_table! is both internal and deprecated, use AliasTables.jl instead │ caller = ConsistencyResampling.AliasSampler(prediction::Vector{Float64}, floatsampler::Random.SamplerTrivial{Random.CloseOpen01{Float64}, Float64}, integersampler::Random.SamplerRangeNDL{UInt64, Int64}) at alias.jl:20 └ @ Core ~/.julia/packages/ConsistencyResampling/J3kOH/src/alias.jl:20 Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.000345007 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.8020 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.201236 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000275148 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.8210 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.202138 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.0170757 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9530 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.195014 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.00448471 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9130 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198381 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.00117915 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.1900 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198981 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000727427 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2010 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.19987 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.000345007 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 1.0000 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.201236 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2821 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000275148 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 1.0000 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.202138 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-08 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.0170757 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9909 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.195014 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.3047 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.00448471 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9994 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198381 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2923 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.00117915 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 1.0000 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198981 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2902 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000727427 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 1.0000 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.19987 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2870 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.0170757 95% confidence interval: (0.0, Inf) Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9716 Details: number of observations per block: 2 number of blocks of observations: 250 z-statistic: -1.90451 standard error of evaluations of pairs of observations: 0.00896593 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.195014 95% confidence interval: (0.1645, Inf) Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-25 Details: number of observations per block: 2 number of blocks of observations: 250 z-statistic: 10.5046 standard error of evaluations of pairs of observations: 0.0185646 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.00448471 95% confidence interval: (0.0, Inf) Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9710 Details: number of observations per block: 10 number of blocks of observations: 50 z-statistic: -1.89579 standard error of evaluations of pairs of observations: 0.00236562 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198381 95% confidence interval: (0.1755, Inf) Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-45 Details: number of observations per block: 10 number of blocks of observations: 50 z-statistic: 14.2913 standard error of evaluations of pairs of observations: 0.0138813 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.00117915 95% confidence interval: (0.0, Inf) Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2324 Details: number of observations per block: 50 number of blocks of observations: 10 z-statistic: 0.73094 standard error of evaluations of pairs of observations: 0.0016132 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198981 95% confidence interval: (0.183, Inf) Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-92 Details: number of observations per block: 50 number of blocks of observations: 10 z-statistic: 20.4845 standard error of evaluations of pairs of observations: 0.00971375 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000727427 95% confidence interval: (0.0, Inf) Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2779 Details: number of observations per block: 100 number of blocks of observations: 5 z-statistic: 0.588951 standard error of evaluations of pairs of observations: 0.00123512 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.19987 95% confidence interval: (0.1881, Inf) Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: number of observations per block: 100 number of blocks of observations: 5 z-statistic: 27.8717 standard error of evaluations of pairs of observations: 0.00717106 Asymptotic SKCE test -------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.000345007 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.8260 Details: test statistic: -0.0006208465603674856 Asymptotic SKCE test -------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.201236 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: test statistic: -0.0004979008922686926 Asymptotic CME test ------------------- Population details: parameter of interest: Mean vector value under h_0: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0] point estimate: [0.000286133, -0.00484939, -0.000258507, 0.000255976, 0.00824945, 0.00105589, 0.00804896, 0.0068479, 0.000920529, 0.00731591] Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.1251 Details: number of observations: 500 number of test locations: 10 UCME estimate: 2.58949e-5 test statistic: 15.1965 Asymptotic CME test ------------------- Population details: parameter of interest: Mean vector value under h_0: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0] point estimate: [0.208427, -0.184933, -0.210616, 0.200109, 0.130239, 0.233877, 0.135295, 0.170037, -0.247142, 0.104442] Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: number of observations: 500 number of test locations: 10 UCME estimate: 0.035291 test statistic: 5757.34 Consistency test with ECE (2 classes) ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 59 running 1 of 1 signal (10): User defined signal 1 _ZNK4llvm6object7ELFFileINS0_7ELFTypeILNS_10endiannessE1ELb1EEEE10getSectionEj at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) _ZNK4llvm6object7ELFFileINS0_7ELFTypeILNS_10endiannessE1ELb1EEEE8getEntryINS0_12Elf_Sym_ImplIS4_EEEENS_8ExpectedIPKT_EEjj at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) _ZNK4llvm6object13ELFObjectFileINS0_7ELFTypeILNS_10endiannessE1ELb1EEEE14getSymbolFlagsENS0_11DataRefImplE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) _ZNK4llvm6object10ObjectFile14getSymbolValueENS0_11DataRefImplE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) _ZNK4llvm6object13ELFObjectFileINS0_7ELFTypeILNS_10endiannessE1ELb1EEEE16getSymbolAddressENS0_11DataRefImplE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) getAddress at /source/usr/include/llvm/Object/ObjectFile.h:465 [inlined] get_function_name_and_base at /source/src/debuginfo.cpp:751 [inlined] jl_dylib_DI_for_fptr at /source/src/debuginfo.cpp:1150 jl_getDylibFunctionInfo at /source/src/debuginfo.cpp:1182 [inlined] jl_getFunctionInfo_impl at /source/src/debuginfo.cpp:1278 ijl_lookup_code_address at /source/src/stackwalk.c:616 lookup at ./stacktraces.jl:110 firstcaller at ./deprecated.jl:295 [inlined] firstcaller at ./deprecated.jl:290 [inlined] macro expansion at ./deprecated.jl:270 [inlined] macro expansion at ./logging/logging.jl:401 [inlined] _depwarn at ./deprecated.jl:265 jfptr__depwarn_29532.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 jl_apply at /source/src/julia.h:2344 [inlined] jl_f_invoke_in_world at /source/src/builtins.c:896 #invokelatest_gr#232 at ./reflection.jl:1280 [inlined] invokelatest_gr at ./reflection.jl:1274 [inlined] #depwarn#955 at ./deprecated.jl:256 [inlined] depwarn at ./deprecated.jl:251 [inlined] make_alias_table! at /home/pkgeval/.julia/packages/StatsBase/s2YJR/src/deprecates.jl:53 AliasSampler at /home/pkgeval/.julia/packages/ConsistencyResampling/J3kOH/src/alias.jl:20 #make_samplers##0 at /home/pkgeval/.julia/packages/ConsistencyResampling/J3kOH/src/many.jl:22 [inlined] iterate at ./generator.jl:48 [inlined] collect_to! at ./array.jl:854 [inlined] collect_to_with_first! at ./array.jl:832 [inlined] _collect at ./array.jl:826 collect_similar at ./array.jl:738 [inlined] map at ./abstractarray.jl:3374 [inlined] make_samplers at /home/pkgeval/.julia/packages/ConsistencyResampling/J3kOH/src/many.jl:21 [inlined] Sampler at /home/pkgeval/.julia/packages/ConsistencyResampling/J3kOH/src/many.jl:5 [inlined] Sampler at /source/usr/share/julia/stdlib/v1.13/Random/src/Random.jl:143 [inlined] Sampler at /source/usr/share/julia/stdlib/v1.13/Random/src/Random.jl:143 [inlined] #pvalue#2 at /home/pkgeval/.julia/packages/CalibrationTests/Y6T40/src/consistency.jl:42 pvalue at /home/pkgeval/.julia/packages/CalibrationTests/Y6T40/src/consistency.jl:30 [inlined] #pvalue#1 at /home/pkgeval/.julia/packages/CalibrationTests/Y6T40/src/consistency.jl:28 [inlined] pvalue at /home/pkgeval/.julia/packages/CalibrationTests/Y6T40/src/consistency.jl:27 [inlined] #26 at ./none (unknown line) [inlined] iterate at ./generator.jl:48 [inlined] collect_to! at ./array.jl:854 [inlined] collect_to_with_first! at ./array.jl:832 [inlined] collect at ./array.jl:806 unknown function (ip: 0x70b4a5f14a33) at (unknown file) _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 jl_apply at /source/src/julia.h:2344 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_body at /source/src/interpreter.c:581 eval_body at /source/src/interpreter.c:558 eval_body at /source/src/interpreter.c:558 eval_body at /source/src/interpreter.c:558 eval_body at /source/src/interpreter.c:558 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 jl_toplevel_eval_flex at /source/src/toplevel.c:713 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 include_string at ./loading.jl:2846 _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 _include at ./loading.jl:2906 include at ./Base.jl:310 IncludeInto at ./Base.jl:311 jfptr_IncludeInto_48869.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 jl_apply at /source/src/julia.h:2344 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:708 eval_body at /source/src/interpreter.c:558 eval_body at /source/src/interpreter.c:558 eval_body at /source/src/interpreter.c:558 eval_body at /source/src/interpreter.c:558 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 jl_toplevel_eval_flex at /source/src/toplevel.c:713 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 include_string at ./loading.jl:2846 _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 _include at ./loading.jl:2906 include at ./Base.jl:310 IncludeInto at ./Base.jl:311 jfptr_IncludeInto_48869.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 jl_apply at /source/src/julia.h:2344 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:708 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 jl_toplevel_eval_flex at /source/src/toplevel.c:713 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 exec_options at ./client.jl:290 _start at ./client.jl:557 jfptr__start_72357.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 jl_apply at /source/src/julia.h:2344 [inlined] true_main at /source/src/jlapi.c:964 jl_repl_entrypoint at /source/src/jlapi.c:1132 main at /source/cli/loader_exe.c:58 unknown function (ip: 0x70b4a723b249) at /lib/x86_64-linux-gnu/libc.so.6 __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) unknown function (ip: 0x4010b8) at /workspace/srcdir/glibc-2.17/csu/../sysdeps/x86_64/start.S unknown function (ip: (nil)) at (unknown file) ============================================================== Profile collected. A report will print at the next yield point ============================================================== ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 1 running 0 of 1 signal (10): User defined signal 1 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_42615.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 jl_apply at /source/src/julia.h:2344 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) ============================================================== Profile collected. A report will print at the next yield point ============================================================== ┌ Warning: There were no samples collected in one or more groups. │ This may be due to idle threads, or you may need to run your │ program longer (perhaps by running it multiple times), │ or adjust the delay between samples with `Profile.init()`. └ @ Profile /opt/julia/share/julia/stdlib/v1.13/Profile/src/Profile.jl:1362 Overhead ╎ [+additional indent] Count File:Line Function ========================================================= Thread 1 (default) Task 0x000079da60736b30 Total snapshots: 495. Utilization: 0% ╎495 @Base/task.jl:1150 wait_forever() 494╎ 495 @Base/task.jl:1213 wait() [1] signal 15: Terminated in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 [59] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/CalibrationTests/Y6T40/test/consistency.jl:1 wait at ./task.jl:1213 _ZN4llvm8ExpectedINS_8ArrayRefINS_6object13Elf_Shdr_ImplINS2_7ELFTypeILNS_10endiannessE1ELb1EEEEEEEED1Ev at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) _ZNK4llvm6object7ELFFileINS0_7ELFTypeILNS_10endiannessE1ELb1EEEE10getSectionEj at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) _ZNK4llvm6object13ELFObjectFileINS0_7ELFTypeILNS_10endiannessE1ELb1EEEE16getSymbolSectionENS0_11DataRefImplE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) _ZNK4llvm6object10SectionRef14containsSymbolENS0_9SymbolRefE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) get_function_name_and_base at /source/src/debuginfo.cpp:749 [inlined] jl_dylib_DI_for_fptr at /source/src/debuginfo.cpp:1150 jl_getDylibFunctionInfo at /source/src/debuginfo.cpp:1182 [inlined] jl_getFunctionInfo_impl at /source/src/debuginfo.cpp:1278 ijl_lookup_code_address at /source/src/stackwalk.c:616 wait_forever at ./task.jl:1150 lookup at ./stacktraces.jl:110 jfptr_wait_forever_42615.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 jl_apply at /source/src/julia.h:2344 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) Allocations: 20799669 (Pool: 20799162; Big: 507); GC: 19 firstcaller at ./deprecated.jl:295 [inlined] firstcaller at ./deprecated.jl:290 [inlined] macro expansion at ./deprecated.jl:270 [inlined] macro expansion at ./logging/logging.jl:401 [inlined] _depwarn at ./deprecated.jl:265 jfptr__depwarn_29532.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 jl_apply at /source/src/julia.h:2344 [inlined] jl_f_invoke_in_world at /source/src/builtins.c:896 #invokelatest_gr#232 at ./reflection.jl:1280 [inlined] invokelatest_gr at ./reflection.jl:1274 [inlined] #depwarn#955 at ./deprecated.jl:256 [inlined] depwarn at ./deprecated.jl:251 [inlined] make_alias_table! at /home/pkgeval/.julia/packages/StatsBase/s2YJR/src/deprecates.jl:53 AliasSampler at /home/pkgeval/.julia/packages/ConsistencyResampling/J3kOH/src/alias.jl:20 #make_samplers##0 at /home/pkgeval/.julia/packages/ConsistencyResampling/J3kOH/src/many.jl:22 [inlined] iterate at ./generator.jl:48 [inlined] collect_to! at ./array.jl:854 [inlined] collect_to_with_first! at ./array.jl:832 [inlined] _collect at ./array.jl:826 collect_similar at ./array.jl:738 [inlined] map at ./abstractarray.jl:3374 [inlined] make_samplers at /home/pkgeval/.julia/packages/ConsistencyResampling/J3kOH/src/many.jl:21 [inlined] Sampler at /home/pkgeval/.julia/packages/ConsistencyResampling/J3kOH/src/many.jl:5 [inlined] Sampler at /source/usr/share/julia/stdlib/v1.13/Random/src/Random.jl:143 [inlined] Sampler at /source/usr/share/julia/stdlib/v1.13/Random/src/Random.jl:143 [inlined] #pvalue#2 at /home/pkgeval/.julia/packages/CalibrationTests/Y6T40/src/consistency.jl:42 pvalue at /home/pkgeval/.julia/packages/CalibrationTests/Y6T40/src/consistency.jl:30 [inlined] #pvalue#1 at /home/pkgeval/.julia/packages/CalibrationTests/Y6T40/src/consistency.jl:28 [inlined] pvalue at /home/pkgeval/.julia/packages/CalibrationTests/Y6T40/src/consistency.jl:27 [inlined] #26 at ./none (unknown line) [inlined] iterate at ./generator.jl:48 [inlined] collect_to! at ./array.jl:854 [inlined] collect_to_with_first! at ./array.jl:832 [inlined] collect at ./array.jl:806 unknown function (ip: 0x70b4a5f14a33) at (unknown file) _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 jl_apply at /source/src/julia.h:2344 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_body at /source/src/interpreter.c:581 eval_body at /source/src/interpreter.c:558 eval_body at /source/src/interpreter.c:558 eval_body at /source/src/interpreter.c:558 eval_body at /source/src/interpreter.c:558 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 jl_toplevel_eval_flex at /source/src/toplevel.c:713 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 include_string at ./loading.jl:2846 _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 _include at ./loading.jl:2906 include at ./Base.jl:310 IncludeInto at ./Base.jl:311 jfptr_IncludeInto_48869.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 jl_apply at /source/src/julia.h:2344 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:708 eval_body at /source/src/interpreter.c:558 eval_body at /source/src/interpreter.c:558 eval_body at /source/src/interpreter.c:558 eval_body at /source/src/interpreter.c:558 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 jl_toplevel_eval_flex at /source/src/toplevel.c:713 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 include_string at ./loading.jl:2846 _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 _include at ./loading.jl:2906 include at ./Base.jl:310 IncludeInto at ./Base.jl:311 jfptr_IncludeInto_48869.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 jl_apply at /source/src/julia.h:2344 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:708 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 jl_toplevel_eval_flex at /source/src/toplevel.c:713 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 exec_options at ./client.jl:290 _start at ./client.jl:557 jfptr__start_72357.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3693 [inlined] ijl_apply_generic at /source/src/gf.c:3893 jl_apply at /source/src/julia.h:2344 [inlined] true_main at /source/src/jlapi.c:964 jl_repl_entrypoint at /source/src/jlapi.c:1132 main at /source/cli/loader_exe.c:58 unknown function (ip: 0x70b4a723b249) at /lib/x86_64-linux-gnu/libc.so.6 __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) unknown function (ip: 0x4010b8) at /workspace/srcdir/glibc-2.17/csu/../sysdeps/x86_64/start.S unknown function (ip: (nil)) at (unknown file) Allocations: 94866612 (Pool: 94866266; Big: 346); GC: 106 PkgEval terminated after 2728.22s: test duration exceeded the time limit