Package evaluation of CalibrationTests on Julia 1.12.0-DEV.1805 (a080deafdd*) started at 2025-03-24T20:58:31.285 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 8.96s ################################################################################ # Installation # Installing CalibrationTests... Resolving package versions... Updating `~/.julia/environments/v1.12/Project.toml` [2818745e] + CalibrationTests v0.6.3 Updating `~/.julia/environments/v1.12/Manifest.toml` [14f7f29c] + AMD v0.5.3 [7d9f7c33] + Accessors v0.1.42 [66dad0bd] + AliasTables v1.1.3 [6e4b80f9] + BenchmarkTools v1.6.0 [33913031] + CalibrationErrors v0.6.4 [2818745e] + CalibrationTests v0.6.3 [d360d2e6] + ChainRulesCore v1.25.1 [523fee87] + CodecBzip2 v0.8.5 [944b1d66] + CodecZlib v0.7.8 [861a8166] + Combinatorics v1.0.2 [38540f10] + CommonSolve v0.2.4 [bbf7d656] + CommonSubexpressions v0.3.1 [34da2185] + Compat v4.16.0 [a33af91c] + CompositionsBase v0.1.2 [4937dc1f] + ConsistencyResampling v0.3.3 [187b0558] + ConstructionBase v1.5.8 [9a962f9c] + DataAPI v1.16.0 [864edb3b] + DataStructures v0.18.22 [e2d170a0] + DataValueInterfaces v1.0.0 [163ba53b] + DiffResults v1.1.0 [b552c78f] + DiffRules v1.15.1 [b4f34e82] + Distances v0.10.12 [31c24e10] + Distributions v0.25.118 [ffbed154] + DocStringExtensions v0.9.3 [24df6009] + ExactOptimalTransport v0.2.5 [e2ba6199] + ExprTools v0.1.10 [9aa1b823] + FastClosures v0.3.2 [1a297f60] + FillArrays v1.13.0 [f6369f11] + ForwardDiff v0.10.38 [d9f16b24] + Functors v0.5.2 [34004b35] + HypergeometricFunctions v0.3.28 [09f84164] + HypothesisTests v0.11.3 [3587e190] + InverseFunctions v0.1.17 [92d709cd] + IrrationalConstants v0.2.4 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.7.0 [682c06a0] + JSON v0.21.4 [0f8b85d8] + JSON3 v1.14.1 [ec8451be] + KernelFunctions v0.10.65 [ba0b0d4f] + Krylov v0.9.10 [40e66cde] + LDLFactorizations v0.10.1 [5c8ed15e] + LinearOperators v2.9.0 [2ab3a3ac] + LogExpFunctions v0.3.29 [1914dd2f] + MacroTools v0.5.15 [b8f27783] + MathOptInterface v1.38.0 [e1d29d7a] + Missings v1.2.0 [d8a4904e] + MutableArithmetics v1.6.4 [77ba4419] + NaNMath v1.1.2 [bac558e1] + OrderedCollections v1.8.0 [90014a1f] + PDMats v0.11.32 [69de0a69] + Parsers v2.8.1 [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [43287f4e] + PtrArrays v1.3.0 [10f199a5] + QPSReader v0.2.1 [1fd47b50] + QuadGK v2.11.2 [189a3867] + Reexport v1.2.2 [ae029012] + Requires v1.3.1 [79098fc4] + Rmath v0.8.0 [f2b01f46] + Roots v2.2.6 [ce78b400] + SimpleUnPack v1.1.0 [a2af1166] + SortingAlgorithms v1.2.1 [276daf66] + SpecialFunctions v2.5.0 [1e83bf80] + StaticArraysCore v1.4.3 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.7.0 [2913bbd2] + StatsBase v0.34.4 [4c63d2b9] + StatsFuns v1.3.2 ⌅ [09ab397b] + StructArrays v0.6.21 [856f2bd8] + StructTypes v1.11.0 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.12.0 [62fd8b95] + TensorCore v0.1.1 [a759f4b9] + TimerOutputs v0.5.28 [3bb67fe8] + TranscodingStreams v0.11.3 [6dd1b50a] + Tulip v0.9.6 [700de1a5] + ZygoteRules v0.2.7 [6e34b625] + Bzip2_jll v1.0.9+0 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [f50d1b31] + Rmath_jll v0.5.1+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [dc6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.12.0 [de0858da] + Printf v1.11.0 [9abbd945] + Profile v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [2f01184e] + SparseArrays v1.12.0 [f489334b] + StyledStrings v1.11.0 [4607b0f0] + SuiteSparse [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.2.0+0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.8.0+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+1 [14a3606d] + MozillaCACerts_jll v2024.11.26 [4536629a] + OpenBLAS_jll v0.3.28+3 [05823500] + OpenLibm_jll v0.8.1+3 [bea87d4a] + SuiteSparse_jll v7.8.0+1 [83775a58] + Zlib_jll v1.3.1+1 [8e850b90] + libblastrampoline_jll v5.11.2+0 [8e850ede] + nghttp2_jll v1.63.0+1 [3f19e933] + p7zip_jll v17.5.0+1 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 4.2s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 85.01s ################################################################################ # Testing # Testing CalibrationTests Status `/tmp/jl_wyd3MM/Project.toml` [4c88cf16] Aqua v0.8.11 [33913031] CalibrationErrors v0.6.4 [2818745e] CalibrationTests v0.6.3 [4937dc1f] ConsistencyResampling v0.3.3 [31c24e10] Distributions v0.25.118 [09f84164] HypothesisTests v0.11.3 [ec8451be] KernelFunctions v0.10.65 [189a3867] Reexport v1.2.2 [860ef19b] StableRNGs v1.0.2 [10745b16] Statistics v1.11.1 [2913bbd2] StatsBase v0.34.4 [4c63d2b9] StatsFuns v1.3.2 ⌅ [09ab397b] StructArrays v0.6.21 [37e2e46d] LinearAlgebra v1.11.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_wyd3MM/Manifest.toml` [14f7f29c] AMD v0.5.3 [7d9f7c33] Accessors v0.1.42 [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.11 [6e4b80f9] BenchmarkTools v1.6.0 [33913031] CalibrationErrors v0.6.4 [2818745e] CalibrationTests v0.6.3 [d360d2e6] ChainRulesCore v1.25.1 [523fee87] CodecBzip2 v0.8.5 [944b1d66] CodecZlib v0.7.8 [861a8166] Combinatorics v1.0.2 [38540f10] CommonSolve v0.2.4 [bbf7d656] CommonSubexpressions v0.3.1 [34da2185] Compat v4.16.0 [a33af91c] CompositionsBase v0.1.2 [4937dc1f] ConsistencyResampling v0.3.3 [187b0558] ConstructionBase v1.5.8 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [163ba53b] DiffResults v1.1.0 [b552c78f] DiffRules v1.15.1 [b4f34e82] Distances v0.10.12 [31c24e10] Distributions v0.25.118 [ffbed154] DocStringExtensions v0.9.3 [24df6009] ExactOptimalTransport v0.2.5 [e2ba6199] ExprTools v0.1.10 [9aa1b823] FastClosures v0.3.2 [1a297f60] FillArrays v1.13.0 [f6369f11] ForwardDiff v0.10.38 [d9f16b24] Functors v0.5.2 [34004b35] HypergeometricFunctions v0.3.28 [09f84164] HypothesisTests v0.11.3 [3587e190] InverseFunctions v0.1.17 [92d709cd] IrrationalConstants v0.2.4 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.0 [682c06a0] JSON v0.21.4 [0f8b85d8] JSON3 v1.14.1 [ec8451be] KernelFunctions v0.10.65 [ba0b0d4f] Krylov v0.9.10 [40e66cde] LDLFactorizations v0.10.1 [5c8ed15e] LinearOperators v2.9.0 [2ab3a3ac] LogExpFunctions v0.3.29 [1914dd2f] MacroTools v0.5.15 [b8f27783] MathOptInterface v1.38.0 [e1d29d7a] Missings v1.2.0 [d8a4904e] MutableArithmetics v1.6.4 [77ba4419] NaNMath v1.1.2 [bac558e1] OrderedCollections v1.8.0 [90014a1f] PDMats v0.11.32 [69de0a69] Parsers v2.8.1 [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [43287f4e] PtrArrays v1.3.0 [10f199a5] QPSReader v0.2.1 [1fd47b50] QuadGK v2.11.2 [189a3867] Reexport v1.2.2 [ae029012] Requires v1.3.1 [79098fc4] Rmath v0.8.0 [f2b01f46] Roots v2.2.6 [ce78b400] SimpleUnPack v1.1.0 [a2af1166] SortingAlgorithms v1.2.1 [276daf66] SpecialFunctions v2.5.0 [860ef19b] StableRNGs v1.0.2 [1e83bf80] StaticArraysCore v1.4.3 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.7.0 [2913bbd2] StatsBase v0.34.4 [4c63d2b9] StatsFuns v1.3.2 ⌅ [09ab397b] StructArrays v0.6.21 [856f2bd8] StructTypes v1.11.0 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.0 [62fd8b95] TensorCore v0.1.1 [a759f4b9] TimerOutputs v0.5.28 [3bb67fe8] TranscodingStreams v0.11.3 [6dd1b50a] Tulip v0.9.6 [700de1a5] ZygoteRules v0.2.7 [6e34b625] Bzip2_jll v1.0.9+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [f50d1b31] Rmath_jll v0.5.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [dc6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.12.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [2f01184e] SparseArrays v1.12.0 [f489334b] StyledStrings v1.11.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.2.0+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.8.0+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+1 [14a3606d] MozillaCACerts_jll v2024.11.26 [4536629a] OpenBLAS_jll v0.3.28+3 [05823500] OpenLibm_jll v0.8.1+3 [bea87d4a] SuiteSparse_jll v7.8.0+1 [83775a58] Zlib_jll v1.3.1+1 [8e850b90] libblastrampoline_jll v5.11.2+0 [8e850ede] nghttp2_jll v1.63.0+1 [3f19e933] p7zip_jll v17.5.0+1 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Aqua: Error During Test at /home/pkgeval/.julia/packages/CalibrationTests/Y6T40/test/aqua.jl:1 Got exception outside of a @test MethodError: no method matching test_all(::Module; ambiguities::Bool, project_toml_formatting::Bool) This method does not support all of the given keyword arguments (and may not support any). Closest candidates are: test_all(::Module; ambiguities, unbound_args, undefined_exports, project_extras, stale_deps, deps_compat, piracies, persistent_tasks) got unsupported keyword argument "project_toml_formatting" @ Aqua ~/.julia/packages/Aqua/epbUr/src/Aqua.jl:56 Stacktrace: [1] kwerr(::@NamedTuple{ambiguities::Bool, project_toml_formatting::Bool}, ::Function, ::Module) @ Base ./error.jl:175 [2] top-level scope @ ~/.julia/packages/CalibrationTests/Y6T40/test/aqua.jl:6 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1724 [inlined] [4] macro expansion @ ~/.julia/packages/CalibrationTests/Y6T40/test/aqua.jl:6 [inlined] [5] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:301 [6] top-level scope @ ~/.julia/packages/CalibrationTests/Y6T40/test/runtests.jl:15 [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1724 [inlined] [8] macro expansion @ ~/.julia/packages/CalibrationTests/Y6T40/test/runtests.jl:16 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1724 [inlined] [10] macro expansion @ ~/.julia/packages/CalibrationTests/Y6T40/test/runtests.jl:16 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:301 [12] top-level scope @ none:6 [13] eval(m::Module, e::Any) @ Core ./boot.jl:485 [14] exec_options(opts::Base.JLOptions) @ Base ./client.jl:295 [15] _start() @ Base ./client.jl:558 ┌ Warning: make_alias_table! is both internal and deprecated, use AliasTables.jl instead │ caller = ConsistencyResampling.AliasSampler(prediction::Vector{Float64}, floatsampler::Random.SamplerTrivial{Random.CloseOpen01{Float64}, Float64}, integersampler::Random.SamplerRangeNDL{UInt64, Int64}) at alias.jl:20 └ @ Core ~/.julia/packages/ConsistencyResampling/J3kOH/src/alias.jl:20 Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.000345007 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.8020 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.201236 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000275148 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.8210 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.202138 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.0170757 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9530 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.195014 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.00448471 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9130 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198381 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.00117915 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.1900 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198981 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000727427 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2010 Details: Consistency resampling test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.19987 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.000345007 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 1.0000 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.201236 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2821 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000275148 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 1.0000 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.202138 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-08 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.0170757 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9909 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.195014 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.3047 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.00448471 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9994 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198381 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2923 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.00117915 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 1.0000 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198981 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2902 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000727427 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 1.0000 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Distribution-free SKCE test --------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.19987 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2870 Details: number of observations: 500 uniform bound of the terms of the estimator: 2 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.0170757 95% confidence interval: (0.0, Inf) Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9716 Details: number of observations per block: 2 number of blocks of observations: 250 z-statistic: -1.90451 standard error of evaluations of pairs of observations: 0.00896593 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.195014 95% confidence interval: (0.1645, Inf) Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-25 Details: number of observations per block: 2 number of blocks of observations: 250 z-statistic: 10.5046 standard error of evaluations of pairs of observations: 0.0185646 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.00448471 95% confidence interval: (0.0, Inf) Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.9710 Details: number of observations per block: 10 number of blocks of observations: 50 z-statistic: -1.89579 standard error of evaluations of pairs of observations: 0.00236562 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198381 95% confidence interval: (0.1755, Inf) Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-45 Details: number of observations per block: 10 number of blocks of observations: 50 z-statistic: 14.2913 standard error of evaluations of pairs of observations: 0.0138813 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.00117915 95% confidence interval: (0.0, Inf) Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2324 Details: number of observations per block: 50 number of blocks of observations: 10 z-statistic: 0.73094 standard error of evaluations of pairs of observations: 0.0016132 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.198981 95% confidence interval: (0.183, Inf) Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-92 Details: number of observations per block: 50 number of blocks of observations: 10 z-statistic: 20.4845 standard error of evaluations of pairs of observations: 0.00971375 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.000727427 95% confidence interval: (0.0, Inf) Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.2779 Details: number of observations per block: 100 number of blocks of observations: 5 z-statistic: 0.588951 standard error of evaluations of pairs of observations: 0.00123512 Asymptotic block SKCE test -------------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.19987 95% confidence interval: (0.1881, Inf) Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: number of observations per block: 100 number of blocks of observations: 5 z-statistic: 27.8717 standard error of evaluations of pairs of observations: 0.00717106 Asymptotic SKCE test -------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: -0.000345007 Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.8260 Details: test statistic: -0.0006208465603674856 Asymptotic SKCE test -------------------- Population details: parameter of interest: SKCE value under h_0: 0.0 point estimate: 0.201236 Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: test statistic: -0.0004979008922686926 Asymptotic CME test ------------------- Population details: parameter of interest: Mean vector value under h_0: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0] point estimate: [0.000286133, -0.00484939, -0.000258507, 0.000255976, 0.00824945, 0.00105589, 0.00804896, 0.0068479, 0.000920529, 0.00731591] Test summary: outcome with 95% confidence: fail to reject h_0 one-sided p-value: 0.1251 Details: number of observations: 500 number of test locations: 10 UCME estimate: 2.58949e-5 test statistic: 15.1965 Asymptotic CME test ------------------- Population details: parameter of interest: Mean vector value under h_0: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0] point estimate: [0.208427, -0.184933, -0.210616, 0.200109, 0.130239, 0.233877, 0.135295, 0.170037, -0.247142, 0.104442] Test summary: outcome with 95% confidence: reject h_0 one-sided p-value: <1e-99 Details: number of observations: 500 number of test locations: 10 UCME estimate: 0.035291 test statistic: 5757.34 Consistency test with ECE (2 classes) Consistency test with ECE (5 classes) ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 63 running 1 of 1 signal (10): User defined signal 1 _ZNK4llvm6object7ELFFileINS0_7ELFTypeILNS_10endiannessE1ELb1EEEE25getSectionContentsAsArrayINS0_12Elf_Sym_ImplIS4_EEEENS_8ExpectedINS_8ArrayRefIT_EEEERKNS0_13Elf_Shdr_ImplIS4_EE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) unknown function (ip: (nil)) at (unknown file) ============================================================== Profile collected. A report will print at the next yield point ============================================================== ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 1 running 0 of 1 signal (10): User defined signal 1 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:454 poptask at ./task.jl:1187 wait at ./task.jl:1199 #wait#551 at ./condition.jl:141 wait at ./condition.jl:136 [inlined] wait at ./process.jl:694 wait at ./process.jl:687 jfptr_wait_97191.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3359 [inlined] ijl_apply_generic at /source/src/gf.c:3547 subprocess_handler at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2377 unknown function (ip: 0x70d1164bbd53) at (unknown file) _jl_invoke at /source/src/gf.c:3359 [inlined] ijl_apply_generic at /source/src/gf.c:3547 #201 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2317 withenv at ./env.jl:265 #186 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2138 with_temp_env at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:1996 #182 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2105 #mktempdir#21 at ./file.jl:899 unknown function (ip: 0x70d1164aa3ac) at (unknown file) _jl_invoke at /source/src/gf.c:3359 [inlined] ijl_apply_generic at /source/src/gf.c:3547 mktempdir at ./file.jl:895 mktempdir at ./file.jl:895 #sandbox#178 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2052 [inlined] sandbox at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2044 unknown function (ip: 0x70d1164a53e9) at (unknown file) _jl_invoke at /source/src/gf.c:3359 [inlined] ijl_apply_generic at /source/src/gf.c:3547 #test#189 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2302 test at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2214 [inlined] #test#170 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:481 test at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:460 unknown function (ip: 0x70d1164a5021) at (unknown file) _jl_invoke at /source/src/gf.c:3359 [inlined] ijl_apply_generic at /source/src/gf.c:3547 #test#84 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:159 unknown function (ip: 0x70d11649ddb8) at (unknown file) _jl_invoke at /source/src/gf.c:3359 [inlined] ijl_apply_generic at /source/src/gf.c:3547 test at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:148 #test#82 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:147 test at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:147 [inlined] #test#81 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:146 [inlined] test at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:146 unknown function (ip: 0x70d1164996ef) at (unknown file) _jl_invoke at /source/src/gf.c:3359 [inlined] ijl_apply_generic at /source/src/gf.c:3547 jl_apply at /source/src/julia.h:2244 [inlined] do_call at /source/src/interpreter.c:125 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:687 eval_body at /source/src/interpreter.c:562 eval_body at /source/src/interpreter.c:562 jl_interpret_toplevel_thunk at /source/src/interpreter.c:896 jl_toplevel_eval_flex at /source/src/toplevel.c:1070 jl_toplevel_eval_flex at /source/src/toplevel.c:1010 ijl_toplevel_eval at /source/src/toplevel.c:1082 ijl_toplevel_eval_in at /source/src/toplevel.c:1127 eval at ./boot.jl:485 include_string at ./loading.jl:2846 _jl_invoke at /source/src/gf.c:3359 [inlined] ijl_apply_generic at /source/src/gf.c:3547 _include at ./loading.jl:2906 include at ./Base.jl:300 exec_options at ./client.jl:329 _start at ./client.jl:558 jfptr__start_108457.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3359 [inlined] ijl_apply_generic at /source/src/gf.c:3547 jl_apply at /source/src/julia.h:2244 [inlined] true_main at /source/src/jlapi.c:922 jl_repl_entrypoint at /source/src/jlapi.c:1081 main at /source/cli/loader_exe.c:58 unknown function (ip: 0x70d118092249) at /lib/x86_64-linux-gnu/libc.so.6 __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) unknown function (ip: 0x4010b8) at /workspace/srcdir/glibc-2.17/csu/../sysdeps/x86_64/start.S unknown function (ip: (nil)) at (unknown file) ============================================================== Profile collected. A report will print at the next yield point ============================================================== ┌ Warning: There were no samples collected in one or more groups. │ This may be due to idle threads, or you may need to run your │ program longer (perhaps by running it multiple times), │ or adjust the delay between samples with `Profile.init()`. └ @ Profile /opt/julia/share/julia/stdlib/v1.12/Profile/src/Profile.jl:1353 Overhead ╎ [+additional indent] Count File:Line Function ========================================================= Thread 1 (default) Task 0x000070d109e00010 Total snapshots: 1. Utilization: 0% ╎1 @Base/client.jl:558 _start() ╎ 1 @Base/client.jl:329 exec_options(opts::Base.JLOptions) ╎ 1 @Base/Base.jl:300 include(mod::Module, _path::String) ╎ 1 @Base/loading.jl:2906 _include(mapexpr::Function, mod::Module, _path::S… ╎ 1 @Base/loading.jl:2846 include_string(mapexpr::typeof(identity), mod::M… ╎ 1 @Base/boot.jl:485 eval(m::Module, e::Any) ╎ ╎ 1 @Pkg/src/API.jl:146 kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(… ╎ ╎ 1 @Pkg/src/API.jl:146 #test#81 ╎ ╎ 1 @Pkg/src/API.jl:147 test ╎ ╎ 1 @Pkg/src/API.jl:147 test(pkgs::Vector{String}; kwargs::Base.Pairs… ╎ ╎ 1 @Pkg/src/API.jl:148 kwcall(::@NamedTuple{julia_args::Cmd}, ::typ… ╎ ╎ ╎ 1 @Pkg/src/API.jl:159 test(pkgs::Vector{Pkg.Types.PackageSpec}; i… ╎ ╎ ╎ 1 @Pkg/src/API.jl:460 kwcall(::@NamedTuple{julia_args::Cmd, io::… ╎ ╎ ╎ 1 @Pkg/src/API.jl:481 test(ctx::Pkg.Types.Context, pkgs::Vector… ╎ ╎ ╎ 1 @Pkg/…Operations.jl:2214 test ╎ ╎ ╎ 1 @Pkg/…perations.jl:2302 test(ctx::Pkg.Types.Context, pkgs::… ╎ ╎ ╎ ╎ 1 @Pkg/…perations.jl:2044 kwcall(::@NamedTuple{preferences::… ╎ ╎ ╎ ╎ 1 @Pkg/…perations.jl:2052 #sandbox#178 ╎ ╎ ╎ ╎ 1 @Base/file.jl:895 mktempdir(fn::Function) ╎ ╎ ╎ ╎ 1 @Base/file.jl:895 mktempdir(fn::Function, parent::Strin… ╎ ╎ ╎ ╎ 1 @Base/file.jl:899 mktempdir(fn::Pkg.Operations.var"#18… ╎ ╎ ╎ ╎ ╎ 1 @Pkg/…rations.jl:2105 (::Pkg.Operations.var"#182#183"… ╎ ╎ ╎ ╎ ╎ 1 @Pkg/…rations.jl:1996 with_temp_env(fn::Pkg.Operatio… ╎ ╎ ╎ ╎ ╎ 1 @Pkg/…ations.jl:2138 (::Pkg.Operations.var"#186#187… ╎ ╎ ╎ ╎ ╎ 1 @Base/env.jl:265 withenv(::Pkg.Operations.var"#201… ╎ ╎ ╎ ╎ ╎ 1 @Pkg/…tions.jl:2317 (::Pkg.Operations.var"#201#20… ╎ ╎ ╎ ╎ ╎ ╎ 1 @Pkg/…tions.jl:2377 subprocess_handler(cmd::Cmd,… ╎ ╎ ╎ ╎ ╎ ╎ 1 @Base/…cess.jl:687 wait(x::Base.Process) ╎ ╎ ╎ ╎ ╎ ╎ 1 @Base/…cess.jl:694 wait(x::Base.Process, syncd… ╎ ╎ ╎ ╎ ╎ ╎ 1 @Base/…ion.jl:136 wait ╎ ╎ ╎ ╎ ╎ ╎ 1 @Base/…ion.jl:141 wait(c::Base.GenericCondit… ╎ ╎ ╎ ╎ ╎ ╎ ╎ 1 @Base/…sk.jl:1199 wait() ╎ ╎ ╎ ╎ ╎ ╎ ╎ 1 @Base/…sk.jl:1187 poptask(W::Base.Intrusiv… [63] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/CalibrationTests/Y6T40/test/consistency.jl:1 _ZNK4llvm6object7ELFFileINS0_7ELFTypeILNS_10endiannessE1ELb1EEEE25getSectionContentsAsArrayINS0_12Elf_Sym_ImplIS4_EEEENS_8ExpectedINS_8ArrayRefIT_EEEERKNS0_13Elf_Shdr_ImplIS4_EE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) unknown function (ip: 0x715fe641b82f) at (unknown file) unknown function (ip: 0x7fffeb868cbf) at (unknown file) unknown function (ip: (nil)) at (unknown file) Allocations: 104794242 (Pool: 104793724; Big: 518); GC: 117 [1] signal 15: Terminated in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:454 poptask at ./task.jl:1187 wait at ./task.jl:1199 #wait#551 at ./condition.jl:141 wait at ./condition.jl:136 [inlined] _trywait at ./asyncevent.jl:145 profile_printing_listener at ./Base.jl:326 #start_profile_listener##0 at ./Base.jl:346 jfptr_YY.start_profile_listenerYY.YY.0_111230.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3359 [inlined] ijl_apply_generic at /source/src/gf.c:3547 jl_apply at /source/src/julia.h:2244 [inlined] start_task at /source/src/task.c:1281 unknown function (ip: (nil)) at (unknown file) Allocations: 20637711 (Pool: 20637141; Big: 570); GC: 17 PkgEval terminated after 2721.81s: test duration exceeded the time limit