Package evaluation of QUnfold on Julia 1.11.4 (a71dd056e0*) started at 2025-04-08T14:53:30.279 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 8.44s ################################################################################ # Installation # Installing QUnfold... Resolving package versions... Updating `~/.julia/environments/v1.11/Project.toml` [05092f44] + QUnfold v0.0.1 Updating `~/.julia/environments/v1.11/Manifest.toml` [6e4b80f9] + BenchmarkTools v1.6.0 ⌅ [523fee87] + CodecBzip2 v0.7.2 [944b1d66] + CodecZlib v0.7.8 [bbf7d656] + CommonSubexpressions v0.3.1 [34da2185] + Compat v4.16.0 [9a962f9c] + DataAPI v1.16.0 [864edb3b] + DataStructures v0.18.22 [163ba53b] + DiffResults v1.1.0 [b552c78f] + DiffRules v1.15.1 [ffbed154] + DocStringExtensions v0.9.4 ⌅ [f6369f11] + ForwardDiff v0.10.38 ⌅ [b6b21f68] + Ipopt v1.1.0 [92d709cd] + IrrationalConstants v0.2.4 [692b3bcd] + JLLWrappers v1.7.0 [682c06a0] + JSON v0.21.4 ⌅ [4076af6c] + JuMP v1.6.0 [2ab3a3ac] + LogExpFunctions v0.3.29 [1914dd2f] + MacroTools v0.5.15 ⌅ [b8f27783] + MathOptInterface v1.11.5 [e1d29d7a] + Missings v1.2.0 [d8a4904e] + MutableArithmetics v1.6.4 [77ba4419] + NaNMath v1.1.3 [bac558e1] + OrderedCollections v1.8.0 [69de0a69] + Parsers v2.8.1 ⌅ [f27b6e38] + Polynomials v3.2.13 ⌅ [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [05092f44] + QUnfold v0.0.1 [3cdcf5f2] + RecipesBase v1.3.4 [ae029012] + Requires v1.3.1 [6e75b9c4] + ScikitLearnBase v0.5.0 [66db9d55] + SnoopPrecompile v1.0.3 [a2af1166] + SortingAlgorithms v1.2.1 [276daf66] + SpecialFunctions v2.5.0 [1e83bf80] + StaticArraysCore v1.4.3 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.7.0 ⌅ [2913bbd2] + StatsBase v0.33.21 ⌅ [3bb67fe8] + TranscodingStreams v0.9.13 [ae81ac8f] + ASL_jll v0.1.3+0 [6e34b625] + Bzip2_jll v1.0.9+0 ⌅ [9cc047cb] + Ipopt_jll v300.1400.400+0 [d00139f3] + METIS_jll v5.1.3+0 ⌅ [d7ed1dd3] + MUMPS_seq_jll v5.4.1+0 [656ef2d0] + OpenBLAS32_jll v0.3.29+0 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9abbd945] + Profile v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [2f01184e] + SparseArrays v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [4536629a] + OpenBLAS_jll v0.3.27+1 [05823500] + OpenLibm_jll v0.8.5+0 [bea87d4a] + SuiteSparse_jll v7.7.0+0 [83775a58] + Zlib_jll v1.2.13+1 [8e850b90] + libblastrampoline_jll v5.11.0+0 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 4.56s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 340.99s ################################################################################ # Testing # Testing QUnfold Status `/tmp/jl_lnwVrN/Project.toml` ⌅ [b6b21f68] Ipopt v1.1.0 ⌅ [4076af6c] JuMP v1.6.0 ⌅ [b8f27783] MathOptInterface v1.11.5 [438e738f] PyCall v1.96.4 [05092f44] QUnfold v0.0.1 [3646fa90] ScikitLearn v0.7.0 [6e75b9c4] ScikitLearnBase v0.5.0 ⌅ [2913bbd2] StatsBase v0.33.21 [37e2e46d] LinearAlgebra v1.11.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_lnwVrN/Manifest.toml` [6e4b80f9] BenchmarkTools v1.6.0 ⌅ [523fee87] CodecBzip2 v0.7.2 [944b1d66] CodecZlib v0.7.8 [bbf7d656] CommonSubexpressions v0.3.1 [34da2185] Compat v4.16.0 [8f4d0f93] Conda v1.10.2 [a8cc5b0e] Crayons v4.1.1 [9a962f9c] DataAPI v1.16.0 [a93c6f00] DataFrames v1.7.0 [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [163ba53b] DiffResults v1.1.0 [b552c78f] DiffRules v1.15.1 [ffbed154] DocStringExtensions v0.9.4 ⌅ [f6369f11] ForwardDiff v0.10.38 [842dd82b] InlineStrings v1.4.3 [41ab1584] InvertedIndices v1.3.1 ⌅ [b6b21f68] Ipopt v1.1.0 [92d709cd] IrrationalConstants v0.2.4 [c8e1da08] IterTools v1.10.0 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.0 [682c06a0] JSON v0.21.4 ⌅ [4076af6c] JuMP v1.6.0 [b964fa9f] LaTeXStrings v1.4.0 [2ab3a3ac] LogExpFunctions v0.3.29 [1914dd2f] MacroTools v0.5.15 ⌅ [b8f27783] MathOptInterface v1.11.5 [e1d29d7a] Missings v1.2.0 [d8a4904e] MutableArithmetics v1.6.4 [77ba4419] NaNMath v1.1.3 [bac558e1] OrderedCollections v1.8.0 [d96e819e] Parameters v0.12.3 [69de0a69] Parsers v2.8.1 ⌅ [f27b6e38] Polynomials v3.2.13 [2dfb63ee] PooledArrays v1.4.3 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [08abe8d2] PrettyTables v2.4.0 [438e738f] PyCall v1.96.4 [05092f44] QUnfold v0.0.1 [3cdcf5f2] RecipesBase v1.3.4 [189a3867] Reexport v1.2.2 [ae029012] Requires v1.3.1 [3646fa90] ScikitLearn v0.7.0 [6e75b9c4] ScikitLearnBase v0.5.0 [91c51154] SentinelArrays v1.4.8 [66db9d55] SnoopPrecompile v1.0.3 [a2af1166] SortingAlgorithms v1.2.1 [276daf66] SpecialFunctions v2.5.0 [1e83bf80] StaticArraysCore v1.4.3 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.7.0 ⌅ [2913bbd2] StatsBase v0.33.21 [892a3eda] StringManipulation v0.4.1 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.0 ⌅ [3bb67fe8] TranscodingStreams v0.9.13 [3a884ed6] UnPack v1.0.2 [81def892] VersionParsing v1.3.0 [ae81ac8f] ASL_jll v0.1.3+0 [6e34b625] Bzip2_jll v1.0.9+0 ⌅ [9cc047cb] Ipopt_jll v300.1400.400+0 [d00139f3] METIS_jll v5.1.3+0 ⌅ [d7ed1dd3] MUMPS_seq_jll v5.4.1+0 [656ef2d0] OpenBLAS32_jll v0.3.29+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [05823500] OpenLibm_jll v0.8.5+0 [bea87d4a] SuiteSparse_jll v7.7.0+0 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Precompiling QUnfold... 1409.1 ms ✓ MUMPS_seq_jll 87709.3 ms ✓ MathOptInterface 1577.4 ms ✓ Ipopt_jll 15397.5 ms ✓ JuMP 9507.2 ms ✓ Ipopt 152293.7 ms ✓ QUnfold 6 dependencies successfully precompiled in 270 seconds. 75 already precompiled. Precompiling ScikitLearn... 113029.1 ms ✓ DataFrames 12858.0 ms ✓ ScikitLearn 2 dependencies successfully precompiled in 128 seconds. 64 already precompiled. [ Info: Installing sklearn.ensemble via the Conda scikit-learn package... [ Info: Running `conda install -q -y scikit-learn` in root environment Channels: - conda-forge Platform: linux-64 Collecting package metadata (repodata.json): ...working... done Solving environment: ...working... done ## Package Plan ## environment location: /home/pkgeval/.julia/conda/3/x86_64 added / updated specs: - scikit-learn The following packages will be downloaded: package | build ---------------------------|----------------- joblib-1.4.2 | pyhd8ed1ab_1 215 KB conda-forge scikit-learn-1.6.1 | py312h7a48858_0 10.1 MB conda-forge scipy-1.15.2 | py312ha707e6e_0 16.3 MB conda-forge threadpoolctl-3.6.0 | pyhecae5ae_0 23 KB conda-forge ------------------------------------------------------------ Total: 26.6 MB The following NEW packages will be INSTALLED: joblib conda-forge/noarch::joblib-1.4.2-pyhd8ed1ab_1 scikit-learn conda-forge/linux-64::scikit-learn-1.6.1-py312h7a48858_0 scipy conda-forge/linux-64::scipy-1.15.2-py312ha707e6e_0 threadpoolctl conda-forge/noarch::threadpoolctl-3.6.0-pyhecae5ae_0 Preparing transaction: ...working... done Verifying transaction: ...working... done Executing transaction: ...working... done ┌ Info: OOB predictions └ mean(y_trn .== y_oob) = 0.844 ┌ Info: M_acc │ M_acc = │ 3×3 Matrix{Float64}: │ 0.877907 0.0773994 0.0138614 │ 0.0697674 0.76161 0.10099 │ 0.0523256 0.160991 0.885149 │ M_acc_quapy = │ 3×3 Matrix{Float64}: │ 0.877907 0.0773994 0.0138614 │ 0.0697674 0.76161 0.10099 └ 0.0523256 0.160991 0.885149 ┌ Info: M_pacc │ M_pacc = │ 3×3 Matrix{Float64}: │ 0.829532 0.0677697 0.0179294 │ 0.120693 0.752725 0.120284 │ 0.0497744 0.179506 0.861786 │ M_pacc_quapy = │ 3×3 Matrix{Float64}: │ 0.829532 0.0677697 0.0179294 │ 0.120693 0.752725 0.120284 └ 0.0497744 0.179506 0.861786 Test Summary: | Total Time Transfer matrix estimation | 0 19.7s ┌ Info: Artificial quantification task │ M = │ 3×3 Matrix{Float64}: │ 0.875503 0.0974342 0.0270624 │ 0.0656443 0.818687 0.115669 │ 0.022793 0.111062 0.866145 │ p_tst = │ 3-element Vector{Float64}: │ 0.509 │ 0.325 └ 0.166 ****************************************************************************** This program contains Ipopt, a library for large-scale nonlinear optimization. Ipopt is released as open source code under the Eclipse Public License (EPL). For more information visit https://github.com/coin-or/Ipopt ****************************************************************************** ┌ Info: o-ACC (constrained, τ=10.0) │ p_hat = │ 3-element Vector{Float64}: │ 0.4983417822961005 │ 0.3332913867680044 └ 0.1683668309358952 ┌ Info: ACC (constrained) │ p_hat = │ 3-element Vector{Float64}: │ 0.4996547289152761 │ 0.33038832434459464 └ 0.16995694674012932 ┌ Info: ACC (softmax) │ p_hat = │ 3-element Vector{Float64}: │ 0.4996547302780901 │ 0.33038832593659234 └ 0.1699569437853176 ┌ Info: ACC (softmax_reg) │ p_hat = │ 3-element Vector{Float64}: │ 0.4996508958187402 │ 0.3303780951572771 └ 0.16997100902398263 ┌ Info: ACC (softmax_full_reg) │ p_hat = │ 3-element Vector{Float64}: │ 0.4996528867702258 │ 0.33038574902540135 └ 0.16996136420437283 ┌ Info: ACC (pinv) │ p_hat = │ 3-element Vector{Float64}: │ 0.49965473213100475 │ 0.3303883291928214 └ 0.16995693867617376 ┌ Info: ACC (inv) │ p_hat = │ 3-element Vector{Float64}: │ 0.49965473213100453 │ 0.3303883291928214 └ 0.169956938676174 ┌ Info: CC │ p_hat = │ 3-element Vector{Float64}: │ 0.463 │ 0.303 └ 0.234 ┌ Info: o-PACC (constrained, τ=10.0) │ p_hat = │ 3-element Vector{Float64}: │ 0.5076016704522269 │ 0.33311149138862645 └ 0.15928683815914654 ┌ Info: PACC (constrained) │ p_hat = │ 3-element Vector{Float64}: │ 0.5152711554041824 │ 0.31654313442170234 └ 0.16818571017411507 ┌ Info: PACC (softmax) │ p_hat = │ 3-element Vector{Float64}: │ 0.5152711541904479 │ 0.3165431269948156 └ 0.1681857188147365 ┌ Info: PACC (softmax_reg) │ p_hat = │ 3-element Vector{Float64}: │ 0.515266737643825 │ 0.31653219845570835 └ 0.16820106390046652 ┌ Info: PACC (softmax_full_reg) │ p_hat = │ 3-element Vector{Float64}: │ 0.515268938385389 │ 0.31654057759099563 └ 0.16819048402361528 ┌ Info: PACC (pinv) │ p_hat = │ 3-element Vector{Float64}: │ 0.5152711596293067 │ 0.3165431402532082 └ 0.16818570011748493 ┌ Info: PACC (inv) │ p_hat = │ 3-element Vector{Float64}: │ 0.5152711596293066 │ 0.3165431402532084 └ 0.16818570011748513 ┌ Info: PCC │ p_hat = │ 3-element Vector{Float64}: │ 0.44898000000000043 │ 0.3220899999999997 └ 0.22893000000000002 ┌ Info: RUN (constrained, τ=1e-6) │ p_hat = │ 3-element Vector{Float64}: │ 0.5420326142821418 │ 0.28151974965833293 └ 0.17644763605952535 ┌ Info: RUN (softmax, τ=1e-6) │ p_hat = │ 3-element Vector{Float64}: │ 0.5420326359706567 │ 0.28151973444407985 └ 0.1764476295852635 ┌ Info: RUN (softmax_reg, τ=1e-6) │ p_hat = │ 3-element Vector{Float64}: │ 0.5420326337671675 │ 0.2815197322787372 └ 0.1764476339540952 ┌ Info: RUN (softmax_full_reg, τ=1e-6) │ p_hat = │ 3-element Vector{Float64}: │ 0.5420326343953121 │ 0.28151973466978153 └ 0.17644763093490634 ┌ Info: RUN (constrained, τ=10.0) │ p_hat = │ 3-element Vector{Float64}: │ 0.5405652147493538 │ 0.2834997490031267 └ 0.17593503624751958 ┌ Info: RUN (softmax, τ=10.0) │ p_hat = │ 3-element Vector{Float64}: │ 0.5405652336945247 │ 0.2834997372057964 └ 0.17593502909967884 ┌ Info: RUN (softmax_reg, τ=10.0) │ p_hat = │ 3-element Vector{Float64}: │ 0.5405652314460172 │ 0.28349973508078924 └ 0.1759350334731937 ┌ Info: RUN (softmax_full_reg, τ=10.0) │ p_hat = │ 3-element Vector{Float64}: │ 0.5405652321450363 │ 0.2834997373932826 └ 0.1759350304616811 ┌ Info: SVD (constrained, τ=1e-6) │ p_hat = │ 3-element Vector{Float64}: │ 0.5477786220086835 │ 0.2862487769920144 └ 0.1659726009993021 ┌ Info: SVD (softmax, τ=1e-6) │ p_hat = │ 3-element Vector{Float64}: │ 0.5477786376131873 │ 0.2862487723288656 └ 0.16597259005794707 ┌ Info: SVD (softmax_reg, τ=1e-6) │ p_hat = │ 3-element Vector{Float64}: │ 0.5477635882158589 │ 0.2862322108028185 └ 0.1660042009813226 ┌ Info: SVD (softmax_full_reg, τ=1e-6) │ p_hat = │ 3-element Vector{Float64}: │ 0.5477681059654098 │ 0.286249417911902 └ 0.16598247612268818 ┌ Info: SVD (constrained, τ=10.0) │ p_hat = │ 3-element Vector{Float64}: │ 0.5123841629194718 │ 0.3331552678822574 └ 0.15446056919827084 ┌ Info: SVD (softmax, τ=10.0) │ p_hat = │ 3-element Vector{Float64}: │ 0.5123841761156407 │ 0.3331552678853532 └ 0.1544605559990062 ┌ Info: SVD (softmax_reg, τ=10.0) │ p_hat = │ 3-element Vector{Float64}: │ 0.5123514201394664 │ 0.3331551867222943 └ 0.15449339313823912 ┌ Info: SVD (softmax_full_reg, τ=10.0) │ p_hat = │ 3-element Vector{Float64}: │ 0.5123726341362028 │ 0.33315525503471766 └ 0.15447211082907958 ┌ Info: o-HDx (constrained, τ=10.0) │ p_hat = │ 3-element Vector{Float64}: │ 0.5129507710826872 │ 0.32555080519526286 └ 0.16149842372205003 ┌ Info: HDx (constrained) │ p_hat = │ 3-element Vector{Float64}: │ 0.5081176500731664 │ 0.3222280042450504 └ 0.16965434568178314 ┌ Info: HDx (softmax) │ p_hat = │ 3-element Vector{Float64}: │ 0.504336834746511 │ 0.3255546424654751 └ 0.17010852278801383 ┌ Info: HDx (softmax_reg) │ p_hat = │ 3-element Vector{Float64}: │ 0.504336834746511 │ 0.3255546424654751 └ 0.17010852278801383 ┌ Info: HDx (softmax_full_reg) │ p_hat = │ 3-element Vector{Float64}: │ 0.504336834746511 │ 0.32555464246547516 └ 0.1701085227880138 ┌ Info: o-HDy (constrained, τ=10.0) │ p_hat = │ 3-element Vector{Float64}: │ 0.4957563284504087 │ 0.33218613132096936 └ 0.1720575402286219 ┌ Info: HDy (constrained) │ p_hat = │ 3-element Vector{Float64}: │ 0.5112044445301607 │ 0.3225958671413511 └ 0.1661996883284883 ┌ Info: HDy (softmax) │ p_hat = │ 3-element Vector{Float64}: │ 0.5080628479500846 │ 0.3315056173679859 └ 0.16043153468192942 ┌ Info: HDy (softmax_reg) │ p_hat = │ 3-element Vector{Float64}: │ 0.508063040166438 │ 0.33150516484359477 └ 0.1604317949899673 ┌ Info: HDy (softmax_full_reg) │ p_hat = │ 3-element Vector{Float64}: │ 0.5080627982214988 │ 0.33150559882996955 └ 0.1604316029485317 ┌ Info: RUN (original, n_df=2) │ p_hat = │ 3-element Vector{Float64}: │ 0.5457539863251256 │ 0.28685381477519556 └ 0.16739219889967885 ┌ Info: SVD (original, n_df=2) │ p_hat = │ 3-element Vector{Float64}: │ 0.4327826821499128 │ 0.32571812908277065 └ 0.2414991887673166 ┌ Info: IBU (o=0, λ=1.) │ p_hat = │ 3-element Vector{Float64}: │ 0.48832718431552186 │ 0.31281791058527486 └ 0.19885490509920326 ┌ Info: o-SLD (o=0, λ=1.) │ p_hat = │ 3-element Vector{Float64}: │ 0.47650262214385825 │ 0.3190915808713541 └ 0.2044057969847875 Test Summary: | Total Time Execution of all methods | 0 3m19.4s Testing QUnfold tests passed Testing completed after 691.47s PkgEval succeeded after 1061.72s