Package evaluation of SurveyDataWeighting on Julia 1.11.4 (a71dd056e0*) started at 2025-04-08T16:04:22.842 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 8.68s ################################################################################ # Installation # Installing SurveyDataWeighting... Resolving package versions... Updating `~/.julia/environments/v1.11/Project.toml` [0d23d9a6] + SurveyDataWeighting v1.0.6 Updating `~/.julia/environments/v1.11/Manifest.toml` [47edcb42] + ADTypes v1.14.0 [7d9f7c33] + Accessors v0.1.42 [79e6a3ab] + Adapt v4.3.0 [4fba245c] + ArrayInterface v7.18.0 [4c555306] + ArrayLayouts v1.11.1 [d360d2e6] + ChainRulesCore v1.25.1 [38540f10] + CommonSolve v0.2.4 [34da2185] + Compat v4.16.0 [a33af91c] + CompositionsBase v0.1.2 [2569d6c7] + ConcreteStructs v0.2.3 [187b0558] + ConstructionBase v1.5.8 [a8cc5b0e] + Crayons v4.1.1 [9a962f9c] + DataAPI v1.16.0 [a93c6f00] + DataFrames v1.7.0 [864edb3b] + DataStructures v0.18.22 [e2d170a0] + DataValueInterfaces v1.0.0 [8bb1440f] + DelimitedFiles v1.9.1 [ffbed154] + DocStringExtensions v0.9.4 [4e289a0a] + EnumX v1.0.5 [e2ba6199] + ExprTools v0.1.10 [55351af7] + ExproniconLite v0.10.14 [1a297f60] + FillArrays v1.13.0 [069b7b12] + FunctionWrappers v1.1.3 [77dc65aa] + FunctionWrappersWrappers v0.1.3 [46192b85] + GPUArraysCore v0.2.0 [842dd82b] + InlineStrings v1.4.3 [3587e190] + InverseFunctions v0.1.17 [41ab1584] + InvertedIndices v1.3.1 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.7.0 [ae98c720] + Jieko v0.2.1 [ba0b0d4f] + Krylov v0.9.10 [b964fa9f] + LaTeXStrings v1.4.0 [5078a376] + LazyArrays v2.6.1 [7ed4a6bd] + LinearSolve v3.7.2 [1914dd2f] + MacroTools v0.5.15 [e1d29d7a] + Missings v1.2.0 [2e0e35c7] + Moshi v0.3.5 [bac558e1] + OrderedCollections v1.8.0 [2dfb63ee] + PooledArrays v1.4.3 ⌅ [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [08abe8d2] + PrettyTables v2.4.0 [3cdcf5f2] + RecipesBase v1.3.4 [731186ca] + RecursiveArrayTools v3.31.2 [189a3867] + Reexport v1.2.2 [ae029012] + Requires v1.3.1 [7e49a35a] + RuntimeGeneratedFunctions v0.5.13 [0bca4576] + SciMLBase v2.82.1 [c0aeaf25] + SciMLOperators v0.3.13 [53ae85a6] + SciMLStructures v1.7.0 [91c51154] + SentinelArrays v1.4.8 [efcf1570] + Setfield v1.1.2 [a2af1166] + SortingAlgorithms v1.2.1 [1e83bf80] + StaticArraysCore v1.4.3 [10745b16] + Statistics v1.11.1 [892a3eda] + StringManipulation v0.4.1 [0d23d9a6] + SurveyDataWeighting v1.0.6 [2efcf032] + SymbolicIndexingInterface v0.3.38 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.12.0 [3a884ed6] + UnPack v1.0.2 [1d5cc7b8] + IntelOpenMP_jll v2025.0.4+0 [856f044c] + MKL_jll v2025.0.1+1 [1317d2d5] + oneTBB_jll v2022.0.0+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [9fa8497b] + Future v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [4af54fe1] + LazyArtifacts v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [2f01184e] + SparseArrays v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [4536629a] + OpenBLAS_jll v0.3.27+1 [bea87d4a] + SuiteSparse_jll v7.7.0+0 [83775a58] + Zlib_jll v1.2.13+1 [8e850b90] + libblastrampoline_jll v5.11.0+0 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 4.48s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 107.6s ################################################################################ # Testing # Testing SurveyDataWeighting Status `/tmp/jl_oGqiZm/Project.toml` [a93c6f00] DataFrames v1.7.0 [8bb1440f] DelimitedFiles v1.9.1 [7ed4a6bd] LinearSolve v3.7.2 [0d23d9a6] SurveyDataWeighting v1.0.6 [3783bdb8] TableTraits v1.0.1 [37e2e46d] LinearAlgebra v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_oGqiZm/Manifest.toml` [47edcb42] ADTypes v1.14.0 [7d9f7c33] Accessors v0.1.42 [79e6a3ab] Adapt v4.3.0 [4fba245c] ArrayInterface v7.18.0 [4c555306] ArrayLayouts v1.11.1 [d360d2e6] ChainRulesCore v1.25.1 [38540f10] CommonSolve v0.2.4 [34da2185] Compat v4.16.0 [a33af91c] CompositionsBase v0.1.2 [2569d6c7] ConcreteStructs v0.2.3 [187b0558] ConstructionBase v1.5.8 [a8cc5b0e] Crayons v4.1.1 [9a962f9c] DataAPI v1.16.0 [a93c6f00] DataFrames v1.7.0 [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [8bb1440f] DelimitedFiles v1.9.1 [ffbed154] DocStringExtensions v0.9.4 [4e289a0a] EnumX v1.0.5 [e2ba6199] ExprTools v0.1.10 [55351af7] ExproniconLite v0.10.14 [1a297f60] FillArrays v1.13.0 [069b7b12] FunctionWrappers v1.1.3 [77dc65aa] FunctionWrappersWrappers v0.1.3 [46192b85] GPUArraysCore v0.2.0 [842dd82b] InlineStrings v1.4.3 [3587e190] InverseFunctions v0.1.17 [41ab1584] InvertedIndices v1.3.1 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.0 [ae98c720] Jieko v0.2.1 [ba0b0d4f] Krylov v0.9.10 [b964fa9f] LaTeXStrings v1.4.0 [5078a376] LazyArrays v2.6.1 [7ed4a6bd] LinearSolve v3.7.2 [1914dd2f] MacroTools v0.5.15 [e1d29d7a] Missings v1.2.0 [2e0e35c7] Moshi v0.3.5 [bac558e1] OrderedCollections v1.8.0 [2dfb63ee] PooledArrays v1.4.3 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [08abe8d2] PrettyTables v2.4.0 [3cdcf5f2] RecipesBase v1.3.4 [731186ca] RecursiveArrayTools v3.31.2 [189a3867] Reexport v1.2.2 [ae029012] Requires v1.3.1 [7e49a35a] RuntimeGeneratedFunctions v0.5.13 [0bca4576] SciMLBase v2.82.1 [c0aeaf25] SciMLOperators v0.3.13 [53ae85a6] SciMLStructures v1.7.0 [91c51154] SentinelArrays v1.4.8 [efcf1570] Setfield v1.1.2 [a2af1166] SortingAlgorithms v1.2.1 [1e83bf80] StaticArraysCore v1.4.3 [10745b16] Statistics v1.11.1 [892a3eda] StringManipulation v0.4.1 [0d23d9a6] SurveyDataWeighting v1.0.6 [2efcf032] SymbolicIndexingInterface v0.3.38 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.0 [3a884ed6] UnPack v1.0.2 [1d5cc7b8] IntelOpenMP_jll v2025.0.4+0 [856f044c] MKL_jll v2025.0.1+1 [1317d2d5] oneTBB_jll v2022.0.0+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [4af54fe1] LazyArtifacts v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [bea87d4a] SuiteSparse_jll v7.7.0+0 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... target popns [50.0, 20.0, 230.0, 35.0] direct chi-square results [2.753450253154309, 2.1091624474281843, 5.945166397465298, 4.005276243966518, 2.483621970631973, 4.589083755257182, 5.752196479347934, 4.005276243966518, 2.1091624474281843, 3.1197391338453073, 5.945166397465298, 3.985295117160047, 5.018702586095243, 3.4899118712322332, 4.678383469804393, 2.34468353214391, 5.07016123092654, 4.614060163765271, 4.967243941263946, 2.1091624474281843] wchisq; got [50.0, 20.0, 230.0, 35.0] 13.686760 seconds (1.65 M allocations: 81.967 MiB, 0.62% gc time, 99.99% compilation time) 4.007957 seconds (3.51 M allocations: 174.245 MiB, 1.87% gc time, 99.95% compilation time) results for method chi_square = [2.753450253154309, 2.109162447428184, 5.945166397465298, 4.005276243966518, 2.4836219706319724, 4.589083755257182, 5.752196479347934, 4.005276243966518, 2.109162447428184, 3.1197391338453073, 5.945166397465298, 3.9852951171600464, 5.018702586095243, 3.4899118712322332, 4.678383469804393, 2.34468353214391, 5.07016123092654, 4.614060163765271, 4.967243941263945, 2.109162447428184] weighted_popn = [50.0, 19.999999999999996, 230.0, 35.0] 0.000098 seconds (135 allocations: 7.641 KiB) 0.008817 seconds (409 allocations: 17.984 KiB, 96.63% compilation time) results for method constrained_chi_square = [2.753450253154309, 2.109162447428184, 5.945166397465298, 4.005276243966518, 2.4836219706319724, 4.589083755257182, 5.752196479347934, 4.005276243966518, 2.109162447428184, 3.1197391338453073, 5.945166397465298, 3.9852951171600464, 5.018702586095243, 3.4899118712322332, 4.678383469804393, 2.34468353214391, 5.07016123092654, 4.614060163765271, 4.967243941263945, 2.109162447428184] weighted_popn = [50.0, 19.999999999999996, 230.0, 35.0] 0.000243 seconds (639 allocations: 37.453 KiB) 0.000285 seconds (1.12 k allocations: 50.453 KiB) results for method d_and_s_constrained = [2.666018847516531, 2.2292259981341593, 6.153670743148128, 3.9308529503943346, 2.463482198150711, 4.443364745860885, 5.6154513985088, 3.9308529503943346, 2.2292259981341593, 3.2530731979069643, 6.153670743148128, 3.809695743367884, 5.07273994395966, 3.4758480981517783, 4.746379399435662, 2.3932451675539337, 5.219094162470499, 4.587520358308096, 4.926964396301422, 2.2292259981341593] weighted_popn = [50.00000102058442, 20.00000249870171, 230.00000103785192, 35.00000071049975] 0.000061 seconds (247 allocations: 14.266 KiB) 0.010073 seconds (525 allocations: 24.922 KiB, 98.43% compilation time) results for method d_and_s_type_a = [2.6738135436474604, 2.2284116349605805, 5.997566185738476, 3.94404178500606, 2.513986312761132, 4.456355906079101, 5.729172753245519, 3.94404178500606, 2.2284116349605805, 3.0862549345272896, 5.997566185738476, 3.8144996846062336, 5.108378421467607, 3.489959890880301, 4.665418063063685, 2.370095960788904, 5.190728490317241, 4.602541231692947, 5.027972625522264, 2.2284116349605805] weighted_popn = [50.00000000000381, 20.00000000000344, 230.0000000000043, 35.000000000002785] 0.000129 seconds (303 allocations: 17.578 KiB) 0.010312 seconds (556 allocations: 27.641 KiB, 97.88% compilation time) results for method d_and_s_type_b = [2.6540317201338897, 2.260096530938384, 6.0123387355377425, 3.925942231921158, 2.5214379608397826, 4.423386200223149, 5.716966973168576, 3.925942231921158, 2.260096530938384, 3.0740942639048443, 6.0123387355377425, 3.7619213122788437, 5.135605556864362, 3.4872875376950256, 4.6658730384955955, 2.3803711745489657, 5.231809346041319, 4.60433573020442, 5.042875921679565, 2.260096530938384] weighted_popn = [50.0, 20.0, 230.0, 35.0] Test Summary: | Pass Total Time Reproduce the basic test case in Creedy NEW ZEALAND TREASURY WORKING PAPER 03/17 | 169 169 35.6s initial-weighted_popn vs targets 1 1.340609e6 1.1476975923244006e6 -14.389833849810008% 2 60635.0 55826.665459811724 -7.929965432816486% 3 1.301248e6 1.1380568428674855e6 -12.541126451876547% 4 59302.0 38338.79435191889 -35.349913406092725% 5 370502.0 314781.67994207074 -15.039141504750113% 6 282482.0 229360.15568428673 -18.805390897725616% 7 314433.0 355810.91600289615 13.159533510444561% 8 139982.0 150440.53222302682 7.471340760259763% 9 153297.0 149992.12527154238 -2.155863929794858% 10 150487.0 141023.98624185374 -6.288259954777663% 11 144172.0 113671.1622013034 -21.155867851383483% 12 176066.0 107841.8718320058 -38.74917824451865% 13 191145.0 119724.65604634324 -37.36448452936606% 14 182635.0 131383.2367849385 -28.062399438805% 15 172624.0 147750.09051412024 -14.409299683635973% 16 156790.0 145508.0557566981 -7.195576403662159% 17 174812.0 166358.97900072415 -4.835492414294126% 18 193940.0 176896.54236060832 -8.788005382794513% 19 190775.0 178690.170166546 -6.334598261540552% 20 166852.0 182725.8327299059 9.513720380880002% 21 144460.0 195057.0238957278 35.024936934603204% 22 132339.0 152682.56698044902 15.372314268997814% 23 87886.0 113671.16220130339 29.33932844970006% 24 104741.0 112550.14482259234 7.45567143963905% 25 131733.0 149095.31136857352 13.17992558324301% 26 146019.0 149319.51484431574 2.260332452842259% 27 144187.0 130486.42288196963 -9.501950327026966% 28 137786.0 116137.40043446778 -15.711755596020073% 29 171390.0 119052.04561911659 -30.537344291314206% 30 191110.0 155597.2121650978 -18.582380741406627% 31 186828.0 158960.26430123104 -14.916252220635535% 32 179898.0 165686.36857349752 -7.899827361339473% 33 162642.0 157166.63649529332 -3.3665126503035365% 34 186646.0 170843.04851556852 -8.466804262845967% 35 207150.0 189003.53005068796 -8.76006273198747% 36 202348.0 206715.60463432298 2.158461973591527% 37 177841.0 196626.44822592326 10.563058139530963% 38 154984.0 206491.40115858076 33.234012000323105% 39 146517.0 173085.08327299065 18.133106242272675% 40 108065.0 120173.06299782767 11.204426037873196% 41 165153.0 137660.93410572052 -16.64642234429861% 42 439000.0 391010.861694424 -10.931466584413666% 43 467000.0 482261.67632150557 3.268024908245304% 44 797000.0 895692.8855901505 12.383047125489396% 45 70000.0 65467.41491672699 -6.475121547532867% 46 66000.0 47755.340333091954 -27.643423737739464% 47 448000.0 431367.48732802266 -3.7126144357092277% 48 190000.0 163444.33381607538 -13.976666412591907% 49 77842.0 64570.601013758154 -17.049149541689378% 50 127307.0 82731.08254887765 -35.01450623384602% 51 431461.0 330475.9232440259 -23.405377718026447% direct chi-square results [320.5405640985249, 206.5894042052843, 231.03906018470417, 251.44494464222126, 315.33826564987976, 176.20765861860727, 92.08745713870702, 307.19579751152105, 216.5789062136481, 324.24046305546705] on method chi_square results for method chi_square = [320.5405640984565, 206.58940420529945, 231.0390601847441, 251.44494464229544, 315.338265649836, 176.20765861860826, 92.08745713866351, 307.19579751131533, 216.57890621364862, 324.24046305544204] weighted_popn = [1.340609000000001e6, 60635.0, 1.3012480000000014e6, 59301.99999999999, 370502.00000000006, 282482.0, 314433.0000000003, 139981.99999999988, 153296.99999999994, 150486.9999999999, 144171.99999999994, 176065.99999999997, 191144.9999999999, 182634.99999999997, 172623.99999999997, 156789.99999999988, 174811.9999999999, 193939.9999999999, 190775.0, 166851.99999999988, 144459.99999999985, 132338.99999999988, 87886.0, 104740.99999999996, 131732.99999999997, 146018.99999999988, 144186.9999999999, 137785.99999999994, 171390.00000000003, 191109.99999999985, 186827.99999999988, 179897.99999999985, 162641.9999999999, 186645.99999999983, 207150.0, 202347.99999999994, 177840.99999999994, 154983.9999999999, 146517.0, 108064.99999999999, 165152.9999999999, 439000.00000000035, 467000.00000000064, 797000.0000000016, 69999.99999999999, 66000.0, 448000.0000000003, 189999.9999999999, 77841.99999999997, 127307.00000000003, 431461.0000000001] on method constrained_chi_square results for method constrained_chi_square = [325.185980057385, 207.56008367878943, 244.05794964682346, 264.96957380410805, 268.19638737558677, 176.12694035874907, 78.56740243691739, 265.383992798279, 223.32224462529555, 326.44077518964116] weighted_popn = [1.3406090000000019e6, 60635.000000000015, 1.3012480000000026e6, 59302.0, 370502.0000000003, 282482.00000000006, 314433.00000000035, 139982.0, 153297.00000000003, 150487.00000000003, 144172.00000000015, 176065.99999999994, 191145.00000000003, 182634.99999999994, 172624.0, 156790.0, 174811.9999999999, 193940.0, 190774.9999999999, 166852.00000000003, 144459.99999999977, 132338.99999999994, 87886.0000000001, 104740.99999999991, 131733.00000000006, 146019.0, 144186.99999999994, 137786.0, 171390.00000000006, 191110.0, 186828.00000000003, 179898.00000000003, 162641.99999999994, 186645.99999999994, 207150.0, 202348.00000000006, 177841.00000000003, 154984.00000000006, 146517.00000000003, 108065.00000000004, 165153.0000000001, 439000.0000000004, 467000.00000000076, 797000.0000000021, 70000.00000000006, 66000.00000000001, 448000.0000000007, 190000.0, 77842.00000000001, 127306.99999999988, 431461.00000000035] on method d_and_s_constrained results for method d_and_s_constrained = [301.8545334814097, 205.879252530084, 229.15519058492902, 252.21127756150258, 300.37283132875166, 176.17603101305738, 111.45281192650847, 247.87950826128872, 212.54532890363893, 311.3789339008097] weighted_popn = [1.3406090000049453e6, 60635.000000231405, 1.3012480000047286e6, 59302.00000022923, 370502.0000003888, 282482.0000002457, 314433.00000035914, 139982.00000013554, 153297.00000017366, 150487.00000056732, 144172.00000088074, 176066.0000019416, 191145.00000081066, 182635.00000032355, 172624.00000027867, 156790.0000002795, 174812.00000074704, 193940.00000094596, 190775.0000007691, 166852.00000038164, 144460.00000018376, 132339.00000003385, 87886.00000006644, 104741.00000002988, 131733.00000019168, 146019.0000003082, 144187.00000039203, 137786.0000010377, 171390.00000189745, 191110.0000006613, 186828.00000013862, 179898.00000027785, 162642.0000003983, 186646.00000115245, 207150.0000009361, 202348.000000662, 177841.00000014663, 154984.00000010603, 146517.00000008667, 108065.000000096, 165153.00000013143, 439000.0000000289, 467000.00000001286, 797000.0000000959, 70000.00000002017, 66000.00000002413, 448000.00000175403, 190000.00000191946, 77842.00000028806, 127307.00000005405, 431461.0000012604] Test Summary: | Pass Total Time Weighting Tests using 2018 Scottish FRS Subset | 22183 22183 16.2s Testing SurveyDataWeighting tests passed Testing completed after 70.61s PkgEval succeeded after 198.11s