Package evaluation to test FormulaCompiler on Julia 1.14.0-DEV.2071 (559ec66647*) started at 2026-04-24T02:13:05.155 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.14` Set-up completed after 14.87s ################################################################################ # Installation # Installing FormulaCompiler... Resolving package versions... Updating `~/.julia/environments/v1.14/Project.toml` [72341345] + FormulaCompiler v1.4.0 Updating `~/.julia/environments/v1.14/Manifest.toml` [79e6a3ab] + Adapt v4.5.2 [66dad0bd] + AliasTables v1.1.3 [4c555306] + ArrayLayouts v1.12.2 [69666777] + Arrow v2.8.1 [31f734f8] + ArrowTypes v2.3.0 [093aae92] + BSplineKit v0.19.2 [aae01518] + BandedMatrices v1.11.0 [c3b6d118] + BitIntegers v0.3.7 [fa961155] + CEnum v0.5.0 ⌅ [324d7699] + CategoricalArrays v0.10.9 [5ba52731] + CodecLz4 v0.4.6 [6b39b394] + CodecZstd v0.8.7 [bbf7d656] + CommonSubexpressions v0.3.1 [f70d9fcc] + CommonWorldInvalidations v1.0.0 [34da2185] + Compat v4.18.1 [f0e56b4a] + ConcurrentUtilities v2.5.1 [a8cc5b0e] + Crayons v4.1.1 [9a962f9c] + DataAPI v1.16.0 [a93c6f00] + DataFrames v1.8.2 [864edb3b] + DataStructures v0.19.4 [e2d170a0] + DataValueInterfaces v1.0.0 [85a47980] + Dictionaries v0.4.6 [163ba53b] + DiffResults v1.1.0 [b552c78f] + DiffRules v1.15.1 [31c24e10] + Distributions v0.25.125 [ffbed154] + DocStringExtensions v0.9.5 [4e289a0a] + EnumX v1.0.7 [e2ba6199] + ExprTools v0.1.10 [442a2c76] + FastGaussQuadrature v1.1.0 [1a297f60] + FillArrays v1.16.0 [72341345] + FormulaCompiler v1.4.0 [f6369f11] + ForwardDiff v1.3.3 [38e38edf] + GLM v1.9.4 [34004b35] + HypergeometricFunctions v0.3.28 [615f187c] + IfElse v0.1.1 [313cdc1a] + Indexing v1.1.1 [842dd82b] + InlineStrings v1.4.5 [41ab1584] + InvertedIndices v1.3.1 [92d709cd] + IrrationalConstants v0.2.6 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.7.1 [0f8b85d8] + JSON3 v1.14.3 [b964fa9f] + LaTeXStrings v1.4.0 [2ab3a3ac] + LogExpFunctions v0.3.29 [1914dd2f] + MacroTools v0.5.16 [e1d29d7a] + Missings v1.2.0 ⌅ [ff71e718] + MixedModels v4.38.1 [7e9fb7ac] + MixedModelsDatasets v0.1.2 [78c3b35d] + Mocking v0.8.1 [76087f3c] + NLopt v1.2.1 [77ba4419] + NaNMath v1.1.3 [bac558e1] + OrderedCollections v1.8.1 [90014a1f] + PDMats v0.11.37 [69de0a69] + Parsers v2.8.3 [2dfb63ee] + PooledArrays v1.4.3 [aea7be01] + PrecompileTools v1.3.3 [21216c6a] + Preferences v1.5.2 [08abe8d2] + PrettyTables v3.3.2 [92933f4c] + ProgressMeter v1.11.0 [43287f4e] + PtrArrays v1.4.0 [1fd47b50] + QuadGK v2.11.3 [189a3867] + Reexport v1.2.2 [ae029012] + Requires v1.3.1 [79098fc4] + Rmath v0.9.0 [431bcebd] + SciMLPublic v1.0.1 [6c6a2e73] + Scratch v1.3.0 [91c51154] + SentinelArrays v1.4.9 [1277b4bf] + ShiftedArrays v2.0.0 [a2af1166] + SortingAlgorithms v1.2.2 [276daf66] + SpecialFunctions v2.7.2 [03a91e81] + SplitApplyCombine v1.2.3 [5064a6a7] + StandardizedPredictors v1.0.1 [aedffcd0] + Static v1.3.1 [90137ffa] + StaticArrays v1.9.18 [1e83bf80] + StaticArraysCore v1.4.4 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.8.0 [2913bbd2] + StatsBase v0.34.10 [4c63d2b9] + StatsFuns v1.5.2 [3eaba693] + StatsModels v0.7.9 [892a3eda] + StringManipulation v0.4.4 [354b36f9] + StringViews v1.3.7 [856f2bd8] + StructTypes v1.11.0 [dc5dba14] + TZJData v1.5.0+2025b [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.12.1 [f269a46b] + TimeZones v1.22.2 [3bb67fe8] + TranscodingStreams v0.11.3 [9d95f2ec] + TypedTables v1.4.6 [5ced341a] + Lz4_jll v1.10.1+0 [079eb43e] + NLopt_jll v2.10.0+0 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [f50d1b31] + Rmath_jll v0.5.1+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [9fa8497b] + Future v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.13.0 [4af54fe1] + LazyArtifacts v1.11.0 [b27032c2] + LibCURL v1.0.0 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.13.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.14.0 [de0858da] + Printf v1.11.0 [3fa0cd96] + REPL v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.0.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [2f01184e] + SparseArrays v1.13.0 [f489334b] + StyledStrings v1.13.0 [4607b0f0] + SuiteSparse [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.19.0+0 [e37daf67] + LibGit2_jll v1.9.2+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2026.3.19 [4536629a] + OpenBLAS_jll v0.3.30+0 [05823500] + OpenLibm_jll v0.8.7+0 [458c3c95] + OpenSSL_jll v3.5.6+0 [efcefdf7] + PCRE2_jll v10.47.0+0 [bea87d4a] + SuiteSparse_jll v7.10.1+0 [83775a58] + Zlib_jll v1.3.2+0 [3161d3a3] + Zstd_jll v1.5.7+1 [8e850b90] + libblastrampoline_jll v5.15.0+0 [8e850ede] + nghttp2_jll v1.69.0+0 [3f19e933] + p7zip_jll v17.8.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 5.94s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompiling project... 43.1 s ✓ FormulaCompiler 1 dependency successfully precompiled in 48 seconds. 167 already precompiled. Precompilation completed after 71.88s ################################################################################ # Testing # Testing FormulaCompiler Status `/tmp/jl_RqXH0F/Project.toml` [6e4b80f9] BenchmarkTools v1.8.0 [336ed68f] CSV v0.10.16 ⌅ [324d7699] CategoricalArrays v0.10.9 [a93c6f00] DataFrames v1.8.2 [31c24e10] Distributions v0.25.125 [72341345] FormulaCompiler v1.4.0 [38e38edf] GLM v1.9.4 ⌅ [ff71e718] MixedModels v4.38.1 [ce6b1742] RDatasets v0.8.1 [5064a6a7] StandardizedPredictors v1.0.1 [10745b16] Statistics v1.11.1 [3eaba693] StatsModels v0.7.9 [bd369af6] Tables v1.12.1 [37e2e46d] LinearAlgebra v1.13.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_RqXH0F/Manifest.toml` [79e6a3ab] Adapt v4.5.2 [66dad0bd] AliasTables v1.1.3 [4c555306] ArrayLayouts v1.12.2 [69666777] Arrow v2.8.1 [31f734f8] ArrowTypes v2.3.0 [093aae92] BSplineKit v0.19.2 [aae01518] BandedMatrices v1.11.0 [6e4b80f9] BenchmarkTools v1.8.0 [c3b6d118] BitIntegers v0.3.7 [fa961155] CEnum v0.5.0 [336ed68f] CSV v0.10.16 ⌅ [324d7699] CategoricalArrays v0.10.9 [5ba52731] CodecLz4 v0.4.6 [944b1d66] CodecZlib v0.7.8 [6b39b394] CodecZstd v0.8.7 [bbf7d656] CommonSubexpressions v0.3.1 [f70d9fcc] CommonWorldInvalidations v1.0.0 [34da2185] Compat v4.18.1 [f0e56b4a] ConcurrentUtilities v2.5.1 [a8cc5b0e] Crayons v4.1.1 [9a962f9c] DataAPI v1.16.0 [a93c6f00] DataFrames v1.8.2 [864edb3b] DataStructures v0.19.4 [e2d170a0] DataValueInterfaces v1.0.0 [85a47980] Dictionaries v0.4.6 [163ba53b] DiffResults v1.1.0 [b552c78f] DiffRules v1.15.1 [31c24e10] Distributions v0.25.125 [ffbed154] DocStringExtensions v0.9.5 [4e289a0a] EnumX v1.0.7 [e2ba6199] ExprTools v0.1.10 [442a2c76] FastGaussQuadrature v1.1.0 [5789e2e9] FileIO v1.18.0 [48062228] FilePathsBase v0.9.24 [1a297f60] FillArrays v1.16.0 [72341345] FormulaCompiler v1.4.0 [f6369f11] ForwardDiff v1.3.3 [38e38edf] GLM v1.9.4 [34004b35] HypergeometricFunctions v0.3.28 [615f187c] IfElse v0.1.1 [313cdc1a] Indexing v1.1.1 [842dd82b] InlineStrings v1.4.5 [41ab1584] InvertedIndices v1.3.1 [92d709cd] IrrationalConstants v0.2.6 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.1 ⌃ [682c06a0] JSON v0.21.4 [0f8b85d8] JSON3 v1.14.3 [b964fa9f] LaTeXStrings v1.4.0 [2ab3a3ac] LogExpFunctions v0.3.29 [1914dd2f] MacroTools v0.5.16 [e1d29d7a] Missings v1.2.0 ⌅ [ff71e718] MixedModels v4.38.1 [7e9fb7ac] MixedModelsDatasets v0.1.2 [78c3b35d] Mocking v0.8.1 [76087f3c] NLopt v1.2.1 [77ba4419] NaNMath v1.1.3 [bac558e1] OrderedCollections v1.8.1 [90014a1f] PDMats v0.11.37 [69de0a69] Parsers v2.8.3 [2dfb63ee] PooledArrays v1.4.3 [aea7be01] PrecompileTools v1.3.3 [21216c6a] Preferences v1.5.2 [08abe8d2] PrettyTables v3.3.2 [92933f4c] ProgressMeter v1.11.0 [43287f4e] PtrArrays v1.4.0 [1fd47b50] QuadGK v2.11.3 [df47a6cb] RData v1.1.0 [ce6b1742] RDatasets v0.8.1 [189a3867] Reexport v1.2.2 [ae029012] Requires v1.3.1 [79098fc4] Rmath v0.9.0 [431bcebd] SciMLPublic v1.0.1 [6c6a2e73] Scratch v1.3.0 [91c51154] SentinelArrays v1.4.9 [1277b4bf] ShiftedArrays v2.0.0 [a2af1166] SortingAlgorithms v1.2.2 [276daf66] SpecialFunctions v2.7.2 [03a91e81] SplitApplyCombine v1.2.3 [5064a6a7] StandardizedPredictors v1.0.1 [aedffcd0] Static v1.3.1 [90137ffa] StaticArrays v1.9.18 [1e83bf80] StaticArraysCore v1.4.4 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.8.0 [2913bbd2] StatsBase v0.34.10 [4c63d2b9] StatsFuns v1.5.2 [3eaba693] StatsModels v0.7.9 [892a3eda] StringManipulation v0.4.4 [354b36f9] StringViews v1.3.7 [856f2bd8] StructTypes v1.11.0 [dc5dba14] TZJData v1.5.0+2025b [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.1 [f269a46b] TimeZones v1.22.2 [3bb67fe8] TranscodingStreams v0.11.3 [9d95f2ec] TypedTables v1.4.6 [ea10d353] WeakRefStrings v1.4.2 [76eceee3] WorkerUtilities v1.6.1 [5ced341a] Lz4_jll v1.10.1+0 [079eb43e] NLopt_jll v2.10.0+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [f50d1b31] Rmath_jll v0.5.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0 [4af54fe1] LazyArtifacts v1.11.0 [b27032c2] LibCURL v1.0.0 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.13.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.14.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.0.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.13.0 [f489334b] StyledStrings v1.13.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.19.0+0 [e37daf67] LibGit2_jll v1.9.2+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2026.3.19 [4536629a] OpenBLAS_jll v0.3.30+0 [05823500] OpenLibm_jll v0.8.7+0 [458c3c95] OpenSSL_jll v3.5.6+0 [efcefdf7] PCRE2_jll v10.47.0+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [83775a58] Zlib_jll v1.3.2+0 [3161d3a3] Zstd_jll v1.5.7+1 [8e850b90] libblastrampoline_jll v5.15.0+0 [8e850ede] nghttp2_jll v1.69.0+0 [3f19e933] p7zip_jll v17.8.0+0 Info Packages marked with ⌃ and ⌅ have new versions available. Those with ⌃ may be upgradable, but those with ⌅ are restricted by compatibility constraints from upgrading. Testing Running tests... ┌ Warning: `wts` keyword argument is deprecated, use `weights` instead │ caller = glm(::Matrix{Float64}, ::Vector{Float64}, ::Bernoulli{Float64}, ::Vararg{Any}; kwargs::Base.Pairs{Symbol, Any, Nothing, @NamedTuple{wts::Vector{Float64}, dofit::Bool, offset::Vector{Float64}}}) at glmfit.jl:618 └ @ GLM ~/.julia/packages/GLM/GQCUE/src/glmfit.jl:618 ┌ Warning: `wts` keyword argument is deprecated, use `weights` instead │ caller = glm(::Matrix{Float64}, ::Vector{Float64}, ::Poisson{Float64}, ::Vararg{Any}; kwargs::Base.Pairs{Symbol, Any, Nothing, @NamedTuple{wts::Vector{Float64}, dofit::Bool, offset::Vector{Float64}}}) at glmfit.jl:618 └ @ GLM ~/.julia/packages/GLM/GQCUE/src/glmfit.jl:618 CounterfactualVector Performance: Test Failed at /home/pkgeval/.julia/packages/FormulaCompiler/1s6uu/test/test_overrides.jl:279 Expression: access_time < 0.01 Evaluated: 0.018268996 < 0.01 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:784 [inlined] [2] macro expansion @ ~/.julia/packages/FormulaCompiler/1s6uu/test/test_overrides.jl:279 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [4] macro expansion @ ~/.julia/packages/FormulaCompiler/1s6uu/test/test_overrides.jl:241 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [6] top-level scope @ ~/.julia/packages/FormulaCompiler/1s6uu/test/test_overrides.jl:13 Continuous override benchmark: Memory: 0 bytes Allocations: 0 Min time: 0.07031729785056295 μs Boolean override benchmark: Memory: 0 bytes Allocations: 0 Min time: 0.07311475409836064 μs Categorical override benchmark: Memory: 0 bytes Allocations: 0 Min time: 0.06854405737704919 μs Mixed override benchmark: Memory: 0 bytes Allocations: 0 Min time: 0.06610222672064778 μs ✓ All 6 test rows achieved zero allocation Performance comparison: Normal - Memory: 0 bytes, Allocs: 0 Override - Memory: 0 bytes, Allocs: 0 Normal - Min time: 0.053447261663286005 μs Override - Min time: 0.0524340770791075 μs ✓ Override performance ratio: 0.98x Complex model override benchmark: Memory: 0 bytes Allocations: 0 Min time: 0.1505185185185185 μs ✓ All compressed categorical tests passed === modelrow() Allocations === Allocations: 0 Memory: 0 bytes Median time: 2060.0 ns === derivative_modelrow!() Allocations (AD backend) === Variables: [:age_h, :dists_p_inv, :are_related_dists_a_inv, :schoolyears_h] Allocations: 0 Memory: 0 bytes Median time: 7499.5 ns NOTE: Uses 53-column NamedTuple; cached columns keep allocations at zero === derivative_modelrow!() Allocations (FD backend) === Variables: [:age_h, :dists_p_inv, :are_related_dists_a_inv, :schoolyears_h] Allocations: 0 Memory: 0 bytes Median time: 21375.0 ns === Batch modelrow() n=100 === Total allocations: 0 Allocations/row: 0.0 === Batch modelrow() n=1000 === Total allocations: 0 Allocations/row: 0.0 === Batch modelrow() n=500000 === Total allocations: 0 Allocations/row: 0.0 === Batch derivative_modelrow!() AD n=100 === Total allocations: 0 Allocations/row: 0.0 (target: 0) === Batch derivative_modelrow!() AD n=1000 === Total allocations: 0 Allocations/row: 0.0 (target: 0) === Batch derivative_modelrow!() AD n=500000 === Total allocations: 0 Allocations/row: 0.0 (target: 0) === Batch derivative_modelrow!() FD n=100 === Total allocations: 0 Allocations/row: 0.0 === Batch derivative_modelrow!() FD n=1000 === Total allocations: 0 Allocations/row: 0.0 === Batch derivative_modelrow!() FD n=500000 === Total allocations: 0 Allocations/row: 0.0 === NamedTuple Size Impact on AD Allocations === Allocations: 0 Memory: 0 bytes Dataset columns: 53 ✓ Negative Binomial models supported and working Linear: Treatment=165.7ns, Binary=168.9ns Logistic: Treatment=165.3ns, Binary=171.1ns Poisson: Treatment=172.8ns, Binary=173.9ns Large dataset (2000 rows): 265.2ns GLM Integration Tests completed successfully! Linear, Logistic, and Poisson models fully supported All link functions working correctly with gradient computation Zero allocations maintained across all GLM families Mathematical consistency validated across model types ✓ Fixed effects extraction and contrast computation validated ✓ Multiple random effects grouping handled correctly Minimizing 169 Time: 0:00:00 ( 0.59 ms/it) objective: 269.87138190040395   Minimizing 290 Time: 0:00:00 ( 0.83 ms/it) ✓ Poisson GLMM successfully tested Large mixed model (1000 obs): Treatment=208.9ns, Condition=230.6ns, Binary=207.6ns MixedModels Integration Tests (Phase 6.2.2) completed successfully! ✓ Linear and Generalized Linear Mixed Models fully supported ✓ Fixed effects extraction and contrast computation validated ✓ Complex random effects structures handled correctly ✓ Zero allocations maintained across all mixed model types ✓ Performance scaling confirmed with large hierarchical datasets ✓ Gradient computation and standard errors working for GLMMs [ Info: Creating 100K observation dataset... [ Info: Dataset created: 100000 rows, 12 columns [ Info: Fitting complex model... [ Info: Testing compilation performance... [ Info: Compilation time: 3.281s [ Info: Testing ContrastEvaluator construction... [ Info: ContrastEvaluator construction time: 0.922s [ Info: Testing evaluation performance... [ Info: Mean evaluation time: 1093.3ns [ Info: Max evaluation time: 1273.0ns [ Info: Testing allocation performance... [ Info: Allocation results: min=0, max=0, mean=0.0 [ Info: ✓ Perfect zero allocations confirmed [ Info: Testing memory usage scaling... [ Info: ContrastEvaluator memory usage: 864 bytes [ Info: Testing correctness on random samples... [ Info: ✓ All correctness tests passed [ Info: Creating dataset with 50+ categorical levels... [ Info: High cardinality variable: 60 levels [ Info: Testing high-cardinality ContrastEvaluator... [ Info: Testing contrast between Level_12 and Level_15... [ Info: High-cardinality contrast time: 3814.3ns [ Info: Testing performance scaling with categorical levels... [ Info: Performance ratio (60 vs 5 levels): 0.74x [ Info: Testing multiple variables performance... [ Info: Model compiled with 38 terms [ Info: Creating ContrastEvaluator with 12 variables... [ Info: Testing performance across variable types... [ Info: Variable cat1: 1207.6ns [ Info: Variable cat2: 1145.5ns [ Info: Variable cat3: 1206.4ns [ Info: Variable cat4: 1131.7ns [ Info: Variable cat5: 1175.0ns [ Info: Variable cat6: 1182.9ns [ Info: Testing batch performance... [ Info: Mean batch time: 833.9ns [ Info: ContrastEvaluator memory with 12 vars: 968 bytes [ Info: Testing memory scaling properties... [ Info: Memory usage by dataset size: [ Info: 1000 rows: 192 bytes [ Info: 10000 rows: 192 bytes [ Info: 50000 rows: 192 bytes [ Info: Memory scaling ratio (50K vs 1K): 1.0x Test Summary: | Pass Fail Total Time FormulaCompiler.jl Tests | 1722 1 1723 41m15.9s Position Mapping Tests | 103 103 2m42.7s Zero Allocation Survey | 105 105 3m33.8s Model Correctness Tests | 545 545 54.1s Formula Logic Tests | 41 41 32.0s Tough Formula Direct Compilation | 7 7 3m28.3s CounterfactualVector System Tests | 79 1 80 23.7s NumericCounterfactualVector Basic Functionality | 13 13 0.2s CounterfactualVector Construction | 9 9 0.1s CategoricalCounterfactualVector Creation | 8 8 0.3s BoolCounterfactualVector Creation | 8 8 0.1s Formula Integration with CounterfactualVectors | 9 9 3.7s CounterfactualVector Loop Patterns | 4 4 3.1s CounterfactualVector Performance | 2 1 3 5.0s CounterfactualVector Edge Cases | 10 10 0.5s Integer CounterfactualVector Support | 16 16 10.7s Zero Allocation Override Performance | 28 28 15.3s Check variable differentiation | 6 6 2.8s Categorical Override Tests | 77 77 14.0s Baseline Level Extraction | 17 17 6.1s Compressed categorical arrays | 37 37 1m11.7s Categorical Mixtures - Evaluation Primitives | 61 61 8.8s Modelrow Functions with Categorical Mixtures | 17 17 24.7s Derivative Primitive Allocation Checks | 20 20 17.6s ContrastEvaluator Ground Truth Validation | 78 78 1m12.7s AD Allocation Formula Variants | 18 18 8m07.4s FormulaCompiler Primitives - Complex Formula Allocations | 20 20 6m44.9s Derivative domain edge cases | 37 37 50.6s StandardizedPredictors Correctness Tests | 278 278 47.3s GLM Integration Tests | 52 52 1m30.0s MixedModels Integration Tests | 50 50 1m54.8s Large Dataset Performance | 46 46 4m02.7s RNG of the outermost testset: Xoshiro(0x0349b0ef9ee3d935, 0x972e3d5b6827895d, 0xf25ea93763b8edde, 0x0f4eb2d0a6ae760e, 0xefd49acb58bc5504) ERROR: LoadError: Some tests did not pass: 1722 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/FormulaCompiler/1s6uu/test/runtests.jl:17 Testing failed after 2557.15s ERROR: LoadError: Package FormulaCompiler errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:3162 [3] Cmd(cmd::Cmd) @ Base /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:3025 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:586 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:172 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [7] test @ /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [inlined] [8] test(pkg::String; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:159 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 [10] include(mod::Module, _path::String) @ Base ./Base.jl:326 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:352 [12] _start() @ Base ./client.jl:593 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 2679.65s: package has test failures