Package evaluation to test HerbSearch on Julia 1.14.0-DEV.1601 (79ea5eb99c*) started at 2026-01-24T13:15:17.161 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.14` Set-up completed after 10.53s ################################################################################ # Installation # Installing HerbSearch... Resolving package versions... Installed Missings ──────────── v1.2.0 Installed MacroTools ────────── v0.5.16 Installed Statistics ────────── v1.11.1 Installed DataAPI ───────────── v1.16.0 Installed HerbInterpret ─────── v0.2.1 Installed DataStructures ────── v0.19.3 Installed HerbGrammar ───────── v0.6.2 Installed HerbSearch ────────── v0.4.10 Installed LogExpFunctions ───── v0.3.29 Installed StatsAPI ──────────── v1.8.0 Installed AbstractTrees ─────── v0.4.5 Installed TimerOutputs ──────── v0.5.29 Installed SortingAlgorithms ─── v1.2.2 Installed AutoHashEquals ────── v2.2.0 Installed AliasTables ───────── v1.1.3 Installed IrrationalConstants ─ v0.2.6 Installed ExprTools ─────────── v0.1.10 Installed DocStringExtensions ─ v0.9.5 Installed StatsBase ─────────── v0.34.10 Installed HerbConstraints ───── v0.5.0 Installed MLStyle ───────────── v0.4.17 Installed PtrArrays ─────────── v1.3.0 Installed OrderedCollections ── v1.8.1 Installed HerbCore ──────────── v0.3.12 Installed HerbSpecification ─── v0.2.1 Updating `~/.julia/environments/v1.14/Project.toml` [3008d8e8] + HerbSearch v0.4.10 Updating `~/.julia/environments/v1.14/Manifest.toml` [1520ce14] + AbstractTrees v0.4.5 [66dad0bd] + AliasTables v1.1.3 [15f4f7f2] + AutoHashEquals v2.2.0 [9a962f9c] + DataAPI v1.16.0 [864edb3b] + DataStructures v0.19.3 [ffbed154] + DocStringExtensions v0.9.5 [e2ba6199] + ExprTools v0.1.10 ⌅ [1fa96474] + HerbConstraints v0.5.0 ⌅ [2b23ba43] + HerbCore v0.3.12 ⌅ [4ef9e186] + HerbGrammar v0.6.2 [5bbddadd] + HerbInterpret v0.2.1 [3008d8e8] + HerbSearch v0.4.10 ⌅ [6d54aada] + HerbSpecification v0.2.1 [92d709cd] + IrrationalConstants v0.2.6 [2ab3a3ac] + LogExpFunctions v0.3.29 [d8e11817] + MLStyle v0.4.17 [1914dd2f] + MacroTools v0.5.16 [e1d29d7a] + Missings v1.2.0 [bac558e1] + OrderedCollections v1.8.1 [43287f4e] + PtrArrays v1.3.0 [a2af1166] + SortingAlgorithms v1.2.2 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.8.0 [2913bbd2] + StatsBase v0.34.10 [a759f4b9] + TimerOutputs v0.5.29 [56f22d72] + Artifacts v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.13.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.0.0 [9e88b42a] + Serialization v1.11.0 [2f01184e] + SparseArrays v1.13.0 [f489334b] + StyledStrings v1.13.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [4536629a] + OpenBLAS_jll v0.3.29+0 [bea87d4a] + SuiteSparse_jll v7.10.1+0 [8e850b90] + libblastrampoline_jll v5.15.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 2.18s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling packages... 4572.0 ms ✓ TestEnv 1 dependency successfully precompiled in 5 seconds. 27 already precompiled. Precompiling package dependencies... Precompiling packages... 4430.2 ms ✓ MacroTools 976.5 ms ✓ ANSIColoredPrinters 1081.6 ms ✓ Statistics 840.7 ms ✓ DataAPI 1981.1 ms ✓ IrrationalConstants 836.0 ms ✓ StatsAPI 836.4 ms ✓ LazilyInitializedFields 1216.1 ms ✓ OrderedCollections 25139.9 ms ✓ MLStyle 1081.0 ms ✓ DocStringExtensions 1080.4 ms ✓ AbstractTrees 861.9 ms ✓ ExprTools 966.6 ms ✓ AutoHashEquals 822.1 ms ✓ PtrArrays 1207.2 ms ✓ TranscodingStreams 800.7 ms ✓ IOCapture 934.4 ms ✓ DelimitedFiles 1402.0 ms ✓ StructUtils 1117.0 ms ✓ Compat 1141.2 ms ✓ Preferences 824.8 ms ✓ LegibleLambdas 1306.5 ms ✓ Statistics → SparseArraysExt 957.3 ms ✓ ScikitLearnBase 979.1 ms ✓ Missings 5395.1 ms ✓ RegistryInstances 3430.4 ms ✓ DataStructures 1327.8 ms ✓ LogExpFunctions 3162.7 ms ✓ HerbCore 1745.8 ms ✓ MarkdownAST 3101.4 ms ✓ TimerOutputs 1932.2 ms ✓ HerbSpecification 928.5 ms ✓ AliasTables 930.0 ms ✓ CodecZlib 821.2 ms ✓ Compat → CompatLinearAlgebraExt 1191.9 ms ✓ JLLWrappers 900.6 ms ✓ PrecompileTools 1919.3 ms ✓ DecisionTree 1038.8 ms ✓ SortingAlgorithms 1852.6 ms ✓ HerbGrammar 6394.1 ms ✓ Aqua 1385.0 ms ✓ Libiconv_jll 1366.7 ms ✓ Git_LFS_jll 1463.9 ms ✓ OpenSSH_jll 1385.0 ms ✓ Expat_jll 16435.9 ms ✓ Parsers 4502.9 ms ✓ StatsBase 1331.4 ms ✓ HerbInterpret 15753.6 ms ✓ HerbConstraints 1553.8 ms ✓ Git_jll 7438.1 ms ✓ JSON 14415.0 ms ✓ HerbSearch 1669.0 ms ✓ Git 3776.4 ms ✓ HerbSearch → DivideAndConquerExt 50870.2 ms ✓ Documenter 54 dependencies successfully precompiled in 212 seconds. 35 already precompiled. Precompilation completed after 239.07s ################################################################################ # Testing # Testing HerbSearch Status `/tmp/jl_s0HQMG/Project.toml` [4c88cf16] Aqua v0.8.14 [7806a523] DecisionTree v0.12.4 [e30172f5] Documenter v1.16.1 ⌅ [1fa96474] HerbConstraints v0.5.0 ⌅ [2b23ba43] HerbCore v0.3.12 ⌅ [4ef9e186] HerbGrammar v0.6.2 [5bbddadd] HerbInterpret v0.2.1 [3008d8e8] HerbSearch v0.4.10 ⌅ [6d54aada] HerbSpecification v0.2.1 [f1f30506] LegibleLambdas v0.3.0 [56ddb016] Logging v1.11.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_s0HQMG/Manifest.toml` [a4c015fc] ANSIColoredPrinters v0.0.1 [1520ce14] AbstractTrees v0.4.5 [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.14 [15f4f7f2] AutoHashEquals v2.2.0 [944b1d66] CodecZlib v0.7.8 [34da2185] Compat v4.18.1 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.19.3 [7806a523] DecisionTree v0.12.4 [8bb1440f] DelimitedFiles v1.9.1 [ffbed154] DocStringExtensions v0.9.5 [e30172f5] Documenter v1.16.1 [e2ba6199] ExprTools v0.1.10 [d7ba0133] Git v1.5.0 ⌅ [1fa96474] HerbConstraints v0.5.0 ⌅ [2b23ba43] HerbCore v0.3.12 ⌅ [4ef9e186] HerbGrammar v0.6.2 [5bbddadd] HerbInterpret v0.2.1 [3008d8e8] HerbSearch v0.4.10 ⌅ [6d54aada] HerbSpecification v0.2.1 [b5f81e59] IOCapture v1.0.0 [92d709cd] IrrationalConstants v0.2.6 [692b3bcd] JLLWrappers v1.7.1 [682c06a0] JSON v1.4.0 [0e77f7df] LazilyInitializedFields v1.3.0 [f1f30506] LegibleLambdas v0.3.0 [2ab3a3ac] LogExpFunctions v0.3.29 [d8e11817] MLStyle v0.4.17 [1914dd2f] MacroTools v0.5.16 [d0879d2d] MarkdownAST v0.1.2 [e1d29d7a] Missings v1.2.0 [bac558e1] OrderedCollections v1.8.1 [69de0a69] Parsers v2.8.3 [aea7be01] PrecompileTools v1.3.3 [21216c6a] Preferences v1.5.1 [43287f4e] PtrArrays v1.3.0 [2792f1a3] RegistryInstances v0.1.0 [6e75b9c4] ScikitLearnBase v0.5.0 [a2af1166] SortingAlgorithms v1.2.2 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.8.0 [2913bbd2] StatsBase v0.34.10 [ec057cc2] StructUtils v2.6.2 [a759f4b9] TimerOutputs v0.5.29 [3bb67fe8] TranscodingStreams v0.11.3 [2e619515] Expat_jll v2.7.3+0 [020c3dae] Git_LFS_jll v3.7.0+0 [f8c6e375] Git_jll v2.52.0+0 [94ce4f54] Libiconv_jll v1.18.0+0 [9bd350c2] OpenSSH_jll v10.2.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0 [b27032c2] LibCURL v1.0.0 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.13.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.14.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.0.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.13.0 [f489334b] StyledStrings v1.13.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.18.0+0 [e37daf67] LibGit2_jll v1.9.2+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.12.2 [4536629a] OpenBLAS_jll v0.3.29+0 [458c3c95] OpenSSL_jll v3.5.4+0 [efcefdf7] PCRE2_jll v10.47.0+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [83775a58] Zlib_jll v1.3.1+2 [3161d3a3] Zstd_jll v1.5.7+1 [8e850b90] libblastrampoline_jll v5.15.0+0 [8e850ede] nghttp2_jll v1.68.0+1 [3f19e933] p7zip_jll v17.7.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... ┌ Warning: Unable to determine HTML(edit_link = ...) from remote HEAD branch, defaulting to "master". │ Calling `git remote` failed with an exception. Set JULIA_DEBUG=Documenter to see the error. │ Unless this is due to a configuration error, the relevant variable should be set explicitly. └ @ Documenter ~/.julia/packages/Documenter/xvqbW/src/utilities/utilities.jl:680 Test Summary: | Pass Total Time HerbSearch.jl | 352 352 3m33.9s Aqua | 11 11 1m03.6s Search procedure synth | 8 8 17.0s Search | 1 1 12.6s Search max_enumerations stopping condition | 1 1 0.1s Search with errors in evaluation | 1 1 1.4s Best search | 2 2 0.2s Search_best max_enumerations stopping condition | 1 1 0.1s Search_best with errors in evaluation | 2 2 0.2s Context-free iterators | 41 41 5.8s getters for ProgramIterators | 5 5 0.2s length on single Real grammar | 4 4 0.3s length on grammar with multiplication | 4 4 0.1s length on different arithmetic operators | 16 16 0.0s length on grammar with functions | 4 4 0.0s BFSIterator test | 3 3 0.5s DFSIterator test | 2 2 0.2s MLFSIterator tests | 3 3 4.6s Sampling grammar | 50 50 3.4s Sampling with rand() returns programs in the given max_depth | 20 20 0.5s rand() gives the possible expressions for a certain max_depth | 5 5 0.0s Sampling throws an error if all expressions have a higher depth than max_depth | 5 5 0.4s Only one way to fill constraints | 20 20 2.6s Stochastic | 49 49 19.3s Accept function | 17 17 2.9s Cost functions | 14 14 3.8s Algorithms | 13 13 6.2s MH | 5 5 3.8s mh x * x + 4 | 1 1 2.4s mh x * (x + 5) | 1 1 0.3s factorization | 3 3 1.1s mh 5 * 5 * 5 | 1 1 0.5s mh 2 * 3 * 5 * 5 | 1 1 0.2s mh 2 * 2 * 3 * 4 * 5 | 1 1 0.4s Very Large Scale Neighbourhood | 4 4 0.7s vl x | 1 1 0.5s vl 2 | 1 1 0.1s vl 4 | 1 1 0.1s vl 10 | 1 1 0.1s Simulated Annealing | 4 4 1.7s sa x * x + 4 | 1 1 1.1s sa x * (x + 5) | 1 1 0.3s factorization | 2 2 0.4s sa 5 * 5 | 1 1 0.1s sa 2 * 3 * 4 | 1 1 0.3s Stochastic with Constraints | 5 5 5.4s Genetic search algorithms | 40 40 10.8s mutate_random | 21 21 0.1s Cross over | 10 10 0.2s Synthesize simple arithmetic expressions | 6 6 10.4s syntesizing expr x -> 1 | 1 1 2.3s syntesizing expr x -> 10 | 1 1 0.6s syntesizing expr x -> 625 | 1 1 0.2s syntesizing expr x -> 3x | 1 1 0.1s syntesizing expr x -> 3x + 10 | 1 1 0.2s syntesizing expr x -> 3 * x * x + (x + 2) | 1 1 5.3s Validation logic | 3 3 0.2s @iterator macro | 20 20 0.6s no inheritance | 3 3 0.1s with inheritance | 2 2 0.0s inheriting from something !<: ProgramIterator | 1 1 0.0s mutable iterator | 3 3 0.0s with default values | 3 3 0.0s Check if max_depth and max_size are overwritten | 4 4 0.1s Check default constructors with a solver | 3 3 0.0s Overlapping with default fields throws error | 1 1 0.3s UniformIterator | 7 7 3.2s Without constraints | 1 1 0.4s Forbidden constraint | 2 2 0.8s The root is the only solution | 2 2 0.0s No solutions (ordered constraint) | 1 1 1.9s No solutions (forbidden constraint) | 1 1 0.0s Forbidden | 6 6 1.2s Number of candidate programs | 2 2 0.3s Jump Start | 1 1 0.6s Large Tree | 1 1 0.2s DomainRuleNode | 2 2 0.2s Ordered | 9 9 4.8s Number of candidate programs | 6 6 3.6s DomainRuleNode | 1 1 0.3s 4 symbols | 1 1 0.0s (a, b) and (b, a) | 1 1 0.9s Contains | 1 1 0.5s Permutation grammar | 1 1 0.5s ContainsSubtree | 13 13 2.2s Minimal Example | 3 3 1.6s 1 VarNode | 3 3 0.3s 2 VarNodes | 3 3 0.3s No StateHoles | 3 3 0.0s Permutations | 1 1 0.0s Unique | 3 3 1.6s Number of candidate programs | 3 3 1.6s Constraints | 72 72 8.6s fix_point_running related bug | 1 1 0.3s 1 constraint | 30 30 4.6s 2 constraints | 10 10 2.1s 3 constraints | 10 10 0.2s 4 constraints | 10 10 0.3s 5 constraints | 10 10 0.3s all constraints | 1 1 0.5s Divide and conquer extension | 21 21 11.0s Search procedure divide and conquer | 20 20 7.6s divide, stopping criteria | 4 4 1.8s decide | 2 2 0.0s conquer | 14 14 5.7s conquer() | 3 3 4.4s conquer related functionality | 10 10 0.8s labels | 2 2 0.1s predicates | 5 5 0.2s features | 3 3 0.5s Construct final program | 1 1 0.1s Benchmark BV example for divide and conquer | 1 1 3.0s Doctests: HerbSearch | 1 1 49.9s Testing HerbSearch tests passed Testing completed after 412.04s PkgEval succeeded after 689.64s