Package evaluation of HerbSearch on Julia 1.12.0-DEV.1805 (a080deafdd*) started at 2025-03-24T14:35:12.523 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 9.01s ################################################################################ # Installation # Installing HerbSearch... Resolving package versions... Updating `~/.julia/environments/v1.12/Project.toml` [3008d8e8] + HerbSearch v0.4.3 Updating `~/.julia/environments/v1.12/Manifest.toml` [1520ce14] + AbstractTrees v0.4.5 [66dad0bd] + AliasTables v1.1.3 [15f4f7f2] + AutoHashEquals v2.2.0 [34da2185] + Compat v4.16.0 [9a962f9c] + DataAPI v1.16.0 [864edb3b] + DataStructures v0.18.22 [ffbed154] + DocStringExtensions v0.9.3 [1fa96474] + HerbConstraints v0.3.0 [2b23ba43] + HerbCore v0.3.5 [4ef9e186] + HerbGrammar v0.5.1 [5bbddadd] + HerbInterpret v0.1.6 [3008d8e8] + HerbSearch v0.4.3 [6d54aada] + HerbSpecification v0.2.0 [92d709cd] + IrrationalConstants v0.2.4 [2ab3a3ac] + LogExpFunctions v0.3.29 [d8e11817] + MLStyle v0.4.17 [e1d29d7a] + Missings v1.2.0 [bac558e1] + OrderedCollections v1.8.0 [43287f4e] + PtrArrays v1.3.0 [a2af1166] + SortingAlgorithms v1.2.1 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.7.0 [2913bbd2] + StatsBase v0.34.4 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [dc6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.2.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [2f01184e] + SparseArrays v1.12.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.2.0+0 [e37daf67] + LibGit2_jll v1.8.0+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+1 [4536629a] + OpenBLAS_jll v0.3.28+3 [bea87d4a] + SuiteSparse_jll v7.8.0+1 [8e850b90] + libblastrampoline_jll v5.11.2+0 Installation completed after 1.2s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 57.76s ################################################################################ # Testing # Testing HerbSearch Status `/tmp/jl_hOBwtA/Project.toml` [4c88cf16] Aqua v0.8.11 [1fa96474] HerbConstraints v0.3.0 [2b23ba43] HerbCore v0.3.5 [4ef9e186] HerbGrammar v0.5.1 [5bbddadd] HerbInterpret v0.1.6 [3008d8e8] HerbSearch v0.4.3 [6d54aada] HerbSpecification v0.2.0 [f1f30506] LegibleLambdas v0.3.0 [56ddb016] Logging v1.11.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_hOBwtA/Manifest.toml` [1520ce14] AbstractTrees v0.4.5 [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.11 [15f4f7f2] AutoHashEquals v2.2.0 [34da2185] Compat v4.16.0 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.18.22 [ffbed154] DocStringExtensions v0.9.3 [1fa96474] HerbConstraints v0.3.0 [2b23ba43] HerbCore v0.3.5 [4ef9e186] HerbGrammar v0.5.1 [5bbddadd] HerbInterpret v0.1.6 [3008d8e8] HerbSearch v0.4.3 [6d54aada] HerbSpecification v0.2.0 [92d709cd] IrrationalConstants v0.2.4 [f1f30506] LegibleLambdas v0.3.0 [2ab3a3ac] LogExpFunctions v0.3.29 [d8e11817] MLStyle v0.4.17 [1914dd2f] MacroTools v0.5.15 [e1d29d7a] Missings v1.2.0 [bac558e1] OrderedCollections v1.8.0 [43287f4e] PtrArrays v1.3.0 [a2af1166] SortingAlgorithms v1.2.1 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.7.0 [2913bbd2] StatsBase v0.34.4 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [dc6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.12.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [2f01184e] SparseArrays v1.12.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.2.0+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.8.0+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+1 [14a3606d] MozillaCACerts_jll v2024.11.26 [4536629a] OpenBLAS_jll v0.3.28+3 [bea87d4a] SuiteSparse_jll v7.8.0+1 [83775a58] Zlib_jll v1.3.1+1 [8e850b90] libblastrampoline_jll v5.11.2+0 [8e850ede] nghttp2_jll v1.63.0+1 [3f19e933] p7zip_jll v17.5.0+1 Testing Running tests... Test Summary: | Pass Total Time HerbSearch.jl | 306 306 4m38.1s Aqua | 11 11 2m55.1s Search procedure | 8 8 23.9s Search | 1 1 17.4s Search max_enumerations stopping condition | 1 1 0.1s Search with errors in evaluation | 1 1 2.0s Best search | 2 2 0.2s Search_best max_enumerations stopping condition | 1 1 0.1s Search_best with errors in evaluation | 2 2 0.3s Context-free iterators | 18 18 0.7s length on single Real grammar | 2 2 0.0s length on grammar with multiplication | 2 2 0.0s length on different arithmetic operators | 8 8 0.0s length on grammar with functions | 2 2 0.0s bfs enumerator | 3 3 0.7s dfs enumerator | 1 1 0.0s Sampling grammar | 50 50 4.5s Sampling with rand() returns programs in the given max_depth | 20 20 0.8s rand() gives the possible expressions for a certain max_depth | 5 5 0.0s Sampling throws an error if all expressions have a higher depth than max_depth | 5 5 0.3s Only one way to fill constraints | 20 20 3.4s Stochastic | 49 49 22.4s Accept function | 17 17 2.9s Cost functions | 14 14 3.5s Algorithms | 13 13 7.9s MH | 5 5 4.9s mh x * x + 4 | 1 1 2.7s mh x * (x + 5) | 1 1 0.1s factorization | 3 3 2.0s mh 5 * 5 * 5 | 1 1 0.3s mh 2 * 3 * 5 * 5 | 1 1 1.4s mh 2 * 2 * 3 * 4 * 5 | 1 1 0.3s Very Large Scale Neighbourhood | 4 4 0.9s vl x | 1 1 0.6s vl 2 | 1 1 0.1s vl 4 | 1 1 0.1s vl 10 | 1 1 0.1s Simulated Annealing | 4 4 2.1s sa x * x + 4 | 1 1 1.2s sa x * (x + 5) | 1 1 0.7s factorization | 2 2 0.2s sa 5 * 5 | 1 1 0.1s sa 2 * 3 * 4 | 1 1 0.1s Stochastic with Constraints | 5 5 7.0s Genetic search algorithms | 40 40 16.1s mutate_random | 21 21 0.2s Cross over | 10 10 0.3s Synthesize simple arithmetic expressions | 6 6 15.4s syntesizing expr x -> 1 | 1 1 3.1s syntesizing expr x -> 10 | 1 1 1.0s syntesizing expr x -> 625 | 1 1 0.2s syntesizing expr x -> 3x | 1 1 0.1s syntesizing expr x -> 3x + 10 | 1 1 0.1s syntesizing expr x -> 3 * x * x + (x + 2) | 1 1 8.1s Validation logic | 3 3 0.2s @iterator macro | 19 19 0.3s no inheritance | 3 3 0.1s with inheritance | 2 2 0.0s inheriting from something !<: ProgramIterator | 1 1 0.0s mutable iterator | 3 3 0.0s with default values | 3 3 0.1s Check if max_depth and max_size are overwritten | 4 4 0.1s Check default constructors with a solver | 3 3 0.0s UniformIterator | 7 7 4.3s Without constraints | 1 1 0.7s Forbidden constraint | 2 2 1.3s The root is the only solution | 2 2 0.0s No solutions (ordered constraint) | 1 1 2.4s No solutions (forbidden constraint) | 1 1 0.0s Forbidden | 6 6 1.6s Number of candidate programs | 2 2 0.3s Jump Start | 1 1 0.8s Large Tree | 1 1 0.2s DomainRuleNode | 2 2 0.3s Ordered | 9 9 6.9s Number of candidate programs | 6 6 5.2s DomainRuleNode | 1 1 0.5s 4 symbols | 1 1 0.0s (a, b) and (b, a) | 1 1 1.2s Contains | 1 1 0.8s Permutation grammar | 1 1 0.8s ContainsSubtree | 13 13 2.9s Minimal Example | 3 3 1.9s 1 VarNode | 3 3 0.4s 2 VarNodes | 3 3 0.5s No StateHoles | 3 3 0.0s Permutations | 1 1 0.1s Unique | 3 3 2.5s Number of candidate programs | 3 3 2.5s Constraints | 72 72 11.7s fix_point_running related bug | 1 1 0.3s 1 constraint | 30 30 5.5s 2 constraints | 10 10 3.9s 3 constraints | 10 10 0.3s 4 constraints | 10 10 0.3s 5 constraints | 10 10 0.3s all constraints | 1 1 0.7s Testing HerbSearch tests passed Testing completed after 304.34s PkgEval succeeded after 387.68s