Package evaluation to test HerbSearch on Julia 1.14.0-DEV.3055 (7e75a8061a*) started at 2026-08-27T19:48:47.279 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.14` Set-up completed after 13.39s ################################################################################ # Installation # Installing HerbSearch... Resolving package versions... Installed RuntimeGeneratedFunctions ─ v0.5.25 Installed DataStructures ──────────── v0.19.6 Installed StatsBase ───────────────── v0.34.13 Installed AbstractTrees ───────────── v0.4.5 Installed MacroTools ──────────────── v0.5.16 Installed AliasTables ─────────────── v1.1.3 Installed HerbInterpret ───────────── v1.0.1 Installed HerbGrammar ─────────────── v1.2.0 Installed ExprTools ───────────────── v0.1.11 Installed OrderedCollections ──────── v2.0.1 Installed DataAPI ─────────────────── v1.16.0 Installed StatsAPI ────────────────── v1.8.0 Installed IrrationalConstants ─────── v0.2.6 Installed TimerOutputs ────────────── v0.5.29 Installed Statistics ──────────────── v1.11.1 Installed HerbSpecification ───────── v1.0.0 Installed LogExpFunctions ─────────── v1.0.1 Installed HerbSearch ──────────────── v1.0.2 Installed PrecompileTools ─────────── v1.3.4 Installed SortingAlgorithms ───────── v1.2.3 Installed PtrArrays ───────────────── v1.4.0 Installed HerbCore ────────────────── v1.1.0 Installed Missings ────────────────── v1.2.0 Installed AutoHashEquals ──────────── v2.2.0 Installed HerbConstraints ─────────── v1.2.1 Installed DocStringExtensions ─────── v0.9.5 Installed Preferences ─────────────── v1.5.2 Installed MLStyle ─────────────────── v0.4.17 Updating `~/.julia/environments/v1.14/Project.toml` [3008d8e8] + HerbSearch v1.0.2 Updating `~/.julia/environments/v1.14/Manifest.toml` [1520ce14] + AbstractTrees v0.4.5 [66dad0bd] + AliasTables v1.1.3 [15f4f7f2] + AutoHashEquals v2.2.0 [9a962f9c] + DataAPI v1.16.0 [864edb3b] + DataStructures v0.19.6 [ffbed154] + DocStringExtensions v0.9.5 [e2ba6199] + ExprTools v0.1.11 [1fa96474] + HerbConstraints v1.2.1 [2b23ba43] + HerbCore v1.1.0 [4ef9e186] + HerbGrammar v1.2.0 [5bbddadd] + HerbInterpret v1.0.1 [3008d8e8] + HerbSearch v1.0.2 [6d54aada] + HerbSpecification v1.0.0 [92d709cd] + IrrationalConstants v0.2.6 [2ab3a3ac] + LogExpFunctions v1.0.1 [d8e11817] + MLStyle v0.4.17 [1914dd2f] + MacroTools v0.5.16 [e1d29d7a] + Missings v1.2.0 [bac558e1] + OrderedCollections v2.0.1 [aea7be01] + PrecompileTools v1.3.4 [21216c6a] + Preferences v1.5.2 [43287f4e] + PtrArrays v1.4.0 [7e49a35a] + RuntimeGeneratedFunctions v0.5.25 [a2af1166] + SortingAlgorithms v1.2.3 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.8.0 [2913bbd2] + StatsBase v0.34.13 ⌅ [a759f4b9] + TimerOutputs v0.5.29 [56f22d72] + Artifacts v1.11.0 [ade2ca70] + Dates v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.14.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.13.0 [9e88b42a] + Serialization v1.11.0 [2f01184e] + SparseArrays v1.13.0 [f489334b] + StyledStrings v1.13.0 [fa267f1f] + TOML v1.0.3 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.5.7+0 [4536629a] + OpenBLAS_jll v0.3.34+0 [bea87d4a] + SuiteSparse_jll v7.10.1+0 [8e850b90] + libblastrampoline_jll v5.15.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 2.37s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling project... 3.2 s ✓ TestEnv 1 dependency successfully precompiled in 3 seconds. 27 already precompiled. Precompiling package dependencies... Precompiling project... 3.4 s ✓ MacroTools 0.7 s ✓ ANSIColoredPrinters 0.9 s ✓ Statistics 0.7 s ✓ DataAPI 2.0 s ✓ IrrationalConstants 0.6 s ✓ StatsAPI 0.6 s ✓ LazilyInitializedFields 1.0 s ✓ OrderedCollections 23.7 s ✓ MLStyle 0.8 s ✓ DocStringExtensions 0.9 s ✓ AbstractTrees 0.6 s ✓ ExprTools 0.6 s ✓ AutoHashEquals 0.5 s ✓ PtrArrays 0.8 s ✓ TranscodingStreams 0.5 s ✓ IOCapture 0.7 s ✓ DelimitedFiles 1.7 s ✓ StructUtils 0.8 s ✓ Compat 1.3 s ✓ Preferences 0.5 s ✓ LegibleLambdas 1.6 s ✓ Statistics → SparseArraysExt 0.7 s ✓ ScikitLearnBase 0.9 s ✓ Missings 4.9 s ✓ RegistryInstances 3.6 s ✓ DataStructures 1.2 s ✓ LogExpFunctions 2.3 s ✓ HerbCore 1.5 s ✓ MarkdownAST 2.4 s ✓ TimerOutputs 1.6 s ✓ HerbSpecification 0.8 s ✓ AliasTables 0.7 s ✓ CodecZlib 0.5 s ✓ Compat → CompatLinearAlgebraExt 1.5 s ✓ JLLWrappers 1.0 s ✓ PrecompileTools 1.8 s ✓ DecisionTree 0.9 s ✓ SortingAlgorithms 1.8 s ✓ HerbGrammar 5.6 s ✓ Aqua 1.7 s ✓ Clingo_jll 1.1 s ✓ Libiconv_jll 1.2 s ✓ Git_LFS_jll 1.2 s ✓ OpenSSH_jll 1.1 s ✓ Expat_jll 10.8 s ✓ Parsers 3.2 s ✓ RuntimeGeneratedFunctions 3.5 s ✓ StatsBase 10.2 s ✓ HerbConstraints 1.1 s ✓ Git_jll 9.2 s ✓ JSON 1.8 s ✓ HerbInterpret 2.4 s ✓ HerbConstraints → ASPExt 1.1 s ✓ Git 11.4 s ✓ HerbSearch 52.9 s ✓ Documenter 3.2 s ✓ HerbSearch → DivideAndConquerExt 57 dependencies successfully precompiled in 196 seconds. 35 already precompiled. Precompilation completed after 213.49s ################################################################################ # Testing # Testing HerbSearch Status `/tmp/jl_qwS13W/Project.toml` [4c88cf16] Aqua v0.8.16 [864edb3b] DataStructures v0.19.6 [7806a523] DecisionTree v0.12.4 [e30172f5] Documenter v1.17.0 [1fa96474] HerbConstraints v1.2.1 [2b23ba43] HerbCore v1.1.0 [4ef9e186] HerbGrammar v1.2.0 [5bbddadd] HerbInterpret v1.0.1 [3008d8e8] HerbSearch v1.0.2 [6d54aada] HerbSpecification v1.0.0 [f1f30506] LegibleLambdas v0.3.0 [e1d4ad0e] Clingo_jll v5.8.2+0 [56ddb016] Logging v1.11.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_qwS13W/Manifest.toml` [a4c015fc] ANSIColoredPrinters v0.0.1 [1520ce14] AbstractTrees v0.4.5 [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.16 [15f4f7f2] AutoHashEquals v2.2.0 [944b1d66] CodecZlib v0.7.9 [34da2185] Compat v4.18.1 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.19.6 [7806a523] DecisionTree v0.12.4 [8bb1440f] DelimitedFiles v1.9.1 [ffbed154] DocStringExtensions v0.9.5 [e30172f5] Documenter v1.17.0 [e2ba6199] ExprTools v0.1.11 [d7ba0133] Git v1.5.0 [1fa96474] HerbConstraints v1.2.1 [2b23ba43] HerbCore v1.1.0 [4ef9e186] HerbGrammar v1.2.0 [5bbddadd] HerbInterpret v1.0.1 [3008d8e8] HerbSearch v1.0.2 [6d54aada] HerbSpecification v1.0.0 [b5f81e59] IOCapture v1.0.0 [92d709cd] IrrationalConstants v0.2.6 [692b3bcd] JLLWrappers v1.8.0 [682c06a0] JSON v1.7.1 [0e77f7df] LazilyInitializedFields v1.3.0 [f1f30506] LegibleLambdas v0.3.0 [2ab3a3ac] LogExpFunctions v1.0.1 [d8e11817] MLStyle v0.4.17 [1914dd2f] MacroTools v0.5.16 [d0879d2d] MarkdownAST v0.1.3 [e1d29d7a] Missings v1.2.0 [bac558e1] OrderedCollections v2.0.1 ⌅ [69de0a69] Parsers v2.8.7 [aea7be01] PrecompileTools v1.3.4 [21216c6a] Preferences v1.5.2 [43287f4e] PtrArrays v1.4.0 [2792f1a3] RegistryInstances v0.1.0 [7e49a35a] RuntimeGeneratedFunctions v0.5.25 [6e75b9c4] ScikitLearnBase v0.5.0 [a2af1166] SortingAlgorithms v1.2.3 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.8.0 [2913bbd2] StatsBase v0.34.13 [ec057cc2] StructUtils v2.8.5 ⌅ [a759f4b9] TimerOutputs v0.5.29 [3bb67fe8] TranscodingStreams v0.11.3 [e1d4ad0e] Clingo_jll v5.8.2+0 [2e619515] Expat_jll v2.8.3+0 [020c3dae] Git_LFS_jll v3.7.1+0 [f8c6e375] Git_jll v2.55.0+0 [94ce4f54] Libiconv_jll v1.18.0+0 [9bd350c2] OpenSSH_jll v10.5.1+0 [0dad84c5] ArgTools v1.2.0 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0 [b27032c2] LibCURL v1.0.0 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.14.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.14.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.13.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.13.0 [f489334b] StyledStrings v1.13.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.5.7+0 [deac9b47] LibCURL_jll v8.21.0+0 [e37daf67] LibGit2_jll v1.9.7+0 [29816b5a] LibSSH2_jll v1.11.104+0 [14a3606d] MozillaCACerts_jll v2026.8.13 [4536629a] OpenBLAS_jll v0.3.34+0 [458c3c95] OpenSSL_jll v3.5.8+0 [efcefdf7] PCRE2_jll v10.47.0+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [83775a58] Zlib_jll v1.3.2+0 [3161d3a3] Zstd_jll v1.5.7+1 [8e850b90] libblastrampoline_jll v5.15.0+0 [8e850ede] nghttp2_jll v1.70.0+0 [3f19e933] p7zip_jll v17.8.2+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... ┌ Warning: `_unsetindex!(A, i)` is deprecated, use `Base.unsetindex!(A, i)` instead. │ caller = pop!(d::DataStructures.Deque{Vector{Tuple{StateHole, Int64}}}) at deque.jl:300 └ @ DataStructures ~/.julia/packages/DataStructures/IwRP2/src/deque.jl:300 ┌ Warning: Collecting all programs of a TopDownIterator requires freeze_state └ @ HerbSearch ~/.julia/packages/HerbSearch/IvwnL/src/top_down_iterator.jl:249 ┌ Warning: Unable to determine HTML(edit_link = ...) from remote HEAD branch, defaulting to "master". │ Calling `git remote` failed with an exception. Set JULIA_DEBUG=Documenter to see the error. │ Unless this is due to a configuration error, the relevant variable should be set explicitly. └ @ Documenter ~/.julia/packages/Documenter/AXNMp/src/utilities/utilities.jl:719 ┌ Error: doctest failure in ../src/program_iterator.jl:42-61 │ │ ```jldoctest │ julia> g = @csgrammar begin │ Int = length(List) │ Int = Int + Int │ List = x │ end; │ │ julia> it = BFSIterator(g, :Int; max_depth=4); │ │ julia> programs = rulenode2expr.((freeze_state(p) for p in it), (g,)) │ 5-element Vector{Expr}: │ :(length(x)) │ :(length(x) + length(x)) │ :(length(x) + (length(x) + length(x))) │ :((length(x) + length(x)) + length(x)) │ :((length(x) + length(x)) + (length(x) + length(x))) │ │ julia> get_starting_symbol(it) │ :Int │ ``` │ │ Subexpression: │ │ programs = rulenode2expr.((freeze_state(p) for p in it), (g,)) │ │ Evaluated output: │ │ ┌ Warning: `_unsetindex!(A, i)` is deprecated, use `Base.unsetindex!(A, i)` instead. │ │ caller = pop!(d::DataStructures.Deque{Vector{Tuple{StateHole, Int64}}}) at deque.jl:300 │ └ @ DataStructures ~/.julia/packages/DataStructures/IwRP2/src/deque.jl:300 │ 5-element Vector{Expr}: │ :(length(x)) │ :(length(x) + length(x)) │ :(length(x) + (length(x) + length(x))) │ :((length(x) + length(x)) + length(x)) │ :((length(x) + length(x)) + (length(x) + length(x))) │ │ Expected output: │ │ 5-element Vector{Expr}: │ :(length(x)) │ :(length(x) + length(x)) │ :(length(x) + (length(x) + length(x))) │ :((length(x) + length(x)) + length(x)) │ :((length(x) + length(x)) + (length(x) + length(x))) │ │ diff = │ Warning: Diff output requires color. │ ┌ Warning: `_unsetindex!(A, i)` is deprecated, use `Base.unsetindex!(A, i)` instead. │ │ caller = pop!(d::DataStructures.Deque{Vector{Tuple{StateHole, Int64}}}) at deque.jl:300 │ └ @ DataStructures ~/.julia/packages/DataStructures/IwRP2/src/deque.jl:300 │ 5-element Vector{Expr}: │ :(length(x)) │ :(length(x) + length(x)) │ :(length(x) + (length(x) + length(x))) │ :((length(x) + length(x)) + length(x)) │ :((length(x) + length(x)) + (length(x) + length(x))) └ @ Documenter ~/.julia/packages/HerbSearch/IvwnL/src/program_iterator.jl:42 ┌ Error: Doctesting failed │ exception = │ `makedocs` encountered a doctest error. Terminating build │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] runner(::Type{Documenter.Builder.Doctest}, doc::Documenter.Document) │ @ Documenter ~/.julia/packages/Documenter/AXNMp/src/builder_pipeline.jl:213 │ [3] dispatch(::Core.TypeEgal{Documenter.Builder.DocumentPipeline}, x::Documenter.Document) │ @ Documenter.Selectors ~/.julia/packages/Documenter/AXNMp/src/utilities/Selectors.jl:170 │ [4] (::Documenter.var"#95#96"{Documenter.Document})() │ @ Documenter ~/.julia/packages/Documenter/AXNMp/src/makedocs.jl:283 [inlined] │ [5] withenv(::Documenter.var"#95#96"{Documenter.Document}, ::Pair{String, Nothing}, ::Vararg{Pair{String, Nothing}}) │ @ Base env.jl:283 │ [6] (::Documenter.var"#93#94"{Documenter.Document})() │ @ Documenter ~/.julia/packages/Documenter/AXNMp/src/makedocs.jl:282 [inlined] │ [7] cd(f::Documenter.var"#93#94"{Documenter.Document}, dir::String) │ @ Base.Filesystem file.jl:113 │ [8] makedocs(; debug::Bool, format::Documenter.HTMLWriter.HTML, kwargs::@Kwargs{root::String, source::String, sitename::String, doctest::Symbol, modules::Vector{Module}, doctestfilters::Vector{Regex}, remotes::Nothing, plugins::Vector{Documenter.Plugin}}) │ @ Documenter ~/.julia/packages/Documenter/AXNMp/src/makedocs.jl:281 │ [9] (::Documenter.var"#all_doctests#147"{Bool, Vector{Regex}, Vector{Documenter.Plugin}, Vector{Module}})() │ @ Documenter ~/.julia/packages/Documenter/AXNMp/src/doctest.jl:85 │ [10] macro expansion │ @ ~/.julia/packages/Documenter/AXNMp/src/doctest.jl:110 [inlined] │ [11] macro expansion │ @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:781 [inlined] │ [12] macro expansion │ @ ~/.julia/packages/Documenter/AXNMp/src/doctest.jl:110 [inlined] │ [13] macro expansion │ @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2247 [inlined] │ [14] doctest(source::Nothing, modules::Vector{Module}; fix::Bool, testset::String, doctestfilters::Vector{Regex}, plugins::Vector{Documenter.Plugin}) │ @ Documenter ~/.julia/packages/Documenter/AXNMp/src/doctest.jl:110 │ [15] doctest(package::Module; manual::Bool, testset::Nothing, kwargs::@Kwargs{}) │ @ Documenter ~/.julia/packages/Documenter/AXNMp/src/doctest.jl:37 │ [16] top-level scope │ @ ~/.julia/packages/HerbSearch/IvwnL/test/runtests.jl:20 │ [17] macro expansion │ @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2247 [inlined] │ [18] macro expansion │ @ ~/.julia/packages/HerbSearch/IvwnL/test/runtests.jl:47 [inlined] │ [19] include(mapexpr::Function, mod::Module, _path::String) │ @ Base Base.jl:335 │ [20] top-level scope │ @ none:6 │ [21] eval(m::Module, e::Any) │ @ Core boot.jl:618 │ [22] __script_entry_eval(mod::Module, ex::Any) │ @ Base client.jl:106 [inlined] │ [23] exec_options(opts::Base.JLOptions) │ @ Base client.jl:350 │ [24] _start() │ @ Base client.jl:695 └ @ Documenter ~/.julia/packages/Documenter/AXNMp/src/doctest.jl:99 Doctests: HerbSearch: Test Failed at /home/pkgeval/.julia/packages/Documenter/AXNMp/src/doctest.jl:110 Expression: all_doctests() Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:784 [inlined] [2] macro expansion @ ~/.julia/packages/Documenter/AXNMp/src/doctest.jl:110 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2247 [inlined] [4] doctest(source::Nothing, modules::Vector{Module}; fix::Bool, testset::String, doctestfilters::Vector{Regex}, plugins::Vector{Documenter.Plugin}) @ Documenter ~/.julia/packages/Documenter/AXNMp/src/doctest.jl:110 Test Summary: | Pass Fail Total Time HerbSearch.jl | 694 1 695 12m59.1s Aqua | 11 11 1m21.7s Search procedure synth | 8 8 24.7s Search | 1 1 19.4s Search max_enumerations stopping condition | 1 1 0.1s Search with errors in evaluation | 1 1 1.6s Best search | 2 2 0.4s Search_best max_enumerations stopping condition | 1 1 0.1s Search_best with errors in evaluation | 2 2 0.2s Context-free iterators | 41 41 7.3s getters for ProgramIterators | 5 5 0.2s length on single Real grammar | 4 4 0.3s length on grammar with multiplication | 4 4 0.1s length on different arithmetic operators | 16 16 0.1s length on grammar with functions | 4 4 0.0s BFSIterator test | 3 3 0.7s DFSIterator test | 2 2 0.3s MLFSIterator tests | 3 3 5.6s Sampling grammar | 50 50 5.2s Sampling with rand() returns programs in the given max_depth | 20 20 0.7s rand() gives the possible expressions for a certain max_depth | 5 5 0.0s Sampling throws an error if all expressions have a higher depth than max_depth | 5 5 0.9s Only one way to fill constraints | 20 20 3.6s Stochastic | 49 49 22.0s Accept function | 17 17 3.2s Cost functions | 14 14 4.1s Algorithms | 13 13 6.8s MH | 5 5 4.1s mh x * x + 4 | 1 1 2.7s mh x * (x + 5) | 1 1 0.4s factorization | 3 3 1.1s mh 5 * 5 * 5 | 1 1 0.5s mh 2 * 3 * 5 * 5 | 1 1 0.2s mh 2 * 2 * 3 * 4 * 5 | 1 1 0.4s Very Large Scale Neighbourhood | 4 4 0.8s vl x | 1 1 0.6s vl 2 | 1 1 0.1s vl 4 | 1 1 0.1s vl 10 | 1 1 0.1s Simulated Annealing | 4 4 1.9s sa x * x + 4 | 1 1 1.2s sa x * (x + 5) | 1 1 0.3s factorization | 2 2 0.4s sa 5 * 5 | 1 1 0.1s sa 2 * 3 * 4 | 1 1 0.3s Stochastic with Constraints | 5 5 6.3s Genetic search algorithms | 40 40 10.9s mutate_random | 21 21 0.1s Cross over | 10 10 0.3s Synthesize simple arithmetic expressions | 6 6 10.3s syntesizing expr x -> 1 | 1 1 2.3s syntesizing expr x -> 10 | 1 1 0.6s syntesizing expr x -> 625 | 1 1 0.3s syntesizing expr x -> 3x | 1 1 0.1s syntesizing expr x -> 3x + 10 | 1 1 0.1s syntesizing expr x -> 3 * x * x + (x + 2) | 1 1 5.2s Validation logic | 3 3 0.2s @iterator macro | 20 20 0.7s no inheritance | 3 3 0.1s with inheritance | 2 2 0.0s inheriting from something !<: ProgramIterator | 1 1 0.0s mutable iterator | 3 3 0.1s with default values | 3 3 0.1s Check if max_depth and max_size are overwritten | 4 4 0.1s Check default constructors with a solver | 3 3 0.0s Overlapping with default fields throws error | 1 1 0.3s UniformIterator | 7 7 4.3s Without constraints | 1 1 0.6s Forbidden constraint | 2 2 1.2s The root is the only solution | 2 2 0.2s No solutions (ordered constraint) | 1 1 2.3s No solutions (forbidden constraint) | 1 1 0.0s Forbidden | 6 6 1.6s Number of candidate programs | 2 2 0.5s Jump Start | 1 1 0.7s Large Tree | 1 1 0.3s DomainRuleNode | 2 2 0.2s Ordered | 9 9 6.5s Number of candidate programs | 6 6 5.1s DomainRuleNode | 1 1 0.4s 4 symbols | 1 1 0.0s (a, b) and (b, a) | 1 1 1.1s Contains | 1 1 0.7s Permutation grammar | 1 1 0.7s ContainsSubtree | 13 13 3.0s Minimal Example | 3 3 2.0s 1 VarNode | 3 3 0.5s 2 VarNodes | 3 3 0.4s No StateHoles | 3 3 0.0s Permutations | 1 1 0.1s Unique | 3 3 2.4s Number of candidate programs | 3 3 2.4s Constraints | 72 72 25.4s fix_point_running related bug | 1 1 0.3s 1 constraint | 30 30 9.2s 2 constraints | 10 10 6.1s 3 constraints | 10 10 3.1s 4 constraints | 10 10 2.9s 5 constraints | 10 10 2.9s all constraints | 1 1 0.6s Bottom-Up Search | 260 260 8m01.8s Generic Bottom-Up Search Test | 210 210 7m52.4s Structural Bottom-Up Search (Size/Depth only) | 34 34 6.1s Cost-Based Bottom-Up Search | 16 16 3.4s UniformASPIterator | 77 77 3.1s ASP_solution_conversion | 20 20 1.7s ASP_solution_conversion_nonuniform | 44 44 0.1s Without constraints | 2 2 0.2s Forbidden constraint | 4 4 0.8s The root is the only solution | 3 3 0.0s No solutions (ordered constraint) | 2 2 0.2s No solutions (forbidden constraint) | 2 2 0.0s ASP Iterators | 6 6 1.9s Divide and conquer extension | 21 21 14.7s Search procedure divide and conquer | 20 20 10.3s divide, stopping criteria | 4 4 2.1s decide | 2 2 0.0s conquer | 14 14 8.2s conquer() | 3 3 6.2s conquer related functionality | 10 10 1.3s labels | 2 2 0.2s predicates | 5 5 0.4s features | 3 3 0.7s Construct final program | 1 1 0.2s Benchmark BV example for divide and conquer | 1 1 3.9s Doctests: HerbSearch | 1 1 1m06.5s RNG of the outermost testset: Xoshiro(0x9951797c85a704f1, 0xb9d66be14dfba82b, 0xb170153285fd9556, 0xe90a07f7bdd1fd77, 0x9d4b5ee33e4bd661) ERROR: LoadError: Some tests did not pass: 694 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/HerbSearch/IvwnL/test/runtests.jl:19 Testing failed after 798.03s ERROR: LoadError: Package HerbSearch errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:3283 [3] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:587 [4] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:172 [5] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [6] test(pkg::String; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:159 [inlined] [7] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 1082.69s: package has test failures