Package evaluation to test HerbConstraints on Julia 1.12.4 (01a2eadb04*) started at 2026-01-08T22:34:24.999


################################################################################
# Set-up
#

Installing PkgEval dependencies (TestEnv)...

Set-up completed after 7.97s


################################################################################
# Installation
#

Installing HerbConstraints...
   Resolving package versions...
    Updating `~/.julia/environments/v1.12/Project.toml`
  [1fa96474] + HerbConstraints v0.5.0
    Updating `~/.julia/environments/v1.12/Manifest.toml`
  [1520ce14] + AbstractTrees v0.4.5
  [864edb3b] + DataStructures v0.19.3
  [e2ba6199] + ExprTools v0.1.10
  [1fa96474] + HerbConstraints v0.5.0
  [2b23ba43] + HerbCore v0.3.12
  [4ef9e186] + HerbGrammar v0.6.2
  [d8e11817] + MLStyle v0.4.17
  [1914dd2f] + MacroTools v0.5.16
  [bac558e1] + OrderedCollections v1.8.1
  [a759f4b9] + TimerOutputs v0.5.29
  [de0858da] + Printf v1.11.0
  [9e88b42a] + Serialization v1.11.0
  [f489334b] + StyledStrings v1.11.0
  [4ec0a83e] + Unicode v1.11.0

Installation completed after 1.22s


################################################################################
# Precompilation
#

Precompiling PkgEval dependencies...

┌ Error: Failed to use TestEnv.jl; test dependencies will not be precompiled
│   exception =
│    UndefVarError: `project_rel_path` not defined in `TestEnv`
│    Suggestion: this global was defined as `Pkg.Operations.project_rel_path` but not assigned a value.
│    Stacktrace:
│     [1] get_test_dir(ctx::Pkg.Types.Context, pkgspec::PackageSpec)
│       @ TestEnv ~/.julia/packages/TestEnv/iseFl/src/julia-1.11/common.jl:75
│     [2] test_dir_has_project_file
│       @ ~/.julia/packages/TestEnv/iseFl/src/julia-1.11/common.jl:52 [inlined]
│     [3] maybe_gen_project_override!
│       @ ~/.julia/packages/TestEnv/iseFl/src/julia-1.11/common.jl:83 [inlined]
│     [4] activate(pkg::String; allow_reresolve::Bool)
│       @ TestEnv ~/.julia/packages/TestEnv/iseFl/src/julia-1.11/activate_set.jl:12
│     [5] activate(pkg::String)
│       @ TestEnv ~/.julia/packages/TestEnv/iseFl/src/julia-1.11/activate_set.jl:9
│     [6] top-level scope
│       @ /PkgEval.jl/scripts/precompile.jl:24
│     [7] include(mod::Module, _path::String)
│       @ Base ./Base.jl:306
│     [8] exec_options(opts::Base.JLOptions)
│       @ Base ./client.jl:317
│     [9] _start()
│       @ Base ./client.jl:550
└ @ Main /PkgEval.jl/scripts/precompile.jl:26
Precompiling package dependencies...
Precompiling packages...
  17327.4 ms  ✓ HerbConstraints
  1 dependency successfully precompiled in 18 seconds. 13 already precompiled.

Precompilation completed after 30.48s


################################################################################
# Testing
#

     Testing HerbConstraints
      Status `/tmp/jl_1jOUsf/Project.toml`
  [4c88cf16] Aqua v0.8.14
  [1fa96474] HerbConstraints v0.5.0
  [2b23ba43] HerbCore v0.3.12
  [4ef9e186] HerbGrammar v0.6.2
  [c3a54625] JET v0.11.3
  [817f1d60] ReTestItems v1.35.0
  [f8b46487] TestItemRunner v1.1.4
  [1c621080] TestItems v1.0.0
  [8dfed614] Test v1.11.0
      Status `/tmp/jl_1jOUsf/Manifest.toml`
  [1520ce14] AbstractTrees v0.4.5
  [4c88cf16] Aqua v0.8.14
  [da1fd8a2] CodeTracking v3.0.0
  [34da2185] Compat v4.18.1
  [807dbc54] Compiler v0.1.1
  [864edb3b] DataStructures v0.19.3
  [e2ba6199] ExprTools v0.1.10
  [1fa96474] HerbConstraints v0.5.0
  [2b23ba43] HerbCore v0.3.12
  [4ef9e186] HerbGrammar v0.6.2
  [c3a54625] JET v0.11.3
  [aa1ae85d] JuliaInterpreter v0.10.9
  [70703baa] JuliaSyntax v1.0.2
  [6f1432cf] LoweredCodeUtils v3.5.0
  [d8e11817] MLStyle v0.4.17
  [1914dd2f] MacroTools v0.5.16
  [bac558e1] OrderedCollections v1.8.1
  [aea7be01] PrecompileTools v1.3.3
  [21216c6a] Preferences v1.5.1
  [817f1d60] ReTestItems v1.35.0
  [295af30f] Revise v3.13.1
  [1e6cf692] TestEnv v1.103.1
  [f8b46487] TestItemRunner v1.1.4
  [1c621080] TestItems v1.0.0
  [a759f4b9] TimerOutputs v0.5.29
  [0dad84c5] ArgTools v1.1.2
  [56f22d72] Artifacts v1.11.0
  [2a0f44e3] Base64 v1.11.0
  [ade2ca70] Dates v1.11.0
  [f43a241f] Downloads v1.7.0
  [7b1f6079] FileWatching v1.11.0
  [b77e0a4c] InteractiveUtils v1.11.0
  [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0
  [b27032c2] LibCURL v0.6.4
  [76f85450] LibGit2 v1.11.0
  [8f399da3] Libdl v1.11.0
  [56ddb016] Logging v1.11.0
  [d6f4376e] Markdown v1.11.0
  [ca575930] NetworkOptions v1.3.0
  [44cfe95a] Pkg v1.12.1
  [de0858da] Printf v1.11.0
  [3fa0cd96] REPL v1.11.0
  [9a3f8284] Random v1.11.0
  [ea8e919c] SHA v0.7.0
  [9e88b42a] Serialization v1.11.0
  [6462fe0b] Sockets v1.11.0
  [f489334b] StyledStrings v1.11.0
  [fa267f1f] TOML v1.0.3
  [a4e569a6] Tar v1.10.0
  [8dfed614] Test v1.11.0
  [cf7118a7] UUIDs v1.11.0
  [4ec0a83e] Unicode v1.11.0
  [e66e0078] CompilerSupportLibraries_jll v1.3.0+1
  [deac9b47] LibCURL_jll v8.15.0+0
  [e37daf67] LibGit2_jll v1.9.0+0
  [29816b5a] LibSSH2_jll v1.11.3+1
  [14a3606d] MozillaCACerts_jll v2025.11.4
  [458c3c95] OpenSSL_jll v3.5.4+0
  [83775a58] Zlib_jll v1.3.1+2
  [8e850ede] nghttp2_jll v1.64.0+1
  [3f19e933] p7zip_jll v17.7.0+0
     Testing Running tests...
[ Info: Scanning for test items in project `HerbConstraints` at paths: /home/pkgeval/.julia/packages/HerbConstraints/Oc0Sz
[ Info: Finished scanning for test items in 5.82 seconds.
[ Info: Scheduling 24 tests on pid 15
22:36:18 | maxrss  2.3% | mem  3.1% | START ( 1/24) test item "Aqua.jl" at test/aqua_test.jl:1
22:37:08 | maxrss  2.3% | mem  3.3% | DONE  ( 1/24) test item "Aqua.jl" 49.8 secs (60.6% compile, 5.9% recompile, 1.7% GC), 13.59 M allocs (773.994 MB)
22:37:08 | maxrss  2.3% | mem  3.3% | START ( 2/24) test item "ContainsSubtree" at test/contains_subtree_test.jl:1
22:37:33 | maxrss  2.3% | mem  3.3% | DONE  ( 2/24) test item "ContainsSubtree" 25.0 secs (99.0% compile, 3.2% recompile, 0.7% GC), 11.02 M allocs (598.828 MB)
22:37:33 | maxrss  2.3% | mem  3.3% | START ( 3/24) test item "Contains" at test/contains_test.jl:1
22:37:35 | maxrss  2.3% | mem  3.3% | DONE  ( 3/24) test item "Contains" 1.3 secs (94.5% compile, 19.6% recompile, 4.0% GC), 547.96 K allocs (29.827 MB)
22:37:35 | maxrss  2.3% | mem  3.3% | START ( 4/24) test item "csg annotated constraints" at test/csg_annotated_constraints_test.jl:10
22:37:44 | maxrss  2.3% | mem  3.3% | DONE  ( 4/24) test item "csg annotated constraints" 9.7 secs (98.5% compile, 0.5% GC), 4.19 M allocs (225.853 MB)
22:37:44 | maxrss  2.3% | mem  3.3% | START ( 5/24) test item "csgrammar_annotated" at test/csg_annotated_test.jl:1
22:37:47 | maxrss  2.3% | mem  3.3% | DONE  ( 5/24) test item "csgrammar_annotated" 2.3 secs (94.3% compile), 664.93 K allocs (36.819 MB)
22:37:47 | maxrss  2.3% | mem  3.3% | START ( 6/24) test item "Domain Utils" at test/domain_utils_test.jl:1
22:37:53 | maxrss  2.3% | mem  3.3% | DONE  ( 6/24) test item "Domain Utils" 6.0 secs (97.6% compile), 2.17 M allocs (118.618 MB)
22:37:53 | maxrss  2.3% | mem  3.3% | START ( 7/24) test item "DomainRuleNode" at test/domainrulenode_test.jl:1
22:37:54 | maxrss  2.3% | mem  3.3% | DONE  ( 7/24) test item "DomainRuleNode" 1.6 secs (96.0% compile, 2.6% GC), 325.93 K allocs (17.574 MB)
22:37:54 | maxrss  2.3% | mem  3.3% | START ( 8/24) test item "Forbidden Sequence" at test/forbidden_sequence_test.jl:1
22:38:03 | maxrss  2.3% | mem  3.3% | DONE  ( 8/24) test item "Forbidden Sequence" 8.8 secs (97.5% compile, 0.5% GC), 3.65 M allocs (199.271 MB)
22:38:03 | maxrss  2.3% | mem  3.3% | START ( 9/24) test item "Forbidden" at test/forbidden_test.jl:1
22:38:03 | maxrss  2.3% | mem  3.3% | DONE  ( 9/24) test item "Forbidden" 0.2 secs (64.9% compile), 48.00 K allocs (2.104 MB)
22:38:03 | maxrss  2.3% | mem  3.3% | START (10/24) test item "AbstractGrammarConstraint" at test/grammarconstraints_test.jl:1
22:38:06 | maxrss  2.3% | mem  3.3% | DONE  (10/24) test item "AbstractGrammarConstraint" 2.9 secs (97.1% compile), 1.43 M allocs (75.889 MB)
22:38:06 | maxrss  2.3% | mem  3.3% | START (11/24) test item "LessThanOrEqual" at test/lessthanorequal_test.jl:3
22:38:13 | maxrss  2.3% | mem  3.3% | DONE  (11/24) test item "LessThanOrEqual" 6.5 secs (95.7% compile, 0.7% GC), 1.85 M allocs (101.740 MB)
22:38:13 | maxrss  2.3% | mem  3.3% | START (12/24) test item "MakeEqual (UniformSolver)" at test/makeequal_test.jl:1
22:38:14 | maxrss  2.3% | mem  3.3% | DONE  (12/24) test item "MakeEqual (UniformSolver)" 1.2 secs (88.9% compile), 320.75 K allocs (17.248 MB)
22:38:14 | maxrss  2.3% | mem  3.3% | START (13/24) test item "Ordered" at test/ordered_test.jl:1
22:38:14 | maxrss  2.3% | mem  3.3% | DONE  (13/24) test item "Ordered" 0.2 secs (48.1% compile), 55.06 K allocs (2.363 MB)
22:38:14 | maxrss  2.3% | mem  3.3% | START (14/24) test item "PatternMatch with DomainRuleNode" at test/pattern_match_domainrulenode_test.jl:1
22:38:15 | maxrss  2.3% | mem  3.3% | DONE  (14/24) test item "PatternMatch with DomainRuleNode" 0.7 secs (77.1% compile), 152.57 K allocs (8.181 MB)
22:38:15 | maxrss  2.3% | mem  3.3% | START (15/24) test item "PatternMatch Edgecase" at test/pattern_match_edgecases_test.jl:2
22:38:16 | maxrss  2.3% | mem  3.3% | DONE  (15/24) test item "PatternMatch Edgecase" 0.8 secs (97.9% compile), 261.73 K allocs (14.616 MB)
22:38:16 | maxrss  2.3% | mem  3.3% | START (16/24) test item "PatternMatch" at test/pattern_match_test.jl:1
22:38:17 | maxrss  2.3% | mem  3.3% | DONE  (16/24) test item "PatternMatch" 1.3 secs (73.7% compile), 338.02 K allocs (17.635 MB)
22:38:17 | maxrss  2.3% | mem  3.3% | START (17/24) test item "StateHole" at test/state_fixed_shaped_hole_test.jl:1
22:38:18 | maxrss  2.3% | mem  3.3% | DONE  (17/24) test item "StateHole" 0.6 secs (85.7% compile), 117.76 K allocs (5.919 MB)
22:38:18 | maxrss  2.3% | mem  3.3% | START (18/24) test item "StateManager" at test/state_manager_test.jl:1
22:38:18 | maxrss  2.3% | mem  3.3% | DONE  (18/24) test item "StateManager" 0.4 secs (79.0% compile), 310.63 K allocs (16.100 MB)
22:38:18 | maxrss  2.3% | mem  3.3% | START (19/24) test item "StateSparseSet" at test/state_sparse_set_test.jl:1
22:38:20 | maxrss  2.3% | mem  3.3% | DONE  (19/24) test item "StateSparseSet" 1.5 secs (87.5% compile), 270.92 K allocs (14.686 MB)
22:38:20 | maxrss  2.3% | mem  3.3% | START (20/24) test item "StateStack" at test/state_stack_test.jl:1
22:38:20 | maxrss  2.3% | mem  3.3% | DONE  (20/24) test item "StateStack" 0.5 secs (79.6% compile), 89.04 K allocs (4.431 MB)
22:38:20 | maxrss  2.3% | mem  3.3% | START (21/24) test item "Tree Manipulations (GenericSolver)" at test/treemanipulations_test.jl:1
22:38:23 | maxrss  2.3% | mem  3.3% | DONE  (21/24) test item "Tree Manipulations (GenericSolver)" 2.7 secs (96.4% compile), 881.30 K allocs (47.224 MB)
22:38:23 | maxrss  2.3% | mem  3.3% | START (22/24) test item "Tree Manipulations (UniformSolver)" at test/uniform_treemanipulations_test.jl:1
22:38:23 | maxrss  2.3% | mem  3.3% | DONE  (22/24) test item "Tree Manipulations (UniformSolver)" 0.1 secs (89.1% compile), 12.53 K allocs (647.712 KB)
22:38:23 | maxrss  2.3% | mem  3.3% | START (23/24) test item "Unique" at test/unique_test.jl:1
22:38:25 | maxrss  2.3% | mem  3.3% | DONE  (23/24) test item "Unique" 2.1 secs (94.9% compile), 824.75 K allocs (44.702 MB)
22:38:25 | maxrss  2.3% | mem  3.3% | START (24/24) test item "VarNode" at test/varnode_test.jl:1
22:38:25 | maxrss  2.3% | mem  3.3% | DONE  (24/24) test item "VarNode" 0.2 secs (80.7% compile), 80.91 K allocs (4.022 MB)
[ Tests Completed: 24/24 test items were run.
Test Summary:   | Pass  Broken  Total     Time
HerbConstraints |  955       2    957  2m10.1s
     Testing HerbConstraints tests passed 

Testing completed after 197.78s

PkgEval succeeded after 249.56s