Package evaluation to test WeaklyHard on Julia 1.14.0-DEV.87 (8bcaa34afa*) started at 2025-11-15T07:26:37.454 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 9.23s ################################################################################ # Installation # Installing WeaklyHard... Resolving package versions... Updating `~/.julia/environments/v1.14/Project.toml` [e696503b] + WeaklyHard v0.2.1 Updating `~/.julia/environments/v1.14/Manifest.toml` [e696503b] + WeaklyHard v0.2.1 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.13.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.0.0 [9e88b42a] + Serialization v1.11.0 [f489334b] + StyledStrings v1.11.0 [8dfed614] + Test v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [4536629a] + OpenBLAS_jll v0.3.29+0 [8e850b90] + libblastrampoline_jll v5.15.0+0 Installation completed after 1.0s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... ┌ Error: Failed to use TestEnv.jl; test dependencies will not be precompiled │ exception = │ UndefVarError: `project_rel_path` not defined in `TestEnv` │ Suggestion: this global was defined as `Pkg.Operations.project_rel_path` but not assigned a value. │ Stacktrace: │ [1] get_test_dir(ctx::Pkg.Types.Context, pkgspec::PackageSpec) │ @ TestEnv ~/.julia/packages/TestEnv/i9lgt/src/julia-1.11/common.jl:75 │ [2] test_dir_has_project_file │ @ ~/.julia/packages/TestEnv/i9lgt/src/julia-1.11/common.jl:52 [inlined] │ [3] maybe_gen_project_override! │ @ ~/.julia/packages/TestEnv/i9lgt/src/julia-1.11/common.jl:83 [inlined] │ [4] activate(pkg::String; allow_reresolve::Bool) │ @ TestEnv ~/.julia/packages/TestEnv/i9lgt/src/julia-1.11/activate_set.jl:12 │ [5] activate(pkg::String) │ @ TestEnv ~/.julia/packages/TestEnv/i9lgt/src/julia-1.11/activate_set.jl:9 │ [6] top-level scope │ @ /PkgEval.jl/scripts/precompile.jl:24 │ [7] include(mod::Module, _path::String) │ @ Base ./Base.jl:309 │ [8] exec_options(opts::Base.JLOptions) │ @ Base ./client.jl:344 │ [9] _start() │ @ Base ./client.jl:577 └ @ Main /PkgEval.jl/scripts/precompile.jl:26 Precompiling package dependencies... Precompiling packages... 971.8 ms ✓ WeaklyHard 1 dependency successfully precompiled in 1 seconds. 8 already precompiled. Precompilation completed after 14.22s ################################################################################ # Testing # Testing WeaklyHard Status `/tmp/jl_2T4lqA/Project.toml` [e696503b] WeaklyHard v0.2.1 [37e2e46d] LinearAlgebra v1.13.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_2T4lqA/Manifest.toml` [e696503b] WeaklyHard v0.2.1 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.13.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.0.0 [9e88b42a] Serialization v1.11.0 [f489334b] StyledStrings v1.11.0 [8dfed614] Test v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [4536629a] OpenBLAS_jll v0.3.29+0 [8e850b90] libblastrampoline_jll v5.15.0+0 Testing Running tests... length(seqs) = 32 Test Summary: | Pass Total Time Trivial Tests - RowHitConstraint | 48116 48116 2.8s Test Summary: | Pass Total Time Trivial Tests - RowMissConstraint | 62419 62419 0.4s Test Summary: | Pass Total Time Trivial Tests - AnyMissConstraint | 62176 62176 0.6s Test Summary: | Pass Total Time Trivial Tests - AnyHitConstraint | 62176 62176 0.8s Test Summary: | Pass Total Time RowMiss-RowMiss - Tests | 10000 10000 0.1s Test Summary: | Pass Total Time RowHit-RowHit - Tests | 10000 10000 0.0s Test Summary: | Pass Total Time AnyMiss-AnyMiss - Tests | 10000 10000 0.0s Test Summary: | Pass Total Time AnyHit-AnyHit - Tests | 10000 10000 0.3s Test Summary: | Pass Total Time RowMiss-X - Analytic Tests | 30000 30000 0.4s Test Summary: | Pass Total Time RowHit-X - Analytic Tests | 20000 20000 0.3s Test Summary: | Pass Total Time AnyMiss-X - Analytic Tests | 30000 30000 0.4s Test Summary: | Pass Total Time AnyHit-X - Analytic Tests | 30000 30000 0.4s Test Summary: | Pass Total Time BruteForce Tests | 49640 49640 0.1s Test Summary: | Pass Total Time BruteForce Tests | 49640 49640 0.1s Test Summary: | Pass Total Time BruteForce Tests | 49640 49640 0.2s Test Summary: | Pass Total Time BruteForce Tests | 49640 49640 0.1s Test Summary: | Pass Total Time BruteForce Tests | 49640 49640 0.1s Test Summary: | Pass Total Time BruteForce Tests | 49640 49640 0.1s Test Summary: | Pass Total Time BruteForce Tests | 49640 49640 0.1s Test Summary: | Pass Total Time BruteForce Tests | 49640 49640 0.1s Test Summary: | Pass Total Time BruteForce Tests | 49640 49640 0.1s Test Summary: | Pass Total Time BruteForce Tests | 49640 49640 0.1s Test Summary: | Pass Total Time BruteForce Tests | 49640 49640 0.1s Test Summary: | Pass Total Time BruteForce Tests | 49640 49640 0.1s Test Summary: | Pass Total Time BruteForce Tests | 49640 49640 0.1s Test Summary: | Pass Total Time BruteForce Tests | 49640 49640 0.1s Test Summary: | Pass Total Time 2 Random Constraints | 10000 10000 7.4s Test Summary: | Pass Total Time Arbitrary Random Constraints | 10000 10000 4.6s Test Summary: | Pass Total Time Shift Tests | 5000 5000 0.9s Test Summary: | Pass Total Time Shift_RowHit Tests | 5000 5000 0.2s Executed tests on 455 different automata Test Summary: | Pass Total Time Vertices Tests | 455 455 27.3s Executed tests on 449 different automata Test Summary: | Pass Total Time Transitions Tests | 449 449 6.8s Test Summary: | Pass Total Time Set-construction Tests | 19042614 19042614 1m59.5s Test Summary: | Pass Total Time Minimizing single-constraint automata | 1000 1000 13.0s Test Summary: | Pass Total Time Test all sequences generated by automaton - Not RowHitConstraint | 780 780 3.9s Test Summary: | Pass Total Time Test all sequences generated by automaton - Only RowHitConstraint | 158 158 0.4s Test Summary: | Pass Total Time Test all sequences generated by automaton - Sets of All but RowHitConstraint | 600 600 8.9s Test Summary: | Pass Total Time Test all sequences generated by automaton - Only Sets of RowHitConstraint | 600 600 2.4s Test Summary: | Pass Total Time Test all sequences generated by automaton - Arbitrary sets | 600 600 10.9s Biggest automaton for AnyMissConstraint: 6435 Test Summary: | Pass Total Time Random sequence tests - AnyMissConstraint | 25110 25110 5.5s Biggest automaton for AnyHitConstraint: 6435 Test Summary: | Pass Total Time Random sequence tests - AnyHitConstraint | 25110 25110 6.7s Biggest automaton for RowMissConstraint: 16 Test Summary: | Pass Total Time Random sequence tests - RowMissConstraint | 25110 25110 5.1s Biggest automaton for RowHitConstraint: 28 Test Summary: | Pass Total Time Random sequence tests - RowHitConstraint | 25110 25110 17.7s Test Summary: | Pass Total Time Print automaton | 6 6 2.0s Test Summary: | Pass Total Time Print BigInt | 2 2 4.6s Test Summary: | Pass Total Time Print Constraint | 4 4 0.2s Testing WeaklyHard tests passed Testing completed after 273.1s PkgEval succeeded after 307.24s