Package evaluation to test SimilaritySearch on Julia 1.14.0-DEV.3071 (c76331c927*) started at 2026-08-30T20:51:20.774 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.14` Set-up completed after 16.54s ################################################################################ # Installation # Installing SimilaritySearch... Resolving package versions... Installed SimilaritySearch ─ v1.3.0 Updating `~/.julia/environments/v1.14/Project.toml` [053f045d] + SimilaritySearch v1.3.0 Updating `~/.julia/environments/v1.14/Manifest.toml` [621f4979] + AbstractFFTs v1.5.0 [7d9f7c33] + Accessors v0.1.45 [66dad0bd] + AliasTables v1.1.3 [7d9fca2a] + Arpack v0.5.4 [38540f10] + CommonSolve v0.2.14 [a33af91c] + CompositionsBase v0.1.2 [187b0558] + ConstructionBase v1.6.0 [9a962f9c] + DataAPI v1.16.0 [864edb3b] + DataStructures v0.19.6 [b4f34e82] + Distances v0.10.12 [31c24e10] + Distributions v0.25.131 [ffbed154] + DocStringExtensions v0.9.5 [7a1cc6ca] + FFTW v1.10.0 [1a297f60] + FillArrays v1.17.0 [a0844989] + Gamma v1.2.0 [4a05ff16] + Hadamard v1.8.0 [34004b35] + HypergeometricFunctions v0.3.30 [3587e190] + InverseFunctions v0.1.17 [92d709cd] + IrrationalConstants v0.2.6 [692b3bcd] + JLLWrappers v1.8.0 [682c06a0] + JSON v1.7.1 [2ab3a3ac] + LogExpFunctions v1.0.1 [1914dd2f] + MacroTools v0.5.16 [e1d29d7a] + Missings v1.2.0 [6f286f6a] + MultivariateStats v0.10.5 [bac558e1] + OrderedCollections v2.0.1 [90014a1f] + PDMats v0.11.41 ⌅ [69de0a69] + Parsers v2.8.7 [aea7be01] + PrecompileTools v1.3.4 [21216c6a] + Preferences v1.5.2 [92933f4c] + ProgressMeter v1.11.0 [43287f4e] + PtrArrays v1.4.0 [1fd47b50] + QuadGK v2.11.3 [189a3867] + Reexport v1.2.2 [79098fc4] + Rmath v0.9.0 [f2b01f46] + Roots v3.0.7 [fdea26ae] + SIMD v3.7.2 [0e966ebe] + SearchModels v0.5.1 [053f045d] + SimilaritySearch v1.3.0 [a2af1166] + SortingAlgorithms v1.2.3 [276daf66] + SpecialFunctions v2.9.0 [10745b16] + Statistics v1.11.4 [82ae8749] + StatsAPI v1.8.0 [2913bbd2] + StatsBase v0.34.13 [4c63d2b9] + StatsFuns v2.2.1 [ec057cc2] + StructUtils v2.8.5 ⌅ [68821587] + Arpack_jll v3.5.2+0 [f5851436] + FFTW_jll v3.3.12+0 [1d5cc7b8] + IntelOpenMP_jll v2025.2.0+0 [856f044c] + MKL_jll v2025.2.0+0 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [f50d1b31] + Rmath_jll v0.5.2+0 [1317d2d5] + oneTBB_jll v2022.3.0+0 [0dad84c5] + ArgTools v1.2.0 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.12.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.13.0 [4af54fe1] + LazyArtifacts v1.11.0 [b27032c2] + LibCURL v1.0.0 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.14.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.14.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.13.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [2f01184e] + SparseArrays v1.13.0 [f489334b] + StyledStrings v1.13.0 [4607b0f0] + SuiteSparse [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.5.7+0 [deac9b47] + LibCURL_jll v8.21.0+0 [e37daf67] + LibGit2_jll v1.9.7+0 [29816b5a] + LibSSH2_jll v1.11.104+0 [14a3606d] + MozillaCACerts_jll v2026.8.13 [4536629a] + OpenBLAS_jll v0.3.34+0 [05823500] + OpenLibm_jll v0.8.7+0 [458c3c95] + OpenSSL_jll v3.5.8+0 [efcefdf7] + PCRE2_jll v10.47.0+0 [bea87d4a] + SuiteSparse_jll v7.10.1+0 [83775a58] + Zlib_jll v1.3.2+0 [3161d3a3] + Zstd_jll v1.5.7+1 [8e850b90] + libblastrampoline_jll v5.15.0+0 [8e850ede] + nghttp2_jll v1.70.0+0 [3f19e933] + p7zip_jll v17.8.2+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 5.56s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompiling project... 4.0 s ✓ SearchModels 1.4 s ✓ Hadamard 12.0 s ✓ SimilaritySearch 3 dependencies successfully precompiled in 19 seconds. 106 already precompiled. Precompilation completed after 47.07s ################################################################################ # Testing # Testing SimilaritySearch Status `/tmp/jl_gzlgd8/Project.toml` [7d9f7c33] Accessors v0.1.45 [4c88cf16] Aqua v0.8.16 [b4f34e82] Distances v0.10.12 [31c24e10] Distributions v0.25.131 [4a05ff16] Hadamard v1.8.0 [682c06a0] JSON v1.7.1 [6f286f6a] MultivariateStats v0.10.5 [92933f4c] ProgressMeter v1.11.0 [fdea26ae] SIMD v3.7.2 [0e966ebe] SearchModels v0.5.1 [053f045d] SimilaritySearch v1.3.0 [10745b16] Statistics v1.11.4 [2913bbd2] StatsBase v0.34.13 [ade2ca70] Dates v1.11.0 [37e2e46d] LinearAlgebra v1.14.0 [56ddb016] Logging v1.11.0 [a63ad114] Mmap v1.11.0 [9a3f8284] Random v1.11.0 [2f01184e] SparseArrays v1.13.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_gzlgd8/Manifest.toml` [621f4979] AbstractFFTs v1.5.0 [7d9f7c33] Accessors v0.1.45 [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.16 [7d9fca2a] Arpack v0.5.4 [38540f10] CommonSolve v0.2.14 [34da2185] Compat v4.18.1 [a33af91c] CompositionsBase v0.1.2 [187b0558] ConstructionBase v1.6.0 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.19.6 [b4f34e82] Distances v0.10.12 [31c24e10] Distributions v0.25.131 [ffbed154] DocStringExtensions v0.9.5 [7a1cc6ca] FFTW v1.10.0 [1a297f60] FillArrays v1.17.0 [a0844989] Gamma v1.2.0 [4a05ff16] Hadamard v1.8.0 [34004b35] HypergeometricFunctions v0.3.30 [3587e190] InverseFunctions v0.1.17 [92d709cd] IrrationalConstants v0.2.6 [692b3bcd] JLLWrappers v1.8.0 [682c06a0] JSON v1.7.1 [2ab3a3ac] LogExpFunctions v1.0.1 [1914dd2f] MacroTools v0.5.16 [e1d29d7a] Missings v1.2.0 [6f286f6a] MultivariateStats v0.10.5 [bac558e1] OrderedCollections v2.0.1 [90014a1f] PDMats v0.11.41 ⌅ [69de0a69] Parsers v2.8.7 [aea7be01] PrecompileTools v1.3.4 [21216c6a] Preferences v1.5.2 [92933f4c] ProgressMeter v1.11.0 [43287f4e] PtrArrays v1.4.0 [1fd47b50] QuadGK v2.11.3 [189a3867] Reexport v1.2.2 [79098fc4] Rmath v0.9.0 [f2b01f46] Roots v3.0.7 [fdea26ae] SIMD v3.7.2 [0e966ebe] SearchModels v0.5.1 [053f045d] SimilaritySearch v1.3.0 [a2af1166] SortingAlgorithms v1.2.3 [276daf66] SpecialFunctions v2.9.0 [10745b16] Statistics v1.11.4 [82ae8749] StatsAPI v1.8.0 [2913bbd2] StatsBase v0.34.13 [4c63d2b9] StatsFuns v2.2.1 [ec057cc2] StructUtils v2.8.5 ⌅ [68821587] Arpack_jll v3.5.2+0 [f5851436] FFTW_jll v3.3.12+0 [1d5cc7b8] IntelOpenMP_jll v2025.2.0+0 [856f044c] MKL_jll v2025.2.0+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [f50d1b31] Rmath_jll v0.5.2+0 [1317d2d5] oneTBB_jll v2022.3.0+0 [0dad84c5] ArgTools v1.2.0 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.12.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0 [4af54fe1] LazyArtifacts v1.11.0 [b27032c2] LibCURL v1.0.0 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.14.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.14.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.13.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.13.0 [f489334b] StyledStrings v1.13.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.5.7+0 [deac9b47] LibCURL_jll v8.21.0+0 [e37daf67] LibGit2_jll v1.9.7+0 [29816b5a] LibSSH2_jll v1.11.104+0 [14a3606d] MozillaCACerts_jll v2026.8.13 [4536629a] OpenBLAS_jll v0.3.34+0 [05823500] OpenLibm_jll v0.8.7+0 [458c3c95] OpenSSL_jll v3.5.8+0 [efcefdf7] PCRE2_jll v10.47.0+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [83775a58] Zlib_jll v1.3.2+0 [3161d3a3] Zstd_jll v1.5.7+1 [8e850b90] libblastrampoline_jll v5.15.0+0 [8e850ede] nghttp2_jll v1.70.0+0 [3f19e933] p7zip_jll v17.8.2+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Test Summary: | Pass Total Time Distances | 145 145 4.8s Test Summary: | Pass Total Time test database abstractions | 57 57 14.2s Test Summary: | Pass Total Time MMapMatrixDatabase roundtrip | 135 135 3.1s Test Summary: | Pass Total Time MMapMatrixDatabase read_only mode | 6 6 1.4s Test Summary: | Pass Total Time MMapMatrixDatabase: push_item!/append_items! are not durable without flush | 3 3 0.5s Test Summary: | Pass Total Time MMapMatrixDatabase in-process crash-safety (uncommitted writes never surface) | 7 7 0.6s Test Summary: | Pass Total Time MMapMatrixDatabase crash-safety across a killed process | 5 5 4.4s ┌ Info: MMapMatrixDatabase perf sanity │ push_VectorDatabase = 5.504e-5 │ push_BlockMatrixDatabase = 0.000269188 │ push_MMapMatrixDatabase = 0.356939441 │ get_VectorDatabase = 4.74e-6 │ get_BlockMatrixDatabase = 7.95e-6 └ get_MMapMatrixDatabase = 9.0e-8 Test Summary: | Pass Total Time MMapMatrixDatabase performance sanity (opt-in, no RAM-path regression) | 2 2 2.0s Test Summary: | Pass Total Time OBSERVE events: exactly-once :add!, no duplicate/no-op misnaming | 13 13 29.4s the same run does report when given a reporter: Test Failed at /home/pkgeval/.julia/packages/SimilaritySearch/cWPtW/test/testlog.jl:175 Expression: occursin("n.size-quantiles", s) Evaluated: occursin("n.size-quantiles", "LOG add! sp=1 ep=1 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=142MB max-rss=661MB 2026-08-30T20:54:02.234\nLOG add! sp=2 ep=2 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.561\nLOG add! sp=3 ep=3 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.561\nLOG add! sp=4 ep=4 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.561\nLOG add! sp=5 ep=5 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.561\nLOG add! sp=6 ep=6 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.561\nLOG add! sp=7 ep=7 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.561\nLOG add! sp=8 ep=8 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.561\nLOG add! sp=9 ep=9 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.561\nLOG add! sp=10 ep=10 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.561\nLOG add! sp=11 ep=11 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.561\nLOG add! sp=12 ep=12 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.561\nLOG add! sp=13 ep=13 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=14 ep=14 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=15 ep=15 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=16 ep=16 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=17 ep=17 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=18 ep=18 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=19 ep=19 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=20 ep=20 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=21 ep=21 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=22 ep=22 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=23 ep=23 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=24 ep=24 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=25 ep=25 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=26 ep=26 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=27 ep=27 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=28 ep=28 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=29 ep=29 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=30 ep=30 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=31 ep=31 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=32 ep=32 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=33 ep=33 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=34 ep=34 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=35 ep=35 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=36 ep=36 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=37 ep=37 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=38 ep=38 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=39 ep=39 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=40 ep=40 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=41 ep=41 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=42 ep=42 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=43 ep=43 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=44 ep=44 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=45 ep=45 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=46 ep=46 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=47 ep=47 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=48 ep=48 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=49 ep=49 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\nLOG add! sp=50 ep=50 BeamSearch(bsize=4, Δ=1.0, maxvisits=1000000) mem=146MB max-rss=661MB 2026-08-30T20:54:02.562\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/SimilaritySearch/cWPtW/test/testlog.jl:148 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2247 [inlined] [3] macro expansion @ ~/.julia/packages/SimilaritySearch/cWPtW/test/testlog.jl:168 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2247 [inlined] [5] macro expansion @ ~/.julia/packages/SimilaritySearch/cWPtW/test/testlog.jl:175 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:784 [inlined] SearchModels> search params iter=0, initialpopulation=16, maxpopulation=16, bsize=4, mutbsize=16, crossbsize=8 SearchModels iteration 1> population: 15, bsize: 4, queue: 13, observed: 28, best-error: (visited = (min = 2705, mean = 2705.0, max = 2705), radius = (min = 0.25391969084739685, mean = 0.32496357272411214, max = 0.4386347234249115), recall = 0.993103448275862, searchtime = 0.0023197022758620687, conf = BeamSearch(bsize=6, Δ=0.925, maxvisits=1000000)) worst-error: (visited = (min = 2441, mean = 2441.0, max = 2441), radius = (min = 0.25391969084739685, mean = 0.32677414910546665, max = 0.4386347234249115), recall = 0.9655172413793104, searchtime = 9.663379310344827e-6, conf = BeamSearch(bsize=2, Δ=1.075, maxvisits=1000000)) SearchModels iteration 2> population: 16, bsize: 4, queue: 10, observed: 38, best-error: (visited = (min = 2677, mean = 2677.0, max = 2677), radius = (min = 0.25391969084739685, mean = 0.32496357272411214, max = 0.4386347234249115), recall = 0.993103448275862, searchtime = 1.0739896551724139e-5, conf = BeamSearch(bsize=6, Δ=0.8809524, maxvisits=1000000)) worst-error: (visited = (min = 2897, mean = 2897.0, max = 2897), radius = (min = 0.25391969084739685, mean = 0.32496357272411214, max = 0.4386347234249115), recall = 0.993103448275862, searchtime = 1.4833e-5, conf = BeamSearch(bsize=13, Δ=0.97125, maxvisits=1000000)) SearchModels iteration 3> population: 16, bsize: 4, queue: 8, observed: 46, best-error: (visited = (min = 2654, mean = 2654.0, max = 2654), radius = (min = 0.25391969084739685, mean = 0.32496357272411214, max = 0.4386347234249115), recall = 0.993103448275862, searchtime = 1.0064724137931034e-5, conf = BeamSearch(bsize=6, Δ=0.8390023, maxvisits=1000000)) worst-error: (visited = (min = 2787, mean = 2787.0, max = 2787), radius = (min = 0.25391969084739685, mean = 0.32496357272411214, max = 0.4386347234249115), recall = 0.993103448275862, searchtime = 1.002093103448276e-5, conf = BeamSearch(bsize=14, Δ=0.9, maxvisits=1000000)) SearchModels iteration 4> population: 16, bsize: 4, queue: 7, observed: 53, best-error: (visited = (min = 2630, mean = 2630.0, max = 2630), radius = (min = 0.25391969084739685, mean = 0.32497799293748264, max = 0.4386347234249115), recall = 0.9896551724137931, searchtime = 1.0805068965517242e-5, conf = BeamSearch(bsize=6, Δ=0.7990498, maxvisits=1000000)) worst-error: (visited = (min = 2710, mean = 2710.0, max = 2710), radius = (min = 0.25391969084739685, mean = 0.32496357272411214, max = 0.4386347234249115), recall = 0.993103448275862, searchtime = 1.051096551724138e-5, conf = BeamSearch(bsize=14, Δ=0.8571428, maxvisits=1000000)) SearchModels iteration 5> population: 16, bsize: 4, queue: 6, observed: 59, best-error: (visited = (min = 2630, mean = 2630.0, max = 2630), radius = (min = 0.25391969084739685, mean = 0.32497799293748264, max = 0.4386347234249115), recall = 0.9896551724137931, searchtime = 1.0805068965517242e-5, conf = BeamSearch(bsize=6, Δ=0.7990498, maxvisits=1000000)) worst-error: (visited = (min = 2692, mean = 2692.0, max = 2692), radius = (min = 0.25391969084739685, mean = 0.32497799293748264, max = 0.4386347234249115), recall = 0.9896551724137931, searchtime = 1.0024724137931035e-5, conf = BeamSearch(bsize=10, Δ=0.83, maxvisits=1000000)) SearchModels iteration 6> population: 16, bsize: 4, queue: 8, observed: 67, best-error: (visited = (min = 2621, mean = 2621.0, max = 2621), radius = (min = 0.25391969084739685, mean = 0.3253248169504363, max = 0.4386347234249115), recall = 0.9827586206896551, searchtime = 1.0192655172413792e-5, conf = BeamSearch(bsize=6, Δ=0.7609998, maxvisits=1000000)) worst-error: (visited = (min = 2683, mean = 2683.0, max = 2683), radius = (min = 0.25391969084739685, mean = 0.32497799293748264, max = 0.4386347234249115), recall = 0.9896551724137931, searchtime = 1.0420931034482757e-5, conf = BeamSearch(bsize=14, Δ=0.8163265, maxvisits=1000000)) SearchModels iteration 7> population: 16, bsize: 4, queue: 6, observed: 73, best-error: (visited = (min = 2590, mean = 2590.0, max = 2590), radius = (min = 0.25391969084739685, mean = 0.32560363103603496, max = 0.4386347234249115), recall = 0.9758620689655172, searchtime = 9.925758620689654e-6, conf = BeamSearch(bsize=6, Δ=0.7247617, maxvisits=1000000)) worst-error: (visited = (min = 2654, mean = 2654.0, max = 2654), radius = (min = 0.25391969084739685, mean = 0.32496357272411214, max = 0.4386347234249115), recall = 0.993103448275862, searchtime = 1.0594379310344829e-5, conf = BeamSearch(bsize=6, Δ=0.84, maxvisits=1000000)) SearchModels iteration 8> population: 16, bsize: 4, queue: 8, observed: 81, best-error: (visited = (min = 2586, mean = 2586.0, max = 2586), radius = (min = 0.25391969084739685, mean = 0.32560363103603496, max = 0.4386347234249115), recall = 0.9758620689655172, searchtime = 1.0350931034482758e-5, conf = BeamSearch(bsize=6, Δ=0.7169852, maxvisits=1000000)) worst-error: (visited = (min = 2643, mean = 2643.0, max = 2643), radius = (min = 0.25391969084739685, mean = 0.32497799293748264, max = 0.4386347234249115), recall = 0.9896551724137931, searchtime = 1.0143689655172415e-5, conf = BeamSearch(bsize=6, Δ=0.82, maxvisits=1000000)) SearchModels iteration 9> population: 16, bsize: 4, queue: 8, observed: 89, best-error: (visited = (min = 2531, mean = 2531.0, max = 2531), radius = (min = 0.25391969084739685, mean = 0.3268995243927528, max = 0.4386347234249115), recall = 0.9724137931034481, searchtime = 9.015413793103448e-6, conf = BeamSearch(bsize=6, Δ=0.6828431, maxvisits=1000000)) worst-error: (visited = (min = 2625, mean = 2625.0, max = 2625), radius = (min = 0.25391969084739685, mean = 0.32497799293748264, max = 0.4386347234249115), recall = 0.9896551724137931, searchtime = 1.0583724137931034e-5, conf = BeamSearch(bsize=6, Δ=0.79, maxvisits=1000000)) SearchModels iteration 10> population: 16, bsize: 4, queue: 4, observed: 93, best-error: (visited = (min = 2531, mean = 2531.0, max = 2531), radius = (min = 0.25391969084739685, mean = 0.3268995243927528, max = 0.4386347234249115), recall = 0.9724137931034481, searchtime = 9.015413793103448e-6, conf = BeamSearch(bsize=6, Δ=0.6828431, maxvisits=1000000)) worst-error: (visited = (min = 2610, mean = 2610.0, max = 2610), radius = (min = 0.25391969084739685, mean = 0.3253306294309682, max = 0.4386347234249115), recall = 0.9793103448275862, searchtime = 9.92955172413793e-6, conf = BeamSearch(bsize=7, Δ=0.74, maxvisits=1000000)) SearchModels> stop by convergence error=BeamSearch(bsize=6, Δ=0.735, maxvisits=1000000) => (visited = (min = 2609, mean = 2609.0, max = 2609), radius = (min = 0.25391969084739685, mean = 0.3253306294309682, max = 0.4386347234249115), recall = 0.9793103448275862, searchtime = 9.326793103448276e-6, conf = BeamSearch(bsize=6, Δ=0.735, maxvisits=1000000)), iter=11 (of 12) SearchModels> search params iter=0, initialpopulation=16, maxpopulation=16, bsize=4, mutbsize=16, crossbsize=8 SearchModels iteration 1> population: 15, bsize: 4, queue: 12, observed: 27, best-error: (visited = (min = 2880, mean = 2880.0, max = 2880), radius = (min = 0.20640501379966736, mean = 0.28473759442567825, max = 0.3908872604370117), recall = 0.98, searchtime = 1.0623566666666666e-5, conf = BeamSearch(bsize=4, Δ=0.925, maxvisits=1000000)) worst-error: (visited = (min = 2667, mean = 2667.0, max = 2667), radius = (min = 0.20640501379966736, mean = 0.28860082974036533, max = 0.3931029736995697), recall = 0.9266666666666664, searchtime = 1.0314266666666667e-5, conf = BeamSearch(bsize=2, Δ=0.9, maxvisits=1000000)) SearchModels iteration 2> population: 16, bsize: 4, queue: 9, observed: 36, best-error: (visited = (min = 2880, mean = 2880.0, max = 2880), radius = (min = 0.20640501379966736, mean = 0.28473759442567825, max = 0.3908872604370117), recall = 0.98, searchtime = 1.0623566666666666e-5, conf = BeamSearch(bsize=4, Δ=0.925, maxvisits=1000000)) worst-error: (visited = (min = 3298, mean = 3298.0, max = 3298), radius = (min = 0.20640501379966736, mean = 0.2837574899196625, max = 0.3908872604370117), recall = 0.9933333333333333, searchtime = 1.1945533333333333e-5, conf = BeamSearch(bsize=7, Δ=1.075, maxvisits=1000000)) SearchModels iteration 3> population: 16, bsize: 4, queue: 7, observed: 43, best-error: (visited = (min = 2880, mean = 2880.0, max = 2880), radius = (min = 0.20640501379966736, mean = 0.28473759442567825, max = 0.3908872604370117), recall = 0.98, searchtime = 1.0623566666666666e-5, conf = BeamSearch(bsize=4, Δ=0.925, maxvisits=1000000)) worst-error: (visited = (min = 3045, mean = 3045.0, max = 3045), radius = (min = 0.20640501379966736, mean = 0.28473759442567825, max = 0.3908872604370117), recall = 0.98, searchtime = 1.0469233333333333e-5, conf = BeamSearch(bsize=4, Δ=1.07625, maxvisits=1000000)) SearchModels iteration 4> population: 16, bsize: 4, queue: 8, observed: 51, best-error: (visited = (min = 2869, mean = 2869.0, max = 2869), radius = (min = 0.20640501379966736, mean = 0.28511304408311844, max = 0.3908872604370117), recall = 0.9766666666666666, searchtime = 9.7249e-6, conf = BeamSearch(bsize=4, Δ=0.9047619, maxvisits=1000000)) worst-error: (visited = (min = 2971, mean = 2971.0, max = 2971), radius = (min = 0.20640501379966736, mean = 0.28473759442567825, max = 0.3908872604370117), recall = 0.98, searchtime = 1.0497233333333333e-5, conf = BeamSearch(bsize=4, Δ=1.0198125, maxvisits=1000000)) SearchModels iteration 5> population: 16, bsize: 4, queue: 4, observed: 55, best-error: (visited = (min = 2864, mean = 2864.0, max = 2864), radius = (min = 0.20640501379966736, mean = 0.2856739873687426, max = 0.3908872604370117), recall = 0.9733333333333333, searchtime = 1.0174933333333333e-5, conf = BeamSearch(bsize=4, Δ=0.8952381, maxvisits=1000000)) worst-error: (visited = (min = 2914, mean = 2914.0, max = 2914), radius = (min = 0.20640501379966736, mean = 0.28473759442567825, max = 0.3908872604370117), recall = 0.98, searchtime = 1.07289e-5, conf = BeamSearch(bsize=4, Δ=0.987, maxvisits=1000000)) SearchModels> stop by convergence error=BeamSearch(bsize=4, Δ=0.99, maxvisits=1000000) => (visited = (min = 2914, mean = 2914.0, max = 2914), radius = (min = 0.20640501379966736, mean = 0.28473759442567825, max = 0.3908872604370117), recall = 0.98, searchtime = 1.0401233333333333e-5, conf = BeamSearch(bsize=4, Δ=0.99, maxvisits=1000000)), iter=6 (of 12) Test Summary: | Pass Fail Total Time INFORM: silencing, throttling, and what a context inherits | 7 1 8 54.6s reporters=[] silences everything, observers keep working | 2 2 0.2s the same run does report when given a reporter | 1 1 2 15.3s dt <= 0 drops nothing | 1 1 1.8s dt > 0 throttles | 1 1 0.0s an internally built context inherits reporters, never observers | 2 2 37.3s RNG of the outermost testset: Xoshiro(0xdb2fa90498613fdf, 0x48d73dc42d195740, 0x8c49bc52dc8a77ea, 0x1911b814c02405e8, 0x22a21880af5dc689) ERROR: LoadError: Some tests did not pass: 7 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/SimilaritySearch/cWPtW/test/testlog.jl:147 in expression starting at /home/pkgeval/.julia/packages/SimilaritySearch/cWPtW/test/runtests.jl:31 Testing failed after 144.19s ERROR: LoadError: Package SimilaritySearch errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:3283 [3] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:587 [4] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:172 [5] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [6] test(pkg::String; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:159 [inlined] [7] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 248.21s: package has test failures