Package evaluation to test ColBERT on Julia 1.12.4 (422f456051*) started at 2026-01-29T18:52:06.154 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.12` Set-up completed after 8.44s ################################################################################ # Installation # Installing ColBERT... Resolving package versions... Installed ContextVariablesX ─────────── v0.1.3 Installed ShowCases ─────────────────── v0.1.0 Installed OffsetArrays ──────────────── v1.17.0 Installed LRUCache ──────────────────── v1.6.2 Installed SciMLPublic ───────────────── v1.0.1 Installed LoggingExtras ─────────────── v1.2.0 Installed Accessors ─────────────────── v0.1.43 Installed Preferences ───────────────── v1.5.1 Installed RelocatableFolders ────────── v1.0.1 Installed ConcurrentUtilities ───────── v2.5.0 Installed ProgressMeter ─────────────── v1.11.0 Installed HTML_Entities ─────────────── v1.0.2 Installed ZipFile ───────────────────── v0.10.1 Installed Pidfile ───────────────────── v1.3.0 Installed ScopedValues ──────────────── v1.5.0 Installed StaticArrays ──────────────── v1.9.16 Installed InitialValues ─────────────── v0.3.1 Installed FuncPipelines ─────────────── v0.2.3 Installed Optimisers ────────────────── v0.3.4 Installed NNlib ─────────────────────── v0.9.31 Installed OpenSSL ───────────────────── v1.6.1 Installed CEnum ─────────────────────── v0.5.0 Installed DelimitedFiles ────────────── v1.9.1 Installed FileIO ────────────────────── v1.17.1 Installed Statistics ────────────────── v1.11.1 Installed BFloat16s ─────────────────── v0.5.1 Installed ZygoteRules ───────────────── v0.2.7 Installed HTTP ──────────────────────── v1.10.19 Installed GPUArrays ─────────────────── v10.3.1 Installed Static ────────────────────── v1.3.1 Installed HuggingFaceApi ────────────── v0.1.0 Installed PrettyPrint ───────────────── v0.2.0 Installed MLUtils ───────────────────── v0.4.8 Installed Missings ──────────────────── v1.2.0 Installed Tricks ────────────────────── v0.1.13 Installed RealDot ───────────────────── v0.1.0 Installed IrrationalConstants ───────── v0.2.6 Installed IRTools ───────────────────── v0.4.15 Installed Fetch ─────────────────────── v0.1.4 Installed JLD2 ──────────────────────── v0.4.55 Installed MLCore ────────────────────── v1.0.0 Installed SafeTensors ───────────────── v1.2.0 Installed Functors ──────────────────── v0.4.12 Installed LLVM ──────────────────────── v9.4.4 Installed DoubleArrayTries ──────────── v0.1.1 Installed PtrArrays ─────────────────── v1.3.0 Installed JSON ──────────────────────── v0.21.4 Installed FLoopsBase ────────────────── v0.1.1 Installed ProgressLogging ───────────── v0.1.6 Installed SpecialFunctions ──────────── v2.6.1 Installed BytePairEncoding ──────────── v0.5.2 Installed SimpleBufferStream ────────── v1.2.0 Installed IfElse ────────────────────── v0.1.1 Installed OneHotArrays ──────────────── v0.2.10 Installed StringEncodings ───────────── v0.3.7 Installed NaNMath ───────────────────── v1.1.3 Installed StaticArraysCore ──────────── v1.4.4 Installed DefineSingletons ──────────── v0.1.2 Installed MicroCollections ──────────── v0.2.0 Installed NameResolution ────────────── v0.1.5 Installed Zygote ────────────────────── v0.6.77 Installed TranscodingStreams ────────── v0.11.3 Installed StringViews ───────────────── v1.3.7 Installed MLDataDevices ─────────────── v1.5.3 Installed MbedTLS ───────────────────── v1.1.9 Installed DLFP8Types ────────────────── v0.1.0 Installed DataStructures ────────────── v0.18.22 Installed ValSplit ──────────────────── v0.1.1 Installed MappedArrays ──────────────── v0.4.3 Installed CommonSubexpressions ──────── v0.3.1 Installed ChainRules ────────────────── v1.72.6 Installed StridedViews ──────────────── v0.4.3 Installed StatsAPI ──────────────────── v1.8.0 Installed NeuralAttentionlib ────────── v0.3.3 Installed ExprTools ─────────────────── v0.1.10 Installed BangBang ──────────────────── v0.4.7 Installed FuncTransforms ────────────── v0.1.1 Installed MLStyle ───────────────────── v0.4.17 Installed Compat ────────────────────── v4.18.1 Installed CommonWorldInvalidations ──── v1.0.0 Installed CodecZlib ─────────────────── v0.7.8 Installed StructTypes ───────────────── v1.11.0 Installed ExceptionUnwrapping ───────── v0.1.11 Installed Scratch ───────────────────── v1.3.0 Installed StatsBase ─────────────────── v0.34.10 Installed ArgCheck ──────────────────── v2.5.0 Installed DiffRules ─────────────────── v1.15.1 Installed FLoops ────────────────────── v0.2.2 Installed JSON3 ─────────────────────── v1.14.3 Installed TableTraits ───────────────── v1.0.1 Installed DiffResults ───────────────── v1.1.0 Installed HashArrayMappedTries ──────── v0.2.0 Installed Parsers ───────────────────── v2.8.3 Installed PrimitiveOneHot ───────────── v0.2.1 Installed DataDeps ──────────────────── v0.7.13 Installed Setfield ──────────────────── v1.1.2 Installed JLLWrappers ───────────────── v1.7.1 Installed Flux ──────────────────────── v0.14.25 Installed ConstructionBase ──────────── v1.6.0 Installed AbstractFFTs ──────────────── v1.5.0 Installed LLVMExtra_jll ─────────────── v0.0.38+0 Installed DataValueInterfaces ───────── v1.0.0 Installed StrTables ─────────────────── v1.0.1 Installed OhMyArtifacts ─────────────── v0.3.1 Installed OrderedCollections ────────── v1.8.1 Installed Reexport ──────────────────── v1.2.2 Installed PartialFunctions ──────────── v1.2.1 Installed ChainRulesCore ────────────── v1.26.0 Installed LogExpFunctions ───────────── v0.3.29 Installed RustRegex ─────────────────── v0.1.0 Installed KernelAbstractions ────────── v0.9.39 Installed AliasTables ───────────────── v1.1.3 Installed PackageExtensionCompat ────── v1.0.2 Installed MbedTLS_jll ───────────────── v2.28.1010+0 Installed OpenSpecFun_jll ───────────── v0.5.6+0 Installed MacroTools ────────────────── v0.5.16 Installed CompositionsBase ──────────── v0.1.2 Installed UnsafeAtomics ─────────────── v0.3.0 Installed SparseInverseSubset ───────── v0.1.2 Installed JuliaVariables ────────────── v0.2.4 Installed InverseFunctions ──────────── v0.1.17 Installed SimpleTraits ──────────────── v0.9.5 Installed Atomix ────────────────────── v1.1.2 Installed GPUArraysCore ─────────────── v0.1.6 Installed Adapt ─────────────────────── v4.4.0 Installed rure_jll ──────────────────── v0.2.2+0 Installed DocStringExtensions ───────── v0.9.5 Installed XML2_jll ──────────────────── v2.15.1+0 Installed Transducers ───────────────── v0.4.85 Installed StructWalk ────────────────── v0.2.1 Installed InternedStrings ───────────── v0.7.0 Installed DataAPI ───────────────────── v1.16.0 Installed BitFlags ──────────────────── v0.1.9 Installed Baselet ───────────────────── v0.1.1 Installed Tables ────────────────────── v1.12.1 Installed ColBERT ───────────────────── v0.1.0 Installed IteratorInterfaceExtensions ─ v1.0.0 Installed Libiconv_jll ──────────────── v1.18.0+0 Installed URIs ──────────────────────── v1.6.1 Installed StructArrays ──────────────── v0.6.18 Installed PrecompileTools ───────────── v1.3.3 Installed ForwardDiff ───────────────── v1.3.1 Installed FillArrays ────────────────── v1.16.0 Installed LightXML ──────────────────── v0.9.3 Installed SplittablesBase ───────────── v0.1.15 Installed Requires ──────────────────── v1.3.1 Installed Transformers ──────────────── v0.3.1 Installed WordTokenizers ────────────── v0.5.6 Installed SortingAlgorithms ─────────── v1.2.2 Installed TextEncodeBase ────────────── v0.8.3 Installed Pickle ────────────────────── v0.3.6 Installing 6 artifacts Installed artifact OpenSpecFun 194.9 KiB Installed artifact Libiconv 1.9 MiB Installed artifact XML2 2.2 MiB Installed artifact LLVMExtra 2.9 MiB Installed artifact MbedTLS 2.2 MiB Installed artifact rure 6.0 MiB Updating `~/.julia/environments/v1.12/Project.toml` [7e8ad7a6] + ColBERT v0.1.0 Updating `~/.julia/environments/v1.12/Manifest.toml` [621f4979] + AbstractFFTs v1.5.0 [7d9f7c33] + Accessors v0.1.43 [79e6a3ab] + Adapt v4.4.0 [66dad0bd] + AliasTables v1.1.3 [dce04be8] + ArgCheck v2.5.0 [a9b6321e] + Atomix v1.1.2 ⌅ [ab4f0b2a] + BFloat16s v0.5.1 [198e06fe] + BangBang v0.4.7 [9718e550] + Baselet v0.1.1 [d1d4a3ce] + BitFlags v0.1.9 [a4280ba5] + BytePairEncoding v0.5.2 [fa961155] + CEnum v0.5.0 [082447d4] + ChainRules v1.72.6 [d360d2e6] + ChainRulesCore v1.26.0 [944b1d66] + CodecZlib v0.7.8 [7e8ad7a6] + ColBERT v0.1.0 [bbf7d656] + CommonSubexpressions v0.3.1 [f70d9fcc] + CommonWorldInvalidations v1.0.0 [34da2185] + Compat v4.18.1 [a33af91c] + CompositionsBase v0.1.2 [f0e56b4a] + ConcurrentUtilities v2.5.0 [187b0558] + ConstructionBase v1.6.0 [6add18c4] + ContextVariablesX v0.1.3 [f4c16678] + DLFP8Types v0.1.0 [9a962f9c] + DataAPI v1.16.0 [124859b0] + DataDeps v0.7.13 ⌅ [864edb3b] + DataStructures v0.18.22 [e2d170a0] + DataValueInterfaces v1.0.0 [244e2a9f] + DefineSingletons v0.1.2 [8bb1440f] + DelimitedFiles v1.9.1 [163ba53b] + DiffResults v1.1.0 [b552c78f] + DiffRules v1.15.1 [ffbed154] + DocStringExtensions v0.9.5 [abbaa0e5] + DoubleArrayTries v0.1.1 [460bff9d] + ExceptionUnwrapping v0.1.11 [e2ba6199] + ExprTools v0.1.10 [cc61a311] + FLoops v0.2.2 [b9860ae5] + FLoopsBase v0.1.1 [bb354801] + Fetch v0.1.4 [5789e2e9] + FileIO v1.17.1 [1a297f60] + FillArrays v1.16.0 ⌅ [587475ba] + Flux v0.14.25 [f6369f11] + ForwardDiff v1.3.1 [9ed96fbb] + FuncPipelines v0.2.3 [79abecb7] + FuncTransforms v0.1.1 ⌅ [d9f16b24] + Functors v0.4.12 ⌃ [0c68f7d7] + GPUArrays v10.3.1 ⌅ [46192b85] + GPUArraysCore v0.1.6 [7693890a] + HTML_Entities v1.0.2 [cd3eb016] + HTTP v1.10.19 [076d061b] + HashArrayMappedTries v0.2.0 [3cc741c3] + HuggingFaceApi v0.1.0 [7869d1d1] + IRTools v0.4.15 [615f187c] + IfElse v0.1.1 [22cec73e] + InitialValues v0.3.1 [7d512f48] + InternedStrings v0.7.0 [3587e190] + InverseFunctions v0.1.17 [92d709cd] + IrrationalConstants v0.2.6 [82899510] + IteratorInterfaceExtensions v1.0.0 ⌅ [033835bb] + JLD2 v0.4.55 [692b3bcd] + JLLWrappers v1.7.1 ⌅ [682c06a0] + JSON v0.21.4 [0f8b85d8] + JSON3 v1.14.3 [b14d175d] + JuliaVariables v0.2.4 [63c18a36] + KernelAbstractions v0.9.39 [929cbde3] + LLVM v9.4.4 [8ac3fa9e] + LRUCache v1.6.2 [9c8b4983] + LightXML v0.9.3 [2ab3a3ac] + LogExpFunctions v0.3.29 [e6f89c97] + LoggingExtras v1.2.0 [c2834f40] + MLCore v1.0.0 ⌃ [7e8f7934] + MLDataDevices v1.5.3 [d8e11817] + MLStyle v0.4.17 [f1d291b0] + MLUtils v0.4.8 [1914dd2f] + MacroTools v0.5.16 [dbb5928d] + MappedArrays v0.4.3 [739be429] + MbedTLS v1.1.9 [128add7d] + MicroCollections v0.2.0 [e1d29d7a] + Missings v1.2.0 ⌃ [872c559c] + NNlib v0.9.31 [77ba4419] + NaNMath v1.1.3 [71a1bf82] + NameResolution v0.1.5 [12afc1b8] + NeuralAttentionlib v0.3.3 [6fe1bfb0] + OffsetArrays v1.17.0 [cf8be1f4] + OhMyArtifacts v0.3.1 [0b1bfda6] + OneHotArrays v0.2.10 [4d8831e6] + OpenSSL v1.6.1 ⌅ [3bd65402] + Optimisers v0.3.4 [bac558e1] + OrderedCollections v1.8.1 [65ce6f38] + PackageExtensionCompat v1.0.2 [69de0a69] + Parsers v2.8.3 [570af359] + PartialFunctions v1.2.1 [fbb45041] + Pickle v0.3.6 [fa939f87] + Pidfile v1.3.0 [aea7be01] + PrecompileTools v1.3.3 [21216c6a] + Preferences v1.5.1 [8162dcfd] + PrettyPrint v0.2.0 [13d12f88] + PrimitiveOneHot v0.2.1 [33c8b6b6] + ProgressLogging v0.1.6 [92933f4c] + ProgressMeter v1.11.0 [43287f4e] + PtrArrays v1.3.0 [c1ae055f] + RealDot v0.1.0 [189a3867] + Reexport v1.2.2 [05181044] + RelocatableFolders v1.0.1 [ae029012] + Requires v1.3.1 [cdf36688] + RustRegex v0.1.0 [eeda0dda] + SafeTensors v1.2.0 [431bcebd] + SciMLPublic v1.0.1 [7e506255] + ScopedValues v1.5.0 [6c6a2e73] + Scratch v1.3.0 [efcf1570] + Setfield v1.1.2 [605ecd9f] + ShowCases v0.1.0 [777ac1f9] + SimpleBufferStream v1.2.0 [699a6c99] + SimpleTraits v0.9.5 [a2af1166] + SortingAlgorithms v1.2.2 [dc90abb0] + SparseInverseSubset v0.1.2 [276daf66] + SpecialFunctions v2.6.1 [171d559e] + SplittablesBase v0.1.15 [aedffcd0] + Static v1.3.1 [90137ffa] + StaticArrays v1.9.16 [1e83bf80] + StaticArraysCore v1.4.4 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.8.0 [2913bbd2] + StatsBase v0.34.10 [9700d1a9] + StrTables v1.0.1 [4db3bf67] + StridedViews v0.4.3 [69024149] + StringEncodings v0.3.7 [354b36f9] + StringViews v1.3.7 ⌃ [09ab397b] + StructArrays v0.6.18 [856f2bd8] + StructTypes v1.11.0 [31cdf514] + StructWalk v0.2.1 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.12.1 [f92c20c0] + TextEncodeBase v0.8.3 [3bb67fe8] + TranscodingStreams v0.11.3 [28d57a85] + Transducers v0.4.85 [21ca0261] + Transformers v0.3.1 [410a4b4d] + Tricks v0.1.13 [5c2747f8] + URIs v1.6.1 [013be700] + UnsafeAtomics v0.3.0 [0625e100] + ValSplit v0.1.1 [796a5d58] + WordTokenizers v0.5.6 [a5390f91] + ZipFile v0.10.1 ⌅ [e88e6eb3] + Zygote v0.6.77 [700de1a5] + ZygoteRules v0.2.7 [dad2f222] + LLVMExtra_jll v0.0.38+0 [94ce4f54] + Libiconv_jll v1.18.0+0 [c8ffd9c3] + MbedTLS_jll v2.28.1010+0 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [02c8fc9c] + XML2_jll v2.15.1+0 [2a13b4fb] + rure_jll v0.2.2+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [9fa8497b] + Future v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [4af54fe1] + LazyArtifacts v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.12.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.12.1 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [2f01184e] + SparseArrays v1.12.0 [f489334b] + StyledStrings v1.11.0 [4607b0f0] + SuiteSparse [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.15.0+0 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.11.4 [4536629a] + OpenBLAS_jll v0.3.29+0 [05823500] + OpenLibm_jll v0.8.7+0 [458c3c95] + OpenSSL_jll v3.5.4+0 [bea87d4a] + SuiteSparse_jll v7.8.3+2 [83775a58] + Zlib_jll v1.3.1+2 [8e850b90] + libblastrampoline_jll v5.15.0+0 [8e850ede] + nghttp2_jll v1.64.0+1 [3f19e933] + p7zip_jll v17.7.0+0 Info Packages marked with ⌃ and ⌅ have new versions available. Those with ⌃ may be upgradable, but those with ⌅ are restricted by compatibility constraints from upgrading. To see why use `status --outdated -m` Building HTML_Entities → `~/.julia/scratchspaces/44cfe95a-1eb2-52ea-b672-e2afdf69b78f/781d638b8892cd1a1e867f51863d8881c0a62834/build.log` Installation completed after 19.15s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling packages... 4458.0 ms ✓ TestEnv 1 dependency successfully precompiled in 5 seconds. 26 already precompiled. Precompiling package dependencies... Precompiling packages... 911.0 ms ✓ StringViews 783.7 ms ✓ AbstractFFTs 643.8 ms ✓ ExprTools 637.5 ms ✓ IteratorInterfaceExtensions 2898.7 ms ✓ UnsafeAtomics 716.7 ms ✓ Tricks 737.5 ms ✓ StatsAPI 1332.7 ms ✓ InitialValues 2811.3 ms ✓ CEnum 1337.6 ms ✓ OffsetArrays 1573.6 ms ✓ FillArrays 3148.8 ms ✓ FuncPipelines 715.0 ms ✓ InverseFunctions 822.3 ms ✓ Statistics 734.8 ms ✓ PrettyPrint 676.1 ms ✓ ArgCheck 2950.1 ms ✓ ShowCases 7033.8 ms ✓ MacroTools 899.4 ms ✓ DLFP8Types 4112.5 ms ✓ OrderedCollections 1160.1 ms ✓ Requires 740.9 ms ✓ DataValueInterfaces 727.4 ms ✓ RealDot 851.8 ms ✓ Reexport 1080.0 ms ✓ DocStringExtensions 4978.8 ms ✓ IrrationalConstants 1195.4 ms ✓ URIs 744.6 ms ✓ SimpleBufferStream 776.4 ms ✓ CompositionsBase 775.7 ms ✓ PtrArrays 1144.5 ms ✓ TranscodingStreams 934.4 ms ✓ HashArrayMappedTries 805.7 ms ✓ DefineSingletons 3613.1 ms ✓ NaNMath 931.2 ms ✓ DelimitedFiles 3662.8 ms ✓ FuncTransforms 28849.5 ms ✓ MLStyle 1046.3 ms ✓ LRUCache 747.9 ms ✓ IfElse 3649.4 ms ✓ ConstructionBase 756.8 ms ✓ CommonWorldInvalidations 800.0 ms ✓ DataAPI 751.2 ms ✓ PackageExtensionCompat 977.0 ms ✓ ProgressLogging 807.5 ms ✓ BitFlags 3881.0 ms ✓ Functors 841.0 ms ✓ SciMLPublic 904.7 ms ✓ StaticArraysCore 946.4 ms ✓ MappedArrays 2239.0 ms ✓ Baselet 2023.3 ms ✓ ConcurrentUtilities 1101.6 ms ✓ ZipFile 3849.4 ms ✓ BFloat16s 1799.7 ms ✓ ProgressMeter 1244.3 ms ✓ SparseInverseSubset 3950.0 ms ✓ StructTypes 998.6 ms ✓ StrTables 833.1 ms ✓ Scratch 979.6 ms ✓ LoggingExtras 1073.8 ms ✓ Preferences 4067.6 ms ✓ Compat 1160.7 ms ✓ InternedStrings 1137.8 ms ✓ Pidfile 1656.9 ms ✓ ExceptionUnwrapping 3749.1 ms ✓ AbstractFFTs → AbstractFFTsTestExt 685.9 ms ✓ TableTraits 901.4 ms ✓ Atomix 888.2 ms ✓ ValSplit 1386.9 ms ✓ FillArrays → FillArraysSparseArraysExt 1746.3 ms ✓ InverseFunctions → InverseFunctionsTestExt 855.3 ms ✓ InverseFunctions → InverseFunctionsDatesExt 1216.3 ms ✓ Statistics → SparseArraysExt 829.9 ms ✓ FillArrays → FillArraysStatisticsExt 793.0 ms ✓ NameResolution 1505.5 ms ✓ CommonSubexpressions 4403.0 ms ✓ PartialFunctions 6342.8 ms ✓ IRTools 3009.1 ms ✓ SimpleTraits 932.3 ms ✓ Adapt 8865.3 ms ✓ FileIO 1409.1 ms ✓ LogExpFunctions 832.8 ms ✓ CompositionsBase → CompositionsBaseInverseFunctionsExt 964.4 ms ✓ AliasTables 939.3 ms ✓ CodecZlib 858.4 ms ✓ ScopedValues 801.7 ms ✓ LRUCache → SerializationExt 816.9 ms ✓ ConstructionBase → ConstructionBaseLinearAlgebraExt 3443.7 ms ✓ Missings 905.6 ms ✓ StridedViews 4261.8 ms ✓ OpenSSL 847.7 ms ✓ DiffResults 1096.8 ms ✓ RelocatableFolders 1149.1 ms ✓ JLLWrappers 865.4 ms ✓ PrecompileTools 2198.1 ms ✓ DoubleArrayTries 863.0 ms ✓ Compat → CompatLinearAlgebraExt 5073.8 ms ✓ OhMyArtifacts 4408.3 ms ✓ Tables 11542.4 ms ✓ JuliaVariables 1213.2 ms ✓ Adapt → AdaptSparseArraysExt 1209.8 ms ✓ GPUArraysCore 871.7 ms ✓ OffsetArrays → OffsetArraysAdaptExt 758.5 ms ✓ LogExpFunctions → LogExpFunctionsInverseFunctionsExt 957.4 ms ✓ StructWalk 3021.2 ms ✓ Setfield 7754.8 ms ✓ Accessors 703.2 ms ✓ StridedViews → StridedViewsPtrArraysExt 1868.4 ms ✓ HTML_Entities 5053.3 ms ✓ LLVMExtra_jll 1379.4 ms ✓ MbedTLS_jll 1347.6 ms ✓ rure_jll 1363.4 ms ✓ Libiconv_jll 1364.3 ms ✓ OpenSpecFun_jll 17414.1 ms ✓ StaticArrays 17423.3 ms ✓ Parsers 8272.6 ms ✓ Static 49488.4 ms ✓ JLD2 3996.2 ms ✓ DataStructures 5109.3 ms ✓ ChainRulesCore 5833.6 ms ✓ Aqua 900.7 ms ✓ ContextVariablesX 4249.3 ms ✓ MLDataDevices 3980.9 ms ✓ StructArrays 3879.7 ms ✓ MLCore 3817.4 ms ✓ SplittablesBase 1942.3 ms ✓ Accessors → LinearAlgebraExt 1761.1 ms ✓ Accessors → TestExt 17135.1 ms ✓ LLVM 2076.5 ms ✓ MbedTLS 986.6 ms ✓ RustRegex 991.4 ms ✓ StringEncodings 1392.3 ms ✓ XML2_jll 5554.3 ms ✓ SpecialFunctions 1345.7 ms ✓ StaticArrays → StaticArraysStatisticsExt 1402.5 ms ✓ FillArrays → FillArraysStaticArraysExt 1376.7 ms ✓ ConstructionBase → ConstructionBaseStaticArraysExt 1315.3 ms ✓ Adapt → AdaptStaticArraysExt 1564.6 ms ✓ Accessors → StaticArraysExt 17202.9 ms ✓ JSON3 3974.7 ms ✓ JSON 1643.6 ms ✓ SortingAlgorithms 3798.5 ms ✓ ChainRulesCore → ChainRulesCoreSparseArraysExt 2330.6 ms ✓ ZygoteRules 4745.9 ms ✓ Optimisers 865.8 ms ✓ AbstractFFTs → AbstractFFTsChainRulesCoreExt 3068.4 ms ✓ LogExpFunctions → LogExpFunctionsChainRulesCoreExt 3955.9 ms ✓ StaticArrays → StaticArraysChainRulesCoreExt 930.1 ms ✓ FLoopsBase 1424.6 ms ✓ MLDataDevices → MLDataDevicesChainRulesCoreExt 943.6 ms ✓ MLDataDevices → MLDataDevicesFillArraysExt 1349.7 ms ✓ MLDataDevices → MLDataDevicesSparseArraysExt 870.6 ms ✓ StructArrays → StructArraysAdaptExt 1292.6 ms ✓ StructArrays → StructArraysSparseArraysExt 4222.4 ms ✓ StructArrays → StructArraysStaticArraysExt 859.7 ms ✓ StructArrays → StructArraysGPUArraysCoreExt 1019.1 ms ✓ Accessors → StructArraysExt 1767.4 ms ✓ BangBang 4636.8 ms ✓ LLVM → BFloat16sExt 6128.2 ms ✓ UnsafeAtomics → UnsafeAtomicsLLVM 9821.4 ms ✓ GPUArrays 33713.7 ms ✓ HTTP 8437.6 ms ✓ Pickle 1010.1 ms ✓ LightXML 4530.7 ms ✓ SpecialFunctions → SpecialFunctionsChainRulesCoreExt 1340.7 ms ✓ DiffRules 12096.0 ms ✓ KernelAbstractions 6365.0 ms ✓ HuggingFaceApi 4173.1 ms ✓ SafeTensors 7260.4 ms ✓ StatsBase 15690.4 ms ✓ ChainRules 1754.6 ms ✓ BangBang → BangBangStaticArraysExt 1187.5 ms ✓ BangBang → BangBangChainRulesCoreExt 1171.0 ms ✓ BangBang → BangBangStructArraysExt 1161.7 ms ✓ BangBang → BangBangTablesExt 2339.5 ms ✓ MicroCollections 5123.4 ms ✓ MLDataDevices → MLDataDevicesGPUArraysExt 6287.3 ms ✓ DataDeps 3641.6 ms ✓ Fetch 5967.3 ms ✓ FileIO → HTTPExt 9972.4 ms ✓ ForwardDiff 3036.9 ms ✓ KernelAbstractions → SparseArraysExt 2211.4 ms ✓ KernelAbstractions → LinearAlgebraExt 2014.6 ms ✓ MLDataDevices → MLDataDevicesChainRulesExt 10766.7 ms ✓ Transducers 10779.0 ms ✓ WordTokenizers 1666.3 ms ✓ ForwardDiff → ForwardDiffStaticArraysExt 69098.1 ms ✓ Zygote 13607.6 ms ✓ NNlib 1982.1 ms ✓ Transducers → TransducersAdaptExt 16145.1 ms ✓ FLoops 4648.8 ms ✓ MLDataDevices → MLDataDevicesZygoteExt 2692.2 ms ✓ NNlib → NNlibSpecialFunctionsExt 2800.8 ms ✓ NNlib → NNlibForwardDiffExt 9425.0 ms ✓ NeuralAttentionlib 3365.4 ms ✓ OneHotArrays 3390.8 ms ✓ PrimitiveOneHot 23860.6 ms ✓ MLUtils 6766.1 ms ✓ NeuralAttentionlib → NeuralAttentionlibGPUArraysExt 5939.0 ms ✓ NeuralAttentionlib → NeuralAttentionlibZygoteExt 3248.3 ms ✓ MLDataDevices → MLDataDevicesOneHotArraysExt 2624.4 ms ✓ PrimitiveOneHot → PrimitiveOneHotOneHotArraysExt 6286.1 ms ✓ PrimitiveOneHot → PrimitiveOneHotGPUArraysExt 9681.5 ms ✓ TextEncodeBase 6958.3 ms ✓ MLDataDevices → MLDataDevicesMLUtilsExt 12371.5 ms ✓ BytePairEncoding 26863.7 ms ✓ Flux 34016.3 ms ✓ Transformers 25663.4 ms ✓ ColBERT 208 dependencies successfully precompiled in 938 seconds. 37 already precompiled. Precompilation completed after 955.49s ################################################################################ # Testing # Testing ColBERT Status `/tmp/jl_lh5Fuo/Project.toml` [4c88cf16] Aqua v0.8.14 [7e8ad7a6] ColBERT v0.1.0 ⌅ [033835bb] JLD2 v0.4.55 ⌅ [682c06a0] JSON v0.21.4 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_lh5Fuo/Manifest.toml` [621f4979] AbstractFFTs v1.5.0 [7d9f7c33] Accessors v0.1.43 [79e6a3ab] Adapt v4.4.0 [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.14 [dce04be8] ArgCheck v2.5.0 [a9b6321e] Atomix v1.1.2 ⌅ [ab4f0b2a] BFloat16s v0.5.1 [198e06fe] BangBang v0.4.7 [9718e550] Baselet v0.1.1 [d1d4a3ce] BitFlags v0.1.9 [a4280ba5] BytePairEncoding v0.5.2 [fa961155] CEnum v0.5.0 [082447d4] ChainRules v1.72.6 [d360d2e6] ChainRulesCore v1.26.0 [944b1d66] CodecZlib v0.7.8 [7e8ad7a6] ColBERT v0.1.0 [bbf7d656] CommonSubexpressions v0.3.1 [f70d9fcc] CommonWorldInvalidations v1.0.0 [34da2185] Compat v4.18.1 [a33af91c] CompositionsBase v0.1.2 [f0e56b4a] ConcurrentUtilities v2.5.0 [187b0558] ConstructionBase v1.6.0 [6add18c4] ContextVariablesX v0.1.3 [f4c16678] DLFP8Types v0.1.0 [9a962f9c] DataAPI v1.16.0 [124859b0] DataDeps v0.7.13 ⌅ [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [244e2a9f] DefineSingletons v0.1.2 [8bb1440f] DelimitedFiles v1.9.1 [163ba53b] DiffResults v1.1.0 [b552c78f] DiffRules v1.15.1 [ffbed154] DocStringExtensions v0.9.5 [abbaa0e5] DoubleArrayTries v0.1.1 [460bff9d] ExceptionUnwrapping v0.1.11 [e2ba6199] ExprTools v0.1.10 [cc61a311] FLoops v0.2.2 [b9860ae5] FLoopsBase v0.1.1 [bb354801] Fetch v0.1.4 [5789e2e9] FileIO v1.17.1 [1a297f60] FillArrays v1.16.0 ⌅ [587475ba] Flux v0.14.25 [f6369f11] ForwardDiff v1.3.1 [9ed96fbb] FuncPipelines v0.2.3 [79abecb7] FuncTransforms v0.1.1 ⌅ [d9f16b24] Functors v0.4.12 ⌃ [0c68f7d7] GPUArrays v10.3.1 ⌅ [46192b85] GPUArraysCore v0.1.6 [7693890a] HTML_Entities v1.0.2 [cd3eb016] HTTP v1.10.19 [076d061b] HashArrayMappedTries v0.2.0 [3cc741c3] HuggingFaceApi v0.1.0 [7869d1d1] IRTools v0.4.15 [615f187c] IfElse v0.1.1 [22cec73e] InitialValues v0.3.1 [7d512f48] InternedStrings v0.7.0 [3587e190] InverseFunctions v0.1.17 [92d709cd] IrrationalConstants v0.2.6 [82899510] IteratorInterfaceExtensions v1.0.0 ⌅ [033835bb] JLD2 v0.4.55 [692b3bcd] JLLWrappers v1.7.1 ⌅ [682c06a0] JSON v0.21.4 [0f8b85d8] JSON3 v1.14.3 [b14d175d] JuliaVariables v0.2.4 [63c18a36] KernelAbstractions v0.9.39 [929cbde3] LLVM v9.4.4 [8ac3fa9e] LRUCache v1.6.2 [9c8b4983] LightXML v0.9.3 [2ab3a3ac] LogExpFunctions v0.3.29 [e6f89c97] LoggingExtras v1.2.0 [c2834f40] MLCore v1.0.0 ⌃ [7e8f7934] MLDataDevices v1.5.3 [d8e11817] MLStyle v0.4.17 [f1d291b0] MLUtils v0.4.8 [1914dd2f] MacroTools v0.5.16 [dbb5928d] MappedArrays v0.4.3 [739be429] MbedTLS v1.1.9 [128add7d] MicroCollections v0.2.0 [e1d29d7a] Missings v1.2.0 ⌃ [872c559c] NNlib v0.9.31 [77ba4419] NaNMath v1.1.3 [71a1bf82] NameResolution v0.1.5 [12afc1b8] NeuralAttentionlib v0.3.3 [6fe1bfb0] OffsetArrays v1.17.0 [cf8be1f4] OhMyArtifacts v0.3.1 [0b1bfda6] OneHotArrays v0.2.10 [4d8831e6] OpenSSL v1.6.1 ⌅ [3bd65402] Optimisers v0.3.4 [bac558e1] OrderedCollections v1.8.1 [65ce6f38] PackageExtensionCompat v1.0.2 [69de0a69] Parsers v2.8.3 [570af359] PartialFunctions v1.2.1 [fbb45041] Pickle v0.3.6 [fa939f87] Pidfile v1.3.0 [aea7be01] PrecompileTools v1.3.3 [21216c6a] Preferences v1.5.1 [8162dcfd] PrettyPrint v0.2.0 [13d12f88] PrimitiveOneHot v0.2.1 [33c8b6b6] ProgressLogging v0.1.6 [92933f4c] ProgressMeter v1.11.0 [43287f4e] PtrArrays v1.3.0 [c1ae055f] RealDot v0.1.0 [189a3867] Reexport v1.2.2 [05181044] RelocatableFolders v1.0.1 [ae029012] Requires v1.3.1 [cdf36688] RustRegex v0.1.0 [eeda0dda] SafeTensors v1.2.0 [431bcebd] SciMLPublic v1.0.1 [7e506255] ScopedValues v1.5.0 [6c6a2e73] Scratch v1.3.0 [efcf1570] Setfield v1.1.2 [605ecd9f] ShowCases v0.1.0 [777ac1f9] SimpleBufferStream v1.2.0 [699a6c99] SimpleTraits v0.9.5 [a2af1166] SortingAlgorithms v1.2.2 [dc90abb0] SparseInverseSubset v0.1.2 [276daf66] SpecialFunctions v2.6.1 [171d559e] SplittablesBase v0.1.15 [aedffcd0] Static v1.3.1 [90137ffa] StaticArrays v1.9.16 [1e83bf80] StaticArraysCore v1.4.4 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.8.0 [2913bbd2] StatsBase v0.34.10 [9700d1a9] StrTables v1.0.1 [4db3bf67] StridedViews v0.4.3 [69024149] StringEncodings v0.3.7 [354b36f9] StringViews v1.3.7 ⌃ [09ab397b] StructArrays v0.6.18 [856f2bd8] StructTypes v1.11.0 [31cdf514] StructWalk v0.2.1 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.1 [f92c20c0] TextEncodeBase v0.8.3 [3bb67fe8] TranscodingStreams v0.11.3 [28d57a85] Transducers v0.4.85 [21ca0261] Transformers v0.3.1 [410a4b4d] Tricks v0.1.13 [5c2747f8] URIs v1.6.1 [013be700] UnsafeAtomics v0.3.0 [0625e100] ValSplit v0.1.1 [796a5d58] WordTokenizers v0.5.6 [a5390f91] ZipFile v0.10.1 ⌅ [e88e6eb3] Zygote v0.6.77 [700de1a5] ZygoteRules v0.2.7 [dad2f222] LLVMExtra_jll v0.0.38+0 [94ce4f54] Libiconv_jll v1.18.0+0 [c8ffd9c3] MbedTLS_jll v2.28.1010+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [02c8fc9c] XML2_jll v2.15.1+0 [2a13b4fb] rure_jll v0.2.2+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [4af54fe1] LazyArtifacts v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.1 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.12.0 [f489334b] StyledStrings v1.11.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+0 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [4536629a] OpenBLAS_jll v0.3.29+0 [05823500] OpenLibm_jll v0.8.7+0 [458c3c95] OpenSSL_jll v3.5.4+0 [bea87d4a] SuiteSparse_jll v7.8.3+2 [83775a58] Zlib_jll v1.3.1+2 [8e850b90] libblastrampoline_jll v5.15.0+0 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.7.0+0 Info Packages marked with ⌃ and ⌅ have new versions available. Those with ⌃ may be upgradable, but those with ⌅ are restricted by compatibility constraints from upgrading. Testing Running tests... Test Summary: | Pass Total Time compress_into_codes! | 6 6 9.2s Test Summary: | Pass Total Time _binarize | 25 25 23.0s Test Summary: | Pass Total Time _unbinarize | 6 6 4.2s Test Summary: | Pass Total Time _unbinarize inverts _binarize | 1 1 0.0s Test Summary: | Pass Total Time _bucket_indices | 174 174 14.7s Test Summary: | Pass Total Time _packbits | 8 8 1.1s Test Summary: | Pass Total Time _unpackbits | 5 5 0.7s Test Summary: | Pass Total Time _unpackbits inverts _packbits | 1 1 0.0s Test Summary: | Pass Total Time binarize | 5 5 4.4s Test Summary: | Pass Total Time compress | 13 13 3.2s Test Summary: | Pass Total Time decompress_residuals | 7 7 0.8s Test Summary: | Pass Total Time decompress_residuals inverts binarize | 1 1 0.2s Test Summary: | Pass Total Time decompress | 2 2 4.0s Test Summary: | Pass Total Time _sample_pids tests | 2 2 0.8s Test Summary: | Pass Total Time _heldout_split | 22 22 0.8s Test Summary: | Pass Total Time setup | 8 8 0.4s Test Summary: | Pass Total Time _bucket_cutoffs_and_weights | 8 8 3.3s Test Summary: | Pass Total Time _compute_avg_residuals! | 12 12 4.6s Test Summary: | Pass Total Time train | 10 10 15.8s Test Summary: | Pass Total Time _check_all_files_are_saved | 18 18 6.3s Test Summary: | Pass Total Time _collect_embedding_id_offset | 8 8 0.3s Test Summary: | Pass Total Time _build_ivf | 9 9 1.7s Test Summary: | Pass Total Time _add_marker_row | 52 52 8.2s Test Summary: | Pass Total Time mask_skiplist! | 6 6 1.2s Test Summary: | Pass Total Time _clear_masked_embeddings! | 7 7 3.0s Test Summary: | Pass Total Time _flatten_embeddings | 2 2 0.7s Test Summary: | Pass Total Time _remove_masked_tokens | 2 2 1.1s Test Summary: | Pass Total Time _build_emb2pid | 334 334 1.9s Test Summary: | Pass Total Time _cids_to_eids! | 9 9 1.1s Test Summary: | Pass Total Time retrieve | 1 1 5.4s Test Summary: | Pass Total Time _collect_compressed_embs_for_pids | 10 10 1.8s Test Summary: | Pass Total Time maxsim | 4 4 1.8s Test Summary: | Pass Total Time compute_distances_kernel! | 5 5 3.6s Test Summary: | Pass Total Time update_centroids_kernel! | 3 3 0.8s Test Summary: | Pass Total Time assign_clusters_kernel! | 2 2 1.3s Test Summary: | Pass Total Time onehot_encode! | 4 4 1.2s Test Summary: | Pass Total Time kmeans_gpu_onehot! | 1 1 0.3s Test Summary: | Pass Total Time _normalize_array! | 103 103 0.9s Test Summary: | Pass Total Time _topk | 3 3 3.6s Test Summary: | Pass Total Time _head | 6 6 0.5s Test Summary: | Pass Total Time load_codec inverts save_codec | 8 8 41.1s Test Summary: | Pass Total Time load_config inverts save_config | 2 2 2.2s Test Summary: | Pass Total Time load_doclens | 2 2 1.5s Test Summary: | Pass Total Time load_compressed_embs | 2 2 1.4s Test Summary: | Pass Total Time load_chunk_metadata_property inverts save_chunk_metadata_property | 1 1 0.9s Test Summary: | Pass Total Time load_codes | 1 1 0.5s Test Summary: | Pass Total Time save_chunk | 6 6 0.5s Testing ColBERT tests passed Testing completed after 238.04s PkgEval succeeded after 1254.4s