Package evaluation of BytePairEncoding on Julia 1.11.4 (a71dd056e0*) started at 2025-04-08T14:40:25.648 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 9.1s ################################################################################ # Installation # Installing BytePairEncoding... Resolving package versions... Installed HTML_Entities ─ v1.0.1 Updating `~/.julia/environments/v1.11/Project.toml` [a4280ba5] + BytePairEncoding v0.5.2 Updating `~/.julia/environments/v1.11/Manifest.toml` [79e6a3ab] + Adapt v4.3.0 [a9b6321e] + Atomix v1.1.1 [d1d4a3ce] + BitFlags v0.1.9 [a4280ba5] + BytePairEncoding v0.5.2 [d360d2e6] + ChainRulesCore v1.25.1 [944b1d66] + CodecZlib v0.7.8 [34da2185] + Compat v4.16.0 [f0e56b4a] + ConcurrentUtilities v2.5.0 [187b0558] + ConstructionBase v1.5.8 [124859b0] + DataDeps v0.7.13 [864edb3b] + DataStructures v0.18.22 [abbaa0e5] + DoubleArrayTries v0.1.1 [460bff9d] + ExceptionUnwrapping v0.1.11 [9ed96fbb] + FuncPipelines v0.2.3 ⌅ [46192b85] + GPUArraysCore v0.1.6 [7693890a] + HTML_Entities v1.0.1 [cd3eb016] + HTTP v1.10.15 [076d061b] + HashArrayMappedTries v0.2.0 [692b3bcd] + JLLWrappers v1.7.0 [63c18a36] + KernelAbstractions v0.9.34 [8ac3fa9e] + LRUCache v1.6.2 [e6f89c97] + LoggingExtras v1.1.0 [1914dd2f] + MacroTools v0.5.15 [739be429] + MbedTLS v1.1.9 [872c559c] + NNlib v0.9.30 [6fe1bfb0] + OffsetArrays v1.16.0 [4d8831e6] + OpenSSL v1.4.3 [bac558e1] + OrderedCollections v1.8.0 [570af359] + PartialFunctions v1.2.0 ⌅ [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [13d12f88] + PrimitiveOneHot v0.2.1 [189a3867] + Reexport v1.2.2 [ae029012] + Requires v1.3.1 [cdf36688] + RustRegex v0.1.0 [7e506255] + ScopedValues v1.3.0 [6c6a2e73] + Scratch v1.2.1 [777ac1f9] + SimpleBufferStream v1.2.0 [90137ffa] + StaticArrays v1.9.13 [1e83bf80] + StaticArraysCore v1.4.3 [10745b16] + Statistics v1.11.1 [9700d1a9] + StrTables v1.0.1 [354b36f9] + StringViews v1.3.4 [31cdf514] + StructWalk v0.2.1 [f92c20c0] + TextEncodeBase v0.8.3 [3bb67fe8] + TranscodingStreams v0.11.3 [5c2747f8] + URIs v1.5.2 [013be700] + UnsafeAtomics v0.3.0 [796a5d58] + WordTokenizers v0.5.6 [458c3c95] + OpenSSL_jll v3.0.16+0 [2a13b4fb] + rure_jll v0.2.2+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [4af54fe1] + LazyArtifacts v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [4536629a] + OpenBLAS_jll v0.3.27+1 [83775a58] + Zlib_jll v1.2.13+1 [8e850b90] + libblastrampoline_jll v5.11.0+0 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Building HTML_Entities → `~/.julia/scratchspaces/44cfe95a-1eb2-52ea-b672-e2afdf69b78f/c4144ed3bc5f67f595622ad03c0e39fa6c70ccc7/build.log` Installation completed after 7.2s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 26.65s ################################################################################ # Testing # Testing BytePairEncoding Status `/tmp/jl_R8KeEg/Project.toml` [a4280ba5] BytePairEncoding v0.5.2 [992eb4ea] CondaPkg v0.2.27 [8bb1440f] DelimitedFiles v1.9.1 [6099a3de] PythonCall v0.9.24 [f92c20c0] TextEncodeBase v0.8.3 [56f22d72] Artifacts v1.11.0 [f43a241f] Downloads v1.6.0 [4af54fe1] LazyArtifacts v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_R8KeEg/Manifest.toml` [79e6a3ab] Adapt v4.3.0 [a9b6321e] Atomix v1.1.1 [d1d4a3ce] BitFlags v0.1.9 [a4280ba5] BytePairEncoding v0.5.2 [d360d2e6] ChainRulesCore v1.25.1 [944b1d66] CodecZlib v0.7.8 [34da2185] Compat v4.16.0 [f0e56b4a] ConcurrentUtilities v2.5.0 [992eb4ea] CondaPkg v0.2.27 [187b0558] ConstructionBase v1.5.8 [9a962f9c] DataAPI v1.16.0 [124859b0] DataDeps v0.7.13 [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [8bb1440f] DelimitedFiles v1.9.1 [abbaa0e5] DoubleArrayTries v0.1.1 [460bff9d] ExceptionUnwrapping v0.1.11 [9ed96fbb] FuncPipelines v0.2.3 ⌅ [46192b85] GPUArraysCore v0.1.6 [7693890a] HTML_Entities v1.0.1 [cd3eb016] HTTP v1.10.15 [076d061b] HashArrayMappedTries v0.2.0 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.0 [0f8b85d8] JSON3 v1.14.2 [63c18a36] KernelAbstractions v0.9.34 [8ac3fa9e] LRUCache v1.6.2 [e6f89c97] LoggingExtras v1.1.0 [1914dd2f] MacroTools v0.5.15 [739be429] MbedTLS v1.1.9 [0b3b1443] MicroMamba v0.1.14 [872c559c] NNlib v0.9.30 [6fe1bfb0] OffsetArrays v1.16.0 [4d8831e6] OpenSSL v1.4.3 [bac558e1] OrderedCollections v1.8.0 [69de0a69] Parsers v2.8.1 [570af359] PartialFunctions v1.2.0 [fa939f87] Pidfile v1.3.0 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [13d12f88] PrimitiveOneHot v0.2.1 [6099a3de] PythonCall v0.9.24 [189a3867] Reexport v1.2.2 [ae029012] Requires v1.3.1 [cdf36688] RustRegex v0.1.0 [7e506255] ScopedValues v1.3.0 [6c6a2e73] Scratch v1.2.1 [777ac1f9] SimpleBufferStream v1.2.0 [90137ffa] StaticArrays v1.9.13 [1e83bf80] StaticArraysCore v1.4.3 [10745b16] Statistics v1.11.1 [9700d1a9] StrTables v1.0.1 [354b36f9] StringViews v1.3.4 [856f2bd8] StructTypes v1.11.0 [31cdf514] StructWalk v0.2.1 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.0 [f92c20c0] TextEncodeBase v0.8.3 [3bb67fe8] TranscodingStreams v0.11.3 [5c2747f8] URIs v1.5.2 [013be700] UnsafeAtomics v0.3.0 [e17b2a0c] UnsafePointers v1.0.0 [796a5d58] WordTokenizers v0.5.6 [458c3c95] OpenSSL_jll v3.0.16+0 [f8abcde7] micromamba_jll v1.5.8+0 [4d7b5844] pixi_jll v0.41.3+0 [2a13b4fb] rure_jll v0.2.2+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [4af54fe1] LazyArtifacts v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Precompiling BytePairEncoding... 1174.7 ms ✓ rure_jll 13284.1 ms ✓ NNlib 5710.1 ms ✓ DataDeps 1092.6 ms ✓ RustRegex 2731.8 ms ✓ PrimitiveOneHot 7215.8 ms ✓ WordTokenizers 42582.9 ms ✓ TextEncodeBase 9765.2 ms ✓ BytePairEncoding 8 dependencies successfully precompiled in 85 seconds. 79 already precompiled. [ Info: Test learn [ Info: Test bpe [ Info: Test bbpe [ Info: Test tiktoken Precompiling PythonCall... 25795.9 ms ✓ PythonCall 1 dependency successfully precompiled in 26 seconds. 49 already precompiled. CondaPkg Found dependencies: /tmp/jl_R8KeEg/CondaPkg.toml CondaPkg Found dependencies: /home/pkgeval/.julia/packages/PythonCall/WMWY0/CondaPkg.toml CondaPkg Resolving changes + libstdcxx-ng + openssl + python + tiktoken (pip) + uv CondaPkg Initialising pixi │ /home/pkgeval/.julia/artifacts/cefba4912c2b400756d043a2563ef77a0088866b/bin/pixi │ init │ --format pixi └ /tmp/jl_R8KeEg/.CondaPkg ✔ Created /tmp/jl_R8KeEg/.CondaPkg/pixi.toml CondaPkg Wrote /tmp/jl_R8KeEg/.CondaPkg/pixi.toml │ [dependencies] │ openssl = ">=3, <3.1" │ uv = ">=0.4" │ libstdcxx-ng = ">=3.4,<13.0" │ │ [dependencies.python] │ channel = "conda-forge" │ build = "*cpython*" │ version = ">=3.8,<4" │ │ [project] │ name = ".CondaPkg" │ platforms = ["linux-64"] │ channels = ["conda-forge"] │ channel-priority = "strict" │ description = "automatically generated by CondaPkg.jl" │ │ [pypi-dependencies] └ tiktoken = "*" CondaPkg Installing packages │ /home/pkgeval/.julia/artifacts/cefba4912c2b400756d043a2563ef77a0088866b/bin/pixi │ install └ --manifest-path /tmp/jl_R8KeEg/.CondaPkg/pixi.toml ✔ The default environment has been installed. ┌ Warning: The maximum encoded value (`length(BPEEncoder.vocab)`) is larger than the number of possible tokens │ because there are some "gaps" in the vocabulary. Be carefull if used to initialize embedding table. └ @ BytePairEncoding ~/.julia/packages/BytePairEncoding/6x3qx/src/encoder.jl:94 ┌ Warning: The maximum encoded value (`length(BPEEncoder.vocab)`) is larger than the number of possible tokens │ because there are some "gaps" in the vocabulary. Be carefull if used to initialize embedding table. └ @ BytePairEncoding ~/.julia/packages/BytePairEncoding/6x3qx/src/encoder.jl:94 ┌ Warning: The maximum encoded value (`length(BPEEncoder.vocab)`) is larger than the number of possible tokens │ because there are some "gaps" in the vocabulary. Be carefull if used to initialize embedding table. └ @ BytePairEncoding ~/.julia/packages/BytePairEncoding/6x3qx/src/encoder.jl:94 Test Summary: | Pass Total Time BytePairEncoding | 1993017 1993017 7m50.8s Testing BytePairEncoding tests passed Testing completed after 568.97s PkgEval succeeded after 632.94s