Package evaluation of KeemenaPreprocessing on Julia 1.13.0-DEV.1080 (ed57414aec*) started at 2025-09-04T15:44:50.093 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 10.12s ################################################################################ # Installation # Installing KeemenaPreprocessing... Resolving package versions... Updating `~/.julia/environments/v1.13/Project.toml` [f4ce45ae] + KeemenaPreprocessing v0.1.0 Updating `~/.julia/environments/v1.13/Manifest.toml` [66dad0bd] + AliasTables v1.1.3 [944b1d66] + CodecZlib v0.7.8 [9a962f9c] + DataAPI v1.16.0 [864edb3b] + DataStructures v0.19.1 [ffbed154] + DocStringExtensions v0.9.5 [5789e2e9] + FileIO v1.17.0 [c27321d9] + Glob v1.3.1 [076d061b] + HashArrayMappedTries v0.2.0 [92d709cd] + IrrationalConstants v0.2.4 ⌅ [033835bb] + JLD2 v0.5.15 [f4ce45ae] + KeemenaPreprocessing v0.1.0 [2ab3a3ac] + LogExpFunctions v0.3.29 [1914dd2f] + MacroTools v0.5.16 [e1d29d7a] + Missings v1.2.0 [bac558e1] + OrderedCollections v1.8.1 [aea7be01] + PrecompileTools v1.3.3 [21216c6a] + Preferences v1.5.0 [43287f4e] + PtrArrays v1.3.0 [ae029012] + Requires v1.3.1 [7e506255] + ScopedValues v1.5.0 [a2af1166] + SortingAlgorithms v1.2.2 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.7.1 [2913bbd2] + StatsBase v0.34.6 [3bb67fe8] + TranscodingStreams v0.11.3 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.13.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.13.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [2f01184e] + SparseArrays v1.13.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.15.0+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.8.12 [4536629a] + OpenBLAS_jll v0.3.29+0 [458c3c95] + OpenSSL_jll v3.5.2+0 [efcefdf7] + PCRE2_jll v10.46.0+0 [bea87d4a] + SuiteSparse_jll v7.10.1+0 [83775a58] + Zlib_jll v1.3.1+2 [3161d3a3] + Zstd_jll v1.5.7+1 [8e850b90] + libblastrampoline_jll v5.13.1+0 [8e850ede] + nghttp2_jll v1.67.0+0 [3f19e933] + p7zip_jll v17.6.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 1.21s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 24.67s ################################################################################ # Testing # Testing KeemenaPreprocessing Status `/tmp/jl_ReRkRc/Project.toml` [4c88cf16] Aqua v0.8.14 [6e4b80f9] BenchmarkTools v1.6.0 [944b1d66] CodecZlib v0.7.8 [c27321d9] Glob v1.3.1 ⌅ [033835bb] JLD2 v0.5.15 [f4ce45ae] KeemenaPreprocessing v0.1.0 [2913bbd2] StatsBase v0.34.6 [f43a241f] Downloads v1.7.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 [4ec0a83e] Unicode v1.11.0 Status `/tmp/jl_ReRkRc/Manifest.toml` [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.14 [6e4b80f9] BenchmarkTools v1.6.0 [944b1d66] CodecZlib v0.7.8 [34da2185] Compat v4.18.0 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.19.1 [ffbed154] DocStringExtensions v0.9.5 [5789e2e9] FileIO v1.17.0 [c27321d9] Glob v1.3.1 [076d061b] HashArrayMappedTries v0.2.0 [92d709cd] IrrationalConstants v0.2.4 ⌅ [033835bb] JLD2 v0.5.15 [682c06a0] JSON v0.21.4 [f4ce45ae] KeemenaPreprocessing v0.1.0 [2ab3a3ac] LogExpFunctions v0.3.29 [1914dd2f] MacroTools v0.5.16 [e1d29d7a] Missings v1.2.0 [bac558e1] OrderedCollections v1.8.1 [69de0a69] Parsers v2.8.3 [aea7be01] PrecompileTools v1.3.3 [21216c6a] Preferences v1.5.0 [43287f4e] PtrArrays v1.3.0 [ae029012] Requires v1.3.1 [7e506255] ScopedValues v1.5.0 [a2af1166] SortingAlgorithms v1.2.2 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.7.1 [2913bbd2] StatsBase v0.34.6 [3bb67fe8] TranscodingStreams v0.11.3 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.13.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [2f01184e] SparseArrays v1.13.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.8.12 [4536629a] OpenBLAS_jll v0.3.29+0 [458c3c95] OpenSSL_jll v3.5.2+0 [efcefdf7] PCRE2_jll v10.46.0+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [83775a58] Zlib_jll v1.3.1+2 [3161d3a3] Zstd_jll v1.5.7+1 [8e850b90] libblastrampoline_jll v5.13.1+0 [8e850ede] nghttp2_jll v1.67.0+0 [3f19e933] p7zip_jll v17.6.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Test Summary: | Pass Total Time Pipeline - real texts (Alice + Time Machine) | 7 7 12.7s Test Summary: | Pass Total Time Raw-text sources of arbitrary length | 2 2 0.5s Test Summary: | Pass Total Time preprocess_corpus_streaming_full - real texts (Alice + Time) | 8 8 3.6s Test Summary: | Pass Total Time Cleaning Module Tests | 57 57 1.1s Test Summary: | Pass Total Time Main Cleaning Functions | 117 117 1.0s Test Summary: | Pass Total Time LevelBundle | 3 3 0.2s Test Summary: | Pass Total Time validate_offsets | 2 2 0.0s Test Summary: | Pass Total Time CrossMap | 3 3 0.0s Test Summary: | Pass Total Time PreprocessBundle | 2 2 0.3s Test Summary: | Pass Total Time add_level! and with_extras | 3 3 0.4s Test Summary: | Pass Total Time PreprocessConfiguration - defaults | 16 16 0.1s Test Summary: | Pass Total Time PreprocessConfiguration - keyword overrides | 5 5 0.0s Test Summary: | Pass Total Time PreprocessConfiguration - argument checks | 2 2 0.0s Test Summary: | Pass Total Time build_vocabulary - specials (default cfg) | 7 7 0.5s Test Summary: | Pass Total Time build_vocabulary - specials (no sentence offsets) | 5 5 0.1s Test Summary: | Pass Total Time build_vocabulary - minimum_token_frequency | 2 2 0.1s Test Summary: | Pass Total Time build_vocabulary _ deterministic ordering | 1 1 0.1s Test Summary: | Pass Total Time build_vocabulary - byte tokens overload | 1 1 0.1s Test Summary: | Pass Total Time build_vocabulary - empty token list | 5 5 0.4s Test Summary: | Pass Total Time tokenize_and_segment - whitespace defaults | 6 6 0.1s Test Summary: | Pass Total Time tokenize_and_segment - paragraph split | 3 3 0.0s Test Summary: | Pass Total Time tokenize_and_segment - unicode tokenizer | 2 2 0.0s Test Summary: | Pass Total Time tokenize_and_segment - char tokenizer + char offsets | 3 3 0.3s Test Summary: | Pass Total Time tokenize_and_segment - byte tokenizer + byte offsets | 2 2 0.1s Test Summary: | Pass Total Time tokenize_and_segment - empty token filtering | 1 1 0.0s Test Summary: | Pass Total Time tokenize_and_segment - invalid char-offset request | 1 1 0.0s Test Summary: | Pass Total Time alignment functions | 6 6 0.0s Test Summary: | Pass Total Time build_alignments! | 2 2 0.7s Test Summary: | Pass Total Time Tests for _ensure_lower_levels! (Isolated) | 24 24 0.3s Test Summary: | Pass Total Time Tests for build_alignments! (Isolated) | 13 13 0.2s Test Summary: | Pass Total Time Tests for build_ensure_alignments! (Combined) | 28 28 0.0s Test Summary: | Pass Total Time Edge Case and Robustness Tests | 14 14 0.1s Test Summary: | Pass Total Time Additional Safe Tests | 8 8 0.1s Test Summary: | Pass Total Time _Assemble Module Tests (Corrected) | 47 47 0.7s Test Summary: | Pass Total Time _BundleIO Module Tests | 28 28 1m24.3s Test Summary: | Pass Total Time Raw Readers Tests (Minimal) | 10 10 0.6s Test Summary: | Pass Total Time Pipeline Tests (Minimal) | 16 16 0.8s Test Summary: | Pass Total Time Process Streaming Tests (basic and deep tests) | 414 414 13.0s Test Summary: | Pass Total Time _PreprocessorState Module Tests | 35 35 0.5s Testing KeemenaPreprocessing tests passed Testing completed after 137.91s PkgEval succeeded after 186.27s