Package evaluation to test PaperFetch on Julia 1.14.0-DEV.2590 (cfde0ec785*) started at 2026-07-04T05:53:41.480 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.14` Set-up completed after 14.46s ################################################################################ # Installation # Installing PaperFetch... Resolving package versions... Updating `~/.julia/environments/v1.14/Project.toml` [5ac78112] + PaperFetch v0.2.0 Updating `~/.julia/environments/v1.14/Manifest.toml` [c7e460c6] + ArgParse v1.2.0 [2027ae74] + BibInternal v0.3.7 [13533e5b] + BibParser v0.2.3 [336ed68f] + CSV v0.10.16 [944b1d66] + CodecZlib v0.7.8 [34da2185] + Compat v4.18.1 [9a962f9c] + DataAPI v1.16.0 [864edb3b] + DataStructures v0.19.5 [e2d170a0] + DataValueInterfaces v1.0.0 [4e289a0a] + EnumX v1.0.7 [48062228] + FilePathsBase v0.9.24 [cd3eb016] + HTTP v2.5.3 [66f2fdda] + IncCSV v0.1.0 [842dd82b] + InlineStrings v1.4.5 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.8.0 [682c06a0] + JSON v1.6.1 [0f8b85d8] + JSON3 v1.14.3 [7d188eb4] + JSONSchema v1.5.0 ⌅ [bac558e1] + OrderedCollections v1.8.2 [5ac78112] + PaperFetch v0.2.0 [69de0a69] + Parsers v2.8.6 [2dfb63ee] + PooledArrays v1.4.3 [aea7be01] + PrecompileTools v1.3.4 [21216c6a] + Preferences v1.5.2 [802f3686] + Reseau v1.3.1 [91c51154] + SentinelArrays v1.4.10 [69024149] + StringEncodings v0.3.7 [856f2bd8] + StructTypes v1.11.0 [ec057cc2] + StructUtils v2.8.2 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.13.0 [1c621080] + TestItems v1.0.0 [b718987f] + TextWrap v1.0.2 [3bb67fe8] + TranscodingStreams v0.11.3 [5c2747f8] + URIs v1.6.1 [ea10d353] + WeakRefStrings v1.4.3 [76eceee3] + WorkerUtilities v1.6.1 [ddb6d928] + YAML v0.4.16 [94ce4f54] + Libiconv_jll v1.18.0+0 [0dad84c5] + ArgTools v1.2.0 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [9fa8497b] + Future v1.11.0 [b27032c2] + LibCURL v1.0.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.13.0 [fa267f1f] + TOML v1.0.3 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.5.5+2 [deac9b47] + LibCURL_jll v8.21.0+0 [29816b5a] + LibSSH2_jll v1.11.101+0 [14a3606d] + MozillaCACerts_jll v2026.5.14 [458c3c95] + OpenSSL_jll v3.5.7+0 [83775a58] + Zlib_jll v1.3.2+0 [3161d3a3] + Zstd_jll v1.5.7+1 [8e850ede] + nghttp2_jll v1.69.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 5.32s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... ┌ Warning: Ignoring incompatible compat entry `SHA = "0.7.0"` in "/tmp/jl_BgGMXA/Project.toml". │ SHA is a non-upgradable standard library with version 1.13.0 in the current Julia version. │ Fix by setting compat to "0.7.0, 1" to mark support of the current version 1.13.0. └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:520 Precompiling package dependencies... Precompiling project... 2.4 s ✓ IncCSV 5.7 s ✓ PaperFetch 2 dependencies successfully precompiled in 9 seconds. 70 already precompiled. Precompilation completed after 36.03s ################################################################################ # Testing # Testing PaperFetch ┌ Warning: Ignoring incompatible compat entry `SHA = "0.7.0"` in "/tmp/jl_t1FN2j/Project.toml". │ SHA is a non-upgradable standard library with version 1.13.0 in the current Julia version. │ Fix by setting compat to "0.7.0, 1" to mark support of the current version 1.13.0. └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:520 Status `/tmp/jl_t1FN2j/Project.toml` [c7e460c6] ArgParse v1.2.0 [13533e5b] BibParser v0.2.3 [cd3eb016] HTTP v2.5.3 [66f2fdda] IncCSV v0.1.0 [0f8b85d8] JSON3 v1.14.3 [5ac78112] PaperFetch v0.2.0 [5c2747f8] URIs v1.6.1 [ade2ca70] Dates v1.11.0 [ea8e919c] SHA v1.13.0 [8dfed614] Test v1.11.0 [4ec0a83e] Unicode v1.11.0 Status `/tmp/jl_t1FN2j/Manifest.toml` [c7e460c6] ArgParse v1.2.0 [2027ae74] BibInternal v0.3.7 [13533e5b] BibParser v0.2.3 [336ed68f] CSV v0.10.16 [944b1d66] CodecZlib v0.7.8 [34da2185] Compat v4.18.1 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.19.5 [e2d170a0] DataValueInterfaces v1.0.0 [4e289a0a] EnumX v1.0.7 [48062228] FilePathsBase v0.9.24 [cd3eb016] HTTP v2.5.3 [66f2fdda] IncCSV v0.1.0 [842dd82b] InlineStrings v1.4.5 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.8.0 [682c06a0] JSON v1.6.1 [0f8b85d8] JSON3 v1.14.3 [7d188eb4] JSONSchema v1.5.0 ⌅ [bac558e1] OrderedCollections v1.8.2 [5ac78112] PaperFetch v0.2.0 [69de0a69] Parsers v2.8.6 [2dfb63ee] PooledArrays v1.4.3 [aea7be01] PrecompileTools v1.3.4 [21216c6a] Preferences v1.5.2 [802f3686] Reseau v1.3.1 [91c51154] SentinelArrays v1.4.10 [69024149] StringEncodings v0.3.7 [856f2bd8] StructTypes v1.11.0 [ec057cc2] StructUtils v2.8.2 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.13.0 [1c621080] TestItems v1.0.0 [b718987f] TextWrap v1.0.2 [3bb67fe8] TranscodingStreams v0.11.3 [5c2747f8] URIs v1.6.1 [ea10d353] WeakRefStrings v1.4.3 [76eceee3] WorkerUtilities v1.6.1 [ddb6d928] YAML v0.4.16 [94ce4f54] Libiconv_jll v1.18.0+0 [0dad84c5] ArgTools v1.2.0 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0 [b27032c2] LibCURL v1.0.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.13.0 [9e88b42a] Serialization v1.11.0 [f489334b] StyledStrings v1.13.0 [fa267f1f] TOML v1.0.3 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.5.5+2 [deac9b47] LibCURL_jll v8.21.0+0 [29816b5a] LibSSH2_jll v1.11.101+0 [14a3606d] MozillaCACerts_jll v2026.5.14 [458c3c95] OpenSSL_jll v3.5.7+0 [83775a58] Zlib_jll v1.3.2+0 [3161d3a3] Zstd_jll v1.5.7+1 [8e850ede] nghttp2_jll v1.69.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Test Summary: | Pass Total Time normalization | 8 8 1.3s Test Summary: | Pass Total Time normalization helpers | 21 21 5.0s Test Summary: | Pass Total Time normalize_url and urls_in_text | 18 18 0.2s Test Summary: | Pass Total Time field importance and comparison severity | 27 27 1.0s Test Summary: | Pass Total Time PMID text extraction requires explicit prefix | 3 3 1.5s Test Summary: | Pass Total Time compare_value author mismatch | 12 12 6.3s Test Summary: | Pass Total Time inproceedings compares booktitle not journal | 5 5 0.2s Test Summary: | Pass Total Time book compares editor when author is absent | 5 5 0.2s Test Summary: | Pass Total Time documented API report examples | 6 6 8.9s Test Summary: | Pass Total Time BibTeX and plain input | 10 10 15.0s Test Summary: | Pass Total Time WorkIdentifier extraction | 15 15 1.0s Test Summary: | Pass Total Time API fallback lookup paths | 4 4 28.0s Test Summary: | Pass Total Time incorrect DOI is detected and the correct paper is found by title search | 7 7 1.0s Test Summary: | Pass Total Time additional provider adapters | 7 7 3.2s Test Summary: | Pass Total Time arXiv current version year | 2 2 0.4s Test Summary: | Pass Total Time source selection rejects hard mismatches | 7 7 0.3s Test Summary: | Pass Total Time URL metadata and direct PDF lookup | 2 2 0.3s Test Summary: | Pass Total Time provider URL construction and errors | 5 5 0.2s Test Summary: | Pass Total Time provider cache and error branches | 21 21 1.4s Test Summary: | Pass Total Time pubmed search with zero hits does not error | 3 3 0.1s Test Summary: | Pass Total Time book and repository provider shapes | 5 5 0.1s Test Summary: | Pass Total Time comparison statuses from examples | 31 31 2.9s Test Summary: | Pass Total Time misplaced DOI bibliography lookup | 3 3 0.2s Test Summary: | Pass Total Time reports | 9 9 39.5s Test Summary: | Pass Total Time report flags and key preservation | 15 15 1.3s Test Summary: | Pass Total Time fetch manifests | 23 23 2.0s Test Summary: | Pass Total Time cookie and proxy helpers | 12 12 0.5s Wrote: /tmp/jl_pSkeH2/01_exact_article.md Wrote: /tmp/jl_pSkeH2/01_exact_article.inc Wrote: /tmp/jl_Hhcpjy/paperfetch_report.md Wrote: /tmp/jl_Hhcpjy/paperfetch_report.inc Test Summary: | Pass Total Time CLI check mode | 12 12 5.6s Wrote: /tmp/jl_pvlVBM/out/nopdf.md Wrote: /tmp/jl_pvlVBM/out/nopdf.inc Wrote: /tmp/jl_pvlVBM/out/manifest.inc Wrote: /tmp/jl_pvlVBM/out/manifest.md Test Summary: | Pass Total Time CLI fetch and invalid mode | 6 6 0.9s ┌ Warning: check_bibliography is running fully offline: no fixture, no explicit providers, and use_apis=false. Entries will only be compared against their own bibliography fields and cannot be validated against any independent source metadata. Pass fixture= for a deterministic offline run, or use_apis=true to query live scholarly APIs. └ @ PaperFetch ~/.julia/packages/PaperFetch/xLiiX/src/PaperFetch.jl:93 ┌ Warning: check_bibliography is running fully offline: no fixture, no explicit providers, and use_apis=false. Entries will only be compared against their own bibliography fields and cannot be validated against any independent source metadata. Pass fixture= for a deterministic offline run, or use_apis=true to query live scholarly APIs. └ @ PaperFetch ~/.julia/packages/PaperFetch/xLiiX/src/PaperFetch.jl:93 ┌ Warning: check_bibliography is running fully offline: no fixture, no explicit providers, and use_apis=false. Entries will only be compared against their own bibliography fields and cannot be validated against any independent source metadata. Pass fixture= for a deterministic offline run, or use_apis=true to query live scholarly APIs. └ @ PaperFetch ~/.julia/packages/PaperFetch/xLiiX/src/PaperFetch.jl:93 Test Summary: | Pass Total Time anon key is skipped by check_bibliography | 5 5 2.5s Test Summary: | Pass Total Time offline fallback warns and the report notes the limitation | 5 5 0.9s Testing PaperFetch tests passed Testing completed after 151.09s PkgEval succeeded after 217.45s