Package evaluation to test Arxiv on Julia 1.12.4 (422f456051*) started at 2026-01-29T04:45:37.216 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.12` Set-up completed after 7.11s ################################################################################ # Installation # Installing Arxiv... Resolving package versions... Installed XML2_jll ──────────── v2.15.1+0 Installed BitFlags ──────────── v0.1.9 Installed LoggingExtras ─────── v1.2.0 Installed SimpleBufferStream ── v1.2.0 Installed EzXML ─────────────── v1.2.3 Installed IterTools ─────────── v1.10.0 Installed Preferences ───────── v1.5.1 Installed XMLDict ───────────── v0.4.1 Installed JLLWrappers ───────── v1.7.1 Installed ConcurrentUtilities ─ v2.5.0 Installed Libiconv_jll ──────── v1.18.0+0 Installed OrderedCollections ── v1.8.1 Installed URIs ──────────────── v1.6.1 Installed TranscodingStreams ── v0.11.3 Installed PrecompileTools ───── v1.3.3 Installed MbedTLS_jll ───────── v2.28.1010+0 Installed CodecZlib ─────────── v0.7.8 Installed ExceptionUnwrapping ─ v0.1.11 Installed OpenSSL ───────────── v1.6.1 Installed MbedTLS ───────────── v1.1.9 Installed HTTP ──────────────── v1.10.19 Installed Arxiv ─────────────── v0.1.0 Installing 3 artifacts Installed artifact Libiconv 1.9 MiB Installed artifact XML2 2.2 MiB Installed artifact MbedTLS 2.2 MiB Updating `~/.julia/environments/v1.12/Project.toml` [95bf46a4] + Arxiv v0.1.0 Updating `~/.julia/environments/v1.12/Manifest.toml` [95bf46a4] + Arxiv v0.1.0 [d1d4a3ce] + BitFlags v0.1.9 [944b1d66] + CodecZlib v0.7.8 [f0e56b4a] + ConcurrentUtilities v2.5.0 [460bff9d] + ExceptionUnwrapping v0.1.11 [8f5d6c58] + EzXML v1.2.3 [cd3eb016] + HTTP v1.10.19 [c8e1da08] + IterTools v1.10.0 [692b3bcd] + JLLWrappers v1.7.1 [e6f89c97] + LoggingExtras v1.2.0 [739be429] + MbedTLS v1.1.9 [4d8831e6] + OpenSSL v1.6.1 [bac558e1] + OrderedCollections v1.8.1 [aea7be01] + PrecompileTools v1.3.3 [21216c6a] + Preferences v1.5.1 [777ac1f9] + SimpleBufferStream v1.2.0 [3bb67fe8] + TranscodingStreams v0.11.3 [5c2747f8] + URIs v1.6.1 [228000da] + XMLDict v0.4.1 [94ce4f54] + Libiconv_jll v1.18.0+0 [c8ffd9c3] + MbedTLS_jll v2.28.1010+0 [02c8fc9c] + XML2_jll v2.15.1+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.3.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.15.0+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.11.4 [458c3c95] + OpenSSL_jll v3.5.4+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850ede] + nghttp2_jll v1.64.0+1 Installation completed after 7.93s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling packages... 3341.7 ms ✓ TestEnv 1 dependency successfully precompiled in 4 seconds. 26 already precompiled. Precompiling package dependencies... Precompiling packages... 943.9 ms ✓ MyterialColors 4063.4 ms ✓ OrderedCollections 812.8 ms ✓ UnPack 770.3 ms ✓ DataValueInterfaces 1155.6 ms ✓ DocStringExtensions 1103.4 ms ✓ AbstractTrees 1132.7 ms ✓ URIs 729.6 ms ✓ IteratorInterfaceExtensions 770.7 ms ✓ SimpleBufferStream 821.3 ms ✓ DataAPI 1031.7 ms ✓ ProgressLogging 1162.7 ms ✓ IterTools 871.4 ms ✓ BitFlags 2171.1 ms ✓ ConcurrentUtilities 1206.5 ms ✓ TranscodingStreams 1026.3 ms ✓ LoggingExtras 1101.9 ms ✓ Preferences 1605.5 ms ✓ CodeTracking 2922.6 ms ✓ UnicodeFun 1693.7 ms ✓ ExceptionUnwrapping 988.2 ms ✓ Parameters 11885.3 ms ✓ Highlights 1370.3 ms ✓ TableTraits 4605.9 ms ✓ OpenSSL 1060.3 ms ✓ CodecZlib 904.4 ms ✓ PrecompileTools 1118.4 ms ✓ JLLWrappers 4537.5 ms ✓ Tables 1446.8 ms ✓ MbedTLS_jll 1473.2 ms ✓ Libiconv_jll 97636.1 ms ✓ Term 2215.8 ms ✓ MbedTLS 1427.5 ms ✓ XML2_jll 34444.7 ms ✓ HTTP 2081.3 ms ✓ EzXML 1003.3 ms ✓ XMLDict 4194.9 ms ✓ Arxiv 7570.6 ms ✓ Arxiv → ArxivTermExt 38 dependencies successfully precompiled in 207 seconds. 24 already precompiled. Precompilation completed after 223.77s ################################################################################ # Testing # Testing Arxiv Status `/tmp/jl_pRLFbn/Project.toml` [95bf46a4] Arxiv v0.1.0 [cd3eb016] HTTP v1.10.19 [22787eb5] Term v2.0.8 [5c2747f8] URIs v1.6.1 [228000da] XMLDict v0.4.1 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_pRLFbn/Manifest.toml` [1520ce14] AbstractTrees v0.4.5 [95bf46a4] Arxiv v0.1.0 [d1d4a3ce] BitFlags v0.1.9 [da1fd8a2] CodeTracking v3.0.0 [944b1d66] CodecZlib v0.7.8 [f0e56b4a] ConcurrentUtilities v2.5.0 [9a962f9c] DataAPI v1.16.0 [e2d170a0] DataValueInterfaces v1.0.0 [ffbed154] DocStringExtensions v0.9.5 [460bff9d] ExceptionUnwrapping v0.1.11 [8f5d6c58] EzXML v1.2.3 [cd3eb016] HTTP v1.10.19 ⌅ [eafb193a] Highlights v0.5.3 [c8e1da08] IterTools v1.10.0 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.1 [e6f89c97] LoggingExtras v1.2.0 [739be429] MbedTLS v1.1.9 [1c23619d] MyterialColors v0.3.0 [4d8831e6] OpenSSL v1.6.1 [bac558e1] OrderedCollections v1.8.1 [d96e819e] Parameters v0.12.3 [aea7be01] PrecompileTools v1.3.3 [21216c6a] Preferences v1.5.1 [33c8b6b6] ProgressLogging v0.1.6 [777ac1f9] SimpleBufferStream v1.2.0 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.1 [22787eb5] Term v2.0.8 [3bb67fe8] TranscodingStreams v0.11.3 [5c2747f8] URIs v1.6.1 [3a884ed6] UnPack v1.0.2 [1cfade01] UnicodeFun v0.4.1 [228000da] XMLDict v0.4.1 [94ce4f54] Libiconv_jll v1.18.0+0 [c8ffd9c3] MbedTLS_jll v2.28.1010+0 [02c8fc9c] XML2_jll v2.15.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.15.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [458c3c95] OpenSSL_jll v3.5.4+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... paper: Test Failed at /home/pkgeval/.julia/packages/Arxiv/rWcc1/test/runtests.jl:54 Expression: startswith(string(p.link_pdf), "http://arxiv.org/pdf/2303.17626") Evaluated: startswith("https://arxiv.org/pdf/2303.17626v1", "http://arxiv.org/pdf/2303.17626") Stacktrace: [1] top-level scope @ ~/.julia/packages/Arxiv/rWcc1/test/runtests.jl:9 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/Arxiv/rWcc1/test/runtests.jl:45 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/Arxiv/rWcc1/test/runtests.jl:54 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Test Summary: | Pass Fail Total Time Arxiv.jl | 32 1 33 29.8s id | 22 22 1.6s paper | 10 1 11 28.2s RNG of the outermost testset: Random.Xoshiro(0x6c3e6232a40306bb, 0x7b3ff202ffeef7d0, 0x0869287c2647714d, 0x79a3a94ba44775c8, 0x5b85a3b9e1295d24) ERROR: LoadError: Some tests did not pass: 32 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/Arxiv/rWcc1/test/runtests.jl:8 Testing failed after 45.71s ERROR: LoadError: Package Arxiv errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2535 [3] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2384 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:538 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:169 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [7] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:156 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 [10] include(mod::Module, _path::String) @ Base ./Base.jl:306 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:317 [12] _start() @ Base ./client.jl:550 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 308.85s: package has test failures