Package evaluation to test Arxiv on Julia 1.14.0-DEV.2435 (e1b2c72e96*) started at 2026-06-25T16:19:00.325


################################################################################
# Set-up
#

Installing PkgEval dependencies (TestEnv)...
  Activating project at `~/.julia/environments/v1.14`

Set-up completed after 15.02s


################################################################################
# Installation
#

Installing Arxiv...
   Resolving package versions...
    Updating `~/.julia/environments/v1.14/Project.toml`
  [95bf46a4] + Arxiv v0.1.0
    Updating `~/.julia/environments/v1.14/Manifest.toml`
  [95bf46a4] + Arxiv v0.1.0
  [d1d4a3ce] + BitFlags v0.1.10
  [944b1d66] + CodecZlib v0.7.8
  [f0e56b4a] + ConcurrentUtilities v2.5.1
  [460bff9d] + ExceptionUnwrapping v0.1.11
  [8f5d6c58] + EzXML v1.2.3
⌅ [cd3eb016] + HTTP v1.11.0
  [c8e1da08] + IterTools v1.10.0
  [692b3bcd] + JLLWrappers v1.8.0
  [e6f89c97] + LoggingExtras v1.2.0
  [739be429] + MbedTLS v1.1.10
  [4d8831e6] + OpenSSL v1.6.1
  [bac558e1] + OrderedCollections v2.0.0
  [aea7be01] + PrecompileTools v1.3.4
  [21216c6a] + Preferences v1.5.2
  [777ac1f9] + SimpleBufferStream v1.2.0
  [3bb67fe8] + TranscodingStreams v0.11.3
  [5c2747f8] + URIs v1.6.1
  [228000da] + XMLDict v0.4.2
  [94ce4f54] + Libiconv_jll v1.18.0+0
  [c8ffd9c3] + MbedTLS_jll v2.28.1010+0
  [02c8fc9c] + XML2_jll v2.15.3+0
  [0dad84c5] + ArgTools v1.2.0
  [56f22d72] + Artifacts v1.11.0
  [2a0f44e3] + Base64 v1.11.0
  [ade2ca70] + Dates v1.11.0
  [f43a241f] + Downloads v1.7.0
  [7b1f6079] + FileWatching v1.11.0
  [b77e0a4c] + InteractiveUtils v1.11.0
  [ac6e5ff7] + JuliaSyntaxHighlighting v1.13.0
  [b27032c2] + LibCURL v1.0.0
  [8f399da3] + Libdl v1.11.0
  [56ddb016] + Logging v1.11.0
  [d6f4376e] + Markdown v1.11.0
  [ca575930] + NetworkOptions v1.3.0
  [de0858da] + Printf v1.11.0
  [9a3f8284] + Random v1.11.0
  [ea8e919c] + SHA v1.13.0
  [9e88b42a] + Serialization v1.11.0
  [6462fe0b] + Sockets v1.11.0
  [f489334b] + StyledStrings v1.13.0
  [fa267f1f] + TOML v1.0.3
  [8dfed614] + Test v1.11.0
  [cf7118a7] + UUIDs v1.11.0
  [4ec0a83e] + Unicode v1.11.0
  [e66e0078] + CompilerSupportLibraries_jll v1.5.5+0
  [deac9b47] + LibCURL_jll v8.20.0+1
  [29816b5a] + LibSSH2_jll v1.11.101+0
  [14a3606d] + MozillaCACerts_jll v2026.5.14
  [458c3c95] + OpenSSL_jll v3.5.7+0
  [83775a58] + Zlib_jll v1.3.2+0
  [3161d3a3] + Zstd_jll v1.5.7+1
  [8e850ede] + nghttp2_jll v1.69.0+0
        Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m`

Installation completed after 5.45s


################################################################################
# Precompilation
#

Precompiling PkgEval dependencies...

┌ Warning: Could not use exact versions of packages in manifest, re-resolving
└ @ TestEnv ~/.julia/packages/TestEnv/RUPmD/src/julia-1.13/activate_set.jl:78
Precompiling package dependencies...
Precompiling project...
   1.9 s  ✓ XML2_jll
   2.0 s  ✓ EzXML
   1.2 s  ✓ XMLDict
   3.9 s  ✓ Arxiv
   8.3 s  ✓ Arxiv → ArxivTermExt
  5 dependencies successfully precompiled in 18 seconds. 58 already precompiled.

Precompilation completed after 47.59s


################################################################################
# Testing
#

     Testing Arxiv
        Test Could not use exact versions of packages in manifest, re-resolving. Note: if you do not check your manifest file into source control, then you can probably ignore this message. However, if you do check your manifest file into source control, then you probably want to pass the `allow_reresolve = false` kwarg when calling the `Pkg.test` function.
    Updating `/tmp/jl_7d7DEV/Project.toml`
  [95bf46a4] + Arxiv v0.1.0
  [22787eb5] + Term v2.0.8
    Updating `/tmp/jl_7d7DEV/Manifest.toml`
  [1520ce14] + AbstractTrees v0.4.5
  [95bf46a4] + Arxiv v0.1.0
  [da1fd8a2] + CodeTracking v3.0.2
  [9a962f9c] + DataAPI v1.16.0
  [e2d170a0] + DataValueInterfaces v1.0.0
  [ffbed154] + DocStringExtensions v0.9.5
⌅ [eafb193a] + Highlights v0.5.3
  [82899510] + IteratorInterfaceExtensions v1.0.0
  [1c23619d] + MyterialColors v0.3.0
⌅ [bac558e1] ↓ OrderedCollections v2.0.0 ⇒ v1.8.2
⌅ [d96e819e] + Parameters v0.12.3
  [33c8b6b6] + ProgressLogging v0.1.6
  [3783bdb8] + TableTraits v1.0.1
  [bd369af6] + Tables v1.12.1
  [22787eb5] + Term v2.0.8
  [3a884ed6] + UnPack v1.0.2
  [1cfade01] + UnicodeFun v0.4.1
  [3fa0cd96] + REPL v1.11.0
        Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m`
        Test Successfully re-resolved
      Status `/tmp/jl_7d7DEV/Project.toml`
  [95bf46a4] Arxiv v0.1.0
⌅ [cd3eb016] HTTP v1.11.0
  [22787eb5] Term v2.0.8
  [5c2747f8] URIs v1.6.1
  [228000da] XMLDict v0.4.2
  [ade2ca70] Dates v1.11.0
  [f43a241f] Downloads v1.7.0
  [8dfed614] Test v1.11.0
      Status `/tmp/jl_7d7DEV/Manifest.toml`
  [1520ce14] AbstractTrees v0.4.5
  [95bf46a4] Arxiv v0.1.0
  [d1d4a3ce] BitFlags v0.1.10
  [da1fd8a2] CodeTracking v3.0.2
  [944b1d66] CodecZlib v0.7.8
  [f0e56b4a] ConcurrentUtilities v2.5.1
  [9a962f9c] DataAPI v1.16.0
  [e2d170a0] DataValueInterfaces v1.0.0
  [ffbed154] DocStringExtensions v0.9.5
  [460bff9d] ExceptionUnwrapping v0.1.11
  [8f5d6c58] EzXML v1.2.3
⌅ [cd3eb016] HTTP v1.11.0
⌅ [eafb193a] Highlights v0.5.3
  [c8e1da08] IterTools v1.10.0
  [82899510] IteratorInterfaceExtensions v1.0.0
  [692b3bcd] JLLWrappers v1.8.0
  [e6f89c97] LoggingExtras v1.2.0
  [739be429] MbedTLS v1.1.10
  [1c23619d] MyterialColors v0.3.0
  [4d8831e6] OpenSSL v1.6.1
⌅ [bac558e1] OrderedCollections v1.8.2
⌅ [d96e819e] Parameters v0.12.3
  [aea7be01] PrecompileTools v1.3.4
  [21216c6a] Preferences v1.5.2
  [33c8b6b6] ProgressLogging v0.1.6
  [777ac1f9] SimpleBufferStream v1.2.0
  [3783bdb8] TableTraits v1.0.1
  [bd369af6] Tables v1.12.1
  [22787eb5] Term v2.0.8
  [3bb67fe8] TranscodingStreams v0.11.3
  [5c2747f8] URIs v1.6.1
  [3a884ed6] UnPack v1.0.2
  [1cfade01] UnicodeFun v0.4.1
  [228000da] XMLDict v0.4.2
  [94ce4f54] Libiconv_jll v1.18.0+0
  [c8ffd9c3] MbedTLS_jll v2.28.1010+0
  [02c8fc9c] XML2_jll v2.15.3+0
  [0dad84c5] ArgTools v1.2.0
  [56f22d72] Artifacts v1.11.0
  [2a0f44e3] Base64 v1.11.0
  [ade2ca70] Dates v1.11.0
  [f43a241f] Downloads v1.7.0
  [7b1f6079] FileWatching v1.11.0
  [b77e0a4c] InteractiveUtils v1.11.0
  [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0
  [b27032c2] LibCURL v1.0.0
  [8f399da3] Libdl v1.11.0
  [56ddb016] Logging v1.11.0
  [d6f4376e] Markdown v1.11.0
  [ca575930] NetworkOptions v1.3.0
  [de0858da] Printf v1.11.0
  [3fa0cd96] REPL v1.11.0
  [9a3f8284] Random v1.11.0
  [ea8e919c] SHA v1.13.0
  [9e88b42a] Serialization v1.11.0
  [6462fe0b] Sockets v1.11.0
  [f489334b] StyledStrings v1.13.0
  [fa267f1f] TOML v1.0.3
  [8dfed614] Test v1.11.0
  [cf7118a7] UUIDs v1.11.0
  [4ec0a83e] Unicode v1.11.0
  [e66e0078] CompilerSupportLibraries_jll v1.5.5+0
  [deac9b47] LibCURL_jll v8.20.0+1
  [29816b5a] LibSSH2_jll v1.11.101+0
  [14a3606d] MozillaCACerts_jll v2026.5.14
  [458c3c95] OpenSSL_jll v3.5.7+0
  [83775a58] Zlib_jll v1.3.2+0
  [3161d3a3] Zstd_jll v1.5.7+1
  [8e850ede] nghttp2_jll v1.69.0+0
        Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading.
     Testing Running tests...

paper: Test Failed at /home/pkgeval/.julia/packages/Arxiv/rWcc1/test/runtests.jl:54
  Expression: startswith(string(p.link_pdf), "http://arxiv.org/pdf/2303.17626")
   Evaluated: startswith("https://arxiv.org/pdf/2303.17626v1", "http://arxiv.org/pdf/2303.17626")
  Stacktrace:
   [1] top-level scope
     @ ~/.julia/packages/Arxiv/rWcc1/test/runtests.jl:9
   [2] macro expansion
     @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined]
   [3] macro expansion
     @ ~/.julia/packages/Arxiv/rWcc1/test/runtests.jl:45 [inlined]
   [4] macro expansion
     @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined]
   [5] macro expansion
     @ ~/.julia/packages/Arxiv/rWcc1/test/runtests.jl:54 [inlined]
   [6] macro expansion
     @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:784 [inlined]
Test Summary: | Pass  Fail  Total   Time
Arxiv.jl      |   32     1     33  35.0s
  id          |   22           22   1.3s
  paper       |   10     1     11  33.7s
RNG of the outermost testset: Random.Xoshiro(0x6092cc662a0da7c9, 0xb5c373a86e49e617, 0x4da1f6ec7584f862, 0xeca3bf85ac0240a5, 0x7e8136a57493f87b)
ERROR: LoadError: Some tests did not pass: 32 passed, 1 failed, 0 errored, 0 broken.
in expression starting at /home/pkgeval/.julia/packages/Arxiv/rWcc1/test/runtests.jl:8

Testing failed after 52.96s

ERROR: LoadError: Package Arxiv errored during testing
Stacktrace:
  [1] pkgerror(msg::String)
    @ Pkg.Types /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Types.jl:68
  [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool)
    @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:3247
  [3] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}})
    @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:587
  [4] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd})
    @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:172
  [5] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd})
    @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160
  [6] test(pkg::String; kwargs::@Kwargs{julia_args::Cmd})
    @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:159 [inlined]
  [7] top-level scope
    @ /PkgEval.jl/scripts/evaluate.jl:223
  [8] include(mod::Module, _path::String)
    @ Base Base.jl:325
  [9] exec_options(opts::Base.JLOptions)
    @ Base client.jl:355
 [10] _start()
    @ Base client.jl:596
in expression starting at /PkgEval.jl/scripts/evaluate.jl:214

PkgEval failed after 139.94s: package has test failures