Package evaluation of Franklin on Julia 1.11.4 (a71dd056e0*) started at 2025-04-08T11:52:15.327 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 8.95s ################################################################################ # Installation # Installing Franklin... Resolving package versions... Updating `~/.julia/environments/v1.11/Project.toml` [713c75ef] + Franklin v0.10.95 Updating `~/.julia/environments/v1.11/Manifest.toml` [d1d4a3ce] + BitFlags v0.1.9 [944b1d66] + CodecZlib v0.7.8 [f0e56b4a] + ConcurrentUtilities v2.5.0 [8bb1440f] + DelimitedFiles v1.9.1 [ffbed154] + DocStringExtensions v0.9.4 [460bff9d] + ExceptionUnwrapping v0.1.11 [e2ba6199] + ExprTools v0.1.10 [713c75ef] + Franklin v0.10.95 [3a985190] + FranklinTemplates v0.10.2 [cd3eb016] + HTTP v1.10.15 [b5f81e59] + IOCapture v0.2.5 [692b3bcd] + JLLWrappers v1.7.0 [682c06a0] + JSON v0.21.4 [98b081ad] + Literate v2.20.1 [16fef848] + LiveServer v1.5.0 [e6f89c97] + LoggingExtras v1.1.0 ⌅ [6c6e2e6c] + MIMEs v0.1.4 [739be429] + MbedTLS v1.1.9 [2bd173c7] + NodeJS v2.0.0 [4d8831e6] + OpenSSL v1.4.3 [bac558e1] + OrderedCollections v1.8.0 [69de0a69] + Parsers v2.8.1 ⌅ [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [777ac1f9] + SimpleBufferStream v1.2.0 [3bb67fe8] + TranscodingStreams v0.11.3 [5c2747f8] + URIs v1.5.2 [458c3c95] + OpenSSL_jll v3.0.16+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [3fa0cd96] + REPL v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [83775a58] + Zlib_jll v1.2.13+1 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 2.1s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 48.28s ################################################################################ # Testing # Testing Franklin Status `/tmp/jl_zWaxyQ/Project.toml` [a93c6f00] DataFrames v1.7.0 [864edb3b] DataStructures v0.18.22 [8bb1440f] DelimitedFiles v1.9.1 [ffbed154] DocStringExtensions v0.9.4 [e2ba6199] ExprTools v0.1.10 [713c75ef] Franklin v0.10.95 [3a985190] FranklinTemplates v0.10.2 [cd3eb016] HTTP v1.10.15 [98b081ad] Literate v2.20.1 [16fef848] LiveServer v1.5.0 [2bd173c7] NodeJS v2.0.0 [bac558e1] OrderedCollections v1.8.0 [fd094767] Suppressor v0.2.8 [ade2ca70] Dates v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [44cfe95a] Pkg v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [fa267f1f] TOML v1.0.3 [8dfed614] Test v1.11.0 Status `/tmp/jl_zWaxyQ/Manifest.toml` [d1d4a3ce] BitFlags v0.1.9 [944b1d66] CodecZlib v0.7.8 [34da2185] Compat v4.16.0 [f0e56b4a] ConcurrentUtilities v2.5.0 [a8cc5b0e] Crayons v4.1.1 [9a962f9c] DataAPI v1.16.0 [a93c6f00] DataFrames v1.7.0 [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [8bb1440f] DelimitedFiles v1.9.1 [ffbed154] DocStringExtensions v0.9.4 [460bff9d] ExceptionUnwrapping v0.1.11 [e2ba6199] ExprTools v0.1.10 [713c75ef] Franklin v0.10.95 [3a985190] FranklinTemplates v0.10.2 [cd3eb016] HTTP v1.10.15 [b5f81e59] IOCapture v0.2.5 [842dd82b] InlineStrings v1.4.3 [41ab1584] InvertedIndices v1.3.1 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.0 [682c06a0] JSON v0.21.4 [b964fa9f] LaTeXStrings v1.4.0 [98b081ad] Literate v2.20.1 [16fef848] LiveServer v1.5.0 [e6f89c97] LoggingExtras v1.1.0 ⌅ [6c6e2e6c] MIMEs v0.1.4 [739be429] MbedTLS v1.1.9 [e1d29d7a] Missings v1.2.0 [2bd173c7] NodeJS v2.0.0 [4d8831e6] OpenSSL v1.4.3 [bac558e1] OrderedCollections v1.8.0 [69de0a69] Parsers v2.8.1 [2dfb63ee] PooledArrays v1.4.3 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [08abe8d2] PrettyTables v2.4.0 [189a3867] Reexport v1.2.2 [91c51154] SentinelArrays v1.4.8 [777ac1f9] SimpleBufferStream v1.2.0 [a2af1166] SortingAlgorithms v1.2.1 [10745b16] Statistics v1.11.1 [892a3eda] StringManipulation v0.4.1 [fd094767] Suppressor v0.2.8 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.0 [3bb67fe8] TranscodingStreams v0.11.3 [5c2747f8] URIs v1.5.2 [458c3c95] OpenSSL_jll v3.0.16+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... UTILS-1 Test Summary: | Pass Total Time set_paths! | 10 10 1.8s Test Summary: | Pass Total Time outp_path | 10 10 1.2s Test Summary: | Pass Total Time Set vars | 4 4 1.6s Test Summary: | Pass Total Time Def+coms | 2 2 28.0s Resolving package versions... No Changes to `/tmp/jl_zWaxyQ/Project.toml` No Changes to `/tmp/jl_zWaxyQ/Manifest.toml` Resolving package versions... No Changes to `/tmp/jl_zWaxyQ/Project.toml` No Changes to `/tmp/jl_zWaxyQ/Manifest.toml` UTILS-2 Test Summary: | Pass Total Time strings | 7 7 0.0s Test Summary: | Pass Total Time ocblock | 2 2 0.1s Test Summary: | Pass Total Time isexactly | 18 18 0.3s Test Summary: | Pass Total Time timeittook | 1 1 0.8s Test Summary: | Pass Total Time refstring | 8 8 0.0s Test Summary: | Pass Total Time misc-html | 8 8 0.4s Test Summary: | Pass Total Time misc-html 2 | 4 4 0.1s Test Summary: | Pass Total Time match_url | 8 8 0.2s Test Summary: | Pass Total Time check_type | 7 7 0.0s Test Summary: | Pass Total Time Date locales | 4 4 13.7s Test Summary: | Pass Total Time dict-inv | 5 5 1.0s Test Summary: | Pass Total Time get_url | 6 6 0.6s Test Summary: | Pass Total Time fd2html#489 | 1 1 0.0s Test Summary: | Pass Total Time context | 6 6 0.9s Test Summary: | Pass Total Time show | 2 2 0.1s Test Summary: | Pass Total Time ocbe | 1 1 0.0s Test Summary: | Pass Total Time lxbe | 7 7 0.1s Test Summary: | Pass Total Time Unfound | 1 1 0.2s Test Summary: | Pass Total Time H-For | 4 4 0.7s Test Summary: | Pass Total Time HToc | 2 2 1.2s Test Summary: | Pass Total Time warn-pv | 3 3 0.2s Test Summary: | Pass Total Time warn-config | 2 2 0.1s Test Summary: | Pass Total Time warn-paginate | 10 10 16.8s Test Summary: | Pass Total Time misc-html | 3 3 0.0s Test Summary: | Pass Total Time misc-html 2 | 4 4 0.0s Test Summary: | Pass Total Time html/hide | 3 3 0.0s Test Summary: | Pass Total Time html_code | 1 1 0.0s Test Summary: | Pass Total Time html_content | 1 1 0.0s Test Summary: | Pass Total Time fd2text | 1 1 0.6s Test Summary: | Pass Total Time latex | 9 9 0.0s Test Summary: | Pass Total Time assign | 2 2 0.0s Test Summary: | Pass Total Time esclink | 13 13 0.0s Test Summary: | Pass Total Time fndef | 1 1 0.0s Test Summary: | Pass Total Time html-ent | 12 12 0.0s Test Summary: | Pass Total Time code | 14 14 0.0s Test Summary: | Pass Total Time hb-if | 6 6 0.0s Test Summary: | Pass Total Time hb-else | 4 4 0.0s Test Summary: | Pass Total Time hb-elseif | 6 6 0.0s Test Summary: | Pass Total Time hb-end | 4 4 0.0s Test Summary: | Pass Total Time hb-isdef | 8 8 0.0s Test Summary: | Pass Total Time hb-isndef | 8 8 0.0s Test Summary: | Pass Total Time hb-ispage | 2 2 0.0s Test Summary: | Pass Total Time hb-isnotpage | 2 2 0.0s Test Summary: | Pass Total Time hb-for | 9 9 0.0s Test Summary: | Pass Total Time hb-fun-0 | 6 6 0.0s Test Summary: | Pass Total Time hb-fun-1 | 6 6 0.0s Test Summary: | Pass Total Time hb-fun-2 | 4 4 0.0s Test Summary: | Pass Total Time ch-for | 5 5 0.0s Test Summary: | Pass Total Time fix_links | 1 1 0.0s 🍺 MANAGER Test Summary: | Pass Total Time Prep outdir | 3 3 0.0s 🐝 Testing file tracking...: tracking new file 'blah.md'. tracking new file 'config.md'. tracking new file 'index.html'. tracking new file 'index.md'. tracking new file 'temp.html'. tracking new file 'temp.rnd'. tracking new file 'temp.css'. tracking new file 'foo.js'. Test Summary: | Pass Total Time Scan dir | 4 4 0.2s Test Summary: | Pass Total Time Config+write | 3 3 0.0s Test Summary: | Pass Total Time Part convert | 4 4 0.1s 🐝 Testing error message...: Test Summary: | Pass Total Time Err procfile | 1 1 0.0s Test Summary: | Pass Total Time config | 6 6 0.2s Test Summary: | Pass Total Time i381 | 1 1 0.7s Test Summary: | Pass Total Time ignore/fs2 | 3 3 2.5s Test Summary: | Pass Total Time coverage | 10 10 0.1s → Initial full pass... Test Summary: | Pass Total Time Scope (#412) | 2 2 0.1s → Initial full pass... → Initial full pass... Test Summary: | Pass Total Time Paginate | 12 12 0.7s Test Summary: | Pass Total Time robots | 1 1 0.0s Test Summary: | Pass Total Time rss_prep | 4 4 0.1s 🍺 PARSER/MD+LX Test Summary: | Pass Total Time P:1:find-tok | 21 21 0.1s Test Summary: | Pass Total Time P:1:ctok | 13 13 0.0s Test Summary: | Pass Total Time P:1:val-fn | 3 3 0.0s Test Summary: | Pass Total Time P:1:val-hd | 6 6 0.1s Test Summary: | Pass Total Time P:1:fib | 22 22 1.0s Test Summary: | Pass Total Time P:2:blk | 5 5 0.3s Test Summary: | Pass Total Time P:2:blk-ind | 7 7 0.0s Test Summary: | Pass Total Time P:2:blk-indF | 7 7 0.1s Test Summary: | Pass Total Time More ind | 1 1 0.0s Test Summary: | Pass Total Time P:2:blk-{} | 4 4 0.0s Test Summary: | Pass Total Time P:2:blk-[] | 6 6 0.0s Test Summary: | Pass Total Time Find Tokens | 6 6 0.0s Test Summary: | Pass Total Time Find blocks | 8 8 2.6s Test Summary: | Pass Total Time Unicode lx | 4 4 1.3s Test Summary: | Pass Total Time Header blocks | 8 8 0.1s Test Summary: | Pass Total Time Line skip | 1 1 0.0s Test Summary: | Pass Total Time Header+lx | 5 5 0.3s Test Summary: | Pass Total Time Bold x* | 2 2 0.1s Test Summary: | Pass Total Time Bold code | 1 1 0.0s Test Summary: | Pass Total Time Tickssss | 16 16 0.0s Test Summary: | Pass Total Time Nested ind | 3 3 0.0s Test Summary: | Pass Total Time Double brace | 2 2 0.0s Test Summary: | Pass Total Time Double brace2 | 1 1 0.1s Test Summary: | Pass Total Time Hz rule | 4 4 0.5s Test Summary: | Pass Total Time mathunicode | 1 1 0.5s Test Summary: | Pass Total Time emoji-basics | 6 6 0.1s Test Summary: | Pass Total Time quad-backticks | 1 1 0.0s Test Summary: | Pass Total Time footnotes | 2 2 0.0s Test Summary: | Pass Total Time Fn in code | 1 1 0.7s Test Summary: | Pass Total Time lx++1 | 1 1 0.0s Test Summary: | Pass Total Time indentation | 11 11 0.1s Test Summary: | Pass Total Time ind+lx | 1 1 0.0s Test Summary: | Pass Total Time Bad cases | 3 3 0.8s Test Summary: | Pass Total Time Script | 1 1 0.0s Test Summary: | Pass Total Time div-dbb | 4 4 0.1s Test Summary: | Pass Total Time iss#502 | 1 1 0.0s 🍺 EVAL Test Summary: | Pass Total Time utils | 10 10 0.1s parse_code: Test Failed at /home/pkgeval/.julia/packages/Franklin/R3VpM/test/eval/run.jl:18 Expression: (exs[2]).args[1] == "incomplete: premature end of input" Evaluated: Base.Meta.ParseError("ParseError:\n# Error @ none:1:15\nf = foo(a = 3\n# \n└ ── Expected `)`", Base.JuliaSyntax.ParseError(Base.JuliaSyntax.SourceFile("f = foo(a = 3\n", 6, "none", 1, [1, 15]), Base.JuliaSyntax.Diagnostic[Base.JuliaSyntax.Diagnostic(21, 20, :error, "Expected `)`")], :other)) == "incomplete: premature end of input" Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/Franklin/R3VpM/test/eval/run.jl:18 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] top-level scope @ ~/.julia/packages/Franklin/R3VpM/test/eval/run.jl:2 Test Summary: | Pass Fail Total Time parse_code | 6 1 7 4.9s ERROR: LoadError: Some tests did not pass: 6 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/Franklin/R3VpM/test/eval/run.jl:1 in expression starting at /home/pkgeval/.julia/packages/Franklin/R3VpM/test/runtests.jl:53 Testing failed after 125.3s ERROR: LoadError: Package Franklin errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:2124 [3] test @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:2007 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:481 [5] test(pkgs::Vector{Pkg.Types.PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:159 [6] test @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:147 [inlined] [7] #test#74 @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:146 [inlined] [8] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 197.49s: package has test failures