Package evaluation of ForwardDiffPullbacks on Julia 1.13.0-DEV.888 (0e1aa6c7eb*) started at 2025-07-22T15:08:43.521 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 9.38s ################################################################################ # Installation # Installing ForwardDiffPullbacks... Resolving package versions... Updating `~/.julia/environments/v1.13/Project.toml` [450a3b6d] + ForwardDiffPullbacks v0.2.7 Updating `~/.julia/environments/v1.13/Manifest.toml` [d360d2e6] + ChainRulesCore v1.25.2 [bbf7d656] + CommonSubexpressions v0.3.1 [f70d9fcc] + CommonWorldInvalidations v1.0.0 [34da2185] + Compat v4.17.0 [187b0558] + ConstructionBase v1.6.0 [163ba53b] + DiffResults v1.1.0 [b552c78f] + DiffRules v1.15.1 [ffbed154] + DocStringExtensions v0.9.5 [f6369f11] + ForwardDiff v1.0.1 [450a3b6d] + ForwardDiffPullbacks v0.2.7 [615f187c] + IfElse v0.1.1 [92d709cd] + IrrationalConstants v0.2.4 [692b3bcd] + JLLWrappers v1.7.0 [2ab3a3ac] + LogExpFunctions v0.3.29 [1914dd2f] + MacroTools v0.5.16 [77ba4419] + NaNMath v1.1.3 [aea7be01] + PrecompileTools v1.3.2 [21216c6a] + Preferences v1.4.3 [276daf66] + SpecialFunctions v2.5.1 [aedffcd0] + Static v1.2.0 [90137ffa] + StaticArrays v1.9.14 [1e83bf80] + StaticArraysCore v1.4.3 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [56f22d72] + Artifacts v1.11.0 [ade2ca70] + Dates v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.13.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [fa267f1f] + TOML v1.0.3 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [4536629a] + OpenBLAS_jll v0.3.29+0 [05823500] + OpenLibm_jll v0.8.5+0 [8e850b90] + libblastrampoline_jll v5.13.1+0 Installation completed after 4.43s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 27.93s ################################################################################ # Testing # Testing ForwardDiffPullbacks Status `/tmp/jl_5xT62s/Project.toml` [4c88cf16] Aqua v0.8.13 [d360d2e6] ChainRulesCore v1.25.2 [cdddcdb0] ChainRulesTestUtils v1.13.0 [31c24e10] Distributions v0.25.120 [e30172f5] Documenter v1.14.1 [f6369f11] ForwardDiff v1.0.1 [450a3b6d] ForwardDiffPullbacks v0.2.7 [90137ffa] StaticArrays v1.9.14 [e88e6eb3] Zygote v0.7.10 [37e2e46d] LinearAlgebra v1.13.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_5xT62s/Manifest.toml` [a4c015fc] ANSIColoredPrinters v0.0.1 [621f4979] AbstractFFTs v1.5.0 [1520ce14] AbstractTrees v0.4.5 [79e6a3ab] Adapt v4.3.0 [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.13 [082447d4] ChainRules v1.72.5 [d360d2e6] ChainRulesCore v1.25.2 [cdddcdb0] ChainRulesTestUtils v1.13.0 [944b1d66] CodecZlib v0.7.8 [bbf7d656] CommonSubexpressions v0.3.1 [f70d9fcc] CommonWorldInvalidations v1.0.0 [34da2185] Compat v4.17.0 [187b0558] ConstructionBase v1.6.0 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [163ba53b] DiffResults v1.1.0 [b552c78f] DiffRules v1.15.1 [31c24e10] Distributions v0.25.120 [ffbed154] DocStringExtensions v0.9.5 [e30172f5] Documenter v1.14.1 [1a297f60] FillArrays v1.13.0 [26cc04aa] FiniteDifferences v0.12.32 [f6369f11] ForwardDiff v1.0.1 [450a3b6d] ForwardDiffPullbacks v0.2.7 [46192b85] GPUArraysCore v0.2.0 [d7ba0133] Git v1.4.0 [34004b35] HypergeometricFunctions v0.3.28 [b5f81e59] IOCapture v0.2.5 [7869d1d1] IRTools v0.4.15 [615f187c] IfElse v0.1.1 [92d709cd] IrrationalConstants v0.2.4 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.0 [682c06a0] JSON v0.21.4 [0e77f7df] LazilyInitializedFields v1.3.0 [2ab3a3ac] LogExpFunctions v0.3.29 [1914dd2f] MacroTools v0.5.16 [d0879d2d] MarkdownAST v0.1.2 [e1d29d7a] Missings v1.2.0 [77ba4419] NaNMath v1.1.3 [bac558e1] OrderedCollections v1.8.1 [90014a1f] PDMats v0.11.35 [69de0a69] Parsers v2.8.3 [aea7be01] PrecompileTools v1.3.2 [21216c6a] Preferences v1.4.3 [43287f4e] PtrArrays v1.3.0 [1fd47b50] QuadGK v2.11.2 [c1ae055f] RealDot v0.1.0 [189a3867] Reexport v1.2.2 [2792f1a3] RegistryInstances v0.1.0 [ae029012] Requires v1.3.1 [708f8203] Richardson v1.4.2 [79098fc4] Rmath v0.8.0 [a2af1166] SortingAlgorithms v1.2.1 [dc90abb0] SparseInverseSubset v0.1.2 [276daf66] SpecialFunctions v2.5.1 [aedffcd0] Static v1.2.0 [90137ffa] StaticArrays v1.9.14 [1e83bf80] StaticArraysCore v1.4.3 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.7.1 [2913bbd2] StatsBase v0.34.5 [4c63d2b9] StatsFuns v1.5.0 [09ab397b] StructArrays v0.7.1 [fd094767] Suppressor v0.2.8 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.1 [3bb67fe8] TranscodingStreams v0.11.3 [e88e6eb3] Zygote v0.7.10 [700de1a5] ZygoteRules v0.2.7 [2e619515] Expat_jll v2.6.5+0 [f8c6e375] Git_jll v2.50.1+0 [94ce4f54] Libiconv_jll v1.18.0+0 [9bd350c2] OpenSSH_jll v10.0.1+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [f50d1b31] Rmath_jll v0.5.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.13.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.13.0 [f489334b] StyledStrings v1.11.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.7.15 [4536629a] OpenBLAS_jll v0.3.29+0 [05823500] OpenLibm_jll v0.8.5+0 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [83775a58] Zlib_jll v1.3.1+2 [8e850b90] libblastrampoline_jll v5.13.1+0 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Testing Running tests... Precompiling packages... 5808.3 ms ✓ ForwardDiffPullbacks 1 dependency successfully precompiled in 6 seconds. 35 already precompiled. ┌ Warning: inference tests have been disabled └ @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/global_config.jl:13 WARNING: Method definition sum_pow2(Any) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:9 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition sum_pow3(Any) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:10 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition f_loss_1(Any...) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:19 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition f_loss_3(Any...) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:25 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition f_loss_3z(Any...) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:31 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition const_foo(Any, Any...) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:38 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition scalar_foo(Any, Any...) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:40 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition nt_foo(Any, Any...) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:45 overwritten on the same line (check for duplicate calls to `include`). test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)}(Main.const_foo) on Float64: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 Test threw exception Expression: isapprox(actual, expected; kwargs...) Problem: Failed primal value check UndefVarError: `eval_test_function` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] test_approx(actual::Union{Number, AbstractArray{<:Number}}, expected::Union{Number, AbstractArray{<:Number}}, msg::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 [3] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:216 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [6] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [7] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [8] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [9] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [11] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:18 [inlined] [12] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [13] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [15] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [16] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [17] top-level scope @ none:6 [18] eval(m::Module, e::Any) @ Core ./boot.jl:489 [19] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [20] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)}(Main.const_foo) on Float64: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:222 Test threw exception Expression: ad_cotangents isa Tuple Problem: The pullback must return a Tuple (∂self, ∂args...) UndefVarError: `eval_test_comparison` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:222 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [4] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [5] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [6] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [7] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [8] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [10] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:18 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [12] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [14] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [19] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)}(Main.const_foo) on Float64: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:226 Test threw exception Expression: length(ad_cotangents) == length(primals) Problem: The pullback should return 1 cotangent for the primal and each primal input. UndefVarError: `eval_test_comparison` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:226 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [4] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [5] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [6] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [7] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [8] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [10] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:18 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [12] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [14] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [19] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)}(Main.const_foo) on Float64: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 Test threw exception Expression: isapprox(actual, expected; kwargs...) Problem: cotangent for input 2, Float64 UndefVarError: `eval_test_function` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] test_approx(actual::Union{Number, AbstractArray{<:Number}}, expected::Union{Number, AbstractArray{<:Number}}, msg::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 [3] test_approx @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:18 [inlined] [4] test_approx @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:42 [inlined] [5] #test_approx#14 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:38 [inlined] [6] test_approx @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:37 [inlined] [7] #_test_cotangent#74 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:312 [inlined] [8] _test_cotangent @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:301 [inlined] [9] #66 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:236 [inlined] [10] #foreach##2 @ ./tuple.jl:680 [inlined] [11] BottomRF @ ./reduce.jl:84 [inlined] [12] _foldl_impl @ ./reduce.jl:60 [inlined] [13] foldl_impl @ ./reduce.jl:46 [inlined] [14] mapfoldl_impl(f::typeof(identity), op::Base.var"#foreach##2#foreach##3"{ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}}, nt::Nothing, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, Float64}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(const_foo), Tuple{Float64}, 1, Float64}}, Tuple{NoTangent, Float64}, Tuple{String, String}}}) @ Base ./reduce.jl:42 [15] mapfoldl(f::Function, op::Function, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, Float64}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(const_foo), Tuple{Float64}, 1, Float64}}, Tuple{NoTangent, Float64}, Tuple{String, String}}}; init::Nothing) @ Base ./reduce.jl:173 [16] mapfoldl @ ./reduce.jl:173 [inlined] [17] #foldl#276 @ ./reduce.jl:196 [inlined] [18] foreach(::ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}, ::Tuple{NoTangent, Float64}, ::Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(const_foo), Tuple{Float64}, 1, Float64}}, ::Vararg{Tuple}) @ Base ./tuple.jl:680 [19] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:235 [inlined] [20] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [21] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [22] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [23] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [24] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [25] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [26] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [27] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:18 [inlined] [28] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [29] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [30] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [31] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [32] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [33] top-level scope @ none:6 [34] eval(m::Module, e::Any) @ Core ./boot.jl:489 [35] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [36] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)}(Main.const_foo) on Float64: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 Test threw exception Expression: isapprox(actual, expected; kwargs...) Problem: in add!! UndefVarError: `eval_test_function` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] test_approx(actual::Union{Number, AbstractArray{<:Number}}, expected::Union{Number, AbstractArray{<:Number}}, msg::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 [3] test_approx @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:18 [inlined] [4] #_test_add!!_behaviour#43 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:188 [inlined] [5] _test_add!!_behaviour @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:183 [inlined] [6] #_test_cotangent#74 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:313 [inlined] [7] _test_cotangent @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:301 [inlined] [8] #66 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:236 [inlined] [9] #foreach##2 @ ./tuple.jl:680 [inlined] [10] BottomRF @ ./reduce.jl:84 [inlined] [11] _foldl_impl @ ./reduce.jl:60 [inlined] [12] foldl_impl @ ./reduce.jl:46 [inlined] [13] mapfoldl_impl(f::typeof(identity), op::Base.var"#foreach##2#foreach##3"{ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}}, nt::Nothing, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, Float64}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(const_foo), Tuple{Float64}, 1, Float64}}, Tuple{NoTangent, Float64}, Tuple{String, String}}}) @ Base ./reduce.jl:42 [14] mapfoldl(f::Function, op::Function, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, Float64}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(const_foo), Tuple{Float64}, 1, Float64}}, Tuple{NoTangent, Float64}, Tuple{String, String}}}; init::Nothing) @ Base ./reduce.jl:173 [15] mapfoldl @ ./reduce.jl:173 [inlined] [16] #foldl#276 @ ./reduce.jl:196 [inlined] [17] foreach(::ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}, ::Tuple{NoTangent, Float64}, ::Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(const_foo), Tuple{Float64}, 1, Float64}}, ::Vararg{Tuple}) @ Base ./tuple.jl:680 [18] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:235 [inlined] [19] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [20] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [21] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [22] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [23] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [24] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [25] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [26] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:18 [inlined] [27] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [28] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [29] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [30] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [31] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [32] top-level scope @ none:6 [33] eval(m::Module, e::Any) @ Core ./boot.jl:489 [34] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [35] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)}(Main.const_foo) on SVector{3, Float64}: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 Test threw exception Expression: isapprox(actual, expected; kwargs...) Problem: Failed primal value check UndefVarError: `eval_test_function` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] test_approx(actual::Union{Number, AbstractArray{<:Number}}, expected::Union{Number, AbstractArray{<:Number}}, msg::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 [3] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:216 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [6] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [7] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [8] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [9] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [11] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:20 [inlined] [12] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [13] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [15] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [16] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [17] top-level scope @ none:6 [18] eval(m::Module, e::Any) @ Core ./boot.jl:489 [19] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [20] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)}(Main.const_foo) on SVector{3, Float64}: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:222 Test threw exception Expression: ad_cotangents isa Tuple Problem: The pullback must return a Tuple (∂self, ∂args...) UndefVarError: `eval_test_comparison` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:222 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [4] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [5] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [6] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [7] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [8] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [10] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:20 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [12] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [14] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [19] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)}(Main.const_foo) on SVector{3, Float64}: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:226 Test threw exception Expression: length(ad_cotangents) == length(primals) Problem: The pullback should return 1 cotangent for the primal and each primal input. UndefVarError: `eval_test_comparison` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:226 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [4] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [5] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [6] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [7] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [8] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [10] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:20 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [12] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [14] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [19] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)}(Main.const_foo) on SVector{3, Float64}: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 Test threw exception Expression: isapprox(actual, expected; kwargs...) Problem: cotangent for input 2, 3-element SVector{3, Float64} with indices SOneTo(3) UndefVarError: `eval_test_function` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] test_approx(actual::Union{Number, AbstractArray{<:Number}}, expected::Union{Number, AbstractArray{<:Number}}, msg::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 [3] test_approx @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:18 [inlined] [4] test_approx @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:42 [inlined] [5] #test_approx#14 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:38 [inlined] [6] test_approx @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:37 [inlined] [7] #_test_cotangent#74 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:312 [inlined] [8] _test_cotangent @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:301 [inlined] [9] #66 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:236 [inlined] [10] #foreach##2 @ ./tuple.jl:680 [inlined] [11] BottomRF @ ./reduce.jl:84 [inlined] [12] _foldl_impl @ ./reduce.jl:60 [inlined] [13] foldl_impl @ ./reduce.jl:46 [inlined] [14] mapfoldl_impl(f::typeof(identity), op::Base.var"#foreach##2#foreach##3"{ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}}, nt::Nothing, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, SVector{3, Float64}}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(const_foo), Tuple{SVector{3, Float64}}, 1, Float64}}, Tuple{NoTangent, SVector{3, Float64}}, Tuple{String, String}}}) @ Base ./reduce.jl:42 [15] mapfoldl(f::Function, op::Function, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, SVector{3, Float64}}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(const_foo), Tuple{SVector{3, Float64}}, 1, Float64}}, Tuple{NoTangent, SVector{3, Float64}}, Tuple{String, String}}}; init::Nothing) @ Base ./reduce.jl:173 [16] mapfoldl @ ./reduce.jl:173 [inlined] [17] #foldl#276 @ ./reduce.jl:196 [inlined] [18] foreach(::ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}, ::Tuple{NoTangent, SVector{3, Float64}}, ::Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(const_foo), Tuple{SVector{3, Float64}}, 1, Float64}}, ::Vararg{Tuple}) @ Base ./tuple.jl:680 [19] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:235 [inlined] [20] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [21] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [22] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [23] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [24] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [25] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [26] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [27] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:20 [inlined] [28] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [29] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [30] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [31] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [32] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [33] top-level scope @ none:6 [34] eval(m::Module, e::Any) @ Core ./boot.jl:489 [35] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [36] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)}(Main.const_foo) on SVector{3, Float64}: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 Test threw exception Expression: isapprox(actual, expected; kwargs...) Problem: in add!! UndefVarError: `eval_test_function` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] test_approx(actual::Union{Number, AbstractArray{<:Number}}, expected::Union{Number, AbstractArray{<:Number}}, msg::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 [3] test_approx @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:18 [inlined] [4] #_test_add!!_behaviour#43 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:188 [inlined] [5] _test_add!!_behaviour @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:183 [inlined] [6] #_test_cotangent#74 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:313 [inlined] [7] _test_cotangent @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:301 [inlined] [8] #66 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:236 [inlined] [9] #foreach##2 @ ./tuple.jl:680 [inlined] [10] BottomRF @ ./reduce.jl:84 [inlined] [11] _foldl_impl @ ./reduce.jl:60 [inlined] [12] foldl_impl @ ./reduce.jl:46 [inlined] [13] mapfoldl_impl(f::typeof(identity), op::Base.var"#foreach##2#foreach##3"{ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}}, nt::Nothing, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, SVector{3, Float64}}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(const_foo), Tuple{SVector{3, Float64}}, 1, Float64}}, Tuple{NoTangent, SVector{3, Float64}}, Tuple{String, String}}}) @ Base ./reduce.jl:42 [14] mapfoldl(f::Function, op::Function, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, SVector{3, Float64}}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(const_foo), Tuple{SVector{3, Float64}}, 1, Float64}}, Tuple{NoTangent, SVector{3, Float64}}, Tuple{String, String}}}; init::Nothing) @ Base ./reduce.jl:173 [15] mapfoldl @ ./reduce.jl:173 [inlined] [16] #foldl#276 @ ./reduce.jl:196 [inlined] [17] foreach(::ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}, ::Tuple{NoTangent, SVector{3, Float64}}, ::Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(const_foo), Tuple{SVector{3, Float64}}, 1, Float64}}, ::Vararg{Tuple}) @ Base ./tuple.jl:680 [18] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:235 [inlined] [19] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [20] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [21] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [22] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [23] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [24] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [25] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [26] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:20 [inlined] [27] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [28] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [29] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [30] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [31] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [32] top-level scope @ none:6 [33] eval(m::Module, e::Any) @ Core ./boot.jl:489 [34] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [35] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)}(Main.scalar_foo) on Float64: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 Test threw exception Expression: isapprox(actual, expected; kwargs...) Problem: Failed primal value check UndefVarError: `eval_test_function` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] test_approx(actual::Union{Number, AbstractArray{<:Number}}, expected::Union{Number, AbstractArray{<:Number}}, msg::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 [3] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:216 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [6] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [7] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [8] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [9] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [11] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:24 [inlined] [12] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [13] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [15] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [16] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [17] top-level scope @ none:6 [18] eval(m::Module, e::Any) @ Core ./boot.jl:489 [19] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [20] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)}(Main.scalar_foo) on Float64: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:222 Test threw exception Expression: ad_cotangents isa Tuple Problem: The pullback must return a Tuple (∂self, ∂args...) UndefVarError: `eval_test_comparison` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:222 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [4] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [5] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [6] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [7] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [8] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [10] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:24 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [12] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [14] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [19] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)}(Main.scalar_foo) on Float64: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:226 Test threw exception Expression: length(ad_cotangents) == length(primals) Problem: The pullback should return 1 cotangent for the primal and each primal input. UndefVarError: `eval_test_comparison` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:226 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [4] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [5] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [6] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [7] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [8] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [10] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:24 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [12] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [14] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [19] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)}(Main.scalar_foo) on Float64: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 Test threw exception Expression: isapprox(actual, expected; kwargs...) Problem: cotangent for input 2, Float64 UndefVarError: `eval_test_function` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] test_approx(actual::Union{Number, AbstractArray{<:Number}}, expected::Union{Number, AbstractArray{<:Number}}, msg::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 [3] test_approx(actual::AbstractThunk, expected::Any, msg::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:38 [4] _test_cotangent(accum_cotangent::Any, ad_cotangent::Any, fd_cotangent::Any, msg::Any; check_inferred::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:312 [5] _test_cotangent @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:301 [inlined] [6] #66 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:236 [inlined] [7] #foreach##2 @ ./tuple.jl:680 [inlined] [8] BottomRF @ ./reduce.jl:84 [inlined] [9] _foldl_impl @ ./reduce.jl:60 [inlined] [10] foldl_impl @ ./reduce.jl:46 [inlined] [11] mapfoldl_impl(f::typeof(identity), op::Base.var"#foreach##2#foreach##3"{ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}}, nt::Nothing, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, Float64}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(scalar_foo), Tuple{Float64}, 1, Float64}}, Tuple{NoTangent, Float64}, Tuple{String, String}}}) @ Base ./reduce.jl:42 [12] mapfoldl(f::Function, op::Function, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, Float64}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(scalar_foo), Tuple{Float64}, 1, Float64}}, Tuple{NoTangent, Float64}, Tuple{String, String}}}; init::Nothing) @ Base ./reduce.jl:173 [13] mapfoldl @ ./reduce.jl:173 [inlined] [14] #foldl#276 @ ./reduce.jl:196 [inlined] [15] foreach(::ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}, ::Tuple{NoTangent, Float64}, ::Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(scalar_foo), Tuple{Float64}, 1, Float64}}, ::Vararg{Tuple}) @ Base ./tuple.jl:680 [16] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:235 [inlined] [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [18] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [19] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [20] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [21] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [22] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [23] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [24] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:24 [inlined] [25] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [26] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [27] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [28] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [29] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [30] top-level scope @ none:6 [31] eval(m::Module, e::Any) @ Core ./boot.jl:489 [32] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [33] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)}(Main.scalar_foo) on Float64: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 Test threw exception Expression: isapprox(actual, expected; kwargs...) Problem: in add!! UndefVarError: `eval_test_function` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] test_approx(actual::Union{Number, AbstractArray{<:Number}}, expected::Union{Number, AbstractArray{<:Number}}, msg::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 [3] _test_add!!_behaviour(acc::Any, val::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:188 [4] _test_cotangent(accum_cotangent::Any, ad_cotangent::Any, fd_cotangent::Any, msg::Any; check_inferred::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:313 [5] _test_cotangent @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:301 [inlined] [6] #66 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:236 [inlined] [7] #foreach##2 @ ./tuple.jl:680 [inlined] [8] BottomRF @ ./reduce.jl:84 [inlined] [9] _foldl_impl @ ./reduce.jl:60 [inlined] [10] foldl_impl @ ./reduce.jl:46 [inlined] [11] mapfoldl_impl(f::typeof(identity), op::Base.var"#foreach##2#foreach##3"{ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}}, nt::Nothing, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, Float64}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(scalar_foo), Tuple{Float64}, 1, Float64}}, Tuple{NoTangent, Float64}, Tuple{String, String}}}) @ Base ./reduce.jl:42 [12] mapfoldl(f::Function, op::Function, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, Float64}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(scalar_foo), Tuple{Float64}, 1, Float64}}, Tuple{NoTangent, Float64}, Tuple{String, String}}}; init::Nothing) @ Base ./reduce.jl:173 [13] mapfoldl @ ./reduce.jl:173 [inlined] [14] #foldl#276 @ ./reduce.jl:196 [inlined] [15] foreach(::ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}, ::Tuple{NoTangent, Float64}, ::Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(scalar_foo), Tuple{Float64}, 1, Float64}}, ::Vararg{Tuple}) @ Base ./tuple.jl:680 [16] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:235 [inlined] [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [18] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [19] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [20] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [21] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [22] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [23] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [24] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:24 [inlined] [25] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [26] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [27] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [28] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [29] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [30] top-level scope @ none:6 [31] eval(m::Module, e::Any) @ Core ./boot.jl:489 [32] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [33] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)}(Main.scalar_foo) on SVector{3, Float64}: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 Test threw exception Expression: isapprox(actual, expected; kwargs...) Problem: Failed primal value check UndefVarError: `eval_test_function` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] test_approx(actual::Union{Number, AbstractArray{<:Number}}, expected::Union{Number, AbstractArray{<:Number}}, msg::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 [3] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:216 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [6] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [7] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [8] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [9] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [11] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:26 [inlined] [12] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [13] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [15] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [16] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [17] top-level scope @ none:6 [18] eval(m::Module, e::Any) @ Core ./boot.jl:489 [19] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [20] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)}(Main.scalar_foo) on SVector{3, Float64}: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:222 Test threw exception Expression: ad_cotangents isa Tuple Problem: The pullback must return a Tuple (∂self, ∂args...) UndefVarError: `eval_test_comparison` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:222 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [4] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [5] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [6] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [7] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [8] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [10] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:26 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [12] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [14] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [19] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)}(Main.scalar_foo) on SVector{3, Float64}: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:226 Test threw exception Expression: length(ad_cotangents) == length(primals) Problem: The pullback should return 1 cotangent for the primal and each primal input. UndefVarError: `eval_test_comparison` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:226 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [4] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [5] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [6] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [7] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [8] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [10] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:26 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [12] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [14] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [19] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)}(Main.scalar_foo) on SVector{3, Float64}: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 Test threw exception Expression: isapprox(actual, expected; kwargs...) Problem: cotangent for input 2, 3-element SVector{3, Float64} with indices SOneTo(3) UndefVarError: `eval_test_function` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] test_approx(actual::Union{Number, AbstractArray{<:Number}}, expected::Union{Number, AbstractArray{<:Number}}, msg::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 [3] test_approx(actual::AbstractThunk, expected::Any, msg::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:38 [4] _test_cotangent(accum_cotangent::Any, ad_cotangent::Any, fd_cotangent::Any, msg::Any; check_inferred::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:312 [5] _test_cotangent @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:301 [inlined] [6] #66 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:236 [inlined] [7] #foreach##2 @ ./tuple.jl:680 [inlined] [8] BottomRF @ ./reduce.jl:84 [inlined] [9] _foldl_impl @ ./reduce.jl:60 [inlined] [10] foldl_impl @ ./reduce.jl:46 [inlined] [11] mapfoldl_impl(f::typeof(identity), op::Base.var"#foreach##2#foreach##3"{ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}}, nt::Nothing, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, SVector{3, Float64}}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(scalar_foo), Tuple{SVector{3, Float64}}, 1, Float64}}, Tuple{NoTangent, SVector{3, Float64}}, Tuple{String, String}}}) @ Base ./reduce.jl:42 [12] mapfoldl(f::Function, op::Function, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, SVector{3, Float64}}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(scalar_foo), Tuple{SVector{3, Float64}}, 1, Float64}}, Tuple{NoTangent, SVector{3, Float64}}, Tuple{String, String}}}; init::Nothing) @ Base ./reduce.jl:173 [13] mapfoldl @ ./reduce.jl:173 [inlined] [14] #foldl#276 @ ./reduce.jl:196 [inlined] [15] foreach(::ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}, ::Tuple{NoTangent, SVector{3, Float64}}, ::Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(scalar_foo), Tuple{SVector{3, Float64}}, 1, Float64}}, ::Vararg{Tuple}) @ Base ./tuple.jl:680 [16] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:235 [inlined] [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [18] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [19] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [20] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [21] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [22] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [23] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [24] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:26 [inlined] [25] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [26] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [27] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [28] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [29] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [30] top-level scope @ none:6 [31] eval(m::Module, e::Any) @ Core ./boot.jl:489 [32] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [33] _start() @ Base ./client.jl:553 test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)}(Main.scalar_foo) on SVector{3, Float64}: Error During Test at /home/pkgeval/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 Test threw exception Expression: isapprox(actual, expected; kwargs...) Problem: in add!! UndefVarError: `eval_test_function` not defined in `ChainRulesTestUtils` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] [2] test_approx(actual::Union{Number, AbstractArray{<:Number}}, expected::Union{Number, AbstractArray{<:Number}}, msg::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:24 [3] _test_add!!_behaviour(acc::Any, val::Any; kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/check_result.jl:188 [4] _test_cotangent(accum_cotangent::Any, ad_cotangent::Any, fd_cotangent::Any, msg::Any; check_inferred::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:313 [5] _test_cotangent @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:301 [inlined] [6] #66 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:236 [inlined] [7] #foreach##2 @ ./tuple.jl:680 [inlined] [8] BottomRF @ ./reduce.jl:84 [inlined] [9] _foldl_impl @ ./reduce.jl:60 [inlined] [10] foldl_impl @ ./reduce.jl:46 [inlined] [11] mapfoldl_impl(f::typeof(identity), op::Base.var"#foreach##2#foreach##3"{ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}}, nt::Nothing, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, SVector{3, Float64}}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(scalar_foo), Tuple{SVector{3, Float64}}, 1, Float64}}, Tuple{NoTangent, SVector{3, Float64}}, Tuple{String, String}}}) @ Base ./reduce.jl:42 [12] mapfoldl(f::Function, op::Function, itr::Base.Iterators.Zip{Tuple{Tuple{NoTangent, SVector{3, Float64}}, Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(scalar_foo), Tuple{SVector{3, Float64}}, 1, Float64}}, Tuple{NoTangent, SVector{3, Float64}}, Tuple{String, String}}}; init::Nothing) @ Base ./reduce.jl:173 [13] mapfoldl @ ./reduce.jl:173 [inlined] [14] #foldl#276 @ ./reduce.jl:196 [inlined] [15] foreach(::ChainRulesTestUtils.var"#66#67"{Bool, @NamedTuple{rtol::Float64, atol::Float64}}, ::Tuple{NoTangent, SVector{3, Float64}}, ::Tuple{NoTangent, ForwardDiffPullbacks.FwdDiffPullbackThunk{typeof(scalar_foo), Tuple{SVector{3, Float64}}, 1, Float64}}, ::Vararg{Tuple}) @ Base ./tuple.jl:680 [16] macro expansion @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:235 [inlined] [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [18] test_rrule(config::RuleConfig, f::Any, args::Any; output_tangent::Any, check_thunked_output_tangent::Any, fdm::Any, rrule_f::Any, check_inferred::Bool, fkwargs::NamedTuple, rtol::Real, atol::Real, testset_name::Any, kwargs...) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:205 [19] test_rrule @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:181 [inlined] [20] #test_rrule#57 @ ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:178 [inlined] [21] test_rrule(::Any, ::Any) @ ChainRulesTestUtils ~/.julia/packages/ChainRulesTestUtils/Ko1Wr/src/testers.jl:177 [22] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:14 [23] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [24] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/test_rrules.jl:26 [inlined] [25] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [26] top-level scope @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:6 [27] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [28] macro expansion @ ~/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:8 [inlined] [29] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [30] top-level scope @ none:6 [31] eval(m::Module, e::Any) @ Core ./boot.jl:489 [32] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [33] _start() @ Base ./client.jl:553 Precompiling packages... 3958.8 ms ✓ StatsFuns → StatsFunsChainRulesCoreExt 1 dependency successfully precompiled in 4 seconds. 23 already precompiled. Precompiling packages... 4961.8 ms ✓ Distributions → DistributionsChainRulesCoreExt 1 dependency successfully precompiled in 6 seconds. 52 already precompiled. Precompiling packages... 1656.9 ms ✓ StructArrays 2565.2 ms ✓ ZygoteRules 1039.8 ms ✓ StructArrays → StructArraysLinearAlgebraExt 1677.1 ms ✓ StructArrays → StructArraysSparseArraysExt 1031.2 ms ✓ StructArrays → StructArraysAdaptExt 12224.3 ms ✓ ChainRules 66469.1 ms ✓ Zygote 7 dependencies successfully precompiled in 87 seconds. 59 already precompiled. Precompiling packages... 2774.4 ms ✓ StructArrays → StructArraysStaticArraysExt 1 dependency successfully precompiled in 3 seconds. 19 already precompiled. WARNING: Method definition sum_pow2(Any) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:9 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition sum_pow3(Any) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:10 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition f_loss_1(Any...) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:19 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition f_loss_3(Any...) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:25 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition f_loss_3z(Any...) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:31 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition const_foo(Any, Any...) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:38 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition scalar_foo(Any, Any...) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:40 overwritten on the same line (check for duplicate calls to `include`). WARNING: Method definition nt_foo(Any, Any...) in module Main at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/testfuncs.jl:45 overwritten on the same line (check for duplicate calls to `include`). ┌ Warning: Unable to determine HTML(edit_link = ...) from remote HEAD branch, defaulting to "master". │ Calling `git remote` failed with an exception. Set JULIA_DEBUG=Documenter to see the error. │ Unless this is due to a configuration error, the relevant variable should be set explicitly. └ @ Documenter ~/.julia/packages/Documenter/eoWm2/src/utilities/utilities.jl:665 [ Info: SetupBuildDirectory: setting up build directory. [ Info: Doctest: running doctests. [ Info: Skipped ExpandTemplates step (doctest only). [ Info: Skipped CrossReferences step (doctest only). [ Info: Skipped CheckDocument step (doctest only). [ Info: Skipped Populate step (doctest only). [ Info: Skipped RenderDocument step (doctest only). Test Summary: | Pass Error Total Time Package ForwardDiffPullbacks | 96 20 116 10m44.5s Package ambiguities | 1 1 2.5s Aqua tests | 10 10 3m20.0s fwd_back | 12 12 8.9s ChainRulesCore | 66 20 86 1m18.0s test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)}(Main.const_foo) on Float64 | 2 5 7 11.5s custom_test_rrule ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)} for Tuple{Tuple{Float64, Float64}} | 5 5 0.2s test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)}(Main.const_foo) on SVector{3, Float64} | 2 5 7 3.1s custom_test_rrule ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)} for Tuple{@NamedTuple{k::Float64, l::@NamedTuple{c::SVector{2, Float64}, m::Tuple{Float64, Float64}}}} | 5 5 0.6s custom_test_rrule ForwardDiffPullbacks.WithForwardDiff{typeof(const_foo)} for Tuple{@NamedTuple{k::Float64, l::@NamedTuple{c::SVector{2, Float64}, m::Tuple{Float64, Float64}}}, SVector{3, Float64}} | 5 5 0.8s test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)}(Main.scalar_foo) on Float64 | 2 5 7 3.5s custom_test_rrule ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)} for Tuple{Tuple{Float64, Float64}} | 5 5 0.0s test_rrule: ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)}(Main.scalar_foo) on SVector{3, Float64} | 2 5 7 2.2s custom_test_rrule ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)} for Tuple{@NamedTuple{k::Float64, l::@NamedTuple{c::SVector{2, Float64}, m::Tuple{Float64, Float64}}}} | 5 5 0.1s custom_test_rrule ForwardDiffPullbacks.WithForwardDiff{typeof(scalar_foo)} for Tuple{@NamedTuple{k::Float64, l::@NamedTuple{c::SVector{2, Float64}, m::Tuple{Float64, Float64}}}, SVector{3, Float64}} | 5 5 0.9s custom_test_rrule ForwardDiffPullbacks.WithForwardDiff{typeof(nt_foo)} for Tuple{Float64} | 5 5 0.9s custom_test_rrule ForwardDiffPullbacks.WithForwardDiff{typeof(nt_foo)} for Tuple{Tuple{Float64, Float64}} | 5 5 0.0s custom_test_rrule ForwardDiffPullbacks.WithForwardDiff{typeof(nt_foo)} for Tuple{SVector{3, Float64}} | 5 5 0.0s custom_test_rrule ForwardDiffPullbacks.WithForwardDiff{typeof(nt_foo)} for Tuple{@NamedTuple{k::Float64, l::@NamedTuple{c::SVector{2, Float64}, m::Tuple{Float64, Float64}}}} | 5 5 0.0s custom_test_rrule ForwardDiffPullbacks.WithForwardDiff{typeof(nt_foo)} for Tuple{@NamedTuple{k::Float64, l::@NamedTuple{c::SVector{2, Float64}, m::Tuple{Float64, Float64}}}, SVector{3, Float64}} | 5 5 1.4s Zygote | 6 6 2m44.1s Doctests: ForwardDiffPullbacks | 1 1 42.8s RNG of the outermost testset: Random.Xoshiro(0x8649176b5f45a3a8, 0x1b6c6ceaea596520, 0xf19fccde9209fcd6, 0x694f7561668aa305, 0x71d9942ec64e3859) ERROR: LoadError: Some tests did not pass: 96 passed, 0 failed, 20 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ForwardDiffPullbacks/IeZc8/test/runtests.jl:5 Testing failed after 649.44s ERROR: LoadError: Package ForwardDiffPullbacks errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:2661 [3] test @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:2510 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:538 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:168 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:156 [7] test @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:156 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:155 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 [10] include(mod::Module, _path::String) @ Base ./Base.jl:309 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:320 [12] _start() @ Base ./client.jl:553 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 725.99s: package has test failures