Package evaluation of RelevancePropagation on Julia 1.11.4 (a71dd056e0*) started at 2025-04-08T17:34:57.743 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 9.1s ################################################################################ # Installation # Installing RelevancePropagation... Resolving package versions... Updating `~/.julia/environments/v1.11/Project.toml` [0be6dd02] + RelevancePropagation v3.0.0 Updating `~/.julia/environments/v1.11/Manifest.toml` [621f4979] + AbstractFFTs v1.5.0 [7d9f7c33] + Accessors v0.1.42 [79e6a3ab] + Adapt v4.3.0 [66dad0bd] + AliasTables v1.1.3 [dce04be8] + ArgCheck v2.5.0 [a9b6321e] + Atomix v1.1.1 [198e06fe] + BangBang v0.4.4 [9718e550] + Baselet v0.1.1 [fa961155] + CEnum v0.5.0 [082447d4] + ChainRules v1.72.3 [d360d2e6] + ChainRulesCore v1.25.1 [bbf7d656] + CommonSubexpressions v0.3.1 [34da2185] + Compat v4.16.0 [a33af91c] + CompositionsBase v0.1.2 [187b0558] + ConstructionBase v1.5.8 [6add18c4] + ContextVariablesX v0.1.3 [9a962f9c] + DataAPI v1.16.0 [864edb3b] + DataStructures v0.18.22 [e2d170a0] + DataValueInterfaces v1.0.0 [244e2a9f] + DefineSingletons v0.1.2 [8bb1440f] + DelimitedFiles v1.9.1 [163ba53b] + DiffResults v1.1.0 [b552c78f] + DiffRules v1.15.1 [ffbed154] + DocStringExtensions v0.9.4 [cc61a311] + FLoops v0.2.2 [b9860ae5] + FLoopsBase v0.1.1 [1a297f60] + FillArrays v1.13.0 ⌅ [587475ba] + Flux v0.14.25 [f6369f11] + ForwardDiff v1.0.1 ⌅ [d9f16b24] + Functors v0.4.12 [0c68f7d7] + GPUArrays v11.2.2 [46192b85] + GPUArraysCore v0.2.0 [076d061b] + HashArrayMappedTries v0.2.0 [7869d1d1] + IRTools v0.4.14 [22cec73e] + InitialValues v0.3.1 [3587e190] + InverseFunctions v0.1.17 [92d709cd] + IrrationalConstants v0.2.4 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.7.0 [b14d175d] + JuliaVariables v0.2.4 [63c18a36] + KernelAbstractions v0.9.34 [929cbde3] + LLVM v9.2.0 [2ab3a3ac] + LogExpFunctions v0.3.29 [c2834f40] + MLCore v1.0.0 ⌃ [7e8f7934] + MLDataDevices v1.5.3 [d8e11817] + MLStyle v0.4.17 [f1d291b0] + MLUtils v0.4.8 [1914dd2f] + MacroTools v0.5.15 [128add7d] + MicroCollections v0.2.0 [e1d29d7a] + Missings v1.2.0 [872c559c] + NNlib v0.9.30 [77ba4419] + NaNMath v1.1.3 [71a1bf82] + NameResolution v0.1.5 [0b1bfda6] + OneHotArrays v0.2.7 ⌅ [3bd65402] + Optimisers v0.3.4 [bac558e1] + OrderedCollections v1.8.0 ⌅ [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [8162dcfd] + PrettyPrint v0.2.0 [33c8b6b6] + ProgressLogging v0.1.4 [43287f4e] + PtrArrays v1.3.0 [c1ae055f] + RealDot v0.1.0 [189a3867] + Reexport v1.2.2 [0be6dd02] + RelevancePropagation v3.0.0 [ae029012] + Requires v1.3.1 [7e506255] + ScopedValues v1.3.0 [efcf1570] + Setfield v1.1.2 [605ecd9f] + ShowCases v0.1.0 [699a6c99] + SimpleTraits v0.9.4 [a2af1166] + SortingAlgorithms v1.2.1 [dc90abb0] + SparseInverseSubset v0.1.2 [276daf66] + SpecialFunctions v2.5.0 [171d559e] + SplittablesBase v0.1.15 [90137ffa] + StaticArrays v1.9.13 [1e83bf80] + StaticArraysCore v1.4.3 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.7.0 [2913bbd2] + StatsBase v0.34.4 [09ab397b] + StructArrays v0.7.1 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.12.0 [28d57a85] + Transducers v0.4.84 [013be700] + UnsafeAtomics v0.3.0 [9b48221d] + XAIBase v4.0.1 ⌅ [e88e6eb3] + Zygote v0.6.76 [700de1a5] + ZygoteRules v0.2.7 [dad2f222] + LLVMExtra_jll v0.0.35+0 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [9fa8497b] + Future v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [4af54fe1] + LazyArtifacts v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [2f01184e] + SparseArrays v1.11.0 [4607b0f0] + SuiteSparse [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [4536629a] + OpenBLAS_jll v0.3.27+1 [05823500] + OpenLibm_jll v0.8.5+0 [bea87d4a] + SuiteSparse_jll v7.7.0+0 [83775a58] + Zlib_jll v1.2.13+1 [8e850b90] + libblastrampoline_jll v5.11.0+0 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 Info Packages marked with ⌃ and ⌅ have new versions available. Those with ⌃ may be upgradable, but those with ⌅ are restricted by compatibility constraints from upgrading. To see why use `status --outdated -m` Installation completed after 5.51s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 50.55s ################################################################################ # Testing # Testing RelevancePropagation Status `/tmp/jl_JU77Bb/Project.toml` [4c88cf16] Aqua v0.8.11 [6e4b80f9] BenchmarkTools v1.6.0 [7d51a73a] ExplicitImports v1.11.2 ⌅ [587475ba] Flux v0.14.25 [033835bb] JLD2 v0.5.12 [98e50ef6] JuliaFormatter v2.1.0 [dbeba491] Metalhead v0.9.5 [872c559c] NNlib v0.9.30 [10150987] PkgJogger v0.5.1 [324d217c] ReferenceTests v0.10.5 [0be6dd02] RelevancePropagation v3.0.0 [860ef19b] StableRNGs v1.0.2 [fd094767] Suppressor v0.2.8 [9b48221d] XAIBase v4.0.1 [37e2e46d] LinearAlgebra v1.11.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_JU77Bb/Manifest.toml` [621f4979] AbstractFFTs v1.5.0 [1520ce14] AbstractTrees v0.4.5 [7d9f7c33] Accessors v0.1.42 [79e6a3ab] Adapt v4.3.0 [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.11 [dce04be8] ArgCheck v2.5.0 [a9b6321e] Atomix v1.1.1 [fbb218c0] BSON v0.3.9 [198e06fe] BangBang v0.4.4 [9718e550] Baselet v0.1.1 [6e4b80f9] BenchmarkTools v1.6.0 [fa961155] CEnum v0.5.0 [082447d4] ChainRules v1.72.3 [d360d2e6] ChainRulesCore v1.25.1 [944b1d66] CodecZlib v0.7.8 [3da002f7] ColorTypes v0.12.1 [c3611d14] ColorVectorSpace v0.11.0 [5ae59095] Colors v0.13.0 [a80b9123] CommonMark v0.9.0 [bbf7d656] CommonSubexpressions v0.3.1 [34da2185] Compat v4.16.0 [a33af91c] CompositionsBase v0.1.2 [187b0558] ConstructionBase v1.5.8 [6add18c4] ContextVariablesX v0.1.3 [a8cc5b0e] Crayons v4.1.1 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [ab62b9b5] DeepDiffs v1.2.0 [244e2a9f] DefineSingletons v0.1.2 [8bb1440f] DelimitedFiles v1.9.1 [163ba53b] DiffResults v1.1.0 [b552c78f] DiffRules v1.15.1 [b4f34e82] Distances v0.10.12 [ffbed154] DocStringExtensions v0.9.4 [7d51a73a] ExplicitImports v1.11.2 [cc61a311] FLoops v0.2.2 [b9860ae5] FLoopsBase v0.1.1 [5789e2e9] FileIO v1.17.0 [1a297f60] FillArrays v1.13.0 [53c48c17] FixedPointNumbers v0.8.5 ⌅ [587475ba] Flux v0.14.25 [f6369f11] ForwardDiff v1.0.1 ⌅ [d9f16b24] Functors v0.4.12 [0c68f7d7] GPUArrays v11.2.2 [46192b85] GPUArraysCore v0.2.0 [c27321d9] Glob v1.3.1 [076d061b] HashArrayMappedTries v0.2.0 [7869d1d1] IRTools v0.4.14 [c817782e] ImageBase v0.1.7 [a09fc81d] ImageCore v0.10.5 [22cec73e] InitialValues v0.3.1 [3587e190] InverseFunctions v0.1.17 [92d709cd] IrrationalConstants v0.2.4 [82899510] IteratorInterfaceExtensions v1.0.0 [033835bb] JLD2 v0.5.12 [692b3bcd] JLLWrappers v1.7.0 [682c06a0] JSON v0.21.4 [98e50ef6] JuliaFormatter v2.1.0 ⌅ [70703baa] JuliaSyntax v0.4.10 [b14d175d] JuliaVariables v0.2.4 [63c18a36] KernelAbstractions v0.9.34 [929cbde3] LLVM v9.2.0 [8cdb02fc] LazyModules v0.3.1 [2ab3a3ac] LogExpFunctions v0.3.29 [c2834f40] MLCore v1.0.0 ⌃ [7e8f7934] MLDataDevices v1.5.3 [d8e11817] MLStyle v0.4.17 [f1d291b0] MLUtils v0.4.8 [1914dd2f] MacroTools v0.5.15 [dbb5928d] MappedArrays v0.4.2 [dbeba491] Metalhead v0.9.5 [128add7d] MicroCollections v0.2.0 [e1d29d7a] Missings v1.2.0 [e94cdb99] MosaicViews v0.3.4 [872c559c] NNlib v0.9.30 [77ba4419] NaNMath v1.1.3 [71a1bf82] NameResolution v0.1.5 [6fe1bfb0] OffsetArrays v1.16.0 [0b1bfda6] OneHotArrays v0.2.7 ⌅ [3bd65402] Optimisers v0.3.4 [bac558e1] OrderedCollections v1.8.0 [5432bcbf] PaddedViews v0.5.12 [69de0a69] Parsers v2.8.1 [570af359] PartialFunctions v1.2.0 [10150987] PkgJogger v0.5.1 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [8162dcfd] PrettyPrint v0.2.0 [33c8b6b6] ProgressLogging v0.1.4 [43287f4e] PtrArrays v1.3.0 [c1ae055f] RealDot v0.1.0 [189a3867] Reexport v1.2.2 [324d217c] ReferenceTests v0.10.5 [0be6dd02] RelevancePropagation v3.0.0 [ae029012] Requires v1.3.1 [7e506255] ScopedValues v1.3.0 [efcf1570] Setfield v1.1.2 [605ecd9f] ShowCases v0.1.0 [699a6c99] SimpleTraits v0.9.4 [a2af1166] SortingAlgorithms v1.2.1 [dc90abb0] SparseInverseSubset v0.1.2 [276daf66] SpecialFunctions v2.5.0 [171d559e] SplittablesBase v0.1.15 [860ef19b] StableRNGs v1.0.2 [cae243ae] StackViews v0.1.1 [90137ffa] StaticArrays v1.9.13 [1e83bf80] StaticArraysCore v1.4.3 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.7.0 [2913bbd2] StatsBase v0.34.4 [09ab397b] StructArrays v0.7.1 [fd094767] Suppressor v0.2.8 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.0 [62fd8b95] TensorCore v0.1.1 [3bb67fe8] TranscodingStreams v0.11.3 [28d57a85] Transducers v0.4.84 [013be700] UnsafeAtomics v0.3.0 [9b48221d] XAIBase v4.0.1 [c8c2cc18] XTermColors v0.2.1 ⌅ [e88e6eb3] Zygote v0.6.76 [700de1a5] ZygoteRules v0.2.7 [dad2f222] LLVMExtra_jll v0.0.35+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [4af54fe1] LazyArtifacts v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.11.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [05823500] OpenLibm_jll v0.8.5+0 [bea87d4a] SuiteSparse_jll v7.7.0+0 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌃ and ⌅ have new versions available. Those with ⌃ may be upgradable, but those with ⌅ are restricted by compatibility constraints from upgrading. Testing Running tests... Precompiling RelevancePropagation... 146138.7 ms ✓ RelevancePropagation 1 dependency successfully precompiled in 149 seconds. 169 already precompiled. [ Info: Testing linting... [ Info: ...with JuliaFormatter.jl Code formatting: Test Failed at /home/pkgeval/.julia/packages/RelevancePropagation/xLyde/test/test_linting.jl:15 Expression: JuliaFormatter.format(RelevancePropagation; verbose = false, overwrite = false) Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/RelevancePropagation/xLyde/test/test_linting.jl:15 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] top-level scope @ ~/.julia/packages/RelevancePropagation/xLyde/test/test_linting.jl:14 [ Info: ...with Aqua.jl [ Info: ...with ExplicitImports.jl [ Info: Testing utilities... [ Info: Testing chain utilities... [ Info: Testing model canonization... WARNING: Method definition pseudorand(Any...) in module Main at /home/pkgeval/.julia/packages/RelevancePropagation/xLyde/test/test_utils.jl:13 overwritten at /home/pkgeval/.julia/packages/RelevancePropagation/xLyde/test/test_canonize.jl:10. [ Info: Testing LRP composites... Precompiling ReferenceTests... 3221.8 ms ✓ XTermColors 5663.6 ms ✓ ReferenceTests 2 dependencies successfully precompiled in 9 seconds. 49 already precompiled. Precompiling ZygoteColorsExt... 12743.5 ms ✓ GPUArrays 5098.9 ms ✓ Zygote → ZygoteColorsExt 2 dependencies successfully precompiled in 20 seconds. 105 already precompiled. Precompiling ZygoteDistancesExt... 6802.2 ms ✓ Zygote → ZygoteDistancesExt 1 dependency successfully precompiled in 8 seconds. 107 already precompiled. WARNING: using NNlib.conv in module Main conflicts with an existing identifier. Precompiling Metalhead... 1403.5 ms ✓ PartialFunctions 5523.8 ms ✓ MLDataDevices → MLDataDevicesGPUArraysExt 21510.1 ms ✓ Metalhead 3 dependencies successfully precompiled in 30 seconds. 171 already precompiled. [ Info: Testing LRP model checks... [ Info: Testing LRP rules... [ Info: Testing CRP... [ Info: Testing analyzers on CNN... WARNING: Method definition pseudorand(Any...) in module Main at /home/pkgeval/.julia/packages/RelevancePropagation/xLyde/test/test_canonize.jl:10 overwritten at /home/pkgeval/.julia/packages/RelevancePropagation/xLyde/test/test_cnn.jl:16. Timing LRPZero_COC... cold: 52.237359 seconds (8.44 M allocations: 430.382 MiB, 0.49% gc time, 99.94% compilation time) warm: 1.451813 seconds (272.31 k allocations: 20.251 MiB, 98.15% compilation time) Timing LRPEpsilonAlpha2Beta1Flat... cold: 0.414210 seconds (245.49 k allocations: 23.001 MiB, 87.85% compilation time) warm: 0.201443 seconds (15.69 k allocations: 11.696 MiB, 74.96% compilation time) Timing LRPZero... cold: 0.195695 seconds (28.06 k allocations: 6.815 MiB, 88.12% compilation time) warm: 0.293286 seconds (15.27 k allocations: 6.283 MiB, 41.52% gc time, 49.83% compilation time) Timing CRP... cold: 13.804231 seconds (5.26 M allocations: 278.086 MiB, 0.66% gc time, 98.83% compilation time) warm: 3.892902 seconds (488.49 k allocations: 37.050 MiB, 98.46% compilation time) [ Info: Testing analyzers on batches... WARNING: Method definition pseudorand(Any...) in module Main at /home/pkgeval/.julia/packages/RelevancePropagation/xLyde/test/test_cnn.jl:16 overwritten at /home/pkgeval/.julia/packages/RelevancePropagation/xLyde/test/test_batches.jl:8. [ Info: Testing whether benchmarks are up-to-date... Precompiling PkgJogger... 4505.4 ms ✓ PkgJogger 1 dependency successfully precompiled in 5 seconds. 39 already precompiled. Test Summary: | Pass Fail Total Time RelevancePropagation.jl | 475 1 476 36m09.1s Linting | 15 1 16 3m19.8s Code formatting | 1 1 1m40.1s Aqua.jl | 10 10 1m03.6s ExplicitImports tests | 5 5 32.2s Utilities | 47 47 52.4s Flux utilities | 35 35 20.7s Canonize | 18 18 4m18.7s Composites | 14 14 2m33.3s Model checks | 18 18 4.0s LRP rules | 259 259 22m19.5s CRP | 1 1 20.5s CNN | 23 23 1m36.1s Batches | 9 9 4.2s Benchmark correctness | 36 36 19.8s ERROR: LoadError: Some tests did not pass: 475 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/RelevancePropagation/xLyde/test/runtests.jl:7 Testing failed after 2332.81s ERROR: LoadError: Package RelevancePropagation errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:2124 [3] test @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:2007 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:481 [5] test(pkgs::Vector{Pkg.Types.PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:159 [6] test @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:147 [inlined] [7] #test#74 @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:146 [inlined] [8] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 2425.36s: package has test failures