Package evaluation of ExplainableAI on Julia 1.11.5 (2d89891cf8*) started at 2025-05-05T10:42:59.280 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 8.95s ################################################################################ # Installation # Installing ExplainableAI... Resolving package versions... Updating `~/.julia/environments/v1.11/Project.toml` [4f1bc3e1] + ExplainableAI v0.10.2 Updating `~/.julia/environments/v1.11/Manifest.toml` [47edcb42] + ADTypes v1.14.0 [66dad0bd] + AliasTables v1.1.3 [34da2185] + Compat v4.16.0 [9a962f9c] + DataAPI v1.16.0 [864edb3b] + DataStructures v0.18.22 [a0c0ee7d] + DifferentiationInterface v0.6.52 [31c24e10] + Distributions v0.25.119 [ffbed154] + DocStringExtensions v0.9.4 [4f1bc3e1] + ExplainableAI v0.10.2 [1a297f60] + FillArrays v1.13.0 [34004b35] + HypergeometricFunctions v0.3.28 [92d709cd] + IrrationalConstants v0.2.4 [692b3bcd] + JLLWrappers v1.7.0 [2ab3a3ac] + LogExpFunctions v0.3.29 [e1d29d7a] + Missings v1.2.0 [bac558e1] + OrderedCollections v1.8.0 [90014a1f] + PDMats v0.11.34 [21216c6a] + Preferences v1.4.3 [92933f4c] + ProgressMeter v1.10.4 [43287f4e] + PtrArrays v1.3.0 [1fd47b50] + QuadGK v2.11.2 [189a3867] + Reexport v1.2.2 [79098fc4] + Rmath v0.8.0 [a2af1166] + SortingAlgorithms v1.2.1 [276daf66] + SpecialFunctions v2.5.1 [10745b16] + Statistics v1.11.1 [82ae8749] + StatsAPI v1.7.0 [2913bbd2] + StatsBase v0.34.5 [4c63d2b9] + StatsFuns v1.5.0 [9b48221d] + XAIBase v4.0.1 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [f50d1b31] + Rmath_jll v0.5.1+0 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.11.0 [d6f4376e] + Markdown v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [2f01184e] + SparseArrays v1.11.0 [4607b0f0] + SuiteSparse [fa267f1f] + TOML v1.0.3 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0 [4536629a] + OpenBLAS_jll v0.3.27+1 [05823500] + OpenLibm_jll v0.8.5+0 [bea87d4a] + SuiteSparse_jll v7.7.0+0 [8e850b90] + libblastrampoline_jll v5.11.0+0 Installation completed after 4.38s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 1019.92s ################################################################################ # Testing # Testing ExplainableAI Status `/tmp/jl_GpJdjk/Project.toml` [4c88cf16] Aqua v0.8.11 [6e4b80f9] BenchmarkTools v1.6.0 [31c24e10] Distributions v0.25.119 [4f1bc3e1] ExplainableAI v0.10.2 [587475ba] Flux v0.16.3 ⌅ [c3a54625] JET v0.9.19 [27aeb0d3] JLArrays v0.2.0 [033835bb] JLD2 v0.5.13 [98e50ef6] JuliaFormatter v2.1.2 [dde4c033] Metal v1.5.1 [10150987] PkgJogger v0.5.1 [324d217c] ReferenceTests v0.10.5 [860ef19b] StableRNGs v1.0.2 [9b48221d] XAIBase v4.0.1 [e88e6eb3] Zygote v0.7.7 [37e2e46d] LinearAlgebra v1.11.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_GpJdjk/Manifest.toml` [47edcb42] ADTypes v1.14.0 [621f4979] AbstractFFTs v1.5.0 [7d9f7c33] Accessors v0.1.42 [79e6a3ab] Adapt v4.3.0 [66dad0bd] AliasTables v1.1.3 [4c88cf16] Aqua v0.8.11 [dce04be8] ArgCheck v2.5.0 [a9b6321e] Atomix v1.1.1 [fbb218c0] BSON v0.3.9 [198e06fe] BangBang v0.4.4 [9718e550] Baselet v0.1.1 [6e4b80f9] BenchmarkTools v1.6.0 [fa961155] CEnum v0.5.0 [082447d4] ChainRules v1.72.3 [d360d2e6] ChainRulesCore v1.25.1 [da1fd8a2] CodeTracking v1.3.9 [523fee87] CodecBzip2 v0.8.5 [944b1d66] CodecZlib v0.7.8 [3da002f7] ColorTypes v0.12.1 [c3611d14] ColorVectorSpace v0.11.0 [5ae59095] Colors v0.13.0 [a80b9123] CommonMark v0.9.1 [bbf7d656] CommonSubexpressions v0.3.1 [34da2185] Compat v4.16.0 [a33af91c] CompositionsBase v0.1.2 [187b0558] ConstructionBase v1.5.8 [6add18c4] ContextVariablesX v0.1.3 [a8cc5b0e] Crayons v4.1.1 [9a962f9c] DataAPI v1.16.0 [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [ab62b9b5] DeepDiffs v1.2.0 [244e2a9f] DefineSingletons v0.1.2 [8bb1440f] DelimitedFiles v1.9.1 [163ba53b] DiffResults v1.1.0 [b552c78f] DiffRules v1.15.1 [a0c0ee7d] DifferentiationInterface v0.6.52 [b4f34e82] Distances v0.10.12 [31c24e10] Distributions v0.25.119 [ffbed154] DocStringExtensions v0.9.4 [f151be2c] EnzymeCore v0.8.8 [4f1bc3e1] ExplainableAI v0.10.2 [e2ba6199] ExprTools v0.1.10 [cc61a311] FLoops v0.2.2 [b9860ae5] FLoopsBase v0.1.1 [5789e2e9] FileIO v1.17.0 [1a297f60] FillArrays v1.13.0 [53c48c17] FixedPointNumbers v0.8.5 [587475ba] Flux v0.16.3 [f6369f11] ForwardDiff v1.0.1 [d9f16b24] Functors v0.5.2 [0c68f7d7] GPUArrays v11.2.2 [46192b85] GPUArraysCore v0.2.0 [61eb1bfa] GPUCompiler v1.4.0 [c27321d9] Glob v1.3.1 [076d061b] HashArrayMappedTries v0.2.0 [34004b35] HypergeometricFunctions v0.3.28 [7869d1d1] IRTools v0.4.14 [c817782e] ImageBase v0.1.7 [a09fc81d] ImageCore v0.10.5 [22cec73e] InitialValues v0.3.1 [3587e190] InverseFunctions v0.1.17 [92d709cd] IrrationalConstants v0.2.4 [82899510] IteratorInterfaceExtensions v1.0.0 ⌅ [c3a54625] JET v0.9.19 [27aeb0d3] JLArrays v0.2.0 [033835bb] JLD2 v0.5.13 [692b3bcd] JLLWrappers v1.7.0 [682c06a0] JSON v0.21.4 [98e50ef6] JuliaFormatter v2.1.2 ⌅ [aa1ae85d] JuliaInterpreter v0.9.46 ⌅ [70703baa] JuliaSyntax v0.4.10 [b14d175d] JuliaVariables v0.2.4 [63c18a36] KernelAbstractions v0.9.34 [929cbde3] LLVM v9.3.1 [8cdb02fc] LazyModules v0.3.1 [2ab3a3ac] LogExpFunctions v0.3.29 ⌃ [6f1432cf] LoweredCodeUtils v3.2.2 [c2834f40] MLCore v1.0.0 [7e8f7934] MLDataDevices v1.9.1 [d8e11817] MLStyle v0.4.17 [f1d291b0] MLUtils v0.4.8 [1914dd2f] MacroTools v0.5.16 [dbb5928d] MappedArrays v0.4.2 [dde4c033] Metal v1.5.1 [128add7d] MicroCollections v0.2.0 [e1d29d7a] Missings v1.2.0 [e94cdb99] MosaicViews v0.3.4 [872c559c] NNlib v0.9.30 [77ba4419] NaNMath v1.1.3 [71a1bf82] NameResolution v0.1.5 [e86c9b32] ObjectiveC v3.4.1 [6fe1bfb0] OffsetArrays v1.17.0 [0b1bfda6] OneHotArrays v0.2.8 [3bd65402] Optimisers v0.4.6 [bac558e1] OrderedCollections v1.8.0 [90014a1f] PDMats v0.11.34 [5432bcbf] PaddedViews v0.5.12 [69de0a69] Parsers v2.8.3 [10150987] PkgJogger v0.5.1 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [8162dcfd] PrettyPrint v0.2.0 [33c8b6b6] ProgressLogging v0.1.4 [92933f4c] ProgressMeter v1.10.4 [43287f4e] PtrArrays v1.3.0 [1fd47b50] QuadGK v2.11.2 [c1ae055f] RealDot v0.1.0 [189a3867] Reexport v1.2.2 [324d217c] ReferenceTests v0.10.5 [ae029012] Requires v1.3.1 [79098fc4] Rmath v0.8.0 [7e506255] ScopedValues v1.3.0 [6c6a2e73] Scratch v1.2.1 [efcf1570] Setfield v1.1.2 [605ecd9f] ShowCases v0.1.0 [699a6c99] SimpleTraits v0.9.4 [a2af1166] SortingAlgorithms v1.2.1 [dc90abb0] SparseInverseSubset v0.1.2 [276daf66] SpecialFunctions v2.5.1 [171d559e] SplittablesBase v0.1.15 [860ef19b] StableRNGs v1.0.2 [cae243ae] StackViews v0.1.1 [90137ffa] StaticArrays v1.9.13 [1e83bf80] StaticArraysCore v1.4.3 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.7.0 [2913bbd2] StatsBase v0.34.5 [4c63d2b9] StatsFuns v1.5.0 [09ab397b] StructArrays v0.7.1 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.0 [62fd8b95] TensorCore v0.1.1 [e689c965] Tracy v0.1.4 [3bb67fe8] TranscodingStreams v0.11.3 [28d57a85] Transducers v0.4.84 [013be700] UnsafeAtomics v0.3.0 [9b48221d] XAIBase v4.0.1 [c8c2cc18] XTermColors v0.2.1 [e88e6eb3] Zygote v0.7.7 [700de1a5] ZygoteRules v0.2.7 [6e34b625] Bzip2_jll v1.0.9+0 [f52de702] LLVMDowngrader_jll v0.6.0+0 [dad2f222] LLVMExtra_jll v0.0.35+0 [ad6e5548] LibTracyClient_jll v0.9.1+6 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [f50d1b31] Rmath_jll v0.5.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [4af54fe1] LazyArtifacts v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.11.0 [4607b0f0] SuiteSparse [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [05823500] OpenLibm_jll v0.8.5+0 [bea87d4a] SuiteSparse_jll v7.7.0+0 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌃ and ⌅ have new versions available. Those with ⌃ may be upgradable, but those with ⌅ are restricted by compatibility constraints from upgrading. Testing Running tests... Precompiling JuliaFormatter... 16691.5 ms ✓ CommonMark 71452.4 ms ✓ JuliaFormatter 2 dependencies successfully precompiled in 89 seconds. 8 already precompiled. [ Info: - running JuliaFormatter code formatting tests... [ Info: - running Aqua.jl tests... [ Info: - running JET.jl type stability tests... [ Info: Testing constructors... [ Info: Testing analyzers on CNN... Precompiling Zygote... 7321.0 ms ✓ ForwardDiff 65765.5 ms ✓ Zygote 2 dependencies successfully precompiled in 74 seconds. 63 already precompiled. Precompiling DifferentiationInterfaceChainRulesCoreExt... 834.0 ms ✓ DifferentiationInterface → DifferentiationInterfaceChainRulesCoreExt 1 dependency successfully precompiled in 1 seconds. 11 already precompiled. Precompiling DifferentiationInterfaceGPUArraysCoreExt... 760.8 ms ✓ DifferentiationInterface → DifferentiationInterfaceGPUArraysCoreExt 1 dependency successfully precompiled in 1 seconds. 6 already precompiled. Precompiling DifferentiationInterfaceForwardDiffExt... 1569.2 ms ✓ DifferentiationInterface → DifferentiationInterfaceForwardDiffExt 1 dependency successfully precompiled in 2 seconds. 22 already precompiled. Precompiling DifferentiationInterfaceZygoteExt... 3614.5 ms ✓ DifferentiationInterface → DifferentiationInterfaceZygoteExt 1 dependency successfully precompiled in 4 seconds. 73 already precompiled. Precompiling ReferenceTests... 4318.1 ms ✓ ImageBase 3029.0 ms ✓ XTermColors 5270.1 ms ✓ ReferenceTests 3 dependencies successfully precompiled in 13 seconds. 48 already precompiled. Precompiling ZygoteColorsExt... 4483.6 ms ✓ Zygote → ZygoteColorsExt 1 dependency successfully precompiled in 5 seconds. 69 already precompiled. Precompiling ZygoteDistancesExt... 6694.4 ms ✓ Zygote → ZygoteDistancesExt 1 dependency successfully precompiled in 7 seconds. 69 already precompiled. Precompiling Flux... 908.0 ms ✓ EnzymeCore → AdaptExt 5425.6 ms ✓ Accessors 1204.4 ms ✓ Functors 2760.7 ms ✓ SplittablesBase 3017.7 ms ✓ MLCore 14159.0 ms ✓ StaticArrays 1058.8 ms ✓ Accessors → StructArraysExt 2350.6 ms ✓ Accessors → LinearAlgebraExt 1292.4 ms ✓ Accessors → TestExt 1782.7 ms ✓ MLDataDevices 2719.4 ms ✓ Optimisers 1669.4 ms ✓ StaticArrays → StaticArraysChainRulesCoreExt 1977.9 ms ✓ StaticArrays → StaticArraysStatisticsExt 1693.2 ms ✓ ConstructionBase → ConstructionBaseStaticArraysExt 1496.6 ms ✓ Adapt → AdaptStaticArraysExt 1812.2 ms ✓ StructArrays → StructArraysStaticArraysExt 2685.6 ms ✓ ForwardDiff → ForwardDiffStaticArraysExt 2312.1 ms ✓ Accessors → StaticArraysExt 1830.3 ms ✓ BangBang 1476.5 ms ✓ MLDataDevices → MLDataDevicesChainRulesCoreExt 901.2 ms ✓ MLDataDevices → MLDataDevicesFillArraysExt 3879.8 ms ✓ MLDataDevices → MLDataDevicesZygoteExt 1311.1 ms ✓ MLDataDevices → MLDataDevicesSparseArraysExt 1807.5 ms ✓ MLDataDevices → MLDataDevicesChainRulesExt 834.8 ms ✓ Optimisers → OptimisersEnzymeCoreExt 833.8 ms ✓ Optimisers → OptimisersAdaptExt 8783.4 ms ✓ KernelAbstractions 1608.6 ms ✓ BangBang → BangBangStaticArraysExt 1104.3 ms ✓ BangBang → BangBangChainRulesCoreExt 1221.1 ms ✓ BangBang → BangBangStructArraysExt 1107.8 ms ✓ BangBang → BangBangTablesExt 2473.7 ms ✓ MicroCollections 2230.3 ms ✓ KernelAbstractions → SparseArraysExt 1665.3 ms ✓ KernelAbstractions → LinearAlgebraExt 1761.4 ms ✓ KernelAbstractions → EnzymeExt 1821.7 ms ✓ StructArrays → StructArraysGPUArraysCoreExt 6659.9 ms ✓ Transducers 14305.3 ms ✓ NNlib 1489.5 ms ✓ Transducers → TransducersAdaptExt 15913.2 ms ✓ FLoops 2141.9 ms ✓ NNlib → NNlibEnzymeCoreExt 2189.5 ms ✓ NNlib → NNlibSpecialFunctionsExt 2307.2 ms ✓ NNlib → NNlibForwardDiffExt 2611.9 ms ✓ OneHotArrays 17428.0 ms ✓ MLUtils 1893.6 ms ✓ MLDataDevices → MLDataDevicesOneHotArraysExt 3807.0 ms ✓ MLDataDevices → MLDataDevicesMLUtilsExt 17430.8 ms ✓ Flux 48 dependencies successfully precompiled in 176 seconds. 104 already precompiled. Precompiling DifferentiationInterfaceStaticArraysExt... 1415.8 ms ✓ DifferentiationInterface → DifferentiationInterfaceStaticArraysExt 1 dependency successfully precompiled in 2 seconds. 10 already precompiled. Precompiling StatsFunsInverseFunctionsExt... 1421.6 ms ✓ StatsFuns → StatsFunsInverseFunctionsExt 1 dependency successfully precompiled in 2 seconds. 21 already precompiled. Precompiling ADTypesEnzymeCoreExt... 786.1 ms ✓ ADTypes → ADTypesEnzymeCoreExt 1 dependency successfully precompiled in 1 seconds. 2 already precompiled. Precompiling JLD2... 54898.3 ms ✓ JLD2 1 dependency successfully precompiled in 55 seconds. 31 already precompiled. Timing Gradient... cold:151.787719 seconds (30.83 M allocations: 1.494 GiB, 0.33% gc time, 99.99% compilation time) warm: 0.028574 seconds (4.02 k allocations: 2.455 MiB, 44.17% compilation time) Timing InputTimesGradient... cold: 14.651352 seconds (507.59 k allocations: 27.693 MiB, 99.88% compilation time) warm: 0.054905 seconds (6.50 k allocations: 2.583 MiB, 73.59% compilation time) Timing SmoothGrad... cold: Sampling NoiseAugmentation... 40%|████████▊ | ETA: 0:00:32 Sampling NoiseAugmentation... 100%|██████████████████████| Time: 0:00:22 60.213465 seconds (911.03 k allocations: 56.524 MiB, 0.06% gc time, 99.85% compilation time) warm: Sampling NoiseAugmentation... 80%|█████████████████▋ | ETA: 0:00:00 Sampling NoiseAugmentation... 100%|██████████████████████| Time: 0:00:00 0.283525 seconds (27.97 k allocations: 13.471 MiB, 17.58% gc time, 49.77% compilation time) Timing GradCAM... cold: 3.756939 seconds (486.84 k allocations: 25.173 MiB, 99.77% compilation time) warm: 0.349738 seconds (67.11 k allocations: 4.138 MiB, 98.05% compilation time) Timing IntegratedGradients... cold: 5.492435 seconds (65.17 k allocations: 17.509 MiB, 98.08% compilation time) warm: 5.503216 seconds (59.62 k allocations: 17.214 MiB, 1.11% gc time, 98.24% compilation time) [ Info: Testing analyzers on batches... WARNING: Method definition pseudorand(Any...) in module Main at /home/pkgeval/.julia/packages/ExplainableAI/LPoru/test/test_cnn.jl:18 overwritten at /home/pkgeval/.julia/packages/ExplainableAI/LPoru/test/test_batches.jl:10. Precompiling Metal... 10323.3 ms ✓ ObjectiveC 1253.6 ms ✓ LibTracyClient_jll 3762.7 ms ✓ LLVMDowngrader_jll 3693.7 ms ✓ LLVMExtra_jll 2595.5 ms ✓ Tracy 13480.3 ms ✓ LLVM 4656.7 ms ✓ UnsafeAtomics → UnsafeAtomicsLLVM 56757.5 ms ✓ GPUCompiler 13597.0 ms ✓ GPUArrays 42615.7 ms ✓ Metal 11189.5 ms ✓ Atomix → AtomixMetalExt 11 dependencies successfully precompiled in 164 seconds. 51 already precompiled. ┌ Error: Metal.jl is only supported on macOS └ @ Metal ~/.julia/packages/Metal/N2ABH/src/initialization.jl:32 Precompiling MLDataDevicesGPUArraysExt... 6920.4 ms ✓ MLDataDevices → MLDataDevicesGPUArraysExt 1 dependency successfully precompiled in 7 seconds. 57 already precompiled. Precompiling SpecialFunctionsExt... 14874.2 ms ✓ Metal → SpecialFunctionsExt 1 dependency successfully precompiled in 16 seconds. 74 already precompiled. Precompiling MLDataDevicesMetalExt... 14530.0 ms ✓ MLDataDevices → MLDataDevicesMetalExt 1 dependency successfully precompiled in 15 seconds. 70 already precompiled. Precompiling JLArrays... 7971.7 ms ✓ JLArrays 1 dependency successfully precompiled in 8 seconds. 50 already precompiled. [ Info: Using JLArrays as GPU device Sampling NoiseAugmentation... 4%|▉ | ETA: 0:01:27 Sampling NoiseAugmentation... 100%|██████████████████████| Time: 0:00:04 [ Info: Testing whether benchmarks are up-to-date... Precompiling PkgJogger... 4436.8 ms ✓ BenchmarkTools 7032.1 ms ✓ PkgJogger 2 dependencies successfully precompiled in 12 seconds. 38 already precompiled. Test Summary: | Pass Total Time ExplainableAI.jl | 60 60 23m00.3s Testing ExplainableAI tests passed Testing completed after 1471.28s PkgEval succeeded after 2579.68s