Package evaluation of VisionHeatmaps on Julia 1.10.8 (92f03a4775*) started at 2025-02-25T07:34:37.078 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 4.61s ################################################################################ # Installation # Installing VisionHeatmaps... Resolving package versions... Updating `~/.julia/environments/v1.10/Project.toml` [27106da1] + VisionHeatmaps v1.5.1 Updating `~/.julia/environments/v1.10/Manifest.toml` [79e6a3ab] + Adapt v4.2.0 [13072b0f] + AxisAlgorithms v1.1.0 [d360d2e6] + ChainRulesCore v1.25.1 [35d6a980] + ColorSchemes v3.29.0 [3da002f7] + ColorTypes v0.12.0 [c3611d14] + ColorVectorSpace v0.11.0 [5ae59095] + Colors v0.13.0 [34da2185] + Compat v4.16.0 [5218b696] + Configurations v0.17.6 [150eb455] + CoordinateTransformations v0.6.4 [55351af7] + ExproniconLite v0.10.14 [53c48c17] + FixedPointNumbers v0.8.5 [c817782e] + ImageBase v0.1.7 [a09fc81d] + ImageCore v0.10.5 [02fcd773] + ImageTransformations v0.10.1 [a98d9a8b] + Interpolations v0.15.1 [dbb5928d] + MappedArrays v0.4.2 [e94cdb99] + MosaicViews v0.3.4 [6fe1bfb0] + OffsetArrays v1.15.0 [bac558e1] + OrderedCollections v1.8.0 [5432bcbf] + PaddedViews v0.5.12 [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [94ee1d12] + Quaternions v0.7.6 [c84ed2f1] + Ratios v0.4.5 [c1ae055f] + RealDot v0.1.0 [189a3867] + Reexport v1.2.2 [ae029012] + Requires v1.3.0 [6038ab10] + Rotations v1.7.1 [cae243ae] + StackViews v0.1.1 [90137ffa] + StaticArrays v1.9.12 [1e83bf80] + StaticArraysCore v1.4.3 [62fd8b95] + TensorCore v0.1.1 [27106da1] + VisionHeatmaps v1.5.1 [efce3f68] + WoodburyMatrices v1.0.0 [9b48221d] + XAIBase v4.0.0 [56f22d72] + Artifacts [ade2ca70] + Dates [8ba89e20] + Distributed [8f399da3] + Libdl [37e2e46d] + LinearAlgebra [a63ad114] + Mmap [de0858da] + Printf [9a3f8284] + Random [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization [1a1011a3] + SharedArrays [6462fe0b] + Sockets [2f01184e] + SparseArrays v1.10.0 [10745b16] + Statistics v1.10.0 [fa267f1f] + TOML v1.0.3 [cf7118a7] + UUIDs [4ec0a83e] + Unicode [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0 [4536629a] + OpenBLAS_jll v0.3.23+4 [bea87d4a] + SuiteSparse_jll v7.2.1+1 [8e850b90] + libblastrampoline_jll v5.11.0+0 Installation completed after 5.15s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/tgnBf/src/julia-1.9/activate_set.jl:63 Precompiling package dependencies... Precompilation completed after 19.9s ################################################################################ # Testing # Testing VisionHeatmaps ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:1829 Status `/tmp/jl_mrU6Ra/Project.toml` [4c88cf16] Aqua v0.8.11 [35d6a980] ColorSchemes v3.29.0 [a09fc81d] ImageCore v0.10.5 [98e50ef6] JuliaFormatter v1.0.62 [324d217c] ReferenceTests v0.10.5 [27106da1] VisionHeatmaps v1.5.1 ⌅ [9b48221d] XAIBase v3.0.0 [8dfed614] Test Status `/tmp/jl_mrU6Ra/Manifest.toml` [79e6a3ab] Adapt v4.2.0 [4c88cf16] Aqua v0.8.11 [13072b0f] AxisAlgorithms v1.1.0 [00ebfdb7] CSTParser v3.4.3 [d360d2e6] ChainRulesCore v1.25.1 [35d6a980] ColorSchemes v3.29.0 [3da002f7] ColorTypes v0.12.0 [c3611d14] ColorVectorSpace v0.11.0 [5ae59095] Colors v0.13.0 [a80b9123] CommonMark v0.8.15 [34da2185] Compat v4.16.0 [5218b696] Configurations v0.17.6 [150eb455] CoordinateTransformations v0.6.4 [a8cc5b0e] Crayons v4.1.1 [864edb3b] DataStructures v0.18.20 [ab62b9b5] DeepDiffs v1.2.0 [b4f34e82] Distances v0.10.12 [55351af7] ExproniconLite v0.10.14 [5789e2e9] FileIO v1.16.6 [53c48c17] FixedPointNumbers v0.8.5 [c27321d9] Glob v1.3.1 [c817782e] ImageBase v0.1.7 [a09fc81d] ImageCore v0.10.5 [02fcd773] ImageTransformations v0.10.1 [a98d9a8b] Interpolations v0.15.1 [98e50ef6] JuliaFormatter v1.0.62 [8cdb02fc] LazyModules v0.3.1 [dbb5928d] MappedArrays v0.4.2 [e94cdb99] MosaicViews v0.3.4 [6fe1bfb0] OffsetArrays v1.15.0 [bac558e1] OrderedCollections v1.8.0 [5432bcbf] PaddedViews v0.5.12 [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [94ee1d12] Quaternions v0.7.6 [c84ed2f1] Ratios v0.4.5 [c1ae055f] RealDot v0.1.0 [189a3867] Reexport v1.2.2 [324d217c] ReferenceTests v0.10.5 [ae029012] Requires v1.3.0 [6038ab10] Rotations v1.7.1 [cae243ae] StackViews v0.1.1 [90137ffa] StaticArrays v1.9.12 [1e83bf80] StaticArraysCore v1.4.3 [82ae8749] StatsAPI v1.7.0 [62fd8b95] TensorCore v0.1.1 [0796e94c] Tokenize v0.5.29 [27106da1] VisionHeatmaps v1.5.1 [efce3f68] WoodburyMatrices v1.0.0 ⌅ [9b48221d] XAIBase v3.0.0 [c8c2cc18] XTermColors v0.2.1 [0dad84c5] ArgTools v1.1.1 [56f22d72] Artifacts [2a0f44e3] Base64 [ade2ca70] Dates [8ba89e20] Distributed [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching [b77e0a4c] InteractiveUtils [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 [8f399da3] Libdl [37e2e46d] LinearAlgebra [56ddb016] Logging [d6f4376e] Markdown [a63ad114] Mmap [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.10.0 [de0858da] Printf [3fa0cd96] REPL [9a3f8284] Random [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization [1a1011a3] SharedArrays [6462fe0b] Sockets [2f01184e] SparseArrays v1.10.0 [10745b16] Statistics v1.10.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test [cf7118a7] UUIDs [4ec0a83e] Unicode [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.4.0+0 [e37daf67] LibGit2_jll v1.6.4+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.2+1 [14a3606d] MozillaCACerts_jll v2023.1.10 [4536629a] OpenBLAS_jll v0.3.23+4 [bea87d4a] SuiteSparse_jll v7.2.1+1 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.52.0+1 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... [ Info: Running Aqua.jl's auto quality assurance tests. These might print warnings from dependencies. WARNING: using deprecated binding ImageCore.permuteddimsview in ImageBase. , use PermutedDimsArray instead. WARNING: ImageBase.permuteddimsview is deprecated, use Base.PermutedDimsArrays.PermutedDimsArray{T, N, perm, iperm, AA} where AA<:(AbstractArray{T, N} where N where T) where iperm where perm where N where T instead. likely near none:8 WARNING: using deprecated binding ImageCore.permuteddimsview in ImageBase. , use PermutedDimsArray instead. WARNING: ImageBase.permuteddimsview is deprecated, use Base.PermutedDimsArrays.PermutedDimsArray{T, N, perm, iperm, AA} where AA<:(AbstractArray{T, N} where N where T) where iperm where perm where N where T instead. likely near /home/pkgeval/.julia/packages/VisionHeatmaps/jHGLV/test/runtests.jl:9 [ Info: Running JuliaFormatter's code formatting tests. [ Info: Testing heatmaps... ┌ Info: Reference Test for "process_batch_false.txt" failed: │ - DIFF ------------------------ │ "Matrix{RGB{Float64}}[[RGB{Float64}(1.0, 0.0, 0.0) RGB{Float64}(0.8333333333333331, 0.0, 0.0); RGB{Float64}(0.6666666666666666, 0.0, 0.0) RGB{Float64}(0.5, 0.0, 0.0)], [RGB{Float64}(0.7142857142857142, 0.0, 0.0) RGB{Float64}(0.6428571428571428, 0.0, 0.0); RGB{Float64}(0.5714285714285714, 0.0, 0.0) RGB{Float64}(0.5, 0.0, 0.0)]]" │ ------------------------------- │ reference = "/home/pkgeval/.julia/packages/VisionHeatmaps/jHGLV/test/references/process_batch_false.txt" └ actual = "/tmp/jl_fnFmRt/process_batch_false.txt" Process batch: Error During Test at /home/pkgeval/.julia/packages/VisionHeatmaps/jHGLV/test/test_heatmap.jl:138 Got exception outside of a @test To update the reference images either run the tests interactively with 'include("test/runtests.jl")', or to force-update all failing reference images set the environment variable `JULIA_REFERENCETESTS_UPDATE` to "true" and re-run the tests via Pkg. Stacktrace: [1] error(s::String) @ Base ./error.jl:35 [2] test_reference(reference_file::FileIO.File{FileIO.DataFormat{:TXT}, String}, raw_actual::Vector{Matrix{RGB{Float64}}}, equiv::Nothing, rendermode::Nothing; kw::@Kwargs{}) @ ReferenceTests ~/.julia/packages/ReferenceTests/XRMSp/src/test_reference.jl:165 [3] test_reference(reference_file::FileIO.File{FileIO.DataFormat{:TXT}, String}, raw_actual::Vector{Matrix{RGB{Float64}}}, equiv::Nothing, rendermode::Nothing) @ ReferenceTests ~/.julia/packages/ReferenceTests/XRMSp/src/test_reference.jl:113 [4] test_reference(filename::String, raw_actual::Vector{Matrix{RGB{Float64}}}; by::Nothing, render::Nothing, format::Nothing, kw::@Kwargs{}) @ ReferenceTests ~/.julia/packages/ReferenceTests/XRMSp/src/test_reference.jl:110 [5] test_reference(filename::String, raw_actual::Vector{Matrix{RGB{Float64}}}) @ ReferenceTests ~/.julia/packages/ReferenceTests/XRMSp/src/test_reference.jl:105 [6] macro expansion @ ~/.julia/packages/VisionHeatmaps/jHGLV/test/test_heatmap.jl:142 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] top-level scope @ ~/.julia/packages/VisionHeatmaps/jHGLV/test/test_heatmap.jl:139 [9] include(fname::String) @ Base.MainInclude ./client.jl:494 [10] macro expansion @ ~/.julia/packages/VisionHeatmaps/jHGLV/test/runtests.jl:20 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [12] macro expansion @ ~/.julia/packages/VisionHeatmaps/jHGLV/test/runtests.jl:19 [inlined] [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [14] top-level scope @ ~/.julia/packages/VisionHeatmaps/jHGLV/test/runtests.jl:10 [15] include(fname::String) @ Base.MainInclude ./client.jl:494 [16] top-level scope @ none:6 [17] eval @ ./boot.jl:385 [inlined] [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [19] _start() @ Base ./client.jl:557 [ Info: Testing heatmaps on XAIBase explanations... ┌ Info: Reference Test for "process_batch_false.txt" failed: │ - DIFF ------------------------ │ "Matrix{RGB{Float64}}[[RGB{Float64}(1.0, 0.0, 0.0) RGB{Float64}(0.8333333333333331, 0.0, 0.0); RGB{Float64}(0.6666666666666666, 0.0, 0.0) RGB{Float64}(0.5, 0.0, 0.0)], [RGB{Float64}(0.7142857142857142, 0.0, 0.0) RGB{Float64}(0.6428571428571428, 0.0, 0.0); RGB{Float64}(0.5714285714285714, 0.0, 0.0) RGB{Float64}(0.5, 0.0, 0.0)]]" │ ------------------------------- │ reference = "/home/pkgeval/.julia/packages/VisionHeatmaps/jHGLV/test/references/process_batch_false.txt" └ actual = "/tmp/jl_m7WGrU/process_batch_false.txt" Batched input: Error During Test at /home/pkgeval/.julia/packages/VisionHeatmaps/jHGLV/test/test_xai_presets.jl:36 Got exception outside of a @test To update the reference images either run the tests interactively with 'include("test/runtests.jl")', or to force-update all failing reference images set the environment variable `JULIA_REFERENCETESTS_UPDATE` to "true" and re-run the tests via Pkg. Stacktrace: [1] error(s::String) @ Base ./error.jl:35 [2] test_reference(reference_file::FileIO.File{FileIO.DataFormat{:TXT}, String}, raw_actual::Vector{Matrix{RGB{Float64}}}, equiv::Nothing, rendermode::Nothing; kw::@Kwargs{}) @ ReferenceTests ~/.julia/packages/ReferenceTests/XRMSp/src/test_reference.jl:165 [3] test_reference(reference_file::FileIO.File{FileIO.DataFormat{:TXT}, String}, raw_actual::Vector{Matrix{RGB{Float64}}}, equiv::Nothing, rendermode::Nothing) @ ReferenceTests ~/.julia/packages/ReferenceTests/XRMSp/src/test_reference.jl:113 [4] test_reference(filename::String, raw_actual::Vector{Matrix{RGB{Float64}}}; by::Nothing, render::Nothing, format::Nothing, kw::@Kwargs{}) @ ReferenceTests ~/.julia/packages/ReferenceTests/XRMSp/src/test_reference.jl:110 [5] test_reference(filename::String, raw_actual::Vector{Matrix{RGB{Float64}}}) @ ReferenceTests ~/.julia/packages/ReferenceTests/XRMSp/src/test_reference.jl:105 [6] macro expansion @ ~/.julia/packages/VisionHeatmaps/jHGLV/test/test_xai_presets.jl:43 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] top-level scope @ ~/.julia/packages/VisionHeatmaps/jHGLV/test/test_xai_presets.jl:37 [9] include(fname::String) @ Base.MainInclude ./client.jl:494 [10] macro expansion @ ~/.julia/packages/VisionHeatmaps/jHGLV/test/runtests.jl:24 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [12] macro expansion @ ~/.julia/packages/VisionHeatmaps/jHGLV/test/runtests.jl:23 [inlined] [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [14] top-level scope @ ~/.julia/packages/VisionHeatmaps/jHGLV/test/runtests.jl:10 [15] include(fname::String) @ Base.MainInclude ./client.jl:494 [16] top-level scope @ none:6 [17] eval @ ./boot.jl:385 [inlined] [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [19] _start() @ Base ./client.jl:557 Test Summary: | Pass Error Total Time VisionHeatmaps.jl | 329 2 331 2m39.3s Aqua.jl | 11 11 1m03.1s JuliaFormatter.jl | 1 1 31.3s Heatmap | 310 1 311 51.4s Single input | 210 210 24.5s Overlay rescaling | 60 60 1.7s Overlay alpha masks | 8 8 1.0s Batched input | 20 20 0.0s ColorSchemes | 4 4 0.1s Error handling | 7 7 0.3s Color channel reduction | 1 1 3.4s Process batch | 1 1 18.0s XAIBase Explanations | 7 1 8 13.4s Heatmapping presets | 3 3 0.0s Overlay presets | 3 3 0.0s Batched input | 1 1 0.3s Direct Analyzer call | 1 1 13.0s ERROR: LoadError: Some tests did not pass: 329 passed, 0 failed, 2 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/VisionHeatmaps/jHGLV/test/runtests.jl:9 Testing failed after 167.97s ERROR: LoadError: Package VisionHeatmaps errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Types.jl:70 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:2034 [3] test @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:1915 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::Base.PipeEndpoint}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:444 [5] test(pkgs::Vector{Pkg.Types.PackageSpec}; io::Base.PipeEndpoint, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:159 [6] test @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:147 [inlined] [7] #test#74 @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:146 [inlined] [8] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 221.08s: package tests unexpectedly errored