Package evaluation of MIPVerify on Julia 1.13.0-DEV.1003 (44fdede182*) started at 2025-08-19T21:11:29.917 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 9.97s ################################################################################ # Installation # Installing MIPVerify... Resolving package versions... Updating `~/.julia/environments/v1.13/Project.toml` [e5e5f8be] + MIPVerify v0.5.4 Updating `~/.julia/environments/v1.13/Manifest.toml` [6e4b80f9] + BenchmarkTools v1.6.0 [e1450e63] + BufferedStreams v1.2.2 [96374032] + CRlibm v1.0.2 [336ed68f] + CSV v0.10.15 [523fee87] + CodecBzip2 v0.8.5 [944b1d66] + CodecZlib v0.7.8 [bbf7d656] + CommonSubexpressions v0.3.1 [34da2185] + Compat v4.18.0 [a8cc5b0e] + Crayons v4.1.1 [9a962f9c] + DataAPI v1.16.0 [a93c6f00] + DataFrames v1.7.0 ⌅ [864edb3b] + DataStructures v0.18.22 [e2d170a0] + DataValueInterfaces v1.0.0 [8bb1440f] + DelimitedFiles v1.9.1 [163ba53b] + DiffResults v1.1.0 [b552c78f] + DiffRules v1.15.1 [ffbed154] + DocStringExtensions v0.9.5 [48062228] + FilePathsBase v0.9.24 [f6369f11] + ForwardDiff v1.0.1 [f67ccb44] + HDF5 v0.17.2 [842dd82b] + InlineStrings v1.4.4 ⌅ [d1acc4aa] + IntervalArithmetic v0.22.36 [41ab1584] + InvertedIndices v1.3.1 [92d709cd] + IrrationalConstants v0.2.4 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.7.1 [682c06a0] + JSON v0.21.4 [0f8b85d8] + JSON3 v1.14.3 [4076af6c] + JuMP v1.28.0 [b964fa9f] + LaTeXStrings v1.4.0 [2ab3a3ac] + LogExpFunctions v0.3.29 [23992714] + MAT v0.10.7 [e5e5f8be] + MIPVerify v0.5.4 [3da0fdf6] + MPIPreferences v0.1.11 [1914dd2f] + MacroTools v0.5.16 [b8f27783] + MathOptInterface v1.42.1 [f28f55f0] + Memento v1.4.1 [e1d29d7a] + Missings v1.2.0 [d8a4904e] + MutableArithmetics v1.6.4 [77ba4419] + NaNMath v1.1.3 [bac558e1] + OrderedCollections v1.8.1 [69de0a69] + Parsers v2.8.3 [2dfb63ee] + PooledArrays v1.4.3 [aea7be01] + PrecompileTools v1.3.2 [21216c6a] + Preferences v1.5.0 [08abe8d2] + PrettyTables v2.4.0 [92933f4c] + ProgressMeter v1.10.4 [189a3867] + Reexport v1.2.2 [ae029012] + Requires v1.3.1 [5eaf0fd0] + RoundingEmulator v0.2.1 [91c51154] + SentinelArrays v1.4.8 [a2af1166] + SortingAlgorithms v1.2.2 [276daf66] + SpecialFunctions v2.5.1 [1e83bf80] + StaticArraysCore v1.4.3 [10745b16] + Statistics v1.11.1 [892a3eda] + StringManipulation v0.4.1 [856f2bd8] + StructTypes v1.11.0 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.12.1 [3bb67fe8] + TranscodingStreams v0.11.3 [ea10d353] + WeakRefStrings v1.4.2 [76eceee3] + WorkerUtilities v1.6.1 [6e34b625] + Bzip2_jll v1.0.9+0 [4e9b3aee] + CRlibm_jll v1.0.1+0 [0234f1f7] + HDF5_jll v1.14.6+0 [e33a78d0] + Hwloc_jll v2.12.1+0 [7cb0a576] + MPICH_jll v4.3.1+0 [f1f71cc9] + MPItrampoline_jll v5.5.4+0 [9237b28f] + MicrosoftMPI_jll v10.1.4+3 [6cdc7f73] + OpenBLASConsistentFPCSR_jll v0.3.29+0 [fe0851c0] + OpenMPI_jll v5.0.8+0 [efe28fd5] + OpenSpecFun_jll v0.5.6+0 [477f73a3] + libaec_jll v1.1.3+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [9fa8497b] + Future v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [4af54fe1] + LazyArtifacts v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.13.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.13.0 [de0858da] + Printf v1.11.0 [9abbd945] + Profile v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [2f01184e] + SparseArrays v1.13.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.15.0+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.8.12 [4536629a] + OpenBLAS_jll v0.3.29+0 [05823500] + OpenLibm_jll v0.8.7+0 [458c3c95] + OpenSSL_jll v3.5.2+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [bea87d4a] + SuiteSparse_jll v7.10.1+0 [83775a58] + Zlib_jll v1.3.1+2 [3161d3a3] + Zstd_jll v1.5.7+1 [8e850b90] + libblastrampoline_jll v5.13.1+0 [8e850ede] + nghttp2_jll v1.66.0+0 [3f19e933] + p7zip_jll v17.6.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 9.01s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 44.44s ################################################################################ # Testing # Testing MIPVerify Status `/tmp/jl_lOZ9oj/Project.toml` [336ed68f] CSV v0.10.15 [a93c6f00] DataFrames v1.7.0 [8bb1440f] DelimitedFiles v1.9.1 [ffbed154] DocStringExtensions v0.9.5 [87dc4568] HiGHS v1.19.0 ⌅ [d1acc4aa] IntervalArithmetic v0.22.36 [4076af6c] JuMP v1.28.0 [23992714] MAT v0.10.7 [e5e5f8be] MIPVerify v0.5.4 [b8f27783] MathOptInterface v1.42.1 [f28f55f0] Memento v1.4.1 [92933f4c] ProgressMeter v1.10.4 [10745b16] Statistics v1.11.1 [a759f4b9] TimerOutputs v0.5.29 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [9e88b42a] Serialization v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_lOZ9oj/Manifest.toml` [6e4b80f9] BenchmarkTools v1.6.0 [e1450e63] BufferedStreams v1.2.2 [96374032] CRlibm v1.0.2 [336ed68f] CSV v0.10.15 [523fee87] CodecBzip2 v0.8.5 [944b1d66] CodecZlib v0.7.8 [bbf7d656] CommonSubexpressions v0.3.1 [34da2185] Compat v4.18.0 [a8cc5b0e] Crayons v4.1.1 [9a962f9c] DataAPI v1.16.0 [a93c6f00] DataFrames v1.7.0 ⌅ [864edb3b] DataStructures v0.18.22 [e2d170a0] DataValueInterfaces v1.0.0 [8bb1440f] DelimitedFiles v1.9.1 [163ba53b] DiffResults v1.1.0 [b552c78f] DiffRules v1.15.1 [ffbed154] DocStringExtensions v0.9.5 [e2ba6199] ExprTools v0.1.10 [48062228] FilePathsBase v0.9.24 [f6369f11] ForwardDiff v1.0.1 [f67ccb44] HDF5 v0.17.2 [87dc4568] HiGHS v1.19.0 [842dd82b] InlineStrings v1.4.4 ⌅ [d1acc4aa] IntervalArithmetic v0.22.36 [41ab1584] InvertedIndices v1.3.1 [92d709cd] IrrationalConstants v0.2.4 [82899510] IteratorInterfaceExtensions v1.0.0 [692b3bcd] JLLWrappers v1.7.1 [682c06a0] JSON v0.21.4 [0f8b85d8] JSON3 v1.14.3 [4076af6c] JuMP v1.28.0 [b964fa9f] LaTeXStrings v1.4.0 [2ab3a3ac] LogExpFunctions v0.3.29 [23992714] MAT v0.10.7 [e5e5f8be] MIPVerify v0.5.4 [3da0fdf6] MPIPreferences v0.1.11 [1914dd2f] MacroTools v0.5.16 [8c4f8055] MathOptIIS v0.1.1 [b8f27783] MathOptInterface v1.42.1 [f28f55f0] Memento v1.4.1 [e1d29d7a] Missings v1.2.0 [d8a4904e] MutableArithmetics v1.6.4 [77ba4419] NaNMath v1.1.3 [bac558e1] OrderedCollections v1.8.1 [69de0a69] Parsers v2.8.3 [2dfb63ee] PooledArrays v1.4.3 [aea7be01] PrecompileTools v1.3.2 [21216c6a] Preferences v1.5.0 [08abe8d2] PrettyTables v2.4.0 [92933f4c] ProgressMeter v1.10.4 [189a3867] Reexport v1.2.2 [ae029012] Requires v1.3.1 [5eaf0fd0] RoundingEmulator v0.2.1 [91c51154] SentinelArrays v1.4.8 [a2af1166] SortingAlgorithms v1.2.2 [276daf66] SpecialFunctions v2.5.1 [1e83bf80] StaticArraysCore v1.4.3 [10745b16] Statistics v1.11.1 [892a3eda] StringManipulation v0.4.1 [856f2bd8] StructTypes v1.11.0 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.1 [a759f4b9] TimerOutputs v0.5.29 [3bb67fe8] TranscodingStreams v0.11.3 [ea10d353] WeakRefStrings v1.4.2 [76eceee3] WorkerUtilities v1.6.1 [6e34b625] Bzip2_jll v1.0.9+0 [4e9b3aee] CRlibm_jll v1.0.1+0 [0234f1f7] HDF5_jll v1.14.6+0 [8fd58aa0] HiGHS_jll v1.11.0+1 [e33a78d0] Hwloc_jll v2.12.1+0 [7cb0a576] MPICH_jll v4.3.1+0 [f1f71cc9] MPItrampoline_jll v5.5.4+0 [9237b28f] MicrosoftMPI_jll v10.1.4+3 [6cdc7f73] OpenBLASConsistentFPCSR_jll v0.3.29+0 [fe0851c0] OpenMPI_jll v5.0.8+0 [efe28fd5] OpenSpecFun_jll v0.5.6+0 [477f73a3] libaec_jll v1.1.3+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [4af54fe1] LazyArtifacts v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.13.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.13.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.8.12 [4536629a] OpenBLAS_jll v0.3.29+0 [05823500] OpenLibm_jll v0.8.7+0 [458c3c95] OpenSSL_jll v3.5.2+0 [efcefdf7] PCRE2_jll v10.45.0+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [83775a58] Zlib_jll v1.3.1+2 [3161d3a3] Zstd_jll v1.5.7+1 [8e850b90] libblastrampoline_jll v5.13.1+0 [8e850ede] nghttp2_jll v1.66.0+0 [3f19e933] p7zip_jll v17.6.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Precompiling packages... 2044.2 ms ? Memento 1308.6 ms ✓ IntervalArithmetic → IntervalArithmeticDiffRulesExt 15714.8 ms ✓ HDF5 2591.0 ms ✓ IntervalArithmetic → IntervalArithmeticForwardDiffExt 8237.2 ms ✓ MAT Info Given MIPVerify was explicitly requested, output will be shown live  WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. 13636.6 ms ? MIPVerify 4 dependencies successfully precompiled in 46 seconds. 114 already precompiled. 2 dependencies failed but may be precompilable after restarting julia 2 dependencies had output during precompilation: ┌ MIPVerify │ [Output was shown above] └ ┌ Memento │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. └ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. Precompiling packages... Info Given Memento was explicitly requested, output will be shown live  WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. 2561.4 ms ? Memento WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. ──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── Time Allocations ─────────────────────── ──────────────────────── Tot / % measured: 565s / 97.3% 15.2GiB / 98.5% Section ncalls time %tot avg alloc %tot avg ──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── integration/ 1 215s 39.0% 215s 4.08GiB 27.2% 4.08GiB sequential/ 1 215s 39.0% 215s 4.08GiB 27.2% 4.08GiB generated_weights/ 1 215s 39.0% 215s 4.08GiB 27.2% 4.08GiB conv+fc+softmax.jl 1 109s 19.9% 109s 827MiB 5.4% 827MiB BlurringPerturbationFamily 1 80.1s 14.6% 80.1s 625MiB 4.1% 625MiB UnrestrictedPerturbationFamily 1 28.0s 5.1% 28.0s 175MiB 1.1% 175MiB Minimizing lInf norm 1 13.7s 2.5% 13.7s 52.8MiB 0.3% 52.8MiB Minimizing l1 norm 1 9.46s 1.7% 9.46s 69.1MiB 0.5% 69.1MiB With multiple target labels specified, minimum target label found 1 4.85s 0.9% 4.85s 52.6MiB 0.3% 52.6MiB LInfNormBoundedPerturbationFamily 1 968ms 0.2% 968ms 17.0MiB 0.1% 17.0MiB mfc+mfc+softmax.jl 1 105s 19.1% 105s 3.27GiB 21.8% 3.27GiB batch_processing_helpers/ 1 171s 31.1% 171s 2.79GiB 18.6% 2.79GiB integration.jl 1 158s 28.7% 158s 2.15GiB 14.4% 2.15GiB unit.jl 1 13.1s 2.4% 13.1s 650MiB 4.2% 650MiB utils/ 1 104s 18.9% 104s 6.72GiB 44.8% 6.72GiB import_example_nets.jl 1 71.5s 13.0% 71.5s 3.01GiB 20.0% 3.01GiB get_example_network_params 1 71.5s 13.0% 71.5s 3.01GiB 20.0% 3.01GiB MNIST.WK17a_linf0.1_authors 1 54.6s 9.9% 54.6s 1.52GiB 10.1% 1.52GiB MNIST.RSL18a_linf0.1_authors 1 12.2s 2.2% 12.2s 784MiB 5.1% 784MiB MNIST.n1 1 4.64s 0.8% 4.64s 742MiB 4.8% 742MiB import_datasets.jl 1 32.3s 5.9% 32.3s 3.71GiB 24.7% 3.71GiB net_components/ 1 60.1s 10.9% 60.1s 1.41GiB 9.4% 1.41GiB layers/ 1 34.5s 6.3% 34.5s 832MiB 5.4% 832MiB core_ops.jl 1 15.6s 2.8% 15.6s 442MiB 2.9% 442MiB nets/ 1 2.23s 0.4% 2.23s 45.7MiB 0.3% 45.7MiB models.jl 1 8.92ms 0.0% 8.92ms 16.5KiB 0.0% 16.5KiB ──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── Test Summary: | Pass Total Time MIPVerify | 340 340 9m24.9s Testing MIPVerify tests passed Testing completed after 721.56s PkgEval succeeded after 812.69s