Package evaluation of NistyPQC on Julia 1.10.8 (92f03a4775*) started at 2025-02-25T04:42:52.152 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 5.26s ################################################################################ # Installation # Installing NistyPQC... Resolving package versions... Updating `~/.julia/environments/v1.10/Project.toml` [2b8046e5] + NistyPQC v0.0.2 Updating `~/.julia/environments/v1.10/Manifest.toml` [dce04be8] + ArgCheck v2.4.0 [18e54dd8] + IntegerMathUtils v0.1.2 [2b8046e5] + NistyPQC v0.0.2 [27ebfcd6] + Primes v0.5.6 [9c8de619] + SHAKE v0.0.3 [9a3f8284] + Random [ea8e919c] + SHA v0.7.0 Installation completed after 3.99s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 33.58s ################################################################################ # Testing # Testing NistyPQC Status `/tmp/jl_VA1C1f/Project.toml` [4c88cf16] Aqua v0.8.11 [dce04be8] ArgCheck v2.4.0 [124859b0] DataDeps v0.7.13 [49dea1ee] Nettle v1.0.0 [2b8046e5] NistyPQC v0.0.2 [27ebfcd6] Primes v0.5.6 [9c8de619] SHAKE v0.0.3 [9a3f8284] Random [ea8e919c] SHA v0.7.0 [8dfed614] Test Status `/tmp/jl_VA1C1f/Manifest.toml` [4c88cf16] Aqua v0.8.11 [dce04be8] ArgCheck v2.4.0 [d1d4a3ce] BitFlags v0.1.9 [944b1d66] CodecZlib v0.7.8 [34da2185] Compat v4.16.0 [f0e56b4a] ConcurrentUtilities v2.5.0 [124859b0] DataDeps v0.7.13 [460bff9d] ExceptionUnwrapping v0.1.11 [cd3eb016] HTTP v1.10.15 [18e54dd8] IntegerMathUtils v0.1.2 [692b3bcd] JLLWrappers v1.7.0 [e6f89c97] LoggingExtras v1.1.0 [739be429] MbedTLS v1.1.9 [49dea1ee] Nettle v1.0.0 [2b8046e5] NistyPQC v0.0.2 [4d8831e6] OpenSSL v1.4.3 [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [27ebfcd6] Primes v0.5.6 [189a3867] Reexport v1.2.2 [9c8de619] SHAKE v0.0.3 [6c6a2e73] Scratch v1.2.1 [777ac1f9] SimpleBufferStream v1.2.0 [3bb67fe8] TranscodingStreams v0.11.3 [5c2747f8] URIs v1.5.1 [4c82536e] Nettle_jll v3.10.1+0 [458c3c95] OpenSSL_jll v3.0.16+0 [0dad84c5] ArgTools v1.1.1 [56f22d72] Artifacts [2a0f44e3] Base64 [ade2ca70] Dates [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching [b77e0a4c] InteractiveUtils [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 [8f399da3] Libdl [56ddb016] Logging [d6f4376e] Markdown [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.10.0 [de0858da] Printf [3fa0cd96] REPL [9a3f8284] Random [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization [6462fe0b] Sockets [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test [cf7118a7] UUIDs [4ec0a83e] Unicode [781609d7] GMP_jll v6.2.1+6 [deac9b47] LibCURL_jll v8.4.0+0 [e37daf67] LibGit2_jll v1.6.4+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.2+1 [14a3606d] MozillaCACerts_jll v2023.1.10 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.52.0+1 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... Skipping NistyPQC.MLDSA.Category5._ Skipping NistyPQC.MLDSA.Category3._ Skipping NistyPQC.MLDSA.Category2._ Skipping NistyPQC.Falcon.Parameters._ Skipping NistyPQC.Falcon.Category5._ Skipping NistyPQC.Falcon.Category1._ Skipping NistyPQC.BIKE.Category5._ Skipping NistyPQC.BIKE.Category3._ Skipping NistyPQC.BIKE.Category1._ Test Summary: | Pass Total Time Aqua.jl | 10 10 25.4s Test Summary: | Pass Total Time MLKEM.bits2bytes | 2 2 0.6s Test Summary: | Pass Total Time MLKEM.compress | 119844 119844 0.9s Test Summary: | Pass Total Time MLKEM.byte_encode | 23 23 0.0s Test Summary: | Pass Total Time MLKEM.ntt | 2 2 0.4s Test Summary: | Pass Total Time MLKEM.Category1.KPKE | 1 1 8.6s Test Summary: | Pass Total Time MLKEM.Category1 | 1 1 2.4s Test Summary: | Pass Total Time MLKEM.Category3.KPKE | 1 1 1.6s Test Summary: | Pass Total Time MLKEM.Category3 | 1 1 0.9s Test Summary: | Pass Total Time MLKEM.Category5.KPKE | 1 1 1.3s Test Summary: | Pass Total Time MLKEM.Category5 | 1 1 0.9s Test Summary: | Pass Total Time MLKEM.Category1: KAT.MLKEM_512 | 6000 6000 5.2s Test Summary: | Pass Total Time MLKEM.Category3: KAT.MLKEM_768 | 6000 6000 5.5s Test Summary: | Pass Total Time MLKEM.Category5: KAT.MLKEM_1024 | 6000 6000 7.1s Test Summary: | Pass Total Time MLDSA.power2_round | 8380417 8380417 6.6s Test Summary: | Pass Total Time MLDSA.ntt | 2 2 0.2s Test Summary: | Pass Total Time MLDSA.Category2.Encoding | 4 4 3.7s Test Summary: | Pass Total Time MLDSA.Category2 | 4 4 9.0s Test Summary: | Pass Total Time MLDSA.Category3.Encoding | 4 4 1.4s Test Summary: | Pass Total Time MLDSA.Category3 | 4 4 3.1s Test Summary: | Pass Total Time MLDSA.Category5.Encoding | 4 4 1.5s Test Summary: | Pass Total Time MLDSA.Category5 | 4 4 3.1s Test Summary: | Pass Total Time MLDSA.Category2: KAT.MLDSA_44_det | 300 300 2.8s Test Summary: | Pass Total Time MLDSA.Category2: KAT.MLDSA_44_hedged | 300 300 2.4s Test Summary: | Pass Total Time MLDSA.Category3: KAT.MLDSA_65_det | 300 300 4.4s Test Summary: | Pass Total Time MLDSA.Category3: KAT.MLDSA_65_hedged | 300 300 3.8s Test Summary: | Pass Total Time MLDSA.Category5: KAT.MLDSA_87_det | 300 300 5.4s Test Summary: | Pass Total Time MLDSA.Category5: KAT.MLDSA_87_hedged | 300 300 5.9s Test Summary: | Pass Total Time SLHDSA.base_2ᵇ | 1 1 0.3s Test Summary: | Pass Total Time SLHDSA.Category1s_SHA2.WOTS | 3 3 0.7s Test Summary: | Pass Total Time SLHDSA.Category1s_SHA2.XMSS | 3 3 2.0s Test Summary: | Pass Total Time SLHDSA.Category1s_SHA2.Hypertree | 3 3 7.3s Test Summary: | Pass Total Time SLHDSA.Category1s_SHA2.FORS | 3 3 2.2s Test Summary: | Pass Total Time SLHDSA.Category1s_SHA2 (randomized) | 4 4 9.3s Test Summary: | Pass Total Time SLHDSA.Category1s_SHA2 (not randomized) | 2 2 14.0s Test Summary: | Pass Total Time SLHDSA.Category1s_SHAKE.WOTS | 3 3 0.5s Test Summary: | Pass Total Time SLHDSA.Category1s_SHAKE.XMSS | 3 3 3.4s Test Summary: | Pass Total Time SLHDSA.Category1s_SHAKE.Hypertree | 3 3 13.1s Test Summary: | Pass Total Time SLHDSA.Category1s_SHAKE.FORS | 3 3 2.8s Test Summary: | Pass Total Time SLHDSA.Category1s_SHAKE (randomized) | 4 4 14.6s Test Summary: | Pass Total Time SLHDSA.Category1s_SHAKE (not randomized) | 2 2 25.2s Test Summary: | Pass Total Time SLHDSA.Category1f_SHA2.WOTS | 3 3 0.5s Test Summary: | Pass Total Time SLHDSA.Category1f_SHA2.XMSS | 3 3 0.2s Test Summary: | Pass Total Time SLHDSA.Category1f_SHA2.Hypertree | 3 3 0.6s Test Summary: | Pass Total Time SLHDSA.Category1f_SHA2.FORS | 3 3 0.9s Test Summary: | Pass Total Time SLHDSA.Category1f_SHA2 (randomized) | 4 4 1.0s Test Summary: | Pass Total Time SLHDSA.Category1f_SHA2 (not randomized) | 2 2 1.0s Test Summary: | Pass Total Time SLHDSA.Category1f_SHAKE.WOTS | 3 3 0.5s Test Summary: | Pass Total Time SLHDSA.Category1f_SHAKE.XMSS | 3 3 0.2s Test Summary: | Pass Total Time SLHDSA.Category1f_SHAKE.Hypertree | 3 3 0.9s Test Summary: | Pass Total Time SLHDSA.Category1f_SHAKE.FORS | 3 3 0.9s Test Summary: | Pass Total Time SLHDSA.Category1f_SHAKE (randomized) | 4 4 1.3s Test Summary: | Pass Total Time SLHDSA.Category1f_SHAKE (not randomized) | 2 2 1.6s Test Summary: | Pass Total Time SLHDSA.Category3s_SHA2.WOTS | 3 3 2.2s Test Summary: | Pass Total Time SLHDSA.Category3s_SHA2.XMSS | 3 3 2.8s Test Summary: | Pass Total Time SLHDSA.Category3s_SHA2.Hypertree | 3 3 10.1s Test Summary: | Pass Total Time SLHDSA.Category3s_SHA2.FORS | 3 3 5.5s Test Summary: | Pass Total Time SLHDSA.Category3s_SHA2 (randomized) | 4 4 13.5s Test Summary: | Pass Total Time SLHDSA.Category3s_SHA2 (not randomized) | 2 2 23.7s Test Summary: | Pass Total Time SLHDSA.Category3s_SHAKE.WOTS | 3 3 0.5s Test Summary: | Pass Total Time SLHDSA.Category3s_SHAKE.XMSS | 3 3 5.2s Test Summary: | Pass Total Time SLHDSA.Category3s_SHAKE.Hypertree | 3 3 19.4s Test Summary: | Pass Total Time SLHDSA.Category3s_SHAKE.FORS | 3 3 10.2s Test Summary: | Pass Total Time SLHDSA.Category3s_SHAKE (randomized) | 4 4 24.1s Test Summary: | Pass Total Time SLHDSA.Category3s_SHAKE (not randomized) | 2 2 45.2s Test Summary: | Pass Total Time SLHDSA.Category3f_SHA2.WOTS | 3 3 0.5s Test Summary: | Pass Total Time SLHDSA.Category3f_SHA2.XMSS | 3 3 0.2s Test Summary: | Pass Total Time SLHDSA.Category3f_SHA2.Hypertree | 3 3 0.7s Test Summary: | Pass Total Time SLHDSA.Category3f_SHA2.FORS | 3 3 1.0s Test Summary: | Pass Total Time SLHDSA.Category3f_SHA2 (randomized) | 4 4 1.3s Test Summary: | Pass Total Time SLHDSA.Category3f_SHA2 (not randomized) | 2 2 1.3s Test Summary: | Pass Total Time SLHDSA.Category3f_SHAKE.WOTS | 3 3 0.5s Test Summary: | Pass Total Time SLHDSA.Category3f_SHAKE.XMSS | 3 3 0.2s Test Summary: | Pass Total Time SLHDSA.Category3f_SHAKE.Hypertree | 3 3 1.2s Test Summary: | Pass Total Time SLHDSA.Category3f_SHAKE.FORS | 3 3 1.2s Test Summary: | Pass Total Time SLHDSA.Category3f_SHAKE (randomized) | 4 4 1.8s Test Summary: | Pass Total Time SLHDSA.Category3f_SHAKE (not randomized) | 2 2 2.4s Test Summary: | Pass Total Time SLHDSA.Category5s_SHA2.WOTS | 3 3 0.5s Test Summary: | Pass Total Time SLHDSA.Category5s_SHA2.XMSS | 3 3 1.8s Test Summary: | Pass Total Time SLHDSA.Category5s_SHA2.Hypertree | 3 3 7.6s Test Summary: | Pass Total Time SLHDSA.Category5s_SHA2.FORS | 3 3 6.7s Test Summary: | Pass Total Time SLHDSA.Category5s_SHA2 (randomized) | 4 4 11.0s Test Summary: | Pass Total Time SLHDSA.Category5s_SHA2 (not randomized) | 2 2 20.6s Test Summary: | Pass Total Time SLHDSA.Category5s_SHAKE.WOTS | 3 3 0.5s Test Summary: | Pass Total Time SLHDSA.Category5s_SHAKE.XMSS | 3 3 3.4s Test Summary: | Pass Total Time SLHDSA.Category5s_SHAKE.Hypertree | 3 3 14.7s Test Summary: | Pass Total Time SLHDSA.Category5s_SHAKE.FORS | 3 3 13.3s Test Summary: | Pass Total Time SLHDSA.Category5s_SHAKE (randomized) | 4 4 21.9s Test Summary: | Pass Total Time SLHDSA.Category5s_SHAKE (not randomized) | 2 2 40.7s Test Summary: | Pass Total Time SLHDSA.Category5f_SHA2.WOTS | 3 3 0.5s Test Summary: | Pass Total Time SLHDSA.Category5f_SHA2.XMSS | 3 3 0.5s Test Summary: | Pass Total Time SLHDSA.Category5f_SHA2.Hypertree | 3 3 1.3s Test Summary: | Pass Total Time SLHDSA.Category5f_SHA2.FORS | 3 3 1.2s Test Summary: | Pass Total Time SLHDSA.Category5f_SHA2 (randomized) | 4 4 1.9s Test Summary: | Pass Total Time SLHDSA.Category5f_SHA2 (not randomized) | 2 2 2.5s Test Summary: | Pass Total Time SLHDSA.Category5f_SHAKE.WOTS | 3 3 0.5s Test Summary: | Pass Total Time SLHDSA.Category5f_SHAKE.XMSS | 3 3 0.4s Test Summary: | Pass Total Time SLHDSA.Category5f_SHAKE.Hypertree | 3 3 2.2s Test Summary: | Pass Total Time SLHDSA.Category5f_SHAKE.FORS | 3 3 1.5s Test Summary: | Pass Total Time SLHDSA.Category5f_SHAKE (randomized) | 4 4 3.0s Test Summary: | Pass Total Time SLHDSA.Category5f_SHAKE (not randomized) | 2 2 4.6s Test Summary: | Pass Total Time SLHDSA.Category1s_SHA2: KAT.sphincs-sha2-128s-simple | 3 3 7.9s Test Summary: | Pass Total Time SLHDSA.Category1s_SHAKE: KAT.sphincs-shake-128s-simple | 3 3 15.0s Test Summary: | Pass Total Time SLHDSA.Category1f_SHA2: KAT.sphincs-sha2-128f-simple | 3 3 0.4s Test Summary: | Pass Total Time SLHDSA.Category1f_SHAKE: KAT.sphincs-shake-128f-simple | 3 3 0.6s Test Summary: | Pass Total Time SLHDSA.Category3s_SHA2: KAT.sphincs-sha2-192s-simple | 3 3 13.5s Test Summary: | Pass Total Time SLHDSA.Category3s_SHAKE: KAT.sphincs-shake-192s-simple | 3 3 25.3s Test Summary: | Pass Total Time SLHDSA.Category3f_SHA2: KAT.sphincs-sha2-192f-simple | 3 3 0.6s Test Summary: | Pass Total Time SLHDSA.Category3f_SHAKE: KAT.sphincs-shake-192f-simple | 3 3 1.1s Test Summary: | Pass Total Time SLHDSA.Category5s_SHA2: KAT.sphincs-sha2-256s-simple | 3 3 11.8s Test Summary: | Pass Total Time SLHDSA.Category5s_SHAKE: KAT.sphincs-shake-256s-simple | 3 3 21.3s Test Summary: | Pass Total Time SLHDSA.Category5f_SHA2: KAT.sphincs-sha2-256f-simple | 3 3 1.2s Test Summary: | Pass Total Time SLHDSA.Category5f_SHAKE: KAT.sphincs-shake-256f-simple | 3 3 2.2s Test Summary: | Pass Total Time Falcon.Parameters | 5 5 0.2s Test Summary: | Pass Total Time Falcon.Category1.Parameters (category specific) | 3 3 0.1s Test Summary: | Pass Total Time Falcon.Category5.Parameters (category specific) | 3 3 0.0s Test Summary: | Pass Total Time Falcon.Category1.dft.F0 | 5 5 1.4s Test Summary: | Pass Total Time Falcon.Category1.dft.Fq | 5 5 0.8s Test Summary: | Pass Total Time Falcon.Category1.NTRU.generate | 1 1 10.1s Test Summary: | Pass Total Time Falcon.Category1.Encoding | 3 3 1.3s Test Summary: | Pass Total Time Falcon.Category1 | 4 4 7.2s Test Summary: | Pass Total Time Falcon.Category5.dft.F0 | 5 5 1.2s Test Summary: | Pass Total Time Falcon.Category5.dft.Fq | 5 5 0.8s Test Summary: | Pass Total Time Falcon.Category5.NTRU.generate | 1 1 6.6s Test Summary: | Pass Total Time Falcon.Category5.Encoding | 3 3 0.2s Test Summary: | Pass Total Time Falcon.Category5 | 4 4 6.4s Test Summary: | Pass Total Time Falcon.Category1: KAT.512 | 200 200 2.1s Test Summary: | Pass Total Time Falcon.Category5: KAT.1024 | 199 199 3.4s Test Summary: | Pass Total Time BIKE.Category1.Ring.to_bits | 2 2 0.2s Test Summary: | Pass Total Time BIKE.Category1.Ring.to_bytes | 2 2 0.0s Test Summary: | Pass Total Time BIKE.Category1.Ring | 9 9 2.1s Test Summary: | Pass Total Time BIKE.Category1.Sampling | 2 2 0.7s Test Summary: | Pass Total Time BIKE.Category1.Hashing | 2 2 0.6s Test Summary: | Pass Total Time BIKE.Category1 | 1 1 2.9s Test Summary: | Pass Total Time BIKE.Category3.Ring.to_bits | 2 2 0.1s Test Summary: | Pass Total Time BIKE.Category3.Ring.to_bytes | 2 2 0.0s Test Summary: | Pass Total Time BIKE.Category3.Ring | 9 9 3.2s Test Summary: | Pass Total Time BIKE.Category3.Sampling | 2 2 0.4s Test Summary: | Pass Total Time BIKE.Category3.Hashing | 2 2 0.0s Test Summary: | Pass Total Time BIKE.Category3 | 1 1 4.3s Test Summary: | Pass Total Time BIKE.Category5.Ring.to_bits | 2 2 0.1s Test Summary: | Pass Total Time BIKE.Category5.Ring.to_bytes | 2 2 0.0s Test Summary: | Pass Total Time BIKE.Category5.Ring | 9 9 5.5s Test Summary: | Pass Total Time BIKE.Category5.Sampling | 2 2 0.4s Test Summary: | Pass Total Time BIKE.Category5.Hashing | 2 2 0.0s Test Summary: | Pass Total Time BIKE.Category5 | 1 1 7.4s Test Summary: | Pass Total Time BIKE.Category1: KAT.BIKE_L1 | 500 500 45.6s Test Summary: | Pass Total Time BIKE.Category3: KAT.BIKE_L3 | 500 500 4m05.5s Test Summary: | Pass Total Time BIKE.Category5: KAT.BIKE_L5 | 500 500 8m55.9s Test Summary: | Pass Total Time McEliece.Matrices.rref! | 1 1 1.6s Test Summary: | Pass Total Time McEliece.Matrices.semisystematic_form! | 3 3 2.3s Test Summary: | Pass Total Time McEliece.Category1.Rings | 42 42 2.6s Test Summary: | Pass Total Time McEliece.Category1.ErrorDecoding | 1 1 7.7s Test Summary: | Pass Total Time McEliece.Category1 | 1 1 11.5s Test Summary: | Pass Total Time McEliece.Category1f.Rings | 42 42 1.9s Test Summary: | Pass Total Time McEliece.Category1f.ErrorDecoding | 4 4 5.5s Test Summary: | Pass Total Time McEliece.Category1f | 1 1 5.7s Test Summary: | Pass Total Time McEliece.Category3.Rings | 42 42 2.1s Test Summary: | Pass Total Time McEliece.Category3.ErrorDecoding | 1 1 4.1s Test Summary: | Pass Total Time McEliece.Category3 | 1 1 7.1s Test Summary: | Pass Total Time McEliece.Category3f.Rings | 42 42 2.0s Test Summary: | Pass Total Time McEliece.Category3f.ErrorDecoding | 4 4 5.5s Test Summary: | Pass Total Time McEliece.Category3f | 1 1 6.5s Test Summary: | Pass Total Time McEliece.Category5A.Rings | 42 42 2.0s Test Summary: | Pass Total Time McEliece.Category5A.ErrorDecoding | 1 1 4.5s Test Summary: | Pass Total Time McEliece.Category5A | 1 1 8.7s Test Summary: | Pass Total Time McEliece.Category5Af.Rings | 42 42 2.0s Test Summary: | Pass Total Time McEliece.Category5Af.ErrorDecoding | 4 4 6.5s Test Summary: | Pass Total Time McEliece.Category5Af | 1 1 7.6s Test Summary: | Pass Total Time McEliece.Category5B.Rings | 42 42 2.0s Test Summary: | Pass Total Time McEliece.Category5B.ErrorDecoding | 1 1 4.4s Test Summary: | Pass Total Time McEliece.Category5B | 1 1 15.2s Test Summary: | Pass Total Time McEliece.Category5Bf.Rings | 42 42 2.0s Test Summary: | Pass Total Time McEliece.Category5Bf.ErrorDecoding | 4 4 6.4s Test Summary: | Pass Total Time McEliece.Category5Bf | 1 1 7.6s Test Summary: | Pass Total Time McEliece.Category5C.Rings | 42 42 2.0s Test Summary: | Pass Total Time McEliece.Category5C.ErrorDecoding | 1 1 4.5s Test Summary: | Pass Total Time McEliece.Category5C | 1 1 9.0s Test Summary: | Pass Total Time McEliece.Category5Cf.Rings | 42 42 2.1s Test Summary: | Pass Total Time McEliece.Category5Cf.ErrorDecoding | 4 4 7.2s Test Summary: | Pass Total Time McEliece.Category5Cf | 1 1 8.2s Test Summary: | Pass Total Time McEliece.Category1: KAT.348864 | 50 50 9.1s Test Summary: | Pass Total Time McEliece.Category1f: KAT.348864f | 50 50 7.0s Test Summary: | Pass Total Time McEliece.Category3: KAT.460896 | 50 50 21.8s Test Summary: | Pass Total Time McEliece.Category3f: KAT.460896f | 50 50 14.1s Test Summary: | Pass Total Time McEliece.Category5A: KAT.6688128 | 50 50 45.0s Test Summary: | Pass Total Time McEliece.Category5Af: KAT.6688128f | 50 50 24.4s Test Summary: | Pass Total Time McEliece.Category5B: KAT.6960119 | 50 50 42.6s Test Summary: | Pass Total Time McEliece.Category5Bf: KAT.6960119f | 50 50 24.5s Test Summary: | Pass Total Time McEliece.Category5C: KAT.8192128 | 50 50 46.6s Test Summary: | Pass Total Time McEliece.Category5Cf: KAT.8192128f | 50 50 30.7s Testing NistyPQC tests passed Testing completed after 2035.51s PkgEval succeeded after 2083.45s