Package evaluation of BenchmarkCI on Julia 1.10.8 (92f03a4775*) started at 2025-02-25T09:07:58.941 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 5.28s ################################################################################ # Installation # Installing BenchmarkCI... Resolving package versions... Updating `~/.julia/environments/v1.10/Project.toml` [20533458] + BenchmarkCI v0.1.9 Updating `~/.julia/environments/v1.10/Manifest.toml` [1520ce14] + AbstractTrees v0.4.5 [20533458] + BenchmarkCI v0.1.9 [6e4b80f9] + BenchmarkTools v1.6.0 [d1d4a3ce] + BitFlags v0.1.9 [944b1d66] + CodecZlib v0.7.8 [34da2185] + Compat v4.16.0 [f0e56b4a] + ConcurrentUtilities v2.5.0 [187b0558] + ConstructionBase v1.5.8 [adafc99b] + CpuId v0.3.1 [460bff9d] + ExceptionUnwrapping v0.1.11 [bc5e4493] + GitHub v5.9.0 [cd3eb016] + HTTP v1.10.15 [692b3bcd] + JLLWrappers v1.7.0 [682c06a0] + JSON v0.21.4 [1d6d02ad] + LeftChildRightSiblingTrees v0.2.0 [e6f89c97] + LoggingExtras v1.1.0 [1914dd2f] + MacroTools v0.5.15 [739be429] + MbedTLS v1.1.9 [4d8831e6] + OpenSSL v1.4.3 [69de0a69] + Parsers v2.8.1 [32113eaa] + PkgBenchmark v0.2.12 [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [33c8b6b6] + ProgressLogging v0.1.4 [ae029012] + Requires v1.3.0 ⌅ [efcf1570] + Setfield v0.8.2 [777ac1f9] + SimpleBufferStream v1.2.0 [2133526b] + SodiumSeal v0.1.1 [5d786b92] + TerminalLoggers v0.1.7 [3bb67fe8] + TranscodingStreams v0.11.3 [5c2747f8] + URIs v1.5.1 [3a884ed6] + UnPack v1.0.2 [458c3c95] + OpenSSL_jll v3.0.16+0 [3161d3a3] + Zstd_jll v1.5.7+1 [a9144af2] + libsodium_jll v1.0.20+3 [0dad84c5] + ArgTools v1.1.1 [56f22d72] + Artifacts [2a0f44e3] + Base64 [ade2ca70] + Dates [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching [9fa8497b] + Future [b77e0a4c] + InteractiveUtils [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 [8f399da3] + Libdl [37e2e46d] + LinearAlgebra [56ddb016] + Logging [d6f4376e] + Markdown [a63ad114] + Mmap [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.10.0 [de0858da] + Printf [9abbd945] + Profile [3fa0cd96] + REPL [9a3f8284] + Random [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization [6462fe0b] + Sockets [2f01184e] + SparseArrays v1.10.0 [10745b16] + Statistics v1.10.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test [cf7118a7] + UUIDs [4ec0a83e] + Unicode [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] + LibCURL_jll v8.4.0+0 [e37daf67] + LibGit2_jll v1.6.4+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.2+1 [14a3606d] + MozillaCACerts_jll v2023.1.10 [4536629a] + OpenBLAS_jll v0.3.23+4 [bea87d4a] + SuiteSparse_jll v7.2.1+1 [83775a58] + Zlib_jll v1.2.13+1 [8e850b90] + libblastrampoline_jll v5.11.0+0 [8e850ede] + nghttp2_jll v1.52.0+1 [3f19e933] + p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 6.28s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 23.05s ################################################################################ # Testing # Testing BenchmarkCI Status `/tmp/jl_Uh3PHZ/Project.toml` [20533458] BenchmarkCI v0.1.9 [6e4b80f9] BenchmarkTools v1.6.0 [adafc99b] CpuId v0.3.1 [bc5e4493] GitHub v5.9.0 [682c06a0] JSON v0.21.4 [32113eaa] PkgBenchmark v0.2.12 ⌅ [efcf1570] Setfield v0.8.2 [3a884ed6] UnPack v1.0.2 [3161d3a3] Zstd_jll v1.5.7+1 [2a0f44e3] Base64 [ade2ca70] Dates [37e2e46d] LinearAlgebra [56ddb016] Logging [d6f4376e] Markdown [44cfe95a] Pkg v1.10.0 [a4e569a6] Tar v1.10.0 [8dfed614] Test Status `/tmp/jl_Uh3PHZ/Manifest.toml` [1520ce14] AbstractTrees v0.4.5 [20533458] BenchmarkCI v0.1.9 [6e4b80f9] BenchmarkTools v1.6.0 [d1d4a3ce] BitFlags v0.1.9 [944b1d66] CodecZlib v0.7.8 [34da2185] Compat v4.16.0 [f0e56b4a] ConcurrentUtilities v2.5.0 [187b0558] ConstructionBase v1.5.8 [adafc99b] CpuId v0.3.1 [460bff9d] ExceptionUnwrapping v0.1.11 [bc5e4493] GitHub v5.9.0 [cd3eb016] HTTP v1.10.15 [692b3bcd] JLLWrappers v1.7.0 [682c06a0] JSON v0.21.4 [1d6d02ad] LeftChildRightSiblingTrees v0.2.0 [e6f89c97] LoggingExtras v1.1.0 [1914dd2f] MacroTools v0.5.15 [739be429] MbedTLS v1.1.9 [4d8831e6] OpenSSL v1.4.3 [69de0a69] Parsers v2.8.1 [32113eaa] PkgBenchmark v0.2.12 [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [33c8b6b6] ProgressLogging v0.1.4 [ae029012] Requires v1.3.0 ⌅ [efcf1570] Setfield v0.8.2 [777ac1f9] SimpleBufferStream v1.2.0 [2133526b] SodiumSeal v0.1.1 [5d786b92] TerminalLoggers v0.1.7 [3bb67fe8] TranscodingStreams v0.11.3 [5c2747f8] URIs v1.5.1 [3a884ed6] UnPack v1.0.2 [458c3c95] OpenSSL_jll v3.0.16+0 [3161d3a3] Zstd_jll v1.5.7+1 [a9144af2] libsodium_jll v1.0.20+3 [0dad84c5] ArgTools v1.1.1 [56f22d72] Artifacts [2a0f44e3] Base64 [ade2ca70] Dates [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching [9fa8497b] Future [b77e0a4c] InteractiveUtils [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 [8f399da3] Libdl [37e2e46d] LinearAlgebra [56ddb016] Logging [d6f4376e] Markdown [a63ad114] Mmap [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.10.0 [de0858da] Printf [9abbd945] Profile [3fa0cd96] REPL [9a3f8284] Random [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization [6462fe0b] Sockets [2f01184e] SparseArrays v1.10.0 [10745b16] Statistics v1.10.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test [cf7118a7] UUIDs [4ec0a83e] Unicode [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.4.0+0 [e37daf67] LibGit2_jll v1.6.4+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.2+1 [14a3606d] MozillaCACerts_jll v2023.1.10 [4536629a] OpenBLAS_jll v0.3.23+4 [bea87d4a] SuiteSparse_jll v7.2.1+1 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.52.0+1 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Cloning into 'BenchmarkCIExample.jl'... [ Info: Testing with target = testcase/0000-with-manifest Note: switching to 'testcase/0000-with-manifest'. You are in 'detached HEAD' state. You can look around, make experimental changes and commit them, and you can discard any commits you make in this state without impacting any branches by switching back to a branch. If you want to create a new branch to retain commits you create, you may do so (now or later) by using -c with the switch command. Example: git switch -c Or undo this operation with: git switch - Turn off this advice by setting config variable advice.detachedHead to false HEAD is now at 4f8cbb1 Add benchmark/{Project,Manifest}.toml [ Info: Using existing manifest file. PkgBenchmark: Running benchmarks... Activating project at `/tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark` ┌ Warning: The active manifest file is an older format with no julia version entry. Dependencies may have been resolved with a different julia version. └ @ /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark/Manifest.toml:0 Installed PkgBenchmark ─ v0.2.6 Building PkgBenchmark → `~/.julia/scratchspaces/44cfe95a-1eb2-52ea-b672-e2afdf69b78f/eeda9bde6194b57515c2494082ee1875ebf140ad/build.log` PkgBenchmark: creating benchmark tuning file /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark/tune.json... (1/1) tuning "sum(xs)"... (1/2) tuning "base"... done (took 6.469909815 seconds) (2/2) tuning "naive_sum"... done (took 5.554597872 seconds) done (took 12.842078573 seconds) (1/1) benchmarking "sum(xs)"... (1/2) benchmarking "base"... done (took 1.318233516 seconds) (2/2) benchmarking "naive_sum"... done (took 1.422037016 seconds) done (took 3.41173694 seconds) PkgBenchmark: benchmark results written to .benchmarkci/result-target.json PkgBenchmark: Running benchmarks... Activating project at `/tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark` ┌ Warning: The active manifest file is an older format with no julia version entry. Dependencies may have been resolved with a different julia version. └ @ /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark/Manifest.toml:0 PkgBenchmark: using benchmark tuning data in /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark/tune.json (1/1) benchmarking "sum(xs)"... (1/2) benchmarking "base"... done (took 2.087590145 seconds) (2/2) benchmarking "naive_sum"... done (took 1.632142205 seconds) done (took 4.514147743 seconds) PkgBenchmark: benchmark results written to .benchmarkci/result-baseline.json ┌ Info: Finish running benchmarks. │ * Target: 44 seconds └ * Baseline: 24 seconds Benchmarkjudgement (target / baseline): Package: /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl Dates: 25 Feb 2025 - 9:9 / 25 Feb 2025 - 9:10 Package commits: 4f8cbb / b45747 Julia commits: 92f03a / 92f03a Judge result ≡≡≡≡≡≡≡≡≡≡≡≡ Benchmark Report for /tmp/BenchmarkCIjltest_OuxZEa/BenchmarkCIExample.jl ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Job Properties ============== • Time of benchmarks: • Target: 25 Feb 2025 - 09:09 • Baseline: 25 Feb 2025 - 09:10 • Package commits: • Target: 4f8cbb • Baseline: b45747 • Julia commits: • Target: 92f03a • Baseline: 92f03a • Julia command flags: • Target: None • Baseline: None • Environment variables: • Target: None • Baseline: None Results ======= A ratio greater than 1.0 denotes a possible regression (marked with :x:), while a ratio less than 1.0 denotes a possible improvement (marked with :whitecheckmark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |––––––––––––––|––––––|–––––––| Benchmark Group List ==================== Here's a list of all the benchmark groups executed by this job: • ["sum(xs)"] Julia versioninfo ================= Target –––––– Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2723 MHz 4745037284 s 267028 s 399803657 s 4002671777 s 0 s Memory: 32.0 GB (31862.28515625 MB free) Uptime: 7.16129775e6 sec Load Avg: 141.79 144.61 146.55 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) Baseline –––––––– Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2710 MHz 4745070302 s 267028 s 399805009 s 4002672424 s 0 s Memory: 32.0 GB (31844.234375 MB free) Uptime: 7.16132513e6 sec Load Avg: 137.08 143.19 146.02 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) ──────────────────────────────────────────────────────────────────────────── Target result ≡≡≡≡≡≡≡≡≡≡≡≡≡ Benchmark Report for /tmp/BenchmarkCIjltest_OuxZEa/BenchmarkCIExample.jl ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Job Properties ============== • Time of benchmark: 25 Feb 2025 - 9:9 • Package commit: 4f8cbb • Julia commit: 92f03a • Julia command flags: None • Environment variables: None Results ======= Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. ID time GC time memory allocations –––––––––––––––––––––––– –––––––––––––– ––––––– –––––– ––––––––––– ["sum(xs)", "base"] 11.379 μs (5%) ["sum(xs)", "naive_sum"] 36.459 μs (5%) Benchmark Group List ==================== Here's a list of all the benchmark groups executed by this job: • ["sum(xs)"] Julia versioninfo ================= Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2723 MHz 4745037284 s 267028 s 399803657 s 4002671777 s 0 s Memory: 32.0 GB (31862.28515625 MB free) Uptime: 7.16129775e6 sec Load Avg: 141.79 144.61 146.55 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) ──────────────────────────────────────────────────────────────────────────── Baseline result ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Benchmark Report for /tmp/BenchmarkCIjltest_OuxZEa/BenchmarkCIExample.jl ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Job Properties ============== • Time of benchmark: 25 Feb 2025 - 9:10 • Package commit: b45747 • Julia commit: 92f03a • Julia command flags: None • Environment variables: None Results ======= Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. ID time GC time memory allocations –––––––––––––––––––––––– –––––––––––––– ––––––– –––––– ––––––––––– ["sum(xs)", "base"] 11.380 μs (5%) ["sum(xs)", "naive_sum"] 36.420 μs (5%) Benchmark Group List ==================== Here's a list of all the benchmark groups executed by this job: • ["sum(xs)"] Julia versioninfo ================= Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2710 MHz 4745070302 s 267028 s 399805009 s 4002672424 s 0 s Memory: 32.0 GB (31844.234375 MB free) Uptime: 7.16132513e6 sec Load Avg: 137.08 143.19 146.02 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) ──────────────────────────────────────────────────────────────────────────── Runtime information ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Runtime Info ––––––––––––––– ––– BLAS #threads 1 BLAS.vendor() lbt Sys.CPU_THREADS 1 lscpu output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 43 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 128 On-line CPU(s) list: 0-127 Vendor ID: AuthenticAMD Model name: AMD EPYC 7502 32-Core Processor CPU family: 23 Model: 49 Thread(s) per core: 2 Core(s) per socket: 32 Socket(s): 2 Stepping: 0 Frequency boost: enabled CPU(s) scaling MHz: 108% CPU max MHz: 2500.0000 CPU min MHz: 1500.0000 BogoMIPS: 4999.62 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl nonstop_tsc cpuid extd_apicid aperfmperf rapl pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb cat_l3 cdp_l3 hw_pstate ssbd mba ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep bmi2 cqm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local clzero irperf xsaveerptr rdpru wbnoinvd amd_ppin arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif v_spec_ctrl umip rdpid overflow_recov succor smca sev sev_es Virtualization: AMD-V L1d cache: 2 MiB (64 instances) L1i cache: 2 MiB (64 instances) L2 cache: 32 MiB (64 instances) L3 cache: 256 MiB (16 instances) NUMA node(s): 2 NUMA node0 CPU(s): 0-31,64-95 NUMA node1 CPU(s): 32-63,96-127 Vulnerability Gather data sampling: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Mitigation; untrained return thunk; SMT enabled with STIBP protection Vulnerability Spec rstack overflow: Mitigation; Safe RET Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP always-on; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected Cpu Property Value –––––––––––––––––– –––––––––––––––––––––––––––––––––––––––––––––––––––––––––– Brand AMD EPYC 7502 32-Core Processor Vendor :AMD Architecture :Zen Model Family: 0x8f, Model: 0x31, Stepping: 0x00, Type: 0x00 Cores 32 physical cores, 64 logical cores (on executing CPU) Hyperthreading hardware capability detected Clock Frequencies Not supported by CPU Data Cache Level 1:3 : (32, 512, 16384) kbytes 64 byte cache line size Address Size 48 bits virtual, 48 bits physical SIMD 256 bit = 32 byte max. SIMD vector size Time Stamp Counter TSC is accessible via rdtsc TSC runs at constant rate (invariant from clock frequency) Perf. Monitoring Performance Monitoring Counters (PMC) are not supported CPU supports AMD's Instruction Based Sampling (IBS) Hypervisor No [ Info: Using existing manifest file. PkgBenchmark: Running benchmarks... Activating project at `/tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark` ┌ Warning: The active manifest file is an older format with no julia version entry. Dependencies may have been resolved with a different julia version. └ @ /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark/Manifest.toml:0 PkgBenchmark: using benchmark tuning data in /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark/tune.json (1/1) benchmarking "sum(xs)"... (1/2) benchmarking "base"... done (took 1.999901732 seconds) (2/2) benchmarking "naive_sum"... done (took 1.5456042 seconds) done (took 4.33955271 seconds) PkgBenchmark: benchmark results written to .benchmarkci/result-target.json PkgBenchmark: Running benchmarks... Activating project at `/tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark` ┌ Warning: The active manifest file is an older format with no julia version entry. Dependencies may have been resolved with a different julia version. └ @ /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark/Manifest.toml:0 PkgBenchmark: using benchmark tuning data in /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark/tune.json (1/1) benchmarking "sum(xs)"... (1/2) benchmarking "base"... done (took 1.983703853 seconds) (2/2) benchmarking "naive_sum"... done (took 1.543985918 seconds) done (took 4.317647209 seconds) PkgBenchmark: benchmark results written to .benchmarkci/result-baseline.json ┌ Info: Finish running benchmarks. │ * Target: 22 seconds └ * Baseline: 22 seconds Benchmarkjudgement (target / baseline): Package: /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl Dates: 25 Feb 2025 - 9:10 / 25 Feb 2025 - 9:11 Package commits: 4f8cbb / b45747 Julia commits: 92f03a / 92f03a Judge result ≡≡≡≡≡≡≡≡≡≡≡≡ Benchmark Report for /tmp/BenchmarkCIjltest_OuxZEa/BenchmarkCIExample.jl ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Job Properties ============== • Time of benchmarks: • Target: 25 Feb 2025 - 09:10 • Baseline: 25 Feb 2025 - 09:11 • Package commits: • Target: 4f8cbb • Baseline: b45747 • Julia commits: • Target: 92f03a • Baseline: 92f03a • Julia command flags: • Target: None • Baseline: None • Environment variables: • Target: None • Baseline: None Results ======= A ratio greater than 1.0 denotes a possible regression (marked with :x:), while a ratio less than 1.0 denotes a possible improvement (marked with :whitecheckmark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |––––––––––––––|––––––|–––––––| Benchmark Group List ==================== Here's a list of all the benchmark groups executed by this job: • ["sum(xs)"] Julia versioninfo ================= Target –––––– Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2724 MHz 4745109666 s 267028 s 399806649 s 4002674638 s 0 s Memory: 32.0 GB (31866.29296875 MB free) Uptime: 7.16135895e6 sec Load Avg: 139.47 143.43 146.01 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) Baseline –––––––– Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2749 MHz 4745136425 s 267028 s 399808059 s 4002675599 s 0 s Memory: 32.0 GB (31897.69140625 MB free) Uptime: 7.16138176e6 sec Load Avg: 138.0 142.85 145.77 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) ──────────────────────────────────────────────────────────────────────────── Target result ≡≡≡≡≡≡≡≡≡≡≡≡≡ Benchmark Report for /tmp/BenchmarkCIjltest_OuxZEa/BenchmarkCIExample.jl ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Job Properties ============== • Time of benchmark: 25 Feb 2025 - 9:10 • Package commit: 4f8cbb • Julia commit: 92f03a • Julia command flags: None • Environment variables: None Results ======= Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. ID time GC time memory allocations –––––––––––––––––––––––– –––––––––––––– ––––––– –––––– ––––––––––– ["sum(xs)", "base"] 11.539 μs (5%) ["sum(xs)", "naive_sum"] 36.800 μs (5%) Benchmark Group List ==================== Here's a list of all the benchmark groups executed by this job: • ["sum(xs)"] Julia versioninfo ================= Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2724 MHz 4745109666 s 267028 s 399806649 s 4002674638 s 0 s Memory: 32.0 GB (31866.29296875 MB free) Uptime: 7.16135895e6 sec Load Avg: 139.47 143.43 146.01 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) ──────────────────────────────────────────────────────────────────────────── Baseline result ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Benchmark Report for /tmp/BenchmarkCIjltest_OuxZEa/BenchmarkCIExample.jl ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Job Properties ============== • Time of benchmark: 25 Feb 2025 - 9:11 • Package commit: b45747 • Julia commit: 92f03a • Julia command flags: None • Environment variables: None Results ======= Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. ID time GC time memory allocations –––––––––––––––––––––––– –––––––––––––– ––––––– –––––– ––––––––––– ["sum(xs)", "base"] 11.410 μs (5%) ["sum(xs)", "naive_sum"] 36.460 μs (5%) Benchmark Group List ==================== Here's a list of all the benchmark groups executed by this job: • ["sum(xs)"] Julia versioninfo ================= Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2749 MHz 4745136425 s 267028 s 399808059 s 4002675599 s 0 s Memory: 32.0 GB (31897.69140625 MB free) Uptime: 7.16138176e6 sec Load Avg: 138.0 142.85 145.77 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) ──────────────────────────────────────────────────────────────────────────── Runtime information ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Runtime Info ––––––––––––––– ––– BLAS #threads 1 BLAS.vendor() lbt Sys.CPU_THREADS 1 lscpu output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 43 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 128 On-line CPU(s) list: 0-127 Vendor ID: AuthenticAMD Model name: AMD EPYC 7502 32-Core Processor CPU family: 23 Model: 49 Thread(s) per core: 2 Core(s) per socket: 32 Socket(s): 2 Stepping: 0 Frequency boost: enabled CPU(s) scaling MHz: 109% CPU max MHz: 2500.0000 CPU min MHz: 1500.0000 BogoMIPS: 4999.62 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl nonstop_tsc cpuid extd_apicid aperfmperf rapl pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb cat_l3 cdp_l3 hw_pstate ssbd mba ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep bmi2 cqm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local clzero irperf xsaveerptr rdpru wbnoinvd amd_ppin arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif v_spec_ctrl umip rdpid overflow_recov succor smca sev sev_es Virtualization: AMD-V L1d cache: 2 MiB (64 instances) L1i cache: 2 MiB (64 instances) L2 cache: 32 MiB (64 instances) L3 cache: 256 MiB (16 instances) NUMA node(s): 2 NUMA node0 CPU(s): 0-31,64-95 NUMA node1 CPU(s): 32-63,96-127 Vulnerability Gather data sampling: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Mitigation; untrained return thunk; SMT enabled with STIBP protection Vulnerability Spec rstack overflow: Mitigation; Safe RET Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP always-on; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected Cpu Property Value –––––––––––––––––– –––––––––––––––––––––––––––––––––––––––––––––––––––––––––– Brand AMD EPYC 7502 32-Core Processor Vendor :AMD Architecture :Zen Model Family: 0x8f, Model: 0x31, Stepping: 0x00, Type: 0x00 Cores 32 physical cores, 64 logical cores (on executing CPU) Hyperthreading hardware capability detected Clock Frequencies Not supported by CPU Data Cache Level 1:3 : (32, 512, 16384) kbytes 64 byte cache line size Address Size 48 bits virtual, 48 bits physical SIMD 256 bit = 32 byte max. SIMD vector size Time Stamp Counter TSC is accessible via rdtsc TSC runs at constant rate (invariant from clock frequency) Perf. Monitoring Performance Monitoring Counters (PMC) are not supported CPU supports AMD's Instruction Based Sampling (IBS) Hypervisor No [ Info: Testing with target = testcase/0001-without-manifest Previous HEAD position was 4f8cbb1 Add benchmark/{Project,Manifest}.toml HEAD is now at 5e619c2 Use BenchmarkCI without benchmark/Manifest.toml Removing .benchmarkci/ Removing benchmark/tune.json Installing known registries into `~/.julia` Added `General` registry to ~/.julia/registries Resolving package versions... Updating `/tmp/BenchmarkCI_jl_05OaQl/Project.toml` [d70a8896] + BenchmarkCIExample v0.1.0 `/tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl` [6e4b80f9] + BenchmarkTools v1.6.0 [32113eaa] + PkgBenchmark v0.2.12 Updating `/tmp/BenchmarkCI_jl_05OaQl/Manifest.toml` [1520ce14] + AbstractTrees v0.4.5 [d70a8896] + BenchmarkCIExample v0.1.0 `/tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl` [6e4b80f9] + BenchmarkTools v1.6.0 [34da2185] + Compat v4.16.0 [682c06a0] + JSON v0.21.4 [1d6d02ad] + LeftChildRightSiblingTrees v0.2.0 [69de0a69] + Parsers v2.8.1 [32113eaa] + PkgBenchmark v0.2.12 [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [33c8b6b6] + ProgressLogging v0.1.4 [5d786b92] + TerminalLoggers v0.1.7 [0dad84c5] + ArgTools v1.1.1 [56f22d72] + Artifacts [2a0f44e3] + Base64 [ade2ca70] + Dates [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching [b77e0a4c] + InteractiveUtils [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 [8f399da3] + Libdl [37e2e46d] + LinearAlgebra [56ddb016] + Logging [d6f4376e] + Markdown [a63ad114] + Mmap [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.10.0 [de0858da] + Printf [9abbd945] + Profile [3fa0cd96] + REPL [9a3f8284] + Random [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization [6462fe0b] + Sockets [2f01184e] + SparseArrays v1.10.0 [10745b16] + Statistics v1.10.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [cf7118a7] + UUIDs [4ec0a83e] + Unicode [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] + LibCURL_jll v8.4.0+0 [e37daf67] + LibGit2_jll v1.6.4+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.2+1 [14a3606d] + MozillaCACerts_jll v2023.1.10 [4536629a] + OpenBLAS_jll v0.3.23+4 [bea87d4a] + SuiteSparse_jll v7.2.1+1 [83775a58] + Zlib_jll v1.2.13+1 [8e850b90] + libblastrampoline_jll v5.11.0+0 [8e850ede] + nghttp2_jll v1.52.0+1 [3f19e933] + p7zip_jll v17.4.0+2 [ Info: Using temporary project `/tmp/BenchmarkCI_jl_05OaQl`. PkgBenchmark: Running benchmarks... Activating project at `/tmp/BenchmarkCI_jl_05OaQl` No Changes to `/tmp/BenchmarkCI_jl_05OaQl/Project.toml` No Changes to `/tmp/BenchmarkCI_jl_05OaQl/Manifest.toml` PkgBenchmark: creating benchmark tuning file /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark/tune.json... (1/1) tuning "sum(xs)"... (1/2) tuning "base"... done (took 6.518806113 seconds) (2/2) tuning "naive_sum"... done (took 5.658036962 seconds) done (took 13.093675873 seconds) (1/1) benchmarking "sum(xs)"... (1/2) benchmarking "base"... done (took 1.403583087 seconds) (2/2) benchmarking "naive_sum"... done (took 1.480369351 seconds) done (took 3.630533821 seconds) PkgBenchmark: benchmark results written to .benchmarkci/result-target.json PkgBenchmark: Running benchmarks... Activating project at `/tmp/BenchmarkCI_jl_05OaQl` No Changes to `/tmp/BenchmarkCI_jl_05OaQl/Project.toml` No Changes to `/tmp/BenchmarkCI_jl_05OaQl/Manifest.toml` PkgBenchmark: using benchmark tuning data in /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark/tune.json (1/1) benchmarking "sum(xs)"... (1/2) benchmarking "base"... done (took 2.042947276 seconds) (2/2) benchmarking "naive_sum"... done (took 1.60011359 seconds) done (took 4.510003209 seconds) PkgBenchmark: benchmark results written to .benchmarkci/result-baseline.json ┌ Info: Finish running benchmarks. │ * Target: 37 seconds └ * Baseline: 26 seconds Benchmarkjudgement (target / baseline): Package: /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl Dates: 25 Feb 2025 - 9:12 / 25 Feb 2025 - 9:12 Package commits: 5e619c / b45747 Julia commits: 92f03a / 92f03a Judge result ≡≡≡≡≡≡≡≡≡≡≡≡ Benchmark Report for /tmp/BenchmarkCIjltest_OuxZEa/BenchmarkCIExample.jl ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Job Properties ============== • Time of benchmarks: • Target: 25 Feb 2025 - 09:12 • Baseline: 25 Feb 2025 - 09:12 • Package commits: • Target: 5e619c • Baseline: b45747 • Julia commits: • Target: 92f03a • Baseline: 92f03a • Julia command flags: • Target: None • Baseline: None • Environment variables: • Target: None • Baseline: None Results ======= A ratio greater than 1.0 denotes a possible regression (marked with :x:), while a ratio less than 1.0 denotes a possible improvement (marked with :whitecheckmark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). ID time ratio memory ratio ––––––––––––––––––– ––––––––––––– –––––––––––– ["sum(xs)", "base"] 1.08 (5%) :x: 1.00 (1%) Benchmark Group List ==================== Here's a list of all the benchmark groups executed by this job: • ["sum(xs)"] Julia versioninfo ================= Target –––––– Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2722 MHz 4745196877 s 267028 s 399811036 s 4002678180 s 0 s Memory: 32.0 GB (31816.20703125 MB free) Uptime: 7.16143346e6 sec Load Avg: 142.31 143.49 145.84 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) Baseline –––––––– Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2698 MHz 4745226877 s 267028 s 399812692 s 4002679748 s 0 s Memory: 32.0 GB (31807.65234375 MB free) Uptime: 7.16145947e6 sec Load Avg: 136.79 142.06 145.29 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) ──────────────────────────────────────────────────────────────────────────── Target result ≡≡≡≡≡≡≡≡≡≡≡≡≡ Benchmark Report for /tmp/BenchmarkCIjltest_OuxZEa/BenchmarkCIExample.jl ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Job Properties ============== • Time of benchmark: 25 Feb 2025 - 9:12 • Package commit: 5e619c • Julia commit: 92f03a • Julia command flags: None • Environment variables: None Results ======= Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. ID time GC time memory allocations –––––––––––––––––––––––– –––––––––––––– ––––––– –––––– ––––––––––– ["sum(xs)", "base"] 11.490 μs (5%) ["sum(xs)", "naive_sum"] 36.449 μs (5%) Benchmark Group List ==================== Here's a list of all the benchmark groups executed by this job: • ["sum(xs)"] Julia versioninfo ================= Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2722 MHz 4745196877 s 267028 s 399811036 s 4002678180 s 0 s Memory: 32.0 GB (31816.20703125 MB free) Uptime: 7.16143346e6 sec Load Avg: 142.31 143.49 145.84 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) ──────────────────────────────────────────────────────────────────────────── Baseline result ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Benchmark Report for /tmp/BenchmarkCIjltest_OuxZEa/BenchmarkCIExample.jl ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Job Properties ============== • Time of benchmark: 25 Feb 2025 - 9:12 • Package commit: b45747 • Julia commit: 92f03a • Julia command flags: None • Environment variables: None Results ======= Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. ID time GC time memory allocations –––––––––––––––––––––––– –––––––––––––– ––––––– –––––– ––––––––––– ["sum(xs)", "base"] 10.640 μs (5%) ["sum(xs)", "naive_sum"] 36.410 μs (5%) Benchmark Group List ==================== Here's a list of all the benchmark groups executed by this job: • ["sum(xs)"] Julia versioninfo ================= Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2698 MHz 4745226877 s 267028 s 399812692 s 4002679748 s 0 s Memory: 32.0 GB (31807.65234375 MB free) Uptime: 7.16145947e6 sec Load Avg: 136.79 142.06 145.29 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) ──────────────────────────────────────────────────────────────────────────── Runtime information ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Runtime Info ––––––––––––––– ––– BLAS #threads 1 BLAS.vendor() lbt Sys.CPU_THREADS 1 lscpu output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 43 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 128 On-line CPU(s) list: 0-127 Vendor ID: AuthenticAMD Model name: AMD EPYC 7502 32-Core Processor CPU family: 23 Model: 49 Thread(s) per core: 2 Core(s) per socket: 32 Socket(s): 2 Stepping: 0 Frequency boost: enabled CPU(s) scaling MHz: 109% CPU max MHz: 2500.0000 CPU min MHz: 1500.0000 BogoMIPS: 4999.62 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl nonstop_tsc cpuid extd_apicid aperfmperf rapl pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb cat_l3 cdp_l3 hw_pstate ssbd mba ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep bmi2 cqm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local clzero irperf xsaveerptr rdpru wbnoinvd amd_ppin arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif v_spec_ctrl umip rdpid overflow_recov succor smca sev sev_es Virtualization: AMD-V L1d cache: 2 MiB (64 instances) L1i cache: 2 MiB (64 instances) L2 cache: 32 MiB (64 instances) L3 cache: 256 MiB (16 instances) NUMA node(s): 2 NUMA node0 CPU(s): 0-31,64-95 NUMA node1 CPU(s): 32-63,96-127 Vulnerability Gather data sampling: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Mitigation; untrained return thunk; SMT enabled with STIBP protection Vulnerability Spec rstack overflow: Mitigation; Safe RET Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP always-on; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected Cpu Property Value –––––––––––––––––– –––––––––––––––––––––––––––––––––––––––––––––––––––––––––– Brand AMD EPYC 7502 32-Core Processor Vendor :AMD Architecture :Zen Model Family: 0x8f, Model: 0x31, Stepping: 0x00, Type: 0x00 Cores 32 physical cores, 64 logical cores (on executing CPU) Hyperthreading hardware capability detected Clock Frequencies Not supported by CPU Data Cache Level 1:3 : (32, 512, 16384) kbytes 64 byte cache line size Address Size 48 bits virtual, 48 bits physical SIMD 256 bit = 32 byte max. SIMD vector size Time Stamp Counter TSC is accessible via rdtsc TSC runs at constant rate (invariant from clock frequency) Perf. Monitoring Performance Monitoring Counters (PMC) are not supported CPU supports AMD's Instruction Based Sampling (IBS) Hypervisor No Resolving package versions... Updating `/tmp/BenchmarkCI_jl_ar4w69/Project.toml` [d70a8896] + BenchmarkCIExample v0.1.0 `/tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl` [6e4b80f9] + BenchmarkTools v1.6.0 [32113eaa] + PkgBenchmark v0.2.12 Updating `/tmp/BenchmarkCI_jl_ar4w69/Manifest.toml` [1520ce14] + AbstractTrees v0.4.5 [d70a8896] + BenchmarkCIExample v0.1.0 `/tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl` [6e4b80f9] + BenchmarkTools v1.6.0 [34da2185] + Compat v4.16.0 [682c06a0] + JSON v0.21.4 [1d6d02ad] + LeftChildRightSiblingTrees v0.2.0 [69de0a69] + Parsers v2.8.1 [32113eaa] + PkgBenchmark v0.2.12 [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [33c8b6b6] + ProgressLogging v0.1.4 [5d786b92] + TerminalLoggers v0.1.7 [0dad84c5] + ArgTools v1.1.1 [56f22d72] + Artifacts [2a0f44e3] + Base64 [ade2ca70] + Dates [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching [b77e0a4c] + InteractiveUtils [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 [8f399da3] + Libdl [37e2e46d] + LinearAlgebra [56ddb016] + Logging [d6f4376e] + Markdown [a63ad114] + Mmap [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.10.0 [de0858da] + Printf [9abbd945] + Profile [3fa0cd96] + REPL [9a3f8284] + Random [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization [6462fe0b] + Sockets [2f01184e] + SparseArrays v1.10.0 [10745b16] + Statistics v1.10.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [cf7118a7] + UUIDs [4ec0a83e] + Unicode [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] + LibCURL_jll v8.4.0+0 [e37daf67] + LibGit2_jll v1.6.4+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.2+1 [14a3606d] + MozillaCACerts_jll v2023.1.10 [4536629a] + OpenBLAS_jll v0.3.23+4 [bea87d4a] + SuiteSparse_jll v7.2.1+1 [83775a58] + Zlib_jll v1.2.13+1 [8e850b90] + libblastrampoline_jll v5.11.0+0 [8e850ede] + nghttp2_jll v1.52.0+1 [3f19e933] + p7zip_jll v17.4.0+2 [ Info: Using temporary project `/tmp/BenchmarkCI_jl_ar4w69`. PkgBenchmark: Running benchmarks... Activating project at `/tmp/BenchmarkCI_jl_ar4w69` No Changes to `/tmp/BenchmarkCI_jl_ar4w69/Project.toml` No Changes to `/tmp/BenchmarkCI_jl_ar4w69/Manifest.toml` PkgBenchmark: using benchmark tuning data in /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark/tune.json (1/1) benchmarking "sum(xs)"... (1/2) benchmarking "base"... done (took 2.035096736 seconds) (2/2) benchmarking "naive_sum"... done (took 1.66936069 seconds) done (took 4.567011405 seconds) PkgBenchmark: benchmark results written to .benchmarkci/result-target.json PkgBenchmark: Running benchmarks... Activating project at `/tmp/BenchmarkCI_jl_ar4w69` No Changes to `/tmp/BenchmarkCI_jl_ar4w69/Project.toml` No Changes to `/tmp/BenchmarkCI_jl_ar4w69/Manifest.toml` PkgBenchmark: using benchmark tuning data in /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark/tune.json (1/1) benchmarking "sum(xs)"... (1/2) benchmarking "base"... done (took 2.013964144 seconds) (2/2) benchmarking "naive_sum"... done (took 1.632884437 seconds) done (took 4.522384255 seconds) PkgBenchmark: benchmark results written to .benchmarkci/result-baseline.json ┌ Info: Finish running benchmarks. │ * Target: 26 seconds └ * Baseline: 26 seconds Benchmarkjudgement (target / baseline): Package: /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl Dates: 25 Feb 2025 - 9:13 / 25 Feb 2025 - 9:13 Package commits: 5e619c / b45747 Julia commits: 92f03a / 92f03a Judge result ≡≡≡≡≡≡≡≡≡≡≡≡ Benchmark Report for /tmp/BenchmarkCIjltest_OuxZEa/BenchmarkCIExample.jl ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Job Properties ============== • Time of benchmarks: • Target: 25 Feb 2025 - 09:13 • Baseline: 25 Feb 2025 - 09:13 • Package commits: • Target: 5e619c • Baseline: b45747 • Julia commits: • Target: 92f03a • Baseline: 92f03a • Julia command flags: • Target: None • Baseline: None • Environment variables: • Target: None • Baseline: None Results ======= A ratio greater than 1.0 denotes a possible regression (marked with :x:), while a ratio less than 1.0 denotes a possible improvement (marked with :whitecheckmark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |––––––––––––––|––––––|–––––––| Benchmark Group List ==================== Here's a list of all the benchmark groups executed by this job: • ["sum(xs)"] Julia versioninfo ================= Target –––––– Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2679 MHz 4745268701 s 267028 s 399814846 s 4002682471 s 0 s Memory: 32.0 GB (31784.00390625 MB free) Uptime: 7.16149601e6 sec Load Avg: 130.67 139.95 144.46 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) Baseline –––––––– Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2724 MHz 4745298571 s 267028 s 399816535 s 4002683744 s 0 s Memory: 32.0 GB (31787.54296875 MB free) Uptime: 7.1615217e6 sec Load Avg: 129.39 138.9 143.99 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) ──────────────────────────────────────────────────────────────────────────── Target result ≡≡≡≡≡≡≡≡≡≡≡≡≡ Benchmark Report for /tmp/BenchmarkCIjltest_OuxZEa/BenchmarkCIExample.jl ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Job Properties ============== • Time of benchmark: 25 Feb 2025 - 9:13 • Package commit: 5e619c • Julia commit: 92f03a • Julia command flags: None • Environment variables: None Results ======= Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. ID time GC time memory allocations –––––––––––––––––––––––– –––––––––––––– ––––––– –––––– ––––––––––– ["sum(xs)", "base"] 11.090 μs (5%) ["sum(xs)", "naive_sum"] 36.140 μs (5%) Benchmark Group List ==================== Here's a list of all the benchmark groups executed by this job: • ["sum(xs)"] Julia versioninfo ================= Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2679 MHz 4745268701 s 267028 s 399814846 s 4002682471 s 0 s Memory: 32.0 GB (31784.00390625 MB free) Uptime: 7.16149601e6 sec Load Avg: 130.67 139.95 144.46 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) ──────────────────────────────────────────────────────────────────────────── Baseline result ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Benchmark Report for /tmp/BenchmarkCIjltest_OuxZEa/BenchmarkCIExample.jl ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Job Properties ============== • Time of benchmark: 25 Feb 2025 - 9:13 • Package commit: b45747 • Julia commit: 92f03a • Julia command flags: None • Environment variables: None Results ======= Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. ID time GC time memory allocations –––––––––––––––––––––––– –––––––––––––– ––––––– –––––– ––––––––––– ["sum(xs)", "base"] 11.190 μs (5%) ["sum(xs)", "naive_sum"] 36.420 μs (5%) Benchmark Group List ==================== Here's a list of all the benchmark groups executed by this job: • ["sum(xs)"] Julia versioninfo ================= Julia Version 1.10.8 Commit 92f03a4775* (2025-02-20 09:30 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) uname: Linux 6.8.0-49-generic #49-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 4 02:06:24 UTC 2024 x86_64 unknown CPU: AMD EPYC 7502 32-Core Processor: speed user nice sys idle irq #1-128 2724 MHz 4745298571 s 267028 s 399816535 s 4002683744 s 0 s Memory: 32.0 GB (31787.54296875 MB free) Uptime: 7.1615217e6 sec Load Avg: 129.39 138.9 143.99 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-15.0.7 (ORCJIT, znver2) Threads: 1 default, 0 interactive, 1 GC (on 1 virtual cores) ──────────────────────────────────────────────────────────────────────────── Runtime information ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ Runtime Info ––––––––––––––– ––– BLAS #threads 1 BLAS.vendor() lbt Sys.CPU_THREADS 1 lscpu output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 43 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 128 On-line CPU(s) list: 0-127 Vendor ID: AuthenticAMD Model name: AMD EPYC 7502 32-Core Processor CPU family: 23 Model: 49 Thread(s) per core: 2 Core(s) per socket: 32 Socket(s): 2 Stepping: 0 Frequency boost: enabled CPU(s) scaling MHz: 110% CPU max MHz: 2500.0000 CPU min MHz: 1500.0000 BogoMIPS: 4999.62 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl nonstop_tsc cpuid extd_apicid aperfmperf rapl pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb cat_l3 cdp_l3 hw_pstate ssbd mba ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep bmi2 cqm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local clzero irperf xsaveerptr rdpru wbnoinvd amd_ppin arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif v_spec_ctrl umip rdpid overflow_recov succor smca sev sev_es Virtualization: AMD-V L1d cache: 2 MiB (64 instances) L1i cache: 2 MiB (64 instances) L2 cache: 32 MiB (64 instances) L3 cache: 256 MiB (16 instances) NUMA node(s): 2 NUMA node0 CPU(s): 0-31,64-95 NUMA node1 CPU(s): 32-63,96-127 Vulnerability Gather data sampling: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Mitigation; untrained return thunk; SMT enabled with STIBP protection Vulnerability Spec rstack overflow: Mitigation; Safe RET Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines; IBPB conditional; STIBP always-on; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected Cpu Property Value –––––––––––––––––– –––––––––––––––––––––––––––––––––––––––––––––––––––––––––– Brand AMD EPYC 7502 32-Core Processor Vendor :AMD Architecture :Zen Model Family: 0x8f, Model: 0x31, Stepping: 0x00, Type: 0x00 Cores 32 physical cores, 64 logical cores (on executing CPU) Hyperthreading hardware capability detected Clock Frequencies Not supported by CPU Data Cache Level 1:3 : (32, 512, 16384) kbytes 64 byte cache line size Address Size 48 bits virtual, 48 bits physical SIMD 256 bit = 32 byte max. SIMD vector size Time Stamp Counter TSC is accessible via rdtsc TSC runs at constant rate (invariant from clock frequency) Perf. Monitoring Performance Monitoring Counters (PMC) are not supported CPU supports AMD's Instruction Based Sampling (IBS) Hypervisor No [ Info: Testing with `BenchmarkCI.judge(retune = true)` Resolving package versions... Updating `/tmp/BenchmarkCI_jl_4FoEih/Project.toml` [d70a8896] + BenchmarkCIExample v0.1.0 `/tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl` [6e4b80f9] + BenchmarkTools v1.6.0 [32113eaa] + PkgBenchmark v0.2.12 Updating `/tmp/BenchmarkCI_jl_4FoEih/Manifest.toml` [1520ce14] + AbstractTrees v0.4.5 [d70a8896] + BenchmarkCIExample v0.1.0 `/tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl` [6e4b80f9] + BenchmarkTools v1.6.0 [34da2185] + Compat v4.16.0 [682c06a0] + JSON v0.21.4 [1d6d02ad] + LeftChildRightSiblingTrees v0.2.0 [69de0a69] + Parsers v2.8.1 [32113eaa] + PkgBenchmark v0.2.12 [aea7be01] + PrecompileTools v1.2.1 [21216c6a] + Preferences v1.4.3 [33c8b6b6] + ProgressLogging v0.1.4 [5d786b92] + TerminalLoggers v0.1.7 [0dad84c5] + ArgTools v1.1.1 [56f22d72] + Artifacts [2a0f44e3] + Base64 [ade2ca70] + Dates [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching [b77e0a4c] + InteractiveUtils [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 [8f399da3] + Libdl [37e2e46d] + LinearAlgebra [56ddb016] + Logging [d6f4376e] + Markdown [a63ad114] + Mmap [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.10.0 [de0858da] + Printf [9abbd945] + Profile [3fa0cd96] + REPL [9a3f8284] + Random [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization [6462fe0b] + Sockets [2f01184e] + SparseArrays v1.10.0 [10745b16] + Statistics v1.10.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [cf7118a7] + UUIDs [4ec0a83e] + Unicode [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] + LibCURL_jll v8.4.0+0 [e37daf67] + LibGit2_jll v1.6.4+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.2+1 [14a3606d] + MozillaCACerts_jll v2023.1.10 [4536629a] + OpenBLAS_jll v0.3.23+4 [bea87d4a] + SuiteSparse_jll v7.2.1+1 [83775a58] + Zlib_jll v1.2.13+1 [8e850b90] + libblastrampoline_jll v5.11.0+0 [8e850ede] + nghttp2_jll v1.52.0+1 [3f19e933] + p7zip_jll v17.4.0+2 [ Info: Using temporary project `/tmp/BenchmarkCI_jl_4FoEih`. PkgBenchmark: Running benchmarks... Activating project at `/tmp/BenchmarkCI_jl_4FoEih` No Changes to `/tmp/BenchmarkCI_jl_4FoEih/Project.toml` No Changes to `/tmp/BenchmarkCI_jl_4FoEih/Manifest.toml` PkgBenchmark: creating benchmark tuning file /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark/tune.json... (1/1) tuning "sum(xs)"... (1/2) tuning "base"... done (took 6.34106457 seconds) (2/2) tuning "naive_sum"... done (took 5.652062744 seconds) done (took 12.765082806 seconds) (1/1) benchmarking "sum(xs)"... (1/2) benchmarking "base"... done (took 1.402796716 seconds) (2/2) benchmarking "naive_sum"... done (took 1.549543961 seconds) done (took 3.684935471 seconds) PkgBenchmark: benchmark results written to .benchmarkci/result-target.json PkgBenchmark: Running benchmarks... Activating project at `/tmp/BenchmarkCI_jl_4FoEih` No Changes to `/tmp/BenchmarkCI_jl_4FoEih/Project.toml` No Changes to `/tmp/BenchmarkCI_jl_4FoEih/Manifest.toml` PkgBenchmark: creating benchmark tuning file /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl/benchmark/tune.json... (1/1) tuning "sum(xs)"... (1/2) tuning "base"... done (took 6.456279043 seconds) (2/2) tuning "naive_sum"... done (took 5.643110551 seconds) done (took 12.952897766 seconds) (1/1) benchmarking "sum(xs)"... (1/2) benchmarking "base"... done (took 1.399094074 seconds) (2/2) benchmarking "naive_sum"... done (took 1.498633778 seconds) done (took 3.633461528 seconds) PkgBenchmark: benchmark results written to .benchmarkci/result-baseline.json ┌ Info: Finish running benchmarks. │ * Target: 34 seconds └ * Baseline: 35 seconds Benchmarkjudgement (target / baseline): Package: /tmp/BenchmarkCI_jl_test_OuxZEa/BenchmarkCIExample.jl Dates: 25 Feb 2025 - 9:14 / 25 Feb 2025 - 9:14 Package commits: 5e619c / b45747 Julia commits: 92f03a / 92f03a Test Summary: | Pass Total Time test_integration.jl | 88 88 6m16.6s ┌ Warning: zstdmt() is deprecated, use the non-do-block form │ caller = ip:0x0 └ @ Core :-1 /*stdin*\ : 9.47% ( 1.000 KiB => 97 B, /tmp/jl_pul54r/dest.tar.zst) Test Summary: | Pass Total Time test_misc.jl | 21 21 9.0s hint: Using 'master' as the name for the initial branch. This default branch name hint: is subject to change. To configure the initial branch name to use in all hint: of your new repositories, which will suppress this warning, call: hint: hint: git config --global init.defaultBranch hint: hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and hint: 'development'. The just-created branch can be renamed via this command: hint: hint: git branch -m Initialized empty Git repository in /tmp/jl_nsxUaF/origin/.git/ Switched to a new branch 'somebranch' [somebranch (root-commit) 021f44c] First commit 1 file changed, 1 insertion(+) create mode 100644 README.txt Switched to a new branch 'somebranch.0' Cloning into '/tmp/jl_F8qX7L/repo'... ┌ Info: Committing uncommitted files. │ git status --short = │ ?? spam.txt └ Author identity unknown *** Please tell me who you are. Run git config --global user.email "you@example.com" git config --global user.name "Your Name" to set your account's default identity. Omit --global to set the identity only in this repository. fatal: unable to auto-detect email address (got 'pkgeval@BenchmarkCI-primary-ZCUxRtMF.(none)') updating: Error During Test at /home/pkgeval/.julia/packages/BenchmarkCI/jAAT2/test/test_updating.jl:25 Got exception outside of a @test failed process: Process(`git commit --allow-empty-message --message ''`, ProcessExited(128)) [128] Stacktrace: [1] pipeline_error @ ./process.jl:565 [inlined] [2] run(::Cmd; wait::Bool) @ Base ./process.jl:480 [3] run(::Cmd) @ Base ./process.jl:477 [4] (::BenchmarkCI.GitUtils.var"#7#14"{String, String})() @ BenchmarkCI.GitUtils ~/.julia/packages/BenchmarkCI/jAAT2/src/gitutils.jl:55 [5] cd(f::BenchmarkCI.GitUtils.var"#7#14"{String, String}, dir::String) @ Base.Filesystem ./file.jl:112 [6] (::BenchmarkCI.GitUtils.var"#2#8"{Nothing, String, Main.TestBenchmarkCI.TestUpdating.var"#4#9", String, String})(tmpd::String) @ BenchmarkCI.GitUtils ~/.julia/packages/BenchmarkCI/jAAT2/src/gitutils.jl:48 [7] mktempdir(fn::BenchmarkCI.GitUtils.var"#2#8"{Nothing, String, Main.TestBenchmarkCI.TestUpdating.var"#4#9", String, String}, parent::String; prefix::String) @ Base.Filesystem ./file.jl:766 [8] mktempdir (repeats 2 times) @ ./file.jl:762 [inlined] [9] #updating#1 @ ~/.julia/packages/BenchmarkCI/jAAT2/src/gitutils.jl:16 [inlined] [10] updating @ ~/.julia/packages/BenchmarkCI/jAAT2/src/gitutils.jl:9 [inlined] [11] (::Main.TestBenchmarkCI.TestUpdating.var"#3#8")(dir::String) @ Main.TestBenchmarkCI.TestUpdating ~/.julia/packages/BenchmarkCI/jAAT2/test/test_updating.jl:32 [12] mktempdir(fn::Main.TestBenchmarkCI.TestUpdating.var"#3#8", parent::String; prefix::String) @ Base.Filesystem ./file.jl:766 [13] mktempdir(fn::Function, parent::String) @ Base.Filesystem ./file.jl:762 [14] macro expansion @ ~/.julia/packages/BenchmarkCI/jAAT2/test/test_updating.jl:26 [inlined] [15] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [16] top-level scope @ ~/.julia/packages/BenchmarkCI/jAAT2/test/test_updating.jl:26 [17] include(mod::Module, _path::String) @ Base ./Base.jl:495 [18] include(x::String) @ Main.TestBenchmarkCI ~/.julia/packages/BenchmarkCI/jAAT2/test/runtests.jl:1 [19] macro expansion @ ~/.julia/packages/BenchmarkCI/jAAT2/test/runtests.jl:7 [inlined] [20] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [21] top-level scope @ ~/.julia/packages/BenchmarkCI/jAAT2/test/runtests.jl:4 [22] include(fname::String) @ Base.MainInclude ./client.jl:494 [23] top-level scope @ none:6 [24] eval @ ./boot.jl:385 [inlined] [25] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [26] _start() @ Base ./client.jl:557 hint: Using 'master' as the name for the initial branch. This default branch name hint: is subject to change. To configure the initial branch name to use in all hint: of your new repositories, which will suppress this warning, call: hint: hint: git config --global init.defaultBranch hint: hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and hint: 'development'. The just-created branch can be renamed via this command: hint: hint: git branch -m Initialized empty Git repository in /tmp/jl_ZwbCxv/origin/.git/ Switched to a new branch 'somebranch' [somebranch (root-commit) 4afa737] First commit 1 file changed, 1 insertion(+) create mode 100644 README.txt Switched to a new branch 'somebranch.0' Cloning into '/tmp/jl_ZwbCxv/workdir'... Switched to branch 'somebranch' [somebranch af1b407] Add file-1 1 file changed, 1 insertion(+) create mode 100644 file-1 Switched to branch 'somebranch.0' [somebranch.0 ed089a3] Add file-2 1 file changed, 1 insertion(+) create mode 100644 file-2 To file:///tmp/jl_ZwbCxv/origin ! [rejected] HEAD -> somebranch (fetch first) error: failed to push some refs to 'file:///tmp/jl_ZwbCxv/origin' hint: Updates were rejected because the remote contains work that you do hint: not have locally. This is usually caused by another repository pushing hint: to the same ref. You may want to first integrate the remote changes hint: (e.g., 'git pull ...') before pushing again. hint: See the 'Note about fast-forwards' in 'git push --help' for details. From file:///tmp/jl_ZwbCxv/origin * branch somebranch -> FETCH_HEAD 4afa737..af1b407 somebranch -> origin/somebranch Merge made by the 'ort' strategy. file-1 | 1 + 1 file changed, 1 insertion(+) create mode 100644 file-1 To file:///tmp/jl_ZwbCxv/origin af1b407..840b1af HEAD -> somebranch Test Summary: | Pass Error Total Time test_updating.jl | 2 1 3 4.9s updating | 1 1 3.6s prepare_ssh_command | 1 1 0.1s _push_with_retry | 1 1 1.1s ERROR: LoadError: Some tests did not pass: 2 passed, 0 failed, 1 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/BenchmarkCI/jAAT2/test/runtests.jl:1 Testing failed after 387.94s ERROR: LoadError: Package BenchmarkCI errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Types.jl:70 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:2034 [3] test @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:1915 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::Base.PipeEndpoint}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:444 [5] test(pkgs::Vector{Pkg.Types.PackageSpec}; io::Base.PipeEndpoint, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:159 [6] test @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:147 [inlined] [7] #test#74 @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:146 [inlined] [8] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 450.74s: package tests unexpectedly errored