AWS CPU Instances Optimized for Inference

No 1 C5

C5's

Amazon EC2 C5 instances are the next generation of the Amazon EC2 Compute Optimized instance family. They are ideal for running advanced compute-intensive workloads such as high performance web servers, high-performance computing (HPC), batch processing, ad serving, highly scalable multiplayer gaming, video encoding, scientific modelling, distributed analytics and machine/deep learning inference.

  • Powered by 3.0 GHz Intel Xeon Scalable processors
  • A single core to can run up to 3.5 GHz using Intel Turbo Boost Technology
  • C5 instances offer higher memory to vCPU ratio the C4s
  • Supports the new Intel Advanced Vector Extensions 512 (AVX-512) instruction set
    • Up to 2x the FLOPS per core per cycle

Model vCPU Memory (GiB) Storage EBS Bandwidth
c5.large 2 4 EBS Optimized Up to 2,250 Mbps
c5.xlarge 4 8 EBS Optmized Up to 2,250 Mbps
c5.2xlarge 8 16 EBS Optimized Up to 2,250 Mbps
c5.4xlarge 16 32 EBS Optimized 2,250 Mbps
c5.9xlarge 36 72 EBS Optimized 4,500 Mbps
c5.18xlarge 72 144 EBS Optimized 9,000 Mbps

No 2 M5

M5's

M5 instances offers a balance of compute, memory, and networking resources for a broad range of workloads. This includes web and application servers, back-end servers for enterprise applications, gaming servers, caching fleets, and app development environments.

  • Powered by 2.5 GHz Intel Xeon Scalable processors
    • Up to 14% improvement in price/performance
  • Supports the new Intel Advanced Vector Extensions 512 (AVX-512) instruction set
    • Up to 2x the FLOPS per core

Model vCPU Memory (GiB) Storage EBS Bandwidth
m5.large 2 8 EBS Optimized Up to 2,120 Mbps
m5.xlarge 4 16 EBS Optimized Up to 2,120 Mbps
m5.2xlarge 8 32 EBS Optimized Up to 2,120 Mbps
m5.4xlarge 16 64 EBS Optimized 2,210 Mbps
m5.12xlarge 48 192 EBS Optimized 5,000 Mbps
m5.24xlarge 96 384 EBS Optimized 10,000 Mbps

No 3 More Demos