Instances›AWS EC2›inf2›inf2.8xlarge
Compute
vCPUs32
Memory128 GiB
Mem / vCPU4.00 GiB
ProcessorEPYC 7R13 Processor
Clock speed2.95 GHz
Architecturex86_64
Storage
TypeEBS only
Bandwidth10,000 Mbps
Throughput1250 MB/s
IOPS40,000
Networking
PerformanceUp to 25 Gigabit
Max ENIs8
IPv6Yes
GPUNone
Family sizes
inf2.xlarge4 vCPU · 16 GiB
inf2.8xlarge32 vCPU · 128 GiB
inf2.24xlarge96 vCPU · 384 GiB
inf2.48xlarge192 vCPU · 768 GiB
inf2.8xlarge

inf2.8xlarge is AWS's machine-learning accelerator EC2 size at 32 vCPU and 128 GiB. In the name, "inf" is Inferentia, AWS's inference silicon, "2" is the generation and "8xlarge" is the size within the inf2 family. It runs on AMD EPYC 7R13 Processor at 2.95 GHz, and AWS introduced it in April 2023. inf2 is the current generation of the inf family, so there is no newer AWS size to migrate to. Rackspace Spot has no equivalent to offer: the Inferentia and Trainium accelerators are AWS-exclusive silicon with no third-party equivalent. Spot's largest VM tops out at 16 vCPU and 128 GiB, and even that is not the missing piece here. The table below prices what AWS charges; the honest answer on the Spot side is that this workload stays where it is.

Match qualityNo equivalent

inf2.8xlarge is Machine Learning ASIC hardware. That accelerator has no counterpart in the Rackspace Spot catalog, and nothing in it emulates one at a speed worth paying for — this is a genuine no-match, not a weak one.

Rackspace Spot sells x86_64 Kubernetes nodes up to 16 vCPU, plus one NVIDIA A30 GPU class. What does move is the CPU half of the pipeline built around the accelerator: ingest, pre- and post-processing, orchestration, and the serving front end. On most accelerator workloads that tier runs continuously while the accelerator itself is duty-cycled, which is where the bill actually accumulates.

Pricing by region
1 hr
RegionAWS on-demandAWS Spot1-yr Reserved3-yr ReservedRackspace SpotYou save
US East, N. Virginia$1.968$0.340$1.240$0.850
US Central, Chicagono AWS region
US Central, Dallasno AWS region
Hong Kong
Sydney, Australia$2.558$0.754$1.612$1.105
London, UK$2.952$0.479$1.860$1.360
US West, San Jose
US Central, Dallas 2no AWS region
US East, N. Virginia 2$1.968$0.340$1.240$0.850
When to use it
Good for
  • ●Workloads already built against the Neuron SDK
  • ●Cost-per-inference optimisation inside AWS
  • ●Inference or training on AWS's own accelerator silicon
  • ●Workloads that fit inside 128 GiB of RAM
  • ●Parallel work that can occupy 32 vCPU
  • ●Network-heavy services — AWS rates this size at Up to 25 Gigabit
Avoid if
  • ●The working set needs more than 128 GiB of RAM
  • ●Local NVMe or instance-store disk is a hard requirement
  • ●GPU or FPGA acceleration is needed
  • ●Frameworks that have not been compiled for the Neuron SDK.
  • ●More than 4.00 GiB of RAM per vCPU is needed — that ratio is fixed for the whole family
  • ●The work is single-threaded. Most of these 32 vCPU would sit idle.
Rackspace Spot sells spare capacity at market prices. You pay what the market decides, not a list price.
  • Spot sells spare capacity at market prices. It is the cheapest compute on the internet.
  • Prices are set by supply and demand. You pay what the market decides.
  • Compute is delivered as fully managed Kubernetes. All infrastructure is taken care of.
  • Egress costs $0.01/GB after the free allowance. AWS charges $0.09/GB.
Build your Cloudspace
Frequently asked questions