AWS EC2 Instances›Machine Learning ASIC›inf2›inf2.8xlarge

Compute

vCPUs32
Memory128 GiB
Mem / vCPU4.00 GiB
ProcessorEPYC 7R13 Processor
Clock speed2.95 GHz
Architecturex86_64
GPU0
GPU Wattage0 W
GPU ArchitectureNone
Video Memory0 GiB
FPGA0
ffmpeg FPS198
CoreMark / sec692,341

Storage

TypeEBS only
Bandwidth10,000 Mbps
Throughput1250 MB/s
IOPS40,000
Base Bandwidth10,000 Mbps
Base Throughput1250 MB/s
Base IOPS40,000
Devices0
NVMe DriveNo
SSDNo
Swap PartitionNo

Networking

PerformanceUp to 25 Gigabit
Max ENIs8
IPv6Yes
GPUNone
Placement GroupSupported
TrunkingYes
Branch Interface84
IPs / ENI30
Baseline Bandwidth16.667 Gbps

NUMA Architecture

Uses NUMAYes
Node Count2
Max Distance12
Cores / Node8
Threads / Node16
Memory / Node63,069 MB
L3 Cache / Node32 MB
L3 Cache SharedYes

AWS Metadata

Instance typeinf2.8xlarge
Full nameINF2 Eight Extra Large
FamilyMachine Learning ASIC Instances
Variantinf2
GenerationCurrent
Bare MetalNo
EMR supportNo
DedicatedSupported
Introduced2023-04-13
Family sizes

inf2.8xlarge

inf2.8xlarge is AWS's machine-learning accelerator EC2 size at 32 vCPU and 128 GiB. Rackspace Spot has no equivalent to offer: the Inferentia and Trainium accelerators are AWS-exclusive silicon with no third-party equivalent.

Rackspace Spot's largest VM tops out at 16 vCPU and 128 GiB, and even that is not the missing piece here. The table below prices what AWS charges; the honest answer on the Rackspace Spot side is that this workload stays where it is.

Server comparison caveats
No equivalent

The AWS inf2.8xlarge is Machine Learning ASIC hardware. That accelerator has no counterpart in the Rackspace Spot catalog, and nothing in it emulates one at a speed worth paying for. This is a genuine no-match, not a weak one.

Rackspace Spot sells x86_64 servers up to 16 vCPU, plus one NVIDIA A30 GPU class. What does move is the CPU half of the pipeline built around the accelerator: ingest, pre- and post-processing, orchestration, and the serving front end. On most accelerator workloads that tier runs continuously while the accelerator itself is duty-cycled, which is where the bill actually accumulates.

Pricing by region

1 hr

Regions are Rackspace Spot locations.

RegionAWS on-demandAWS Spot1-yr Reserved3-yr ReservedRackspace on-demandRackspace SpotOn-demand price savingsSpot price savings
US East, N. Virginia$1.968$0.434$1.240$0.850not offerednot offeredn/an/a
US Central, Chicagono AWS regionn/an/an/anot offerednot offeredn/an/a
US Central, Dallasno AWS regionn/an/an/anot offerednot offeredn/an/a
Hong Kongnot sold heren/an/an/anot offerednot offeredn/an/a
Sydney, Australia$2.558$1.662$1.612$1.105not offerednot offeredn/an/a
London, UK$2.952$0.377$1.860$1.360not offerednot offeredn/an/a
US West, San Josenot sold heren/an/an/anot offerednot offeredn/an/a
US Central, Dallas 2no AWS regionn/an/an/anot offerednot offeredn/an/a
US East, N. Virginia 2$1.968$0.434$1.240$0.850not offerednot offeredn/an/a

Prices updated 17 Nov 2026.

When to use it

Good for
  • ●Workloads already built against the Neuron SDK
  • ●Cost-per-inference optimisation inside AWS
  • ●Inference or training on AWS's own accelerator silicon
  • ●Workloads that fit inside 128 GiB of RAM
  • ●Parallel work that can occupy 32 vCPU
  • ●Network-heavy services (AWS rates this size at Up to 25 Gigabit)
Avoid if
  • ●The working set needs more than 128 GiB of RAM
  • ●Local NVMe or instance-store disk is a hard requirement
  • ●GPU or FPGA acceleration is needed
  • ●Frameworks that have not been compiled for the Neuron SDK.
  • ●More than 4.00 GiB of RAM per vCPU is needed, since that ratio is fixed for the whole family
  • ●The work is single-threaded. Most of these 32 vCPU would sit idle.
Rackspace Spot sells spare capacity at market prices. You pay what the market decides, not a list price.
  • Rackspace Spot sells spare capacity at market prices. It is the cheapest compute on the internet.
  • Prices are set by supply and demand. You pay what the market decides.
  • Compute is delivered as fully managed Kubernetes. All infrastructure is taken care of.
  • Egress costs $0.01/GB after the free allowance. AWS charges $0.09/GB.
Build your Cloudspace

Frequently asked questions

How much does inf2.8xlarge cost?

The AWS inf2.8xlarge costs $1.97/hr on-demand in US East (N. Virginia), about $1,437/mo running 24/7, or $0.434/hr at the AWS Spot price. Rackspace Spot also sells in Chicago and Dallas, where AWS operates no region at all, so those rows have no AWS price to compare against.

How much is inf2.8xlarge per month?

At 730 hours a month, inf2.8xlarge in US East (N. Virginia) is $1,437/mo on AWS on-demand, or $317/mo at the AWS Spot price.

Does Rackspace Spot have an equivalent to inf2.8xlarge?

No, and it is worth saying so plainly: the Inferentia and Trainium accelerators are AWS-exclusive silicon with no third-party equivalent. Rackspace Spot sells market-priced CPU and GPU capacity, which is a good fit for the batch, web and inference work around this instance, but not for inf2.8xlarge itself.

What is a cheaper alternative to inf2.8xlarge?

Not on Rackspace Spot, for the reason above. Within AWS the usual levers are a smaller size in the same family, a reserved or savings-plan commitment, or AWS Spot capacity if the work can tolerate interruption.