AWS EC2 Instances›Machine Learning ASIC›inf2›inf2.24xlarge

Compute

vCPUs96
Memory384 GiB
Mem / vCPU4.00 GiB
ProcessorEPYC 7R13 Processor
Clock speed2.95 GHz
Architecturex86_64
GPU0
GPU Wattage0 W
GPU ArchitectureNone
Video Memory0 GiB
FPGA0
ffmpeg FPS249
CoreMark / sec1,914,734

Storage

TypeEBS only
Bandwidth30,000 Mbps
Throughput3750 MB/s
IOPS120,000
Base Bandwidth30,000 Mbps
Base Throughput3750 MB/s
Base IOPS120,000
Devices0
NVMe DriveNo
SSDNo
Swap PartitionNo

Networking

Performance50 Gigabit
Max ENIs15
IPv6Yes
GPUNone
Placement GroupSupported
TrunkingYes
Branch Interface107
IPs / ENI50
Baseline Bandwidth50 Gbps

NUMA Architecture

Uses NUMAYes
Node Count2
Max Distance12
Cores / Node24
Threads / Node48
Memory / Node189,399 MB
L3 Cache / Node96 MB
L3 Cache SharedYes

AWS Metadata

Instance typeinf2.24xlarge
Full nameINF2 24xlarge
FamilyMachine Learning ASIC Instances
Variantinf2
GenerationCurrent
Bare MetalNo
EMR supportNo
DedicatedSupported
Introduced2023-04-13
Family sizes

inf2.24xlarge

The inf2.24xlarge is a machine-learning accelerator AWS EC2 instance with 96 vCPU and 384 GiB of memory. Rackspace Spot has no equivalent to offer: the Inferentia and Trainium accelerators are AWS-exclusive silicon with no third-party equivalent.

Rackspace Spot's largest VM tops out at 16 vCPU and 128 GiB, and even that is not the missing piece here. The table below prices what AWS charges; the honest answer on the Rackspace Spot side is that this workload stays where it is.

Server comparison caveats
No equivalent

The AWS inf2.24xlarge is Machine Learning ASIC hardware. That accelerator has no counterpart in the Rackspace Spot catalog, and nothing in it emulates one at a speed worth paying for. This is a genuine no-match, not a weak one.

Rackspace Spot sells x86_64 servers up to 16 vCPU, plus one NVIDIA A30 GPU class. What does move is the CPU half of the pipeline built around the accelerator: ingest, pre- and post-processing, orchestration, and the serving front end. On most accelerator workloads that tier runs continuously while the accelerator itself is duty-cycled, which is where the bill actually accumulates.

Pricing by region

1 hr

Regions are Rackspace Spot locations.

RegionAWS on-demandAWS Spot1-yr Reserved3-yr ReservedRackspace on-demandRackspace SpotOn-demand price savingsSpot price savings
US East, N. Virginia$6.491$1.057$4.089$2.804not offerednot offeredn/an/a
US Central, Chicagono AWS regionn/an/an/anot offerednot offeredn/an/a
US Central, Dallasno AWS regionn/an/an/anot offerednot offeredn/an/a
Hong Kongnot sold heren/an/an/anot offerednot offeredn/an/a
Sydney, Australia$8.438$5.378$5.316$3.645not offerednot offeredn/an/a
London, UK$9.736$0.974$6.134$4.486not offerednot offeredn/an/a
US West, San Josenot sold heren/an/an/anot offerednot offeredn/an/a
US Central, Dallas 2no AWS regionn/an/an/anot offerednot offeredn/an/a
US East, N. Virginia 2$6.491$1.057$4.089$2.804not offerednot offeredn/an/a

Prices updated 17 Nov 2026.

When to use it

Good for
  • ●Inference or training on AWS's own accelerator silicon
  • ●Workloads already built against the Neuron SDK
  • ●Cost-per-inference optimisation inside AWS
  • ●Workloads that fit inside 384 GiB of RAM
  • ●Parallel work that can occupy 96 vCPU
  • ●Network-heavy services (AWS rates this size at 50 Gigabit)
Avoid if
  • ●The working set needs more than 384 GiB of RAM
  • ●GPU or FPGA acceleration is needed
  • ●Frameworks that have not been compiled for the Neuron SDK.
  • ●More than 4.00 GiB of RAM per vCPU is needed, since that ratio is fixed for the whole family
  • ●The work is single-threaded. Most of these 96 vCPU would sit idle.
  • ●Local NVMe or instance-store disk is a hard requirement
Rackspace Spot sells spare capacity at market prices. You pay what the market decides, not a list price.
  • Rackspace Spot sells spare capacity at market prices. It is the cheapest compute on the internet.
  • Prices are set by supply and demand. You pay what the market decides.
  • Compute is delivered as fully managed Kubernetes. All infrastructure is taken care of.
  • Egress costs $0.01/GB after the free allowance. AWS charges $0.09/GB.
Build your Cloudspace

Frequently asked questions

How much does inf2.24xlarge cost?

The AWS inf2.24xlarge costs $6.49/hr on-demand in US East (N. Virginia), about $4,738/mo running 24/7, or $1.06/hr at the AWS Spot price. Rackspace Spot also sells in Chicago and Dallas, where AWS operates no region at all, so those rows have no AWS price to compare against.

How much is inf2.24xlarge per month?

At 730 hours a month, inf2.24xlarge in US East (N. Virginia) is $4,738/mo on AWS on-demand, or $771/mo at the AWS Spot price.

Does Rackspace Spot have an equivalent to inf2.24xlarge?

No, and it is worth saying so plainly: the Inferentia and Trainium accelerators are AWS-exclusive silicon with no third-party equivalent. Rackspace Spot sells market-priced CPU and GPU capacity, which is a good fit for the batch, web and inference work around this instance, but not for inf2.24xlarge itself.

What is a cheaper alternative to inf2.24xlarge?

Not on Rackspace Spot, for the reason above. Within AWS the usual levers are a smaller size in the same family, a reserved or savings-plan commitment, or AWS Spot capacity if the work can tolerate interruption.