AWS EC2 Instances›Machine Learning ASIC›inf1›inf1.24xlarge

Compute

vCPUs96
Memory192 GiB
Mem / vCPU2.00 GiB
ProcessorXeon Platinum 8275CL
Clock speed3.0 GHz
Architecturex86_64
GPU0
GPU Wattage0 W
GPU ArchitectureNone
Video Memory0 GiB
FPGA0
ffmpeg FPS194
CoreMark / sec1,539,880

Storage

TypeEBS only
Bandwidth19,000 Mbps
Throughput2375 MB/s
IOPS80,000
Base Bandwidth19,000 Mbps
Base Throughput2375 MB/s
Base IOPS80,000
Devices0
NVMe DriveNo
SSDNo
Swap PartitionNo

Networking

Performance100 Gigabit
Max ENIs11
IPv6Yes
GPUNone
Placement GroupSupported
TrunkingYes
Branch Interface111
IPs / ENI30
Baseline Bandwidth100 Gbps

NUMA Architecture

Uses NUMAYes
Node Count2
Max Distance21
Cores / Node24
Threads / Node48
Memory / Node94,647 MB
L3 Cache / Node35 MB
L3 Cache SharedYes

AWS Metadata

Instance typeinf1.24xlarge
Full nameINF1 24xlarge
FamilyMachine Learning ASIC Instances
Variantinf1
GenerationCurrent
Bare MetalNo
EMR supportNo
DedicatedSupported
Introduced2019-12-03
Family sizes

inf1.24xlarge

inf1.24xlarge is AWS's machine-learning accelerator EC2 size at 96 vCPU and 192 GiB. Rackspace Spot has no equivalent to offer: the Inferentia and Trainium accelerators are AWS-exclusive silicon with no third-party equivalent.

Rackspace Spot's largest VM tops out at 16 vCPU and 128 GiB, and even that is not the missing piece here. The table below prices what AWS charges; the honest answer on the Rackspace Spot side is that this workload stays where it is.

Server comparison caveats
No equivalent

The AWS inf1.24xlarge is Machine Learning ASIC hardware. That accelerator has no counterpart in the Rackspace Spot catalog, and nothing in it emulates one at a speed worth paying for. This is a genuine no-match, not a weak one.

Rackspace Spot sells x86_64 servers up to 16 vCPU, plus one NVIDIA A30 GPU class. What does move is the CPU half of the pipeline built around the accelerator: ingest, pre- and post-processing, orchestration, and the serving front end. On most accelerator workloads that tier runs continuously while the accelerator itself is duty-cycled, which is where the bill actually accumulates.

Pricing by region

1 hr

Regions are Rackspace Spot locations.

RegionAWS on-demandAWS Spot1-yr Reserved3-yr ReservedRackspace on-demandRackspace SpotOn-demand price savingsSpot price savings
US East, N. Virginia$4.721$0.918$2.974$2.269not offerednot offeredn/an/a
US Central, Chicagono AWS regionn/an/an/anot offerednot offeredn/an/a
US Central, Dallasno AWS regionn/an/an/anot offerednot offeredn/an/a
Hong Kong$7.274$4.146$4.583$3.496not offerednot offeredn/an/a
Sydney, Australia$5.902$0.782$3.718$2.836not offerednot offeredn/an/a
London, UK$5.530$0.553$3.484$2.658not offerednot offeredn/an/a
US West, San Jose$5.671$3.095$3.573$2.725not offerednot offeredn/an/a
US Central, Dallas 2no AWS regionn/an/an/anot offerednot offeredn/an/a
US East, N. Virginia 2$4.721$0.918$2.974$2.269not offerednot offeredn/an/a

Prices updated 17 Nov 2026.

When to use it

Good for
  • ●Cost-per-inference optimisation inside AWS
  • ●Inference or training on AWS's own accelerator silicon
  • ●Workloads already built against the Neuron SDK
  • ●Workloads that fit inside 192 GiB of RAM
  • ●Parallel work that can occupy 96 vCPU
  • ●Network-heavy services (AWS rates this size at 100 Gigabit)
Avoid if
  • ●The working set needs more than 192 GiB of RAM
  • ●Frameworks that have not been compiled for the Neuron SDK.
  • ●More than 2.00 GiB of RAM per vCPU is needed, since that ratio is fixed for the whole family
  • ●The work is single-threaded. Most of these 96 vCPU would sit idle.
  • ●Local NVMe or instance-store disk is a hard requirement
  • ●GPU or FPGA acceleration is needed
Rackspace Spot sells spare capacity at market prices. You pay what the market decides, not a list price.
  • Rackspace Spot sells spare capacity at market prices. It is the cheapest compute on the internet.
  • Prices are set by supply and demand. You pay what the market decides.
  • Compute is delivered as fully managed Kubernetes. All infrastructure is taken care of.
  • Egress costs $0.01/GB after the free allowance. AWS charges $0.09/GB.
Build your Cloudspace

Frequently asked questions

How much does inf1.24xlarge cost?

The AWS inf1.24xlarge costs $4.72/hr on-demand in US East (N. Virginia), about $3,446/mo running 24/7, or $0.918/hr at the AWS Spot price. Rackspace Spot also sells in Chicago and Dallas, where AWS operates no region at all, so those rows have no AWS price to compare against.

How much is inf1.24xlarge per month?

At 730 hours a month, inf1.24xlarge in US East (N. Virginia) is $3,446/mo on AWS on-demand, or $670/mo at the AWS Spot price.

Does Rackspace Spot have an equivalent to inf1.24xlarge?

No, and it is worth saying so plainly: the Inferentia and Trainium accelerators are AWS-exclusive silicon with no third-party equivalent. Rackspace Spot sells market-priced CPU and GPU capacity, which is a good fit for the batch, web and inference work around this instance, but not for inf1.24xlarge itself.

What is the difference between inf1 and inf2?

inf2 is the newer generation. It runs on AMD EPYC 7R13 Processor against inf1's Intel Xeon Platinum 8275CL (Cascade Lake). On the CoreMark figures in this dataset, inf2.24xlarge scores 1,914,734 per second against inf1.24xlarge's 1,539,880. On-demand in US East (N. Virginia) the newer size is 37% more expensive. Neither generation changes the Rackspace Spot side: both map to the same Rackspace Spot servers.

What is a cheaper alternative to inf1.24xlarge?

Not on Rackspace Spot, for the reason above. Within AWS the usual levers are a smaller size in the same family, a reserved or savings-plan commitment, or AWS Spot capacity if the work can tolerate interruption.