AWS EC2 Instances›Machine Learning ASIC›inf2›inf2.48xlarge

Compute

vCPUs192
Memory768 GiB
Mem / vCPU4.00 GiB
ProcessorEPYC 7R13 Processor
Clock speed2.95 GHz
Architecturex86_64
GPU0
GPU Wattage0 W
GPU ArchitectureNone
Video Memory0 GiB
FPGA0
ffmpeg FPSN/A
CoreMark / secN/A

Storage

TypeEBS only
Bandwidth60,000 Mbps
Throughput7500 MB/s
IOPS240,000
Base Bandwidth60,000 Mbps
Base Throughput7500 MB/s
Base IOPS240,000
Devices0
NVMe DriveNo
SSDNo
Swap PartitionNo

Networking

Performance100 Gigabit
Max ENIs15
IPv6Yes
GPUNone
Placement GroupSupported
TrunkingYes
Branch Interface107
IPs / ENI50
Baseline Bandwidth100 Gbps

NUMA Architecture

Uses NUMANo
Node CountN/A
Max DistanceN/A
Cores / NodeN/A
Threads / NodeN/A
Memory / NodeN/A
L3 Cache / NodeN/A
L3 Cache SharedN/A

AWS Metadata

Instance typeinf2.48xlarge
Full nameINF2 48xlarge
FamilyMachine Learning ASIC Instances
Variantinf2
GenerationCurrent
Bare MetalNo
EMR supportNo
DedicatedSupported
Introduced2023-04-13
Family sizes

inf2.48xlarge

The inf2.48xlarge is a machine-learning accelerator AWS EC2 instance with 192 vCPU and 768 GiB of memory. Rackspace Spot has no equivalent to offer: the Inferentia and Trainium accelerators are AWS-exclusive silicon with no third-party equivalent.

Rackspace Spot's largest VM tops out at 16 vCPU and 128 GiB, and even that is not the missing piece here. The table below prices what AWS charges; the honest answer on the Rackspace Spot side is that this workload stays where it is.

Server comparison caveats
No equivalent

The AWS inf2.48xlarge is Machine Learning ASIC hardware. That accelerator has no counterpart in the Rackspace Spot catalog, and nothing in it emulates one at a speed worth paying for. This is a genuine no-match, not a weak one.

Rackspace Spot sells x86_64 servers up to 16 vCPU, plus one NVIDIA A30 GPU class. What does move is the CPU half of the pipeline built around the accelerator: ingest, pre- and post-processing, orchestration, and the serving front end. On most accelerator workloads that tier runs continuously while the accelerator itself is duty-cycled, which is where the bill actually accumulates.

Pricing by region

1 hr

Regions are Rackspace Spot locations.

RegionAWS on-demandAWS Spot1-yr Reserved3-yr ReservedRackspace on-demandRackspace SpotOn-demand price savingsSpot price savings
US East, N. Virginia$12.981$2.275$8.178$5.608not offerednot offeredn/an/a
US Central, Chicagono AWS regionn/an/an/anot offerednot offeredn/an/a
US Central, Dallasno AWS regionn/an/an/anot offerednot offeredn/an/a
Hong Kongnot sold heren/an/an/anot offerednot offeredn/an/a
Sydney, Australia$16.876$10.678$10.632$7.290not offerednot offeredn/an/a
London, UK$19.472$2.315$12.267$8.973not offerednot offeredn/an/a
US West, San Josenot sold heren/an/an/anot offerednot offeredn/an/a
US Central, Dallas 2no AWS regionn/an/an/anot offerednot offeredn/an/a
US East, N. Virginia 2$12.981$2.275$8.178$5.608not offerednot offeredn/an/a

Prices updated 17 Nov 2026.

When to use it

Good for
  • ●Workloads already built against the Neuron SDK
  • ●Cost-per-inference optimisation inside AWS
  • ●Inference or training on AWS's own accelerator silicon
  • ●Workloads that fit inside 768 GiB of RAM
  • ●Parallel work that can occupy 192 vCPU
  • ●Network-heavy services (AWS rates this size at 100 Gigabit)
Avoid if
  • ●The working set needs more than 768 GiB of RAM
  • ●More than 4.00 GiB of RAM per vCPU is needed, since that ratio is fixed for the whole family
  • ●The work is single-threaded. Most of these 192 vCPU would sit idle.
  • ●Local NVMe or instance-store disk is a hard requirement
  • ●GPU or FPGA acceleration is needed
  • ●Frameworks that have not been compiled for the Neuron SDK.
Rackspace Spot sells spare capacity at market prices. You pay what the market decides, not a list price.
  • Rackspace Spot sells spare capacity at market prices. It is the cheapest compute on the internet.
  • Prices are set by supply and demand. You pay what the market decides.
  • Compute is delivered as fully managed Kubernetes. All infrastructure is taken care of.
  • Egress costs $0.01/GB after the free allowance. AWS charges $0.09/GB.
Build your Cloudspace

Frequently asked questions

How much does inf2.48xlarge cost?

The AWS inf2.48xlarge costs $12.98/hr on-demand in US East (N. Virginia), about $9,476/mo running 24/7, or $2.27/hr at the AWS Spot price. Rackspace Spot also sells in Chicago and Dallas, where AWS operates no region at all, so those rows have no AWS price to compare against.

How much is inf2.48xlarge per month?

At 730 hours a month, inf2.48xlarge in US East (N. Virginia) is $9,476/mo on AWS on-demand, or $1,661/mo at the AWS Spot price.

Does Rackspace Spot have an equivalent to inf2.48xlarge?

No, and it is worth saying so plainly: the Inferentia and Trainium accelerators are AWS-exclusive silicon with no third-party equivalent. Rackspace Spot sells market-priced CPU and GPU capacity, which is a good fit for the batch, web and inference work around this instance, but not for inf2.48xlarge itself.

What is a cheaper alternative to inf2.48xlarge?

Not on Rackspace Spot, for the reason above. Within AWS the usual levers are a smaller size in the same family, a reserved or savings-plan commitment, or AWS Spot capacity if the work can tolerate interruption.