AWS EC2 Instances›GPU Instance›p4de›p4de.24xlarge

Compute

vCPUs96
Memory1152 GiB
Mem / vCPU12.00 GiB
ProcessorXeon Platinum 8275L
Clock speed3 GHz
Architecturex86_64
GPU8
GPU Wattage0 W
GPU ArchitectureAmpere, Ampere, Ampere, Ampere, Ampere, Ampere, Ampere, Ampere
Video Memory640 GiB
FPGA0
ffmpeg FPSN/A
CoreMark / sec1,557,493

Storage

Type8 × 1,000 GB NVMe SSD
Bandwidth19,000 Mbps
Throughput2375 MB/s
IOPS80,000
Base Bandwidth19,000 Mbps
Base Throughput2375 MB/s
Base IOPS80,000
Devices8
NVMe DriveYes
SSDYes
Swap PartitionNo
Local Read IOPS2,000,000
Local Write IOPS1,600,000

Networking

Performance4x 100 Gigabit
Max ENIs60
IPv6Yes
GPUNVIDIA A100
Placement GroupSupported
TrunkingYes
Branch Interface62
IPs / ENI50
Baseline Bandwidth100 Gbps

NUMA Architecture

Uses NUMAYes
Node Count2
Max Distance21
Cores / Node24
Threads / Node48
Memory / Node574,363 MB
L3 Cache / Node35 MB
L3 Cache SharedYes

AWS Metadata

Instance typep4de.24xlarge
Full nameP4DE 24xlarge
FamilyGPU instance
Variantp4de
GenerationCurrent
Bare MetalNo
EMR supportNo
DedicatedSupported
Introduced2022-05-26
Family sizes
p4de.24xlarge96 vCPU · 1152 GiB

p4de.24xlarge

The p4de.24xlarge is a GPU AWS EC2 instance with 96 vCPU and 1152 GiB of memory. Rackspace Spot has no equivalent to offer: 8 × NVIDIA A100 wired together behind a high-speed interconnect is one tightly coupled machine, not 8 independent nodes, and that interconnect is usually what the instance was bought for.

Rackspace Spot's largest VM tops out at 16 vCPU and 128 GiB, and even that is not the missing piece here. The table below prices what AWS charges; the honest answer on the Rackspace Spot side is that this workload stays where it is.

Server comparison caveats
No equivalent

The AWS p4de.24xlarge is 8 Ampere, Ampere, Ampere, Ampere, Ampere, Ampere, Ampere, Ampere GPUs (640 GiB VRAM) wired together inside one chassis. The interconnect is what you bought (that is what makes it one accelerator with pooled memory rather than several machines), and Rackspace Spot has nothing that reproduces it. The Rackspace Spot GPU class is built on the NVIDIA A30 (Ampere, 24 GB VRAM), and separate nodes of it on ordinary datacentre networking are not a substitute for a single interconnect-joined node.

Split the job across independent single-GPU nodes only if it is data-parallel with no per-step synchronisation and the model fits one card. Model-parallel work, or anything synchronising gradients every step, does not survive the move. Rackspace Spot sells x86_64 servers up to 16 vCPU, plus one NVIDIA A30 GPU class.

Pricing by region

1 hr

Regions are Rackspace Spot locations.

RegionAWS on-demandAWS Spot1-yr Reserved3-yr ReservedRackspace on-demandRackspace SpotOn-demand price savingsSpot price savings
US East, N. Virginia$27.447$20.713$17.401$11.718not offerednot offeredn/an/a
US Central, Chicagono AWS regionn/an/an/anot offerednot offeredn/an/a
US Central, Dallasno AWS regionn/an/an/anot offerednot offeredn/an/a
Hong Kongnot sold heren/an/an/anot offerednot offeredn/an/a
Sydney, Australianot sold heren/an/an/anot offerednot offeredn/an/a
London, UKnot sold heren/an/an/anot offerednot offeredn/an/a
US West, San Josenot sold heren/an/an/anot offerednot offeredn/an/a
US Central, Dallas 2no AWS regionn/an/an/anot offerednot offeredn/an/a
US East, N. Virginia 2$27.447$20.713$17.401$11.718not offerednot offeredn/an/a

Prices updated 17 Nov 2026.

When to use it

Good for
  • ●CUDA-accelerated batch jobs
  • ●Model inference and embedding generation
  • ●Video transcoding and image processing
  • ●Workloads that fit inside 1152 GiB of RAM
  • ●Jobs that want 8 × 1,000 GB of local NVMe scratch space
  • ●Network-heavy services (AWS rates this size at 4x 100 Gigabit)
Avoid if
  • ●The working set needs more than 1152 GiB of RAM
  • ●More than 12.00 GiB of RAM per vCPU is needed, since that ratio is fixed for the whole family
  • ●The work is single-threaded. Most of these 96 vCPU would sit idle.
  • ●Anything the CPU can do fast enough. GPU hours are the most expensive on the price list.
Rackspace Spot sells spare capacity at market prices. You pay what the market decides, not a list price.
  • Rackspace Spot sells spare capacity at market prices. It is the cheapest compute on the internet.
  • Prices are set by supply and demand. You pay what the market decides.
  • Compute is delivered as fully managed Kubernetes. All infrastructure is taken care of.
  • Egress costs $0.01/GB after the free allowance. AWS charges $0.09/GB.
Build your Cloudspace

Frequently asked questions

How much does p4de.24xlarge cost?

The AWS p4de.24xlarge costs $27.45/hr on-demand in US East (N. Virginia), about $20,036/mo running 24/7, or $20.71/hr at the AWS Spot price. Rackspace Spot also sells in Chicago and Dallas, where AWS operates no region at all, so those rows have no AWS price to compare against.

How much is p4de.24xlarge per month?

At 730 hours a month, p4de.24xlarge in US East (N. Virginia) is $20,036/mo on AWS on-demand, or $15,120/mo at the AWS Spot price.

Does Rackspace Spot have an equivalent to p4de.24xlarge?

No, and it is worth saying so plainly: 8 × NVIDIA A100 wired together behind a high-speed interconnect is one tightly coupled machine, not 8 independent nodes, and that interconnect is usually what the instance was bought for. Rackspace Spot sells market-priced CPU and GPU capacity, which is a good fit for the batch, web and inference work around this instance, but not for p4de.24xlarge itself.

What is a cheaper alternative to p4de.24xlarge?

Not on Rackspace Spot, for the reason above. Within AWS the usual levers are a smaller size in the same family, a reserved or savings-plan commitment, or AWS Spot capacity if the work can tolerate interruption.