Instances›AWS EC2›p5›p5.4xlarge
Compute
vCPUs16
Memory256 GiB
Mem / vCPU16.00 GiB
ProcessorEPYC 7R13 Processor
Clock speed2.95 GHz
Architecturex86_64
Storage
Type1 × 3,800 GB NVMe SSD
Bandwidth10,000 Mbps
Throughput1250 MB/s
IOPS32,500
Networking
Performance100 Gigabit
Max ENIs4
IPv6Yes
GPUNVIDIA H100
Family sizes
p5.4xlarge16 vCPU · 256 GiB
p5.48xlarge192 vCPU · 2048 GiB
p5.4xlarge

The p5.4xlarge is a GPU AWS EC2 instance: 16 vCPU and 256 GiB of memory, 16.00 GiB per vCPU. In the name, "p" is accelerated computing, "5" is the generation and "4xlarge" is the size within the p5 family. It runs on AMD EPYC 7R13 Processor at 2.95 GHz, and AWS introduced it in August 2025. p5 is the current generation of the p family, so there is no newer AWS size to migrate to. Rackspace Spot runs one GPU class, gpu.vs2.xlargeplusplus — a single NVIDIA A30 with 24 vCPU and 64 GiB, in San Jose only. Against this instance's 1 × NVIDIA H100 that is a downgrade per card, honest for inference and not for the training this instance was bought for.

Match qualityWeaker GPU

p5.4xlarge carries 1 GPU (80 GiB VRAM). The Spot GPU node is built on the NVIDIA A30 (Ampere, 24 GB VRAM) with 24 vCPU and 64 GiB of host memory. Per card that is a downgrade, and it should be read as one: it is honest for inference, batch work and small-batch fine-tuning, and it is not the card p5.4xlarge was bought for if the job is a full training run. The catch is location rather than hardware: US West, San Jose is the only Spot region that offers it, so latency to your users and egress to your data are the things to check.

No local diskp5.4xlarge comes with 1 × 3,800 GB NVMe SSD attached to the machine. Spot nodes use network storage only, so that disk doesn't come with it. If you were using it as fast scratch space, you'd move to a persistent volume or object storage, which are slower to read.
Pricing by region
1 hr
RegionAWS on-demandAWS Spot1-yr Reserved3-yr ReservedRackspace SpotYou save
US West, San Jose$0.191
When to use it
Good for
  • ●Video transcoding and image processing
  • ●Machine learning experimentation and fine-tuning
  • ●Remote graphics workstations and rendering
  • ●Workloads that fit inside 256 GiB of RAM
  • ●Jobs that want 1 × 3,800 GB of local NVMe scratch space
  • ●Network-heavy services — AWS rates this size at 100 Gigabit
Avoid if
  • ●The working set needs more than 256 GiB of RAM
  • ●More than 16.00 GiB of RAM per vCPU is needed — that ratio is fixed for the whole family
  • ●The work is single-threaded. Most of these 16 vCPU would sit idle.
  • ●Anything the CPU can do fast enough. GPU hours are the most expensive on the price list.
Rackspace Spot sells spare capacity at market prices. You pay what the market decides, not a list price.
  • Spot sells spare capacity at market prices. It is the cheapest compute on the internet.
  • Prices are set by supply and demand. You pay what the market decides.
  • Compute is delivered as fully managed Kubernetes. All infrastructure is taken care of.
  • Egress costs $0.01/GB after the free allowance. AWS charges $0.09/GB.
Build your Cloudspace
Frequently asked questions