AWS EC2 Instances›GPU Instance›g5›g5.16xlarge

Compared with Rackspace Spot

AWSRackspace Spot
Machineg5.16xlargegpu.vs2.xlargeplusplus
vCPU6424
Memory256 GiB64 GiB
Local disk1 × 1,900 GB NVMe SSDNone
On-demand / hr--
Spot / hr--

Compute

vCPUs64
Memory256 GiB
Mem / vCPU4.00 GiB
ProcessorEPYC 7R32
Clock speed2.8 GHz
Architecturex86_64
GPU1
GPU Wattage59 W
GPU ArchitectureAmpere
Video Memory24 GiB
FPGA0
ffmpeg FPS113
CoreMark / sec1,246,915

Storage

Type1 × 1,900 GB NVMe SSD
Bandwidth16,000 Mbps
Throughput2000 MB/s
IOPS65,000
Base Bandwidth16,000 Mbps
Base Throughput2000 MB/s
Base IOPS65,000
Devices1
NVMe DriveYes
SSDYes
Swap PartitionNo
Local Read IOPS250,000
Local Write IOPS125,000

Networking

Performance25 Gigabit
Max ENIs8
IPv6Yes
GPUNVIDIA A10G
Placement GroupSupported
TrunkingYes
Branch Interface114
IPs / ENI30
Baseline Bandwidth25 Gbps

NUMA Architecture

Uses NUMANo
Node CountN/A
Max DistanceN/A
Cores / NodeN/A
Threads / NodeN/A
Memory / NodeN/A
L3 Cache / NodeN/A
L3 Cache SharedN/A

AWS Metadata

Instance typeg5.16xlarge
Full nameG5 Graphics and Machine Learning GPU 16xlarge Extra Large
FamilyGPU instance
Variantg5
GenerationCurrent
Bare MetalNo
EMR supportYes
DedicatedSupported
Introduced2021-11-12
Family sizes

g5.16xlarge

AWS's g5.16xlarge is a GPU instance with 64 vCPU and 256 GiB. Rackspace Spot runs one GPU class, gpu.vs2.xlargeplusplus: a single NVIDIA A30 with 24 vCPU and 64 GiB, in San Jose only. Against this instance's 1 × NVIDIA A10G that is a fair swap for inference and media work, because the A30 carries more memory and more throughput per card.

Server comparison caveats
Comparable GPU

The AWS g5.16xlarge pairs 1 Ampere GPU (24 GiB VRAM) with 64 vCPU. Rackspace Spot's GPU server uses the NVIDIA A30 (Ampere, 24 GB VRAM) with 24 vCPU and 64 GiB of memory. That is newer hardware with more GPU memory, but 24 vCPU against 64. For inference, batch transcoding and single-card fine-tuning the card is the upgrade; anything CPU-bound running alongside it gets less to work with. The catch is location rather than hardware: US West, San Jose is the only Rackspace Spot region that offers it, so latency to your users and egress to your data are the things to check.

No local disk

The AWS g5.16xlarge comes with 1 × 1,900 GB NVMe SSD attached to the machine. Rackspace Spot servers use network storage only, so that disk doesn't come with it. If you were using it as fast scratch space, you'd move to a persistent volume attached to your Rackspace Spot server, or object storage, and both are slower to read.

Pricing by region

1 hr

Regions are Rackspace Spot locations.

RegionAWS on-demandAWS Spot1-yr Reserved3-yr ReservedRackspace on-demandRackspace SpotOn-demand price savingsSpot price savings
US West, San Josenot sold heren/an/an/a$7.250$0.151n/an/a

Prices updated 17 Nov 2026.

When to use it

Good for
  • ●CUDA-accelerated batch jobs
  • ●Model inference and embedding generation
  • ●Video transcoding and image processing
  • ●Workloads that fit inside 256 GiB of RAM
  • ●Jobs that want 1 × 1,900 GB of local NVMe scratch space
  • ●Network-heavy services (AWS rates this size at 25 Gigabit)
Avoid if
  • ●Starting a new deployment. g6.16xlarge is the newer generation at this size.
  • ●The working set needs more than 256 GiB of RAM
  • ●More than 4.00 GiB of RAM per vCPU is needed, since that ratio is fixed for the whole family
  • ●The work is single-threaded. Most of these 64 vCPU would sit idle.
  • ●Anything the CPU can do fast enough. GPU hours are the most expensive on the price list.
Rackspace Spot sells spare capacity at market prices. You pay what the market decides, not a list price.
  • Rackspace Spot sells spare capacity at market prices. It is the cheapest compute on the internet.
  • Prices are set by supply and demand. You pay what the market decides.
  • Compute is delivered as fully managed Kubernetes. All infrastructure is taken care of.
  • Egress costs $0.01/GB after the free allowance. AWS charges $0.09/GB.
Build your Cloudspace

Frequently asked questions

How much does g5.16xlarge cost?

AWS publishes no on-demand price for g5.16xlarge in any of the regions this page covers, because it is not sold there. The specifications and the Rackspace Spot prices below still apply.

Can Rackspace Spot run g5.16xlarge GPU workloads?

Rackspace Spot's entire GPU catalog is gpu.vs2.xlargeplusplus: one NVIDIA A30, 24 vCPU and 64 GiB, available in San Jose only. Against g5.16xlarge's 1 × NVIDIA A10G the A30 is comparable or better for inference and transcoding, which is where most of these hours actually go. The pricing table has one row for that reason.

Does the Rackspace Spot equivalent include local NVMe storage?

No. g5.16xlarge ships 1 × 1,900 GB of local NVMe SSD, rated 250,000 read IOPS. Rackspace Spot servers are network-backed, so a workload that leans on local disk throughput needs block storage or a re-architecture. Everything else about the match still holds.

Is g5.16xlarge still worth using?

For workloads already running on it, yes: it works and it is priced accordingly. For anything new, g6.16xlarge is the current answer and measures roughly 11% more CoreMark throughput at the same vCPU count. 2 newer generations of the g family have shipped since (g6 and g7), which is the signal that matters for infrastructure you expect to keep running.

What is the difference between g5 and g6?

g6 is the newer generation. It runs on AMD EPYC 7R13 Processor against g5's AMD EPYC 7R32. On the CoreMark figures in this dataset, g6.16xlarge scores 1,380,873 per second against g5.16xlarge's 1,246,915. On-demand in US East (N. Virginia) the newer size is 17% cheaper. Neither generation changes the Rackspace Spot side: both map to the same Rackspace Spot servers.

What is a cheaper alternative to g5.16xlarge?

Rackspace Spot gpu.vs2.xlargeplusplus is the closest shape; the table above shows current prices by region. Workloads have to be containerized to run on it.