AWS EC2 Instances›GPU Instance›g5›g5.24xlarge

Compared with Rackspace Spot

AWSRackspace Spot
Machineg5.24xlargegpu.vs2.xlargeplusplus
vCPU9624
Memory384 GiB64 GiB
Local disk1 × 3,800 GB NVMe SSDNone
On-demand / hr--
Spot / hr--

Compute

vCPUs96
Memory384 GiB
Mem / vCPU4.00 GiB
ProcessorEPYC 7R32
Clock speed2.8 GHz
Architecturex86_64
GPU4
GPU Wattage59 W
GPU ArchitectureAmpere, Ampere, Ampere, Ampere
Video Memory96 GiB
FPGA0
ffmpeg FPS111
CoreMark / sec1,613,988

Storage

Type1 × 3,800 GB NVMe SSD
Bandwidth19,000 Mbps
Throughput2375 MB/s
IOPS80,000
Base Bandwidth19,000 Mbps
Base Throughput2375 MB/s
Base IOPS80,000
Devices1
NVMe DriveYes
SSDYes
Swap PartitionNo
Local Read IOPS312,500
Local Write IOPS156,250

Networking

Performance50 Gigabit
Max ENIs15
IPv6Yes
GPUNVIDIA A10G
Placement GroupSupported
TrunkingYes
Branch Interface107
IPs / ENI50
Baseline Bandwidth50 Gbps

NUMA Architecture

Uses NUMANo
Node CountN/A
Max DistanceN/A
Cores / NodeN/A
Threads / NodeN/A
Memory / NodeN/A
L3 Cache / NodeN/A
L3 Cache SharedN/A

AWS Metadata

Instance typeg5.24xlarge
Full nameG5 Graphics and Machine Learning GPU 24xlarge
FamilyGPU instance
Variantg5
GenerationCurrent
Bare MetalNo
EMR supportYes
DedicatedSupported
Introduced2021-11-12
Family sizes

g5.24xlarge

g5.24xlarge is AWS's GPU EC2 size at 96 vCPU and 384 GiB. Rackspace Spot runs one GPU class, gpu.vs2.xlargeplusplus: a single NVIDIA A30 with 24 vCPU and 64 GiB, in San Jose only. Against this instance's 4 × NVIDIA A10G that is a downgrade per card, honest for inference and not for the training this instance was bought for.

Server comparison caveats
Weaker GPU

The AWS g5.24xlarge puts 4 Ampere, Ampere, Ampere, Ampere GPUs (96 GiB VRAM) in one machine. Rackspace Spot has a single GPU class and no multi-GPU server, so there is no shape here that places 4 cards behind one host. Per card the NVIDIA A30 (Ampere, 24 GB VRAM) is a step down from what g5.24xlarge carries, and the aggregate is not reachable at all.

That makes this honest for data-parallel inference and embarrassingly parallel batch work, where each card is independent, and dishonest for anything that shards a model across cards or synchronises every step. The catch is location rather than hardware: US West, San Jose is the only Rackspace Spot region that offers it, so latency to your users and egress to your data are the things to check.

No local disk

The AWS g5.24xlarge comes with 1 × 3,800 GB NVMe SSD attached to the machine. Rackspace Spot servers use network storage only, so that disk doesn't come with it. If you were using it as fast scratch space, you'd move to a persistent volume attached to your Rackspace Spot server, or object storage, and both are slower to read.

Pricing by region

1 hr

Regions are Rackspace Spot locations.

RegionAWS on-demandAWS Spot1-yr Reserved3-yr ReservedRackspace on-demandRackspace SpotOn-demand price savingsSpot price savings
US West, San Josenot sold heren/an/an/a$7.250$0.151n/an/a

Prices updated 17 Nov 2026.

When to use it

Good for
  • ●Model inference and embedding generation
  • ●Video transcoding and image processing
  • ●Machine learning experimentation and fine-tuning
  • ●Workloads that fit inside 384 GiB of RAM
  • ●Jobs that want 1 × 3,800 GB of local NVMe scratch space
  • ●Network-heavy services (AWS rates this size at 50 Gigabit)
Avoid if
  • ●Starting a new deployment. g6.24xlarge is the newer generation at this size.
  • ●The working set needs more than 384 GiB of RAM
  • ●More than 4.00 GiB of RAM per vCPU is needed, since that ratio is fixed for the whole family
  • ●The work is single-threaded. Most of these 96 vCPU would sit idle.
  • ●Anything the CPU can do fast enough. GPU hours are the most expensive on the price list.
Rackspace Spot sells spare capacity at market prices. You pay what the market decides, not a list price.
  • Rackspace Spot sells spare capacity at market prices. It is the cheapest compute on the internet.
  • Prices are set by supply and demand. You pay what the market decides.
  • Compute is delivered as fully managed Kubernetes. All infrastructure is taken care of.
  • Egress costs $0.01/GB after the free allowance. AWS charges $0.09/GB.
Build your Cloudspace

Frequently asked questions

How much does g5.24xlarge cost?

AWS publishes no on-demand price for g5.24xlarge in any of the regions this page covers, because it is not sold there. The specifications and the Rackspace Spot prices below still apply.

Can Rackspace Spot run g5.24xlarge GPU workloads?

Rackspace Spot's entire GPU catalog is gpu.vs2.xlargeplusplus: one NVIDIA A30, 24 vCPU and 64 GiB, available in San Jose only. Against g5.24xlarge's 4 × NVIDIA A10G it is a step down per card: fine for inference, not a substitute for training. The pricing table has one row for that reason.

Does the Rackspace Spot equivalent include local NVMe storage?

No. g5.24xlarge ships 1 × 3,800 GB of local NVMe SSD, rated 312,500 read IOPS. Rackspace Spot servers are network-backed, so a workload that leans on local disk throughput needs block storage or a re-architecture. Everything else about the match still holds.

Is g5.24xlarge still worth using?

For workloads already running on it, yes: it works and it is priced accordingly. For anything new, g6.24xlarge is the current answer and measures roughly 17% more CoreMark throughput at the same vCPU count. 2 newer generations of the g family have shipped since (g6 and g7), which is the signal that matters for infrastructure you expect to keep running.

What is the difference between g5 and g6?

g6 is the newer generation. It runs on AMD EPYC 7R13 Processor against g5's AMD EPYC 7R32. On the CoreMark figures in this dataset, g6.24xlarge scores 1,884,200 per second against g5.24xlarge's 1,613,988. On-demand in US East (N. Virginia) the newer size is 18% cheaper. Neither generation changes the Rackspace Spot side: both map to the same Rackspace Spot servers.

What is a cheaper alternative to g5.24xlarge?

Rackspace Spot gpu.vs2.xlargeplusplus is the closest shape; the table above shows current prices by region. Workloads have to be containerized to run on it.