GPUs available on ARC systems

Need a GPU? Here is a list of where you can find them on ARC’s clusters, their configurations, and performance characteristics.

There are 514 GPUs over all clusters.

Architecture	Cluster	Partitions	Number	Memory	Configuration	Interconnect	TDP	FP64	TF64	FP32	TF32	INT8	FLOPS/Watt dp	FLOPS/Watt sp	FLOPS/Watt I8
NVIDIA L40S-48G	Falcon	l40s_normal_q, l40s_preemptable_q	80 (20 nodes, 4 GPU/node)	48G	PCIe, 4 GPUs per node	None	350W	–	–	91.6TF	183TF	733TO	–	523G (TF)	2094G
NVIDIA A30-24G	Falcon	a30_normal_q, a30_preemptable_q	128 (32 nodes, 4 GPU/node)	24G	PCIe, 4 GPUs per node	NVLink Bridge 2-way	165W	5.2TF	10.3TF	10.3TF	82TF	330TO	62.4G (TF)	328G (TF)	1320G
NVIDIA V100-16G	Falcon	v100_normal_q, v100_preemptable_q	72 (36 nodes, 2 GPU/node)	16G	PCIe, 2 GPUs per node	None	250W	7TF	–	14TF	–	250TO	28G (FP)	56G (FP)	1000G
NVIDIA T4-16G	Falcon	t4_normal_q, t4_preemptable_q	18 (18 nodes, 1 GPU/node)	16	PCIe, 1 GPU per node	None	70W	–	–	8.1TF	–	130TO	–	–115G (FP)	1857G
NVIDIA A100-80G	TinkerCliffs	a100_normal_q, a100_preemptable_q	112 (14 nodes, 8 GPU/node)	80G	SXM, 8 GPUs per node	NVSwitch HDR IB	400W	9.7TF	19.5TF	19.5TF	156TF	624TO	48.8G (TF)	390G (TF)	1560G
NVIDIA H200-141G	TinkerCliffs	h200_normal_q, h200_preemptable_q	48 (6 nodes, 8 GPU/node)	141G	SXM, 8 GPUs per node	NVSwitch, NDR IB	700W	34TF	67TF	67TF	989TF	3958TO	95.7G (TF)	1413G (TF)	5654G
NVIDIA B200-180G	Owl	b200_normal_q, b200_preemptable_q	32 (4 nodes, 8 GPU/node)	180G	SXM, 8 GPUs per node	NVSwitch	1000W	37TF	37TF	75TF	1100TF	4500TO	37G (TF)	75G (TF)	4500G
NVIDIA A100-80G	CUI	a100_normal_q, a100_preemptable_q	16 (2 nodes, 8 GPU/node)	80G	SXM, 8 GPUs per node	NVSwitch, HDR IB	400W	9.7TF	19.5TF	19.5TF	156TF	624TO	48.8G (TF)	390G (TF)	1560G
NVIDIA A100-80G	Biomed	a100_normal_q, a100_preemptable_q	8 (1 node, 8 GPU/node)	80G	SXM, 8 GPUs per node	NVSwitch, HDR IB	400W	9.7TF	19.5TF	19.5TF	156TF	624TO	48.8G (TF)	390G (TF)	1560G

Legend

• Memory = Memory per node.

• TDP = Thermal design power.

• FP64 = Double precision = double precision floating point computations.

• TF64 = Tensor float 64 = running double precision floating point instructions on 32 bit cores.

• FP32 = Single precision = single precision floating point computations.

• TF32 = Tensor float 32 = hybrid floating point that is between FP32 and FP16.

• INT8 = Eight-bit integer representations.

• FLOPS/Watt dp = Double precision FLOPS/Watt.

• FLOPS/Watt sp = Single precision FLOPS/Watt.

• FLOPS/Watt I8 = Eight-bit integer FLOPS/Watt.