GPU

AMD Instinct MI300A GPU

Edit@6 days ago

Intergrated Memory(VRAM)
Capacity

128 GB

(HBM3 )

Bandwidth

5300 GB/s

757 Token/s

Vector Compute
FP64
61.30 T
FP32
122.60 T
FP16
X
BF16
X
INT32
NI
INT8
X

AMD Instinct MI300A GPU General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 61.30 TFLOPS

FP32: 122.60 TFLOPS

Matirx Compute
FP64
122.60 T
245.20 T
FP32
122.60 T
245.20 T
FP16
980.60 T
1961.20 T
FP8
1961.20 T
3922.40 T
TF32
490.30 T
980.60 T
BF16
980.60 T
1961.20 T
INT16
X
INT8
1961.20 T
3922.40 T
INT4
X

AMD Instinct MI300A GPU AI performance (Tensor Performance / Matrix Performance)

FP64: 122.60 TFLOPS, with sparsity: 245.20 TFLOPS

FP32: 122.60 TFLOPS, with sparsity: 245.20 TFLOPS

FP16: 980.60 TFLOPS, with sparsity: 1961.20 TFLOPS

FP8: 1961.20 TFLOPS, with sparsity: 3922.40 TFLOPS

TF32: 490.30 TFLOPS, with sparsity: 980.60 TFLOPS

BF16: 980.60 TFLOPS, with sparsity: 1961.20 TFLOPS

INT8: 1961.20 TOPS, with sparsity: 3922.40 TOPS

Hardware Specs
AMD Instinct MI300A GPU is a 6nm chip, launched by AMD at 2023. It has 128 GB built-in(On-Board/On-Chip) memory with bandwidth up to 5300 GB/s. It has 14592 general-purpose ALUs(CUDA cores/Shader cores) and 912 matrix cores(Tensor cores) .
Process Node
6 nm
Launch Year
2023
Vector(CUDA) Cores
14592
Matrix(Tensor) Cores
912
Core Frequency
1000 ~ 2100 MHz
Cache
MB

Comment without registration

Share your experience with AMD Instinct MI300A GPU / Found an Error? Help Us Improve!