GPU

AMD Instinct MI250X GPU

Edit@2 months ago

Intergrated Memory(VRAM)
Capacity

128 GB

(HBM2E 8192-bit)

Bandwidth

3200 GB/s

457 Token/s

Vector Compute
FP64
47.87 T
FP32
47.87 T
FP16
X
BF16
X
INT32
NI
INT8
X

AMD Instinct MI250X GPU General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 47.87 TFLOPS

FP32: 47.87 TFLOPS

Matirx Compute
FP64
95.70 T
FP32
95.70 T
FP16
383 T
FP8
X
TF32
X
BF16
383 T
INT16
X
INT8
383 T
INT4
383 T

AMD Instinct MI250X GPU AI performance (Tensor Performance / Matrix Performance)

FP64: 95.70 TFLOPS

FP32: 95.70 TFLOPS

FP16: 383 TFLOPS

BF16: 383 TFLOPS

INT8: 383 TOPS

INT4: 383 TOPS

Hardware Specs
AMD Instinct MI250X GPU is a 6nm chip, launched by AMD at 2021. It has 128 GB built-in(On-Board/On-Chip) memory with bandwidth up to 3200 GB/s. It has 14080 general-purpose ALUs(CUDA cores/Shader cores) and 880 matrix cores(Tensor cores) .
Process Node
6 nm
Launch Year
2021
Vector(CUDA) Cores
14080
Matrix(Tensor) Cores
880
Core Frequency
1000 ~ 1700 MHz
Cache
16MB