GPU

AMD Instinct MI210 GPU

Edit@2 months ago

Intergrated Memory(VRAM)
Capacity

64 GB

(HBM2E 4096-bit)

Bandwidth

1600 GB/s

228 Token/s

Vector Compute
FP64
22.63 T
FP32
22.63 T
FP16
X
BF16
X
INT32
NI
INT8
X

AMD Instinct MI210 GPU General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 22.63 TFLOPS

FP32: 22.63 TFLOPS

Matirx Compute
FP64
45.30 T
FP32
45.30 T
FP16
181 T
FP8
X
TF32
X
BF16
181 T
INT16
X
INT8
181 T
INT4
X

AMD Instinct MI210 GPU AI performance (Tensor Performance / Matrix Performance)

FP64: 45.30 TFLOPS

FP32: 45.30 TFLOPS

FP16: 181 TFLOPS

BF16: 181 TFLOPS

INT8: 181 TOPS

Hardware Specs
AMD Instinct MI210 GPU is a 6nm chip, launched by AMD at 2022. It has 64 GB built-in(On-Board/On-Chip) memory with bandwidth up to 1600 GB/s. It has 6656 general-purpose ALUs(CUDA cores/Shader cores) and 416 matrix cores(Tensor cores) .
Process Node
6 nm
Launch Year
2022
Vector(CUDA) Cores
6656
Matrix(Tensor) Cores
416
Core Frequency
1000 ~ 1700 MHz
Cache
16MB