GPU

Intel Gaudi 2 AI Accelerator

Edit@2 months ago

Intergrated Memory(VRAM)
Capacity

96 GB

(HBM2E )

Bandwidth

2460 GB/s

351 Token/s

Vector Compute
FP64
X
FP32
X
FP16
X
BF16
11 T
INT32
NI
INT8
X

Intel Gaudi 2 AI Accelerator General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

BF16: 11 TFLOPS

Matirx Compute
FP64
X
FP32
X
FP16
X
FP8
865 T
TF32
X
BF16
432 T
INT16
X
INT8
X
INT4
X

Intel Gaudi 2 AI Accelerator AI performance (Tensor Performance / Matrix Performance)

FP8: 865 TFLOPS

BF16: 432 TFLOPS

Hardware Specs
Intel Gaudi 2 AI Accelerator is a 7nm chip, launched by Intel at 2023. It has 96 GB built-in(On-Board/On-Chip) memory with bandwidth up to 2460 GB/s. .
Process Node
7 nm
Launch Year
2023
Vector(CUDA) Cores
Matrix(Tensor) Cores
Core Frequency
~ MHz
Cache
MB