GPU

Intel Gaudi 3 AI accelerator

Edit@1 months ago

Intergrated Memory(VRAM)
Capacity

128 GB

(HBM2e )

Bandwidth

3700 GB/s

528 Token/s

Vector Compute
FP64
X
FP32
14.30 T
FP16
28.70 T
BF16
28.70 T
INT32
NI
INT8
X

Intel Gaudi 3 AI accelerator General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP32: 14.30 TFLOPS

FP16: 28.70 TFLOPS

BF16: 28.70 TFLOPS

Matirx Compute
FP64
X
FP32
229 T
FP16
459 T
FP8
1678 T
TF32
459 T
BF16
1678 T
INT16
X
INT8
X
INT4
X

Intel Gaudi 3 AI accelerator AI performance (Tensor Performance / Matrix Performance)

FP32: 229 TFLOPS

FP16: 459 TFLOPS

FP8: 1678 TFLOPS

TF32: 459 TFLOPS

BF16: 1678 TFLOPS

Hardware Specs
Intel Gaudi 3 AI accelerator is a 5nm chip, launched by Intel at 2024. It has 128 GB built-in(On-Board/On-Chip) memory with bandwidth up to 3700 GB/s. .
Process Node
5 nm
Launch Year
2024
Vector(CUDA) Cores
Matrix(Tensor) Cores
Core Frequency
~ MHz
Cache
MB