AIU

Google TPUv5p

Edit@3 months ago

Intergrated Memory
Capacity

95 GB

(HBM )

Bandwidth

2765 GB/s

395 Token/s

Vector Compute
FP64
X
FP32
X
FP16
X
BF16
X
INT32
X
INT8
X

Google TPUv5p General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

Matirx Compute
FP64
X
FP32
X
FP16
X
FP8
X
TF32
X
BF16
459 T
INT16
X
INT8
918 T
INT4
X

Google TPUv5p AI performance (Tensor Performance / Matrix Performance)

BF16: 459 TFLOPS

INT8: 918 TOPS

Hardware Specs
Google TPUv5p launched by Google at 2023. It has 95 GB built-in(On-Board/On-Chip) memory with bandwidth up to 2765 GB/s.
Process Node
nm
Launch Year
2023