AIU

Google TPUv6e

Edit@3 months ago

Intergrated Memory
Capacity

32 GB

(HBM )

Bandwidth

1640 GB/s

234 Token/s

Vector Compute
FP64
X
FP32
X
FP16
X
BF16
X
INT32
X
INT8
X

Google TPUv6e General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

Matirx Compute
FP64
X
FP32
X
FP16
X
FP8
X
TF32
X
BF16
918 T
INT16
X
INT8
1836 T
INT4
X

Google TPUv6e AI performance (Tensor Performance / Matrix Performance)

BF16: 918 TFLOPS

INT8: 1836 TOPS

Hardware Specs
Google TPUv6e launched by Google at 2024. It has 32 GB built-in(On-Board/On-Chip) memory with bandwidth up to 1640 GB/s.
Process Node
nm
Launch Year
2024