AIU

AWS Trainium2

Edit@3 months ago

Intergrated Memory
Capacity

96 GB

( )

Bandwidth

4000 GB/s

571 Token/s

Vector Compute
FP64
X
FP32
X
FP16
X
BF16
X
INT32
X
INT8
X

AWS Trainium2 General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

Matirx Compute
FP64
X
FP32
215 T
FP16
431 T
FP8
X
TF32
431 T
BF16
431 T
INT16
X
INT8
861 T
INT4
X

AWS Trainium2 AI performance (Tensor Performance / Matrix Performance)

FP32: 215 TFLOPS

FP16: 431 TFLOPS

TF32: 431 TFLOPS

BF16: 431 TFLOPS

INT8: 861 TOPS

Hardware Specs
AWS Trainium2 launched by Amazon at 2024. It has 96 GB built-in(On-Board/On-Chip) memory with bandwidth up to 4000 GB/s.
Process Node
nm
Launch Year
2024