CPU

Ampere Altra Max M96-30

Edit@3 months ago

Socketed Memory
Capacity

4 TB

8 Channels xDDR4 3200MT/s

Bandwidth

204.8 GB/s

29 Token/s

Vector Compute
FP64
3.07 T
FP32
6.14 T
FP16
12.29 T
BF16
X
INT32
X
INT8
X
Theoretical peak performance: 128 Cores @ 3000 MHz with 128-bit NEON and Dual 128-bit FMAs (Support FP16)

Ampere Altra Max M96-30 General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 3.07 TFLOPS

FP32: 6.14 TFLOPS

FP16: 12.29 TFLOPS

Matirx Compute
No dedicated Tensor(Matrix) Units for AI

Ampere Altra Max M96-30 AI performance (Tensor Performance / Matrix Performance)

Hardware Specs
Ampere Altra Max M96-30 is a 7nm chip, launched by Ampere Computing at 2021. It has 128 cores, can run up to 128 threads.It can use DDR4 3200MT/s memory modules.It supports up to 8 memory channels with max bandwidth 204.8 GB/s and max capacity 4 GB.
Process Node
7 nm
Launch Year
2021
Max SMP
Cache
16MB
Threads
128
Num of Cores
128
Base Frequency
Unknown
Boost Frequency
3000MHz
All Core Turbo Freq
Unknown
SIMD Extensions