CPU

Ampere Altra Max M128-30

Edit@1 months ago

Socketed Memory
Capacity

4 TB

8 Channels xDDR4 3200MT/s

Bandwidth

204.8 GB/s

29 Token/s

Vector Compute
FP64
2.30 T
FP32
4.61 T
FP16
9.22 T
BF16
X
INT32
X
INT8
X
Theoretical peak performance: 96 Cores @ 3000 MHz with 128-bit NEON and Dual 128-bit FMAs (Support FP16)

Ampere Altra Max M128-30 General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 2.30 TFLOPS

FP32: 4.61 TFLOPS

FP16: 9.22 TFLOPS

Matirx Compute
No dedicated Tensor(Matrix) Units for AI

Ampere Altra Max M128-30 AI performance (Tensor Performance / Matrix Performance)

Hardware Specs
Ampere Altra Max M128-30 is a 7nm chip, a product of Ampere Computing. It has 96 cores, can run up to 96 threads.It can use DDR4 3200MT/s memory modules.It supports up to 8 memory channels with max bandwidth 204.8 GB/s and max capacity 4 GB.
Process Node
7 nm
Launch Year
Max SMP
Cache
16MB
Threads
96
Num of Cores
96
Base Frequency
Unknown
Boost Frequency
3000MHz
All Core Turbo Freq
Unknown
SIMD Extensions