CPU

Intel Xeon Platinum 8481C

Edit@3 months ago

Socketed Memory
Capacity

4 TB

8 Channels xDDR5 4800MT/s

Bandwidth

307.2 GB/s

43 Token/s

Vector Compute
FP64
5.20 T
FP32
10.39 T
FP16
20.79 T
BF16
20.79 T
INT32
X
INT8
41.57 T
Theoretical peak performance: 56 Cores @ 2900 MHz with 512-bit AVX512 and Dual 512-bit FMAs (Support INT8, BF16, FP16)

Intel Xeon Platinum 8481C General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 5.20 TFLOPS

FP32: 10.39 TFLOPS

FP16: 20.79 TFLOPS

BF16: 20.79 TFLOPS

INT8: 41.57 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
166.30 T
FP8
X
TF32
X
BF16
166.30 T
INT16
X
INT8
332.60 T
INT4
X
Theoretical peak performance: 56 Cores @ 2900 MHz with Intel Advanced Matrix Extensions

Intel Xeon Platinum 8481C AI performance (Tensor Performance / Matrix Performance)

FP16: 166.30 TFLOPS

BF16: 166.30 TFLOPS

INT8: 332.60 TOPS

Hardware Specs
Intel Xeon Platinum 8481C is a 10nm chip, launched by Intel at 2023. It has 56 cores, can run up to 112 threads.It can use DDR5 4800MT/s memory modules.It supports up to 8 memory channels with max bandwidth 307.2 GB/s and max capacity 4 GB.
Process Node
10 nm
Launch Year
2023
Max SMP
2
Cache
105MB
Threads
112
Num of Cores
56
Base Frequency
2000MHz
Boost Frequency
3800MHz
All Core Turbo Freq
2900MHz
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3
AMX