CPU

Intel Xeon Max 9480

Edit@6 days ago

Intergrated Memory
Capacity

64 GB

(HBM2e )

Bandwidth

1600 GB/s

228 Token/s

Socketed Memory
Capacity

4 TB

(8 t('channels'))

Bandwidth

307.2 GB/s

(DDR5 4800MT/s)

Vector Compute
FP64
4.66 T
FP32
9.32 T
FP16
18.64 T
BF16
18.64 T
INT32
X
INT8
37.27 T
Theoretical peak performance: 56 Cores @ 2600 MHz with 512-bit AVX512 and Dual 512-bit FMAs (Support INT8, BF16, FP16)

Intel Xeon Max 9480 General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 4.66 TFLOPS

FP32: 9.32 TFLOPS

FP16: 18.64 TFLOPS

BF16: 18.64 TFLOPS

INT8: 37.27 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
149.09 T
FP8
X
TF32
X
BF16
149.09 T
INT16
X
INT8
298.19 T
INT4
X
Theoretical peak performance: 56 Cores @ 2600 MHz with Intel Advanced Matrix Extensions

Intel Xeon Max 9480 AI performance (Tensor Performance / Matrix Performance)

FP16: 149.09 TFLOPS

BF16: 149.09 TFLOPS

INT8: 298.19 TOPS

Hardware Specs
Intel Xeon Max 9480 is a 10nm chip, launched by Intel at 2023. It has 64 GB built-in(On-Board/On-Chip) memory with bandwidth up to 1600 GB/s. It has 56 cores, can run up to 112 threads.It can use DDR5 4800MT/s memory modules.It supports up to 8 memory channels with max bandwidth 307.2 GB/s and max capacity 4 TB.
Process Node
10 nm
Launch Year
2023
Max SMP
2
Cache
112.5MB
Threads
112
Num of Cores
56
Base Frequency
1900MHz
Boost Frequency
3500MHz
All Core Turbo Freq
2600MHz
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
AVX-VNNI
FMA3
AMX

Comment without registration

Share your experience with Intel Xeon Max 9480 / Found an Error? Help Us Improve!