CPU

Intel Xeon Platinum 8380H

Edit@3 months ago

Socketed Memory
Capacity

1.13 TB

6 Channels xDDR4 3200MT/s

Bandwidth

153.6 GB/s

21 Token/s

Vector Compute
FP64
3.85 T
FP32
7.71 T
FP16
X
BF16
15.41 T
INT32
X
INT8
30.82 T
Theoretical peak performance: 28 Cores @ 4300 MHz with 512-bit AVX512 and Single 512-bit FMA Unit(Support INT8, BF16)

Intel Xeon Platinum 8380H General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 3.85 TFLOPS

FP32: 7.71 TFLOPS

BF16: 15.41 TFLOPS

INT8: 30.82 TOPS

Matirx Compute
No dedicated Tensor(Matrix) Units for AI

Intel Xeon Platinum 8380H AI performance (Tensor Performance / Matrix Performance)

Hardware Specs
Intel Xeon Platinum 8380H is a 14nm chip, launched by Intel at 2021. It has 28 cores, can run up to 56 threads.It can use DDR4 3200MT/s memory modules.It supports up to 6 memory channels with max bandwidth 153.6 GB/s and max capacity 1.13 GB.
Process Node
14 nm
Launch Year
2021
Max SMP
8
Cache
38.5MB
Threads
56
Num of Cores
28
Base Frequency
2900MHz
Boost Frequency
4300MHz
All Core Turbo Freq
Unknown
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3