CPU

Intel Xeon Gold 6458Q

Edit@3 months ago

Socketed Memory
Capacity

4 TB

8 Channels xDDR5 4800MT/s

Bandwidth

307.2 GB/s

43 Token/s

Vector Compute
FP64
4.10 T
FP32
8.19 T
FP16
16.38 T
BF16
16.38 T
INT32
X
INT8
32.77 T
Theoretical peak performance: 32 Cores @ 4000 MHz with 512-bit AVX512 and Dual 512-bit FMAs (Support INT8, BF16, FP16)

Intel Xeon Gold 6458Q General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 4.10 TFLOPS

FP32: 8.19 TFLOPS

FP16: 16.38 TFLOPS

BF16: 16.38 TFLOPS

INT8: 32.77 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
131.07 T
FP8
X
TF32
X
BF16
131.07 T
INT16
X
INT8
262.14 T
INT4
X
Theoretical peak performance: 32 Cores @ 4000 MHz with Intel Advanced Matrix Extensions

Intel Xeon Gold 6458Q AI performance (Tensor Performance / Matrix Performance)

FP16: 131.07 TFLOPS

BF16: 131.07 TFLOPS

INT8: 262.14 TOPS

Hardware Specs
Intel Xeon Gold 6458Q is a 10nm chip, launched by Intel at 2023. It has 32 cores, can run up to 64 threads.It can use DDR5 4800MT/s memory modules.It supports up to 8 memory channels with max bandwidth 307.2 GB/s and max capacity 4 GB.
Process Node
10 nm
Launch Year
2023
Max SMP
2
Cache
60MB
Threads
64
Num of Cores
32
Base Frequency
3100MHz
Boost Frequency
4000MHz
All Core Turbo Freq
4000MHz
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3
AMX