GPU

NVIDIA CMP 90HX

Edit@11 months ago

Intergrated Memory(VRAM)
Capacity

10 GB

(GDDR6X 320-bit)

Bandwidth

760 GB/s

108 Token/s

Vector Compute
FP64
342 G
FP32
21.89 T
FP16
21.89 T
BF16
NI
INT32
21.89 T
INT8
X

NVIDIA CMP 90HX General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 342 GFLOPS

FP32: 21.89 TFLOPS

FP16: 21.89 TFLOPS

INT32: 21.89 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
X
FP8
X
TF32
X
BF16
X
INT16
X
INT8
X
INT4
X

NVIDIA CMP 90HX AI performance (Tensor Performance / Matrix Performance)

Hardware Specs
NVIDIA CMP 90HX is a 8nm chip, has 28300 million transistors, launched by NVIDIA at 2021. It has 10 GB built-in(On-Board/On-Chip) memory with bandwidth up to 760 GB/s. It has 6400 general-purpose ALUs(CUDA cores/Shader cores) and 200 matrix cores(Tensor cores) .
Process Node
8 nm
Launch Year
2021
Vector(CUDA) Cores
6400
Matrix(Tensor) Cores
200
Core Frequency
1500 ~ 1710 MHz
Cache
5MB