GPU

NVIDIA L2 PCIe

Edit@3 months ago

Intergrated Memory(VRAM)
Capacity

24 GB

(GDDR6 )

Bandwidth

300 GB/s

42 Token/s

Vector Compute
FP64
X
FP32
24.10 T
FP16
24.10 T
BF16
NI
INT32
NI
INT8
X

NVIDIA L2 PCIe General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP32: 24.10 TFLOPS

FP16: 24.10 TFLOPS

Matirx Compute
FP64
X
FP32
X
FP16
96.50 T
193 T
FP8
193 T
386 T
TF32
X
BF16
96.50 T
193 T
INT16
X
INT8
193 T
386 T
INT4
X

NVIDIA L2 PCIe AI performance (Tensor Performance / Matrix Performance)

FP16: 96.50 TFLOPS, with sparsity: 193 TFLOPS

FP8: 193 TFLOPS, with sparsity: 386 TFLOPS

BF16: 96.50 TFLOPS, with sparsity: 193 TFLOPS

INT8: 193 TOPS, with sparsity: 386 TOPS

Hardware Specs
NVIDIA L2 PCIe is a 4nm chip, launched by NVIDIA at 2028. It has 24 GB built-in(On-Board/On-Chip) memory with bandwidth up to 300 GB/s. .
Process Node
4 nm
Launch Year
2028
Vector(CUDA) Cores
Matrix(Tensor) Cores
Core Frequency
~ MHz
Cache
36MB