GPU

NVIDIA L2 PCIe

Edit@11 months ago

集成高速内存(显存)
容量

24 GB

(GDDR6 )

带宽

300 GB/s

42 Token/s

向量计算
FP64
X
FP32
24.10 T
FP16
24.10 T
BF16
NI
INT32
NI
INT8
X

NVIDIA L2 PCIe General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP32: 24.10 TFLOPS

FP16: 24.10 TFLOPS

矩阵计算
FP64
X
FP32
X
FP16
96.50 T
193 T
FP8
193 T
386 T
TF32
X
BF16
96.50 T
193 T
INT16
X
INT8
193 T
386 T
INT4
X

NVIDIA L2 PCIe AI performance (Tensor Performance / Matrix Performance)

FP16: 96.50 TFLOPS, with sparsity: 193 TFLOPS

FP8: 193 TFLOPS, with sparsity: 386 TFLOPS

BF16: 96.50 TFLOPS, with sparsity: 193 TFLOPS

INT8: 193 TOPS, with sparsity: 386 TOPS

一般参数
NVIDIA L2 PCIe is a 4nm chip, launched by NVIDIA at 2028. It has 24 GB built-in(On-Board/On-Chip) memory with bandwidth up to 300 GB/s. .
制程工艺
4 nm
发布年份
2028
向量(CUDA)核心数
矩阵(Tensor)核心数
核心频率
~ MHz
缓存
36MB