GPU

NVIDIA GeForce RTX 3080 Ti Laptop

Edit@4 months ago

Intergrated Memory(VRAM)
Capacity

16 GB

(GDDR6 256-bit)

Bandwidth

512 GB/s

73 Token/s

Vector Compute
FP64
292.30 G
FP32
18.71 T
FP16
18.71 T
BF16
18.71 T
INT32
9.36 T
INT8
X

NVIDIA GeForce RTX 3080 Ti Laptop General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 292.30 GFLOPS

FP32: 18.71 TFLOPS

FP16: 18.71 TFLOPS

BF16: 18.71 TFLOPS

INT32: 9.36 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
37.42 T
74.83 T
FP8
X
TF32
18.71 T
37.42 T
BF16
37.42 T
74.83 T
INT16
X
INT8
149.67 T
299.34 T
INT4
299.34 T
598.67 T

NVIDIA GeForce RTX 3080 Ti Laptop AI performance (Tensor Performance / Matrix Performance)

FP16: 37.42 TFLOPS, with sparsity: 74.83 TFLOPS

TF32: 18.71 TFLOPS, with sparsity: 37.42 TFLOPS

BF16: 37.42 TFLOPS, with sparsity: 74.83 TFLOPS

INT8: 149.67 TOPS, with sparsity: 299.34 TOPS

INT4: 299.34 TOPS, with sparsity: 598.67 TOPS

Hardware Specs
NVIDIA GeForce RTX 3080 Ti Laptop is a 8nm chip, has 22000 million transistors, launched by NVIDIA at 2022. It has 16 GB built-in(On-Board/On-Chip) memory with bandwidth up to 512 GB/s. It has 7424 general-purpose ALUs(CUDA cores/Shader cores) and 232 matrix cores(Tensor cores) .
Process Node
8 nm
Launch Year
2022
Vector(CUDA) Cores
7424
Matrix(Tensor) Cores
232
Core Frequency
810 ~ 1260 MHz
Cache
4MB