GPU

NVIDIA GeForce RTX 3070 Ti Laptop

Edit@4 months ago

Intergrated Memory(VRAM)
Capacity

8 GB

(GDDR6 256-bit)

Bandwidth

448 GB/s

64 Token/s

Vector Compute
FP64
259.40 G
FP32
16.60 T
FP16
16.60 T
BF16
16.60 T
INT32
8.30 T
INT8
X

NVIDIA GeForce RTX 3070 Ti Laptop General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 259.40 GFLOPS

FP32: 16.60 TFLOPS

FP16: 16.60 TFLOPS

BF16: 16.60 TFLOPS

INT32: 8.30 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
33.21 T
66.42 T
FP8
X
TF32
16.60 T
33.21 T
BF16
33.21 T
66.42 T
INT16
X
INT8
132.83 T
265.67 T
INT4
265.67 T
531.33 T

NVIDIA GeForce RTX 3070 Ti Laptop AI performance (Tensor Performance / Matrix Performance)

FP16: 33.21 TFLOPS, with sparsity: 66.42 TFLOPS

TF32: 16.60 TFLOPS, with sparsity: 33.21 TFLOPS

BF16: 33.21 TFLOPS, with sparsity: 66.42 TFLOPS

INT8: 132.83 TOPS, with sparsity: 265.67 TOPS

INT4: 265.67 TOPS, with sparsity: 531.33 TOPS

Hardware Specs
NVIDIA GeForce RTX 3070 Ti Laptop is a 8nm chip, has 17400 million transistors, launched by NVIDIA at 2022. It has 8 GB built-in(On-Board/On-Chip) memory with bandwidth up to 448 GB/s. It has 5888 general-purpose ALUs(CUDA cores/Shader cores) and 184 matrix cores(Tensor cores) .
Process Node
8 nm
Launch Year
2022
Vector(CUDA) Cores
5888
Matrix(Tensor) Cores
184
Core Frequency
915 ~ 1410 MHz
Cache
4MB