GPU

NVIDIA GeForce RTX 3060 Ti

Edit@1 months ago

Intergrated Memory(VRAM)
Capacity

8 GB

(GDDR6 256-bit)

Bandwidth

448 GB/s

64 Token/s

Vector Compute
FP64
253.10 G
FP32
16.20 T
FP16
16.20 T
BF16
16.20 T
INT32
8.10 T
INT8
X

NVIDIA GeForce RTX 3060 Ti General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 253.10 GFLOPS

FP32: 16.20 TFLOPS

FP16: 16.20 TFLOPS

BF16: 16.20 TFLOPS

INT32: 8.10 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
32.39 T
64.79 T
FP8
X
TF32
16.20 T
32.39 T
BF16
32.39 T
64.79 T
INT16
X
INT8
129.58 T
259.15 T
INT4
259.15 T
518.31 T

NVIDIA GeForce RTX 3060 Ti AI performance (Tensor Performance / Matrix Performance)

FP16: 32.39 TFLOPS, with sparsity: 64.79 TFLOPS

TF32: 16.20 TFLOPS, with sparsity: 32.39 TFLOPS

BF16: 32.39 TFLOPS, with sparsity: 64.79 TFLOPS

INT8: 129.58 TOPS, with sparsity: 259.15 TOPS

INT4: 259.15 TOPS, with sparsity: 518.31 TOPS

Hardware Specs
NVIDIA GeForce RTX 3060 Ti is a 8nm chip, has 17400 million transistors, launched by NVIDIA at 2020. It has 8 GB built-in(On-Board/On-Chip) memory with bandwidth up to 448 GB/s. It has 4864 general-purpose ALUs(CUDA cores/Shader cores) and 152 matrix cores(Tensor cores) .
Process Node
8 nm
Launch Year
2020
Vector(CUDA) Cores
4864
Matrix(Tensor) Cores
152
Core Frequency
1410 ~ 1665 MHz
Cache
4MB