GPU

Apple M4 Pro GPU(16 Cores)

Edit@1 months ago

Intergrated Memory(UMA)
Max Capacity

48 GB

( 3/4 of 64 GB UMA memory as VRAM )
Bandwidth

273 GB/s

39 Token/s

Vector Compute
FP64
3.69 T
FP32
7.37 T
FP16
14.75 T
BF16
X
INT32
NI
INT8
X

Apple M4 Pro GPU(16 Cores) General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 3.69 TFLOPS

FP32: 7.37 TFLOPS

FP16: 14.75 TFLOPS

Matirx Compute
FP64
X
FP32
X
FP16
X
FP8
X
TF32
X
BF16
X
INT16
X
INT8
X
INT4
X

Apple M4 Pro GPU(16 Cores) AI performance (Tensor Performance / Matrix Performance)

Hardware Specs
Apple M4 Pro GPU(16 Cores) is a 3nm chip, launched by Apple at 2024. It has 48 GB built-in(On-Board/On-Chip) memory with bandwidth up to 273 GB/s. It has 2048 general-purpose ALUs(CUDA cores/Shader cores).
Process Node
3 nm
Launch Year
2024
Vector(CUDA) Cores
2048
Matrix(Tensor) Cores
Core Frequency
500 ~ 1800 MHz
Cache
MB