NVIDIA GPU
NVIDIA GeForce RTX 4060 Ti 16 GB
The NVIDIA GeForce RTX 4060 Ti 16 GB has 16GB of VRAM and 288 GB/s of memory bandwidth. Its sweet spot tops out around gpt-oss-20b — the largest model that loads cleanly at a quality quant with llama.cpp at 8K context.
- VRAM
- 16 GB
- Memory bandwidth
- 288 GB/s
- TDP
- 165 W
- MSRP
- $499
- Backends
- CUDA · Vulkan
Specs as of 2026-07-08 · source
Affiliate link — we may earn a commission. Verdicts are computed before any link is attached.
What an NVIDIA GeForce RTX 4060 Ti 16 GB can run
Every model we track, graded at its best clean-fit quant. Click any verdict for the full breakdown.
Verdicts computed from published specs and measured GGUF sizes — how the math works.