TokenAssemble

Apple · unified memory

Mac mini M4 24GB

The Mac mini M4 24GB has 24GB of unified memory, roughly 18GB of it GPU-addressable, with 120 GB/s of bandwidth. The largest model that loads cleanly at a quality quant is gpt-oss-20b (llama.cpp, 8K context).

Unified memory: 24GB shared between CPU and GPU; we count ~75% as GPU-addressable for model weights.
Unified memory
24 GB
GPU-addressable
~18 GB (75%)
Memory bandwidth
120 GB/s
Backend
metal
Price (as configured)
$999

Specs as of 2026-07-11 · source

Affiliate link — we may earn a commission. Verdicts are computed before any link is attached.

What a Mac mini M4 24GB can run

Every model we track, graded at its best clean-fit quant.

ModelBest-quant verdict · llama.cpp · 8K context
Qwen3-8BFits · A+ · Q8_0painful
gemma-4-26B-A4B-itWon't fitbeta
Qwen2.5-7B-InstructFits · A+ · Q8_0painful
Qwen2.5-1.5B-InstructFits · A+ · Q8_0interactive
Llama-3.2-1B-InstructFits · A+ · Q8_0interactive
Llama-3.1-8B-InstructFits · A+ · Q8_0painful
DeepSeek-R1Won't fitbeta
Qwen3.5-9BFits · A+ · Q8_0painfulbeta
gpt-oss-20bFits · B · MXFP4usablebeta
Qwen3.6-35B-A3BWon't fitbeta
Qwen2.5-3B-InstructFits · A+ · Q8_0usable
Qwen3-32BWon't fit
Qwen3.6-27BWon't fitbeta
Qwen2.5-0.5B-InstructFits · A+ · Q8_0interactive
Mistral-7B-Instruct-v0.3Fits · A+ · Q8_0usable
gpt-oss-120bWon't fitbeta
Qwen3-14BFits · B · Q6_Kpainful
Qwen3-30B-A3BWon't fit
Qwen2.5-32B-InstructWon't fit
DeepSeek-V4-FlashWon't fitbeta
Qwen2.5-14B-InstructFits · B · Q6_Kpainful
Llama-3.2-3B-InstructFits · A+ · Q8_0usable
gemma-3-4b-itFits · A+ · Q8_0usablebeta
gemma-3-12b-itFits · B · Q6_Kpainfulbeta
Llama-3.1-70B-InstructWon't fit
Phi-3.5-mini-instructFits · A+ · Q8_0usable
Phi-4Fits · B · Q6_Kpainful
DeepSeek-R1-Distill-Qwen-32BWon't fit
gemma-3-27b-itWon't fitbeta
Llama-3.3-70B-InstructWon't fit
Qwen2.5-72B-InstructWon't fit
gemma-2-2b-itFits · A+ · Q8_0interactivebeta
DeepSeek-R1-Distill-Qwen-14BFits · B · Q6_Kpainful
DeepSeek-R1-Distill-Llama-8BFits · A+ · Q8_0painful
DeepSeek-R1-Distill-Qwen-7BFits · A+ · Q8_0painful
gemma-2-9b-itFits · A+ · Q8_0painfulbeta
Mistral-Nemo-Instruct-2407Fits · B · Q8_0painful
QwQ-32BWon't fit
Mistral-Small-24B-Instruct-2501Tight · C · Q4_K_Mpainful
gemma-2-27b-itWon't fitbeta

Verdicts computed from published specs and measured GGUF sizes — how the math works.