TokenAssemble

Alibaba/Qwen · open-weights model

Qwen3-30B-A3B

Qwen3-30B-A3B is a 30.5B-parameter model (MoE, 3.3B active) by Alibaba/Qwen. Its smallest quant (Q4_K_M) needs at least 19.9GB of GPU-addressable memory at 8K context; it loads cleanly at a quality quant on 20 of the 50 machines we track.

Parameters
30.5B total · 3.3B active
Layers
48
Max context
40K
Attention
GQA
License
apache-2.0

Config from Qwen/Qwen3-30B-A3B

Quants and what they need

Measured file sizes; “needs” = weights + KV cache at 8K context + overhead.

QuantFile sizeNeeds ≥
Q8_032.5 GB33.7 GB
Q6_K25.1 GB26.3 GB
Q5_K_M21.7 GB23.0 GB
Q4_K_M18.6 GB19.9 GB

What runs Qwen3-30B-A3B

Every machine we track, graded at its best clean-fit quant.

HardwareBest-quant verdict · llama.cpp · 8K context
Intel Arc A770 16 GBTight · C · Q4_K_Minteractive · offloadbeta
Intel Arc B580Tight · C · Q4_K_Minteractive · offloadbeta
AMD Radeon PRO W7900Fits · B · Q8_0interactivebeta
NVIDIA GeForce RTX 3060 12 GBTight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 3070Tight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 3070 TiTight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 3080 10 GBTight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 3080 12 GBTight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 3080 TiTight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 3090Fits · B · Q4_K_Minteractivebeta
NVIDIA GeForce RTX 3090 TiFits · B · Q4_K_Minteractivebeta
NVIDIA GeForce RTX 4060Tight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 4060 Ti 16 GBTight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 4060 Ti 8 GBTight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 4070Tight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 4070 SUPERTight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 4070 TiTight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 4070 Ti SUPERTight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 4080Tight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 4080 SUPERTight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 4090Fits · B · Q4_K_Minteractivebeta
NVIDIA RTX 5000 Ada GenerationFits · B · Q6_Kinteractivebeta
NVIDIA GeForce RTX 5060 Ti 16 GBTight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 5070Tight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 5070 TiTight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 5080Tight · C · Q4_K_Minteractive · offloadbeta
NVIDIA GeForce RTX 5090Fits · B · Q6_Kinteractivebeta
NVIDIA RTX 6000 Ada GenerationFits · B · Q8_0interactivebeta
NVIDIA RTX A6000Fits · B · Q8_0interactivebeta
AMD Radeon RX 6800Tight · C · Q4_K_Minteractive · offloadbeta
AMD Radeon RX 6900 XTTight · C · Q4_K_Minteractive · offloadbeta
AMD Radeon RX 7800 XTTight · C · Q4_K_Minteractive · offloadbeta
AMD Radeon RX 7900 XTTight · C · Q4_K_Minteractive · offloadbeta
AMD Radeon RX 7900 XTXFits · B · Q4_K_Minteractivebeta
AMD Radeon RX 9070Tight · C · Q4_K_Minteractive · offloadbeta
AMD Radeon RX 9070 XTTight · C · Q4_K_Minteractive · offloadbeta
ASUS Ascent GX10Fits · A+ · Q8_0interactivebeta
Beelink GTR9 Pro Ryzen AI Max+ 395 128GBFits · A+ · Q8_0interactivebeta
NVIDIA DGX SparkFits · A+ · Q8_0interactivebeta
Framework Desktop Ryzen AI Max+ 395 128GBFits · A+ · Q8_0interactivebeta
Framework Desktop Ryzen AI Max+ 395 64GBFits · B · Q8_0interactivebeta
GMKtec EVO-X2 Ryzen AI Max+ 395 128GBFits · A+ · Q8_0interactivebeta
HP Z2 Mini G1a Ryzen AI Max+ PRO 395 128GBFits · A+ · Q8_0interactivebeta
Mac mini M4 16GBWon't fit
Mac mini M4 24GBWon't fit
Mac mini M4 Pro 24GBWon't fit
Mac mini M4 Pro 48GBFits · B · Q6_Kinteractivebeta
Mac Studio M3 Ultra 96GBFits · A+ · Q8_0interactivebeta
Mac Studio M4 Max 36GBFits · B · Q5_K_Minteractivebeta
Mac Studio M4 Max 64GBFits · B · Q8_0interactivebeta

Verdicts computed from published specs and measured GGUF sizes — how the math works.