Runtime comparison
ExLlamaV2 vs LM Studio
ExLlamaV2 is a MIT-licensed runtime for Linux · Windows running on CUDA · ROCm; LM Studio is proprietary-licensed for Linux · macOS · Windows on CUDA · Metal · CPU · Vulkan · ROCm. LM Studio rates easier to set up (5/5 vs 3/5 in our sourced ratings). Pick ExLlamaV2 for maximum control over how the model runs; pick LM Studio for people who want a desktop app and no terminal.
| Spec | ExLlamaV2 | LM Studio |
|---|---|---|
| License | MIT | proprietary |
| Operating systems | Linux · Windows | Linux · macOS · Windows |
| GPU backends | CUDA · ROCm | CUDA · Metal · CPU · Vulkan · ROCm |
| Install | pip / source | binary |
| Ease of use | 3/5 | 5/5 |
| Quant formats | exl2, gptq | gguf, mlx |
| Engine | exllamav2 | llama.cpp|mlx |
| GitHub stars | 4,581 | — |
| Latest version | v0.3.2 | — |
| Graphical app (GUI) | No | Yes |
| Server mode | No | Yes |
| OpenAI-compatible API | No | Yes |
| CPU offload | No | Yes |
| Multi-GPU | Yes | Yes |
| Speculative decoding | Yes | No |
| LoRA support | Yes | Yes |
| KV-cache quantization | Yes | Yes |
Which should you use?
ExLlamaV2
Best for maximum control over how the model runs. Command line and server, runs on CUDA · ROCm.
Full ExLlamaV2 guide →LM Studio
Best for people who want a desktop app and no terminal. Ships a graphical app, runs on CUDA · Metal · CPU · Vulkan · ROCm.
Full LM Studio guide →Neither runtime changes whether a model fits — that is your memory and quantization. Check your hardware first, then pick the runtime.
Sources: ExLlamaV2 github.com/turboderp-org/exllamav2 (as of 2026-07-08); LM Studio lmstudio.ai (as of 2026-07-08).