Local LLM runtime
Text Generation WebUI
Text Generation WebUI is a AGPL-3.0-licensed local-LLM desktop app for Linux · macOS · Windows, running on CUDA · Metal · CPU · ROCm, with an OpenAI-compatible API. Ease of use 3/5 in our sourced ratings.
- License
- AGPL-3.0
- Operating systems
- Linux · macOS · Windows
- Backends
- CUDA · Metal · CPU · ROCm
- Install
- source / binary
- Ease of use
- 3/5
- Latest version
- v4.9
- GitHub stars
- 47,437
- Engine
- llama.cpp|exllamav2|transformers
- Graphical app (GUI)
- Server mode
- OpenAI-compatible API
- CPU offload
- Multi-GPU
- Speculative decoding
- LoRA support
- KV-cache quantization
- One-line install
As of 2026-07-08 · source · GitHub
Software that runs on Text Generation WebUI
Frontends, assistants and harnesses that can use Text Generation WebUI as their local backend.
Will your machine run a model with Text Generation WebUI?
Check with Text Generation WebUI preselected →Support facts come from each runtime's own documentation, stamped and dated — how the math works.