Local LLM runtimes
The software that actually runs the model. Ordered by our sourced ease-of-use rating — every fact stamped and dated, and every runtime wired into the feasibility checker's support gate.
- Ollamaease 5/5
MIT · linux / macos / windows · server · OpenAI API
- LM Studioease 5/5
proprietary · linux / macos / windows · GUI · server · OpenAI API
- KoboldCppease 4/5
AGPL-3.0 · linux / macos / windows · GUI · server · OpenAI API
- MLX LMease 4/5
MIT · macos · server · OpenAI API
- llama.cppease 3/5
MIT · linux / macos / windows · server · OpenAI API
- Text Generation WebUIease 3/5
AGPL-3.0 · linux / macos / windows · GUI · server · OpenAI API
- ExLlamaV2ease 3/5
MIT · linux / windows
- TabbyAPIease 3/5
AGPL-3.0 · linux / windows · server · OpenAI API
- vLLMease 2/5
Apache-2.0 · linux · server · OpenAI API
- SGLangease 2/5
Apache-2.0 · linux · server · OpenAI API