Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
Best API Local LLM Runners for self-hosting
The 22 best API local llm runners you can self-host, ranked by community traction.
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
LiteLLM
Local LLM RunnersUnified proxy and gateway for 100+ LLM APIs
Replaces OpenRouter
exo
Local LLM RunnersRun your own AI cluster across everyday devices
Replaces OpenAI API
New API
Local LLM RunnersNext-gen LLM gateway and AI asset management system
Replaces OpenRouter, OpenAI API
Jan
Local LLM RunnersOpen-source offline ChatGPT alternative for the desktop
Replaces ChatGPT
FastChat
Local LLM RunnersPlatform for serving and evaluating large language models
Replaces OpenAI API
One API
Local LLM RunnersUnified OpenAI-compatible gateway for many LLM providers
Replaces OpenAI API, OpenRouter
Continue
Local LLM RunnersOpen-source AI code assistant for VS Code and JetBrains
Replaces GitHub Copilot, Cursor
llamafile
Local LLM RunnersDistribute and run LLMs with a single executable file
Replaces OpenAI API, ChatGPT
MLC LLM
Local LLM RunnersUniversal LLM deployment engine for any hardware
Replaces OpenAI API
OpenLLM
Local LLM RunnersRun any open LLM as an OpenAI-compatible API endpoint
Replaces OpenAI API
KoboldCpp
Local LLM RunnersSingle-file local LLM runner for text and storytelling
Replaces ChatGPT
Text Generation Inference
Local LLM RunnersHugging Face toolkit for production LLM serving
Replaces OpenAI API
Petals
Local LLM RunnersRun large language models collaboratively in a swarm
Replaces OpenAI API
LMDeploy
Local LLM RunnersToolkit for compressing and serving large language models
Replaces OpenAI API, Hugging Face Inference Endpoints
Enchanted
Local LLM RunnersNative Ollama client for iOS and macOS
Replaces ChatGPT
LM Studio
Local LLM RunnersDesktop app to discover, download, and run local LLMs
Replaces ChatGPT
Text Embeddings Inference
Local LLM RunnersFast inference server for text embedding models
Replaces OpenAI Embeddings API
ik_llama.cpp
Local LLM RunnersPerformance-focused fork of llama.cpp with new quant types
Replaces OpenAI API
Aphrodite Engine
Local LLM RunnersHigh-throughput inference engine for large language models
Replaces OpenAI API
No apps match these filters.
Every option here is open-source and self-hostable, tagged API within the local llm runners category. Compare them on the individual app pages for setup difficulty and resource requirements.