Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
28 self-hosted OpenAI API alternatives
The OpenAI API is the paid programmatic interface to GPT-class models hosted on OpenAI's infrastructure. These open-source apps let you replace OpenAI API with software you host and control yourself.
Best self-hosted OpenAI API alternatives
Hugging Face Transformers
Self-Hosted AIState-of-the-art machine learning model library
Replaces OpenAI API
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4Free
Self-Hosted AIUnified OpenAI-compatible API gateway for many models
Replaces OpenAI API
LocalAI
AI Image GenerationDrop-in OpenAI-compatible API for local inference
Replaces OpenAI API, ElevenLabs
exo
Local LLM RunnersRun your own AI cluster across everyday devices
Replaces OpenAI API
New API
Local LLM RunnersNext-gen LLM gateway and AI asset management system
Replaces OpenRouter, OpenAI API
FastChat
Local LLM RunnersPlatform for serving and evaluating large language models
Replaces OpenAI API
One API
Local LLM RunnersUnified OpenAI-compatible gateway for many LLM providers
Replaces OpenAI API, OpenRouter
SGLang
Self-Hosted AIFast serving framework for LLMs and vision-language models
Replaces OpenAI API
llamafile
Local LLM RunnersDistribute and run LLMs with a single executable file
Replaces OpenAI API, ChatGPT
MLC LLM
Local LLM RunnersUniversal LLM deployment engine for any hardware
Replaces OpenAI API
Guidance
Self-Hosted AIConstrained generation language for controlling LLMs
Replaces OpenAI API
OpenLLM
Local LLM RunnersRun any open LLM as an OpenAI-compatible API endpoint
Replaces OpenAI API
Text Generation Inference
Local LLM RunnersHugging Face toolkit for production LLM serving
Replaces OpenAI API
Petals
Local LLM RunnersRun large language models collaboratively in a swarm
Replaces OpenAI API
Xinference
Self-Hosted AIDistributed inference framework for LLMs and embeddings
Replaces OpenAI API, Hugging Face Inference Endpoints
Llama Stack
Self-Hosted AIComposable API server for building generative AI applications
Replaces OpenAI API
LMDeploy
Local LLM RunnersToolkit for compressing and serving large language models
Replaces OpenAI API, Hugging Face Inference Endpoints
MLX LM
Self-Hosted AIRun and fine-tune LLMs locally on Apple Silicon with MLX
Replaces OpenAI API
GPUStack
Self-Hosted AIManage GPU clusters for running AI models
Replaces OpenAI API
ExLlamaV2
Self-Hosted AIFast inference library for quantized LLMs on consumer GPUs
Replaces OpenAI API
ik_llama.cpp
Local LLM RunnersPerformance-focused fork of llama.cpp with new quant types
Replaces OpenAI API
ExLlama
Self-Hosted AIMemory-efficient inference library for quantized Llama models
Replaces OpenAI API
Aphrodite Engine
Local LLM RunnersHigh-throughput inference engine for large language models
Replaces OpenAI API
Wllama
Local LLM RunnersRun LLM inference directly in the browser with WebAssembly
Replaces OpenAI API
openedai-speech
Self-Hosted AIOpenAI-compatible text-to-speech server using local models
Replaces OpenAI API, ElevenLabs
No apps match these filters.
Compare OpenAI API alternatives
- Aphrodite Engine vs exo
- Aphrodite Engine vs FastChat
- Aphrodite Engine vs ik_llama.cpp
- Aphrodite Engine vs llama.cpp
- Aphrodite Engine vs llamafile
- Aphrodite Engine vs LMDeploy
- Aphrodite Engine vs MLC LLM
- Aphrodite Engine vs New API
- Aphrodite Engine vs Ollama
- Aphrodite Engine vs One API
- Aphrodite Engine vs OpenLLM
- Aphrodite Engine vs Petals
- Aphrodite Engine vs Text Generation Inference
- Aphrodite Engine vs vLLM
- ExLlama vs Hugging Face Transformers
- ExLlamaV2 vs Hugging Face Transformers
- exo vs FastChat
- exo vs GPT4Free
- exo vs GPUStack
- exo vs Guidance
- exo vs ik_llama.cpp
- exo vs llama.cpp
- exo vs Llama Stack
- exo vs llamafile
- exo vs LMDeploy
- exo vs LocalAI
- exo vs MLC LLM
- exo vs MLX LM
- exo vs New API
- exo vs Ollama
- exo vs One API
- exo vs OpenLLM
- exo vs Petals
- exo vs SGLang
- exo vs Text Generation Inference
- exo vs Hugging Face Transformers
- exo vs vLLM
- exo vs Wllama
- exo vs Xinference
- FastChat vs GPT4Free
Switching from OpenAI API
Moving off OpenAI API means trading a managed subscription for a service you run yourself. The payoff is ownership: no per-seat pricing, no vendor lock-in, and full control of your data. Start with the option above that matches your setup-difficulty comfort level — every app links to a detailed specs page and head-to-head comparisons.