One API
Unified OpenAI-compatible gateway for many LLM providers
One API is an LLM API management and distribution system that exposes a single OpenAI-compatible endpoint while routing to many upstream providers. It adds key management, channel load balancing, usage tracking and multi-user billing.
Key features
- Unified OpenAI-compatible API
- Channel load balancing
- Token and quota management
- Multi-user support
Strengths
- Released under the MIT license
- First-class Docker support for quick deployment
- Mature project with 36.3k GitHub stars
- Written in JavaScript
One API replaces
Compare One API
36 head-to-head comparisons.
- One API vs Ollama
- One API vs Hugging Face Transformers
- One API vs llama.cpp
- One API vs vLLM
- One API vs GPT4All
- One API vs GPT4Free
- One API vs LiteLLM
- One API vs LocalAI
- One API vs exo
- One API vs New API
- One API vs Jan
- One API vs FastChat
- One API vs Continue
- One API vs SGLang
- One API vs llamafile
- One API vs MLC LLM
- One API vs Guidance
- One API vs OpenLLM
- One API vs KoboldCpp
- One API vs Text Generation Inference
- One API vs Petals
- One API vs Xinference
- One API vs Llama Stack
- One API vs Page Assist
- One API vs LMDeploy
- One API vs MLX LM
- One API vs Enchanted
- One API vs Serge
- One API vs GPUStack
- One API vs LM Studio
- One API vs Text Embeddings Inference
- One API vs Harbor LLM Toolkit
- One API vs ik_llama.cpp
- One API vs Aphrodite Engine
- One API vs Wllama
- One API vs LLMKube
Similar local llm runners apps
Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4All
Local LLM RunnersPrivacy-first desktop chat with local language models
Replaces ChatGPT
LiteLLM
Local LLM RunnersUnified proxy and gateway for 100+ LLM APIs
Replaces OpenRouter
exo
Local LLM RunnersRun your own AI cluster across everyday devices
Replaces OpenAI API