New API
Next-gen LLM gateway and AI asset management system
New API is a large-model interface management and distribution system derived from One API, providing an OpenAI-compatible gateway with richer billing, rendering and provider support. It is designed for running a self-hosted AI relay service.
Key features
- OpenAI-compatible relay
- Multi-provider channels
- Detailed billing
- Modern dashboard
Strengths
- Released under the MIT license
- First-class Docker support for quick deployment
- Mature project with 44.6k GitHub stars
- Written in Go
New API replaces
Compare New API
36 head-to-head comparisons.
- New API vs Ollama
- New API vs Hugging Face Transformers
- New API vs llama.cpp
- New API vs vLLM
- New API vs GPT4All
- New API vs GPT4Free
- New API vs LiteLLM
- New API vs LocalAI
- New API vs exo
- New API vs Jan
- New API vs FastChat
- New API vs One API
- New API vs Continue
- New API vs SGLang
- New API vs llamafile
- New API vs MLC LLM
- New API vs Guidance
- New API vs OpenLLM
- New API vs KoboldCpp
- New API vs Text Generation Inference
- New API vs Petals
- New API vs Xinference
- New API vs Llama Stack
- New API vs Page Assist
- New API vs LMDeploy
- New API vs MLX LM
- New API vs Enchanted
- New API vs Serge
- New API vs GPUStack
- New API vs LM Studio
- New API vs Text Embeddings Inference
- New API vs Harbor LLM Toolkit
- New API vs ik_llama.cpp
- New API vs Aphrodite Engine
- New API vs Wllama
- New API vs LLMKube
Similar local llm runners apps
Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4All
Local LLM RunnersPrivacy-first desktop chat with local language models
Replaces ChatGPT
LiteLLM
Local LLM RunnersUnified proxy and gateway for 100+ LLM APIs
Replaces OpenRouter
exo
Local LLM RunnersRun your own AI cluster across everyday devices
Replaces OpenAI API