New API
Next-gen LLM gateway and AI asset management system
New API is a large-model interface management and distribution system derived from One API, providing an OpenAI-compatible gateway with richer billing, rendering and provider support. It is designed for running a self-hosted AI relay service.
Key features
- OpenAI-compatible relay
- Multi-provider channels
- Detailed billing
- Modern dashboard
Pros & cons
Strengths
- OpenAI-compatible gateway
- Broad provider support
- Built-in billing and quotas
Trade-offs
- Docs primarily Chinese
- Niche relay use case
New API replaces
Compare New API
16 head-to-head comparisons.
- New API vs Ollama
- New API vs llama.cpp
- New API vs vLLM
- New API vs LiteLLM
- New API vs exo
- New API vs FastChat
- New API vs One API
- New API vs llamafile
- New API vs MLC LLM
- New API vs OpenLLM
- New API vs Text Generation Inference
- New API vs Petals
- New API vs LMDeploy
- New API vs ik_llama.cpp
- New API vs Aphrodite Engine
- New API vs Wllama
Similar local llm runners apps
Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4All
Local LLM RunnersPrivacy-first desktop chat with local language models
Replaces ChatGPT
LiteLLM
Local LLM RunnersUnified proxy and gateway for 100+ LLM APIs
Replaces OpenRouter
exo
Local LLM RunnersRun your own AI cluster across everyday devices
Replaces OpenAI API