New API
Next-gen LLM gateway and AI asset management system
New API is a large-model interface management and distribution system derived from One API, providing an OpenAI-compatible gateway with richer billing, rendering and provider support. It is designed for running a self-hosted AI relay service.
Key features
- OpenAI-compatible relay
- Multi-provider channels
- Detailed billing
- Modern dashboard
Pros & cons
Strengths
- OpenAI-compatible gateway
- Broad provider support
- Built-in billing and quotas
Trade-offs
- Docs primarily Chinese
- Niche relay use case
Is New API secure?
No known vulnerabilities affect New API's latest release (v1.0.0-rc.44). OSV.dev lists 17 past advisories for the project; none of them applies to this release. No known vulnerabilities is not proof of security: it means none have been publicly catalogued.
- Most recent fixed advisory CVE-2026-82909, published 2026-08-31 (44 days ago)
Source: OSV.dev, checked 2026-10-14. How this is measured.
New API replaces
Health badge
Maintain New API? Add its health score to your README. The badge links back to this page.
Compare New API
16 head-to-head comparisons.
- New API vs Ollama
- New API vs llama.cpp
- New API vs vLLM
- New API vs LiteLLM
- New API vs exo
- New API vs FastChat
- New API vs One API
- New API vs llamafile
- New API vs MLC LLM
- New API vs OpenLLM
- New API vs Text Generation Inference
- New API vs Petals
- New API vs LMDeploy
- New API vs ik_llama.cpp
- New API vs Aphrodite Engine
- New API vs Wllama
Similar local llm runners apps
Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4All
Local LLM RunnersPrivacy-first desktop chat with local language models
Replaces ChatGPT
LiteLLM
Local LLM RunnersUnified proxy and gateway for 100+ LLM APIs
Replaces OpenRouter
exo
Local LLM RunnersRun your own AI cluster across everyday devices
Replaces OpenAI API