LiteLLM vs New API
A side-by-side comparison of two self-hosted local llm runners options — licensing, setup difficulty, resource needs, and what each one replaces.
LiteLLM
Unified proxy and gateway for 100+ LLM APIs
VS
New API
Next-gen LLM gateway and AI asset management system
| Feature | LiteLLM | New API |
|---|---|---|
| Deploy effort | Under-an-hour setup | Under-an-hour setup |
| Health score | 100 · Excellent | 100 · Excellent |
| Category | Local LLM Runners | Local LLM Runners |
| License | MIT | MIT |
| Language | Python | Go |
| Setup difficulty | Medium | Medium |
| Min. RAM | 1,024 MB | 512 MB |
| Deployment | docker, kubernetes, bare-metal | docker |
| GitHub stars | ★ 59,433 | ★ 48,726 |
| First released | 2023 | 2024 |
| Replaces | OpenRouter | OpenRouter, OpenAI API |
What are LiteLLM and New API?
LiteLLM
LiteLLM provides a proxy server and Python SDK that exposes a single OpenAI-compatible interface to over a hundred LLM providers. It adds load balancing, spend tracking, caching, and key management.
- One API for many providers
- Spend and rate tracking
- Load balancing and fallbacks
- Virtual API keys
New API
New API is a large-model interface management and distribution system derived from One API, providing an OpenAI-compatible gateway with richer billing, rendering and provider support. It is designed for running a self-hosted AI relay service.
- OpenAI-compatible relay
- Multi-provider channels
- Detailed billing
- Modern dashboard
LiteLLM vs New API: key differences
LiteLLM is written in Python, while New API is built with Go. New API is the lighter option, starting around 512 MB of RAM against 1,024 MB for LiteLLM.
Why pick each one
Choose LiteLLM if…
- OpenAI-compatible interface
- Spend tracking built in
- Supports 100+ providers
Watch out for
- Config can sprawl
- Some features enterprise-only
Choose New API if…
- OpenAI-compatible gateway
- Broad provider support
- Built-in billing and quotas
Watch out for
- Docs primarily Chinese
- Niche relay use case
Frequently asked questions
Is LiteLLM or New API better?
Neither is universally better. LiteLLM has the larger community; both share a medium setup difficulty, so the decision comes down to features and licensing.
Are LiteLLM and New API free and open-source?
Yes. LiteLLM is licensed under MIT and New API under MIT. Both can be self-hosted at no software cost.
Can I run LiteLLM and New API with Docker?
LiteLLM: yes. New API: yes.
Which is lighter on resources, LiteLLM or New API?
New API has the smaller minimum footprint at 512 MB of RAM, compared to about 1,024 MB for LiteLLM. Real-world usage depends on library size, user count, and enabled features.