ON

One API

Unified OpenAI-compatible gateway for many LLM providers

Local LLM Runners ★ 36.3k stars Medium setup MIT

One API is an LLM API management and distribution system that exposes a single OpenAI-compatible endpoint while routing to many upstream providers. It adds key management, channel load balancing, usage tracking and multi-user billing.

Key features

  • Unified OpenAI-compatible API
  • Channel load balancing
  • Token and quota management
  • Multi-user support

Strengths

  • Released under the MIT license
  • First-class Docker support for quick deployment
  • Mature project with 36.3k GitHub stars
  • Written in JavaScript

One API replaces

Compare One API

36 head-to-head comparisons.

Similar local llm runners apps