SHSelfHostIndex

FastChat vs New API

A side-by-side comparison of two self-hosted local llm runners options — licensing, setup difficulty, resource needs, and what each one replaces.

Not the right match-up?
FA FastChat Platform for serving and evaluating large language models VS NE New API Next-gen LLM gateway and AI asset management system
FeatureFastChatNew API
CategoryLocal LLM RunnersLocal LLM Runners
LicenseApache-2.0MIT
LanguagePythonGo
Setup difficultyHardMedium
Min. RAM8,192 MB512 MB
Deploymentdocker, sourcedocker
GitHub stars★ 39,516★ 44,636
First released20232024
ReplacesOpenAI APIOpenRouter, OpenAI API

Why pick each one

Choose FastChat if…

  • Released under the Apache-2.0 license
  • First-class Docker support for quick deployment
  • Mature project with 39.5k GitHub stars
  • Written in Python
FastChat details

Choose New API if…

  • Released under the MIT license
  • First-class Docker support for quick deployment
  • Mature project with 44.6k GitHub stars
  • Written in Go
New API details

Frequently asked questions

Is FastChat or New API better?

New API is the stronger all-round pick: it has both the larger community and the simpler medium setup. Consider FastChat if its specific feature set fits your needs better.

Are FastChat and New API free and open-source?

Yes. FastChat is licensed under Apache-2.0 and New API under MIT. Both can be self-hosted at no software cost.

Can I run FastChat and New API with Docker?

FastChat: yes. New API: yes.

Related comparisons