MLX LM vs New API

A side-by-side comparison of two self-hosted apps from related categories — licensing, setup difficulty, resource needs, and what each one replaces.

Not the right match-up?
FeatureMLX LMNew API
CategorySelf-Hosted AILocal LLM Runners
LicenseMITMIT
LanguagePythonGo
Setup difficultyMediumMedium
Min. RAM16,384 MB512 MB
Deploymentsource, binarydocker
GitHub stars★ 6,543★ 44,636
First released20242024
ReplacesOpenAI APIOpenRouter, OpenAI API

Why pick each one

Choose MLX LM if…

  • Released under the MIT license
  • Mature project with 6.5k GitHub stars
  • Written in Python
MLX LM details

Choose New API if…

  • Released under the MIT license
  • First-class Docker support for quick deployment
  • Mature project with 44.6k GitHub stars
  • Written in Go
New API details

Frequently asked questions

Is MLX LM or New API better?

Neither is universally better. New API has the larger community; both share a medium setup difficulty, so the decision comes down to features and licensing.

Are MLX LM and New API free and open-source?

Yes. MLX LM is licensed under MIT and New API under MIT. Both can be self-hosted at no software cost.

Can I run MLX LM and New API with Docker?

MLX LM: check the project docs for container support. New API: yes.

Related comparisons