SHSelfHostIndex
AP

Aphrodite Engine

High-throughput inference engine for large language models

Local LLM Runners ★ 1.9k stars Hard setup AGPL-3.0

Aphrodite Engine is the official backend serving engine for PygmalionAI, optimized for high-throughput LLM inference. It exposes an OpenAI-compatible API and supports a wide range of quantization formats.

Official siteSource code

Key features

  • High-throughput batching
  • OpenAI-compatible endpoints
  • Many quantization formats
  • Continuous batching

Strengths

  • Released under the AGPL-3.0 license
  • First-class Docker support for quick deployment
  • Active community (1.9k GitHub stars)
  • Written in Python

Is Aphrodite Engine secure?

OSV.dev has no published security advisories for Aphrodite Engine's repository. No known vulnerabilities is not proof of security: it means none have been publicly catalogued.

Source: OSV.dev, checked 2026-10-14. How this is measured.

Aphrodite Engine replaces

Self-hosted OpenAI API alternatives

Health badge

Maintain Aphrodite Engine? Add its health score to your README. The badge links back to this page.

SelfHostIndex: 85 · excellent

Markdown
[![SelfHostIndex health score for Aphrodite Engine](https://selfhostindex.com/badge/aphrodite-engine.svg)](https://selfhostindex.com/app/aphrodite-engine/)
HTML
<a href="https://selfhostindex.com/app/aphrodite-engine/"><img src="https://selfhostindex.com/badge/aphrodite-engine.svg" alt="SelfHostIndex health score for Aphrodite Engine"></a>
reStructuredText
.. image:: https://selfhostindex.com/badge/aphrodite-engine.svg
   :alt: SelfHostIndex health score for Aphrodite Engine
   :target: https://selfhostindex.com/app/aphrodite-engine/

The score is recomputed on every nightly rebuild from public repository data — see how it is calculated.

Compare Aphrodite Engine

15 head-to-head comparisons.

Similar local llm runners apps