OpenLLM
Local LLM RunnersRun any open LLM as an OpenAI-compatible API endpoint
Replaces OpenAI API
Self-hosted apps by bentoml
2 self-hosted projects maintained by bentoml on GitHub — combined community: 21,458 GitHub stars.
Portfolio at a glance
The 2 projects span 2 categories: local llm runners and self-hosted ai. OpenLLM is the flagship at 12,558 stars — Run any open LLM as an OpenAI-compatible API endpoint. 2 of 2 are written primarily in Python, so one toolchain covers the whole portfolio. The oldest dates from 2019 and the newest from 2023. 2 publish a Docker deployment path.
| Projects | 2 |
|---|---|
| Combined stars | 21,458 |
| Hosted on | GitHub |
| Languages | Python (2) |
| Licenses | Apache-2.0 (2) |
| Setup difficulty | Medium (2) |
| Min. RAM range | 2,048–8,192 MB |
| First releases | 2019–2023 |