SHSelfHostIndex
BE

BentoML

Framework for building and serving AI model APIs

Self-Hosted AI ★ 8.9k stars Medium setup Apache-2.0

BentoML is a framework for packaging machine learning models into production-grade prediction services. It builds containerized API servers that can be self-hosted on your own infrastructure or Kubernetes clusters.

Official siteSource code

Key features

  • Package models as API services
  • Automatic containerization
  • Adaptive batching
  • Kubernetes deployment

Strengths

  • Released under the Apache-2.0 license
  • First-class Docker support for quick deployment
  • Kubernetes-ready with Helm charts available
  • Mature project with 8.9k GitHub stars

Is BentoML secure?

No known vulnerabilities affect BentoML's latest release (v1.4.39). OSV.dev lists 13 past advisories for the project; none of them applies to this release. No known vulnerabilities is not proof of security: it means none have been publicly catalogued.

  • Most recent fixed advisory CVE-2026-78205, published 2026-08-24 (51 days ago), fixed in 1.4.39

Source: OSV.dev, checked 2026-10-14. How this is measured.

BentoML replaces

Self-hosted Amazon SageMaker alternativesSelf-hosted Vertex AI alternatives

Health badge

Maintain BentoML? Add its health score to your README. The badge links back to this page.

SelfHostIndex: 92 · excellent

Markdown
[![SelfHostIndex health score for BentoML](https://selfhostindex.com/badge/bentoml.svg)](https://selfhostindex.com/app/bentoml/)
HTML
<a href="https://selfhostindex.com/app/bentoml/"><img src="https://selfhostindex.com/badge/bentoml.svg" alt="SelfHostIndex health score for BentoML"></a>
reStructuredText
.. image:: https://selfhostindex.com/badge/bentoml.svg
   :alt: SelfHostIndex health score for BentoML
   :target: https://selfhostindex.com/app/bentoml/

The score is recomputed on every nightly rebuild from public repository data — see how it is calculated.

Compare BentoML

2 head-to-head comparisons.

Similar self-hosted ai apps