Self-hosted apps by bentoml

2 self-hosted projects maintained by bentoml on GitHub — combined community: 21,220 GitHub stars.

Categories covered

Run any open LLM as an OpenAI-compatible API endpoint

Replaces OpenAI API

Framework for building and serving AI model APIs

Replaces Amazon SageMaker, Vertex AI