Xinference
Self-Hosted AIDistributed inference framework for LLMs and embeddings
Replaces OpenAI API, Hugging Face Inference Endpoints
Hugging Face Inference Endpoints is a popular proprietary tool in the self-hosted ai space. These open-source apps let you replace Hugging Face Inference Endpoints with software you host and control yourself.
Distributed inference framework for LLMs and embeddings
Replaces OpenAI API, Hugging Face Inference Endpoints
Toolkit for compressing and serving large language models
Replaces OpenAI API, Hugging Face Inference Endpoints
No apps match these filters.
Moving off Hugging Face Inference Endpoints means trading a managed subscription for a service you run yourself. The payoff is ownership: no per-seat pricing, no vendor lock-in, and full control of your data. Start with the option above that matches your setup-difficulty comfort level — every app links to a detailed specs page and head-to-head comparisons.