Hugging Face Transformers
Self-Hosted AIState-of-the-art machine learning model library
Replaces OpenAI API
Best Offline-First Self-Hosted AI for self-hosting
The 58 best Offline-First self-hosted ai you can self-host, ranked by community traction.
PaddleOCR
Self-Hosted AIPractical multilingual OCR toolkit
Replaces Google Cloud Vision, AWS Textract
Unsloth
Self-Hosted AIFast, memory-efficient LLM finetuning
Replaces OpenAI Fine-tuning
Docling
Self-Hosted AIParse documents into AI-ready structured formats
Replaces Adobe Acrobat
Open Interpreter
Self-Hosted AINatural-language interface that runs code on your machine
Replaces ChatGPT Code Interpreter
AnythingLLM
Self-Hosted AIAll-in-one desktop and server RAG application
Replaces ChatGPT, NotebookLM
GPT-SoVITS
Self-Hosted AIFew-shot voice cloning and text-to-speech
Replaces ElevenLabs
PrivateGPT
Self-Hosted AIAsk questions about your documents fully offline
Replaces ChatGPT
whisper.cpp
Self-Hosted AIFast C++ port of OpenAI Whisper speech recognition
Replaces Otter.ai, Google Speech-to-Text
Upscayl
Self-Hosted AIFree AI image upscaler for the desktop
Replaces Topaz Gigapixel AI
Aider
Self-Hosted AIAI pair programming in your terminal
Replaces GitHub Copilot, Cursor
Text Generation WebUI
Self-Hosted AIGradio web UI for running and tuning local text models
Replaces ChatGPT
Coqui TTS
Self-Hosted AIDeep learning toolkit for local text-to-speech
Replaces ElevenLabs
Fabric
Self-Hosted AIOpen-source framework for augmenting humans with AI
Replaces ChatGPT
Agno
Self-Hosted AILightweight framework for building multi-agent systems
Replaces LangChain
Marker
Self-Hosted AIConvert PDFs and documents to Markdown with AI
Replaces Adobe Acrobat
Quivr
Self-Hosted AIOpinionated RAG framework for your second brain
Replaces NotebookLM
Bark
Self-Hosted AITransformer-based text-to-audio generation model
Replaces ElevenLabs
Retrieval-based Voice Conversion WebUI
Self-Hosted AISelf-hosted voice conversion and cloning interface
Replaces ElevenLabs voice cloning
OpenVoice
Self-Hosted AIInstant voice cloning with flexible style control
Replaces ElevenLabs
SGLang
Self-Hosted AIFast serving framework for LLMs and vision-language models
Replaces OpenAI API
SillyTavern
Self-Hosted AICustomizable frontend for AI character roleplay
Replaces Character.AI
Tabby
Self-Hosted AISelf-hosted AI coding assistant alternative to Copilot
Replaces GitHub Copilot
FaceFusion
Self-Hosted AIIndustry-leading face manipulation and swapping platform
Replaces DeepFaceLab
Chroma
Self-Hosted AIOpen-source embedding database for AI applications
Replaces Pinecone
Haystack
Self-Hosted AIFramework for building production-ready LLM applications
Replaces LangChain
promptfoo
Self-Hosted AITest, evaluate, and red-team LLM applications
Replaces LangSmith
faster-whisper
Self-Hosted AIReimplementation of Whisper for fast local transcription
Replaces Google Speech-to-Text
Kotaemon
Self-Hosted AIClean RAG UI for chatting with your documents
Replaces NotebookLM
Rembg
Self-Hosted AIRemove image backgrounds automatically with AI
Replaces remove.bg
WhisperX
Self-Hosted AIFast Whisper transcription with word-level timestamps and diarization
Replaces Otter.ai, Rev
AudioCraft
Self-Hosted AIGenerative audio and music models from Meta
Replaces Suno, ElevenLabs
OpenUI
Self-Hosted AIDescribe UI with text and see it rendered live
Replaces Vercel v0
LocalGPT
Self-Hosted AIChat with your documents fully offline
Replaces ChatGPT
Surya
Self-Hosted AIMultilingual document OCR and layout analysis toolkit
Replaces Google Cloud Vision, AWS Textract
Leon
Self-Hosted AIOpen-source personal AI assistant you can self-host
Replaces Google Assistant, Alexa
LM Evaluation Harness
Self-Hosted AIUnified framework to benchmark language models on many tasks
Replaces OpenAI Evals
LitGPT
Self-Hosted AIRecipes for pretraining and finetuning open LLMs
Replaces OpenAI Fine-tuning
txtai
Self-Hosted AIAll-in-one embeddings database for semantic search and RAG
Replaces Pinecone
LlamaGPT
Self-Hosted AISelf-hosted offline ChatGPT-like chatbot powered by Llama
Replaces ChatGPT
OpenRLHF
Self-Hosted AIHigh-performance RLHF framework for training LLMs
Replaces OpenAI Fine-tuning
Kokoro
Self-Hosted AICompact, high-quality open text-to-speech model
Replaces ElevenLabs, OpenAI TTS
MeloTTS
Self-Hosted AIHigh-quality multilingual text-to-speech library
Replaces ElevenLabs, Amazon Polly
SD.Next
Self-Hosted AIAdvanced all-in-one generative image and video studio
Replaces Midjourney
MLX LM
Self-Hosted AIRun and fine-tune LLMs locally on Apple Silicon with MLX
Replaces OpenAI API
GPUStack
Self-Hosted AIManage GPU clusters for running AI models
Replaces OpenAI API
Transformer Lab
Self-Hosted AIWorkspace for training and evaluating local LLMs
Replaces OpenAI Playground
LoLLMs WebUI
Self-Hosted AIHub for many AI models with a personality system
Replaces ChatGPT
Rivet
Self-Hosted AIVisual programming environment for building AI agents
Replaces LangChain
ExLlamaV2
Self-Hosted AIFast inference library for quantized LLMs on consumer GPUs
Replaces OpenAI API
Whisper ASR Webservice
Self-Hosted AISelf-hosted speech-to-text API powered by OpenAI Whisper
Replaces Google Speech-to-Text, Otter.ai
Demucs
Self-Hosted AIState-of-the-art music source separation
Replaces LALAL.AI
Willow
Self-Hosted AIOpen-source privacy-focused voice assistant hardware platform
Replaces Amazon Alexa, Google Assistant
RamaLama
Self-Hosted AIRun AI models using OCI containers
Replaces Ollama
Roop Unleashed
Self-Hosted AISelf-hosted face swapping for images and videos
Replaces Reface
LocalAGI
Self-Hosted AISelf-hosted autonomous AI agent platform
Replaces AutoGPT
Chatd
Self-Hosted AIChat with your documents using local AI
Replaces NotebookLM
Wyoming faster-whisper
Self-Hosted AISpeech-to-text service for the Wyoming voice protocol
Replaces Google Speech-to-Text
No apps match these filters.
At a glance
| App | Deploy effort | Difficulty | Min. RAM | License | ★ Stars |
|---|---|---|---|---|---|
| Hugging Face Transformers | Read-the-docs project | Hard | 8,192 MB | Apache-2.0 | 167,686 |
| PaddleOCR | Under-an-hour setup | Medium | 2,048 MB | Apache-2.0 | 91,059 |
| Unsloth | Read-the-docs project | Medium | 8,192 MB | Apache-2.0 | 77,964 |
| Docling | Under-an-hour setup | Medium | 4,096 MB | MIT | 68,836 |
| Open Interpreter | Read-the-docs project | Medium | 1,024 MB | AGPL-3.0 | 68,574 |
| AnythingLLM | Under-an-hour setup | Medium | 4,096 MB | MIT | 67,036 |
| GPT-SoVITS | Under-an-hour setup | Hard | 4,096 MB | MIT | 62,770 |
| PrivateGPT | Under-an-hour setup | Medium | 8,192 MB | Apache-2.0 | 57,576 |
| whisper.cpp | Read-the-docs project | Medium | 1,024 MB | MIT | 54,355 |
| Upscayl | Read-the-docs project | Easy | 4,096 MB | AGPL-3.0 | 50,543 |
Quick picks
- Most adopted: Hugging Face Transformers (167,686 GitHub stars).
- Lightest footprint: Aider (from 512 MB RAM, against 16,384 MB for the heaviest here).
- Fastest to deploy: SillyTavern (verified single-container compose).
- Licensing: 26 of 58 use MIT; check the rest individually if you plan to modify and redistribute.
Every option here is open-source and self-hostable, tagged Offline-First within the self-hosted ai category. Deploy effort is graded from published container recipes, not vendor claims — see the methodology.