Best Free Self-Hosted AI for self-hosting

The AI that actually does things

The AI agent that grows with you

The open source AI coding agent

Practical multilingual OCR toolkit

Replaces Google Cloud Vision, AWS Textract

Autonomous AI software engineering agent

Replaces Devin, GitHub Copilot Workspace

Fast, memory-efficient LLM finetuning

Replaces OpenAI Fine-tuning

Natural-language interface that runs code on your machine

Replaces ChatGPT Code Interpreter

Unified OpenAI-compatible API gateway for many models

Replaces OpenAI API

Autonomous coding agent for your editor

Replaces GitHub Copilot, Cursor

Self-hosted memory layer for AI agents and assistants

Replaces OpenAI Memory

Few-shot voice cloning and text-to-speech

Replaces ElevenLabs

Generate entire codebases from a natural language prompt

Replaces GitHub Copilot Workspace

Fast C++ port of OpenAI Whisper speech recognition

Replaces Otter.ai, Google Speech-to-Text

Free AI image upscaler for the desktop

Replaces Topaz Gigapixel AI

Deep learning toolkit for local text-to-speech

Replaces ElevenLabs

Transformer-based text-to-audio generation model

Replaces ElevenLabs

Simple and fast retrieval-augmented generation with graphs

Replaces OpenAI Assistants

Self-hosted voice conversion and cloning interface

Replaces ElevenLabs voice cloning

Instant voice cloning with flexible style control

Replaces ElevenLabs

Framework for programming, not prompting, language models

Replaces LangChain

Self-hosted AI notebook for documents and audio overviews

Replaces Google NotebookLM

Configure and deploy autonomous AI agents in the browser

Replaces AutoGPT

AI-powered search engine (alternative to Perplexity AI)

Graph-based retrieval-augmented generation system

Replaces OpenAI Assistants

AI developer that writes apps with human oversight

Replaces Devin

Self-hosted tool to test and refine LLM prompts

Replaces PromptPerfect

Memory and knowledge graph engine for AI agents

Replaces Mem0, Pinecone

Ultra-lightweight personal AI assistant

Industry-leading face manipulation and swapping platform

Replaces DeepFaceLab

Autonomous agent for comprehensive online research reports

Replaces Perplexity, ChatGPT

Customizable AI dev team inside VS Code

Replaces GitHub Copilot, Cursor

Build stateful LLM agents with long-term memory

Replaces OpenAI Assistants

Generative audio and music models from Meta

Replaces Suno, ElevenLabs

Chat with your documents fully offline

Replaces ChatGPT

Constrained generation language for controlling LLMs

Replaces OpenAI API

Framework for building contextual text and voice assistants

Replaces Dialogflow, Amazon Lex

Multilingual document OCR and layout analysis toolkit

Replaces Google Cloud Vision, AWS Textract

Language-model agent that resolves GitHub issues

Replaces Devin

Personal organic agentic AI framework that grows with use

Replaces AutoGPT, Devin

Framework for building controlled conversational AI agents

Replaces Voiceflow

Open-source framework for autonomous AI agents

Replaces AutoGPT

Unit testing framework for LLM outputs

Replaces LangSmith, Braintrust

Query multiple AI chatbots side by side at once

Replaces Poe

Free and Open Source machine translation API

Customizable AI research agent connected to your knowledge

Replaces NotebookLM, Perplexity

Structured text generation for language models

Replaces OpenAI Structured Outputs

Evaluation framework for retrieval-augmented generation

Replaces LangSmith

Framework for enterprise RAG with small language models

Replaces OpenAI Assistants

Recipes for pretraining and finetuning open LLMs

Replaces OpenAI Fine-tuning

Unified framework to benchmark language models on many tasks

Replaces OpenAI Evals

Build and evaluate LLM application flows

Replaces LangSmith, Vertex AI

Embedded vector database for AI applications

Replaces Pinecone

Self-hosted offline ChatGPT-like chatbot powered by Llama

Replaces ChatGPT

Open-source AI observability and evaluation platform

Replaces LangSmith, Helicone

High-performance inference serving for any model framework

Replaces Amazon SageMaker

All-in-one LLM CLI tool with chat-REPL and API server

Replaces ChatGPT

High-performance RLHF framework for training LLMs

Replaces OpenAI Fine-tuning

Distributed inference framework for LLMs and embeddings

Replaces OpenAI API, Hugging Face Inference Endpoints

AI-powered deep research tool with multi-source search (arXiv, PubMed,

Framework for building and serving AI model APIs

Replaces Amazon SageMaker, Vertex AI

Composable API server for building generative AI applications

Replaces OpenAI API

Compact, high-quality open text-to-speech model

Replaces ElevenLabs, OpenAI TTS

Production-ready RAG engine with a RESTful API

Replaces OpenAI Assistants

AI assistant that turns issues into pull requests

Replaces GitHub Copilot Workspace

High-quality multilingual text-to-speech library

Replaces ElevenLabs, Amazon Polly

Open-source observability for LLM applications

Replaces LangSmith, Datadog LLM Observability

Run and fine-tune LLMs locally on Apple Silicon with MLX

Replaces OpenAI API

Workspace for training and evaluating local LLMs

Replaces OpenAI Playground

Open-source LLMOps platform for prompt and app management

Replaces LangSmith

Modular framework for production-ready RAG systems

Replaces LangChain

Simple, hackable GraphRAG implementation in Python

Replaces Microsoft GraphRAG

OpenAI-compatible speech-to-text and text-to-speech server

Replaces OpenAI Audio API, ElevenLabs

Framework for synthetic data generation and AI feedback

Replaces Scale AI

Framework for building AI assistants with memory and plugins

Replaces OpenAI Assistants

State-of-the-art music source separation

Replaces LALAL.AI

Self-hosted face swapping for images and videos

Replaces Reface

Memory-efficient inference library for quantized Llama models

Replaces OpenAI API

DSPy-inspired framework for building typed LLM programs

Replaces DSPy

Quickly deploy your own ChatGPT-style web service

Replaces ChatGPT

AI agent for teams, communities, and multi-user environments

Polished web UI for ChatGPT, DALL-E and other AI models

Replaces ChatGPT

Self-hosted autonomous AI agent platform

Replaces AutoGPT

Private AI chat and document analysis you fully control

Replaces ChatGPT

A ChatGPT web client that supports multiple users, multiple languages,

Crowdsourced distributed cluster for AI generation

Replaces Midjourney

Toolkit for tracking and evaluating LLM applications

Replaces LangSmith

Self-hosted virtual character chat with voice and 3D models

Replaces Character.AI

A document reader with Text-to-Speech capabilities

Framework for training instruction-tuned language models

Replaces OpenAI Fine-tuning