Best API Self-Hosted AI for self-hosting

State-of-the-art machine learning model library

Replaces OpenAI API

Dify

Self-Hosted AI

Open-source platform for building production LLM apps

Replaces OpenAI Assistants, Vertex AI Agent Builder

Langflow

Self-Hosted AI

Visual framework for building AI agents and RAG pipelines

Replaces Vertex AI Agent Builder

RAG engine with deep document understanding

Replaces NotebookLM

Practical multilingual OCR toolkit

Replaces Google Cloud Vision, AWS Textract

OpenHands

Self-Hosted AI

Autonomous AI software engineering agent

Replaces Devin, GitHub Copilot Workspace

Convert screenshots and designs into working code

Replaces Vercel v0

Fast, memory-efficient LLM finetuning

Replaces OpenAI Fine-tuning

LLM toolkit for research, papers, and code analysis

Replaces ChatGPT

Autonomous coding agent for your editor

Replaces GitHub Copilot, Cursor

Parse documents into AI-ready structured formats

Replaces Adobe Acrobat

Natural-language interface that runs code on your machine

Replaces ChatGPT Code Interpreter

Self-hosted memory layer for AI agents and assistants

Replaces OpenAI Memory

AnythingLLM

Self-Hosted AI

All-in-one desktop and server RAG application

Replaces ChatGPT, NotebookLM

Unified OpenAI-compatible API gateway for many models

Replaces OpenAI API

Few-shot voice cloning and text-to-speech

Replaces ElevenLabs

Ask questions about your documents fully offline

Replaces ChatGPT

AI pair programming in your terminal

Replaces GitHub Copilot, Cursor

Gradio web UI for running and tuning local text models

Replaces ChatGPT

Deep learning toolkit for local text-to-speech

Replaces ElevenLabs

Open-source framework for augmenting humans with AI

Replaces ChatGPT

Lightweight framework for building multi-agent systems

Replaces LangChain

Convert PDFs and documents to Markdown with AI

Replaces Adobe Acrobat

Self-hosted AI notebook for documents and audio overviews

Replaces Google NotebookLM

Simple and fast retrieval-augmented generation with graphs

Replaces OpenAI Assistants

Opinionated RAG framework for your second brain

Replaces NotebookLM

Transformer-based text-to-audio generation model

Replaces ElevenLabs

Framework for programming, not prompting, language models

Replaces LangChain

Self-hosted tool to test and refine LLM prompts

Replaces PromptPerfect

Instant voice cloning with flexible style control

Replaces ElevenLabs

Fast serving framework for LLMs and vision-language models

Replaces OpenAI API

Graph-based retrieval-augmented generation system

Replaces OpenAI Assistants

Langfuse

Self-Hosted AI

Open-source observability and analytics for LLM apps

Replaces LangSmith

Customizable frontend for AI character roleplay

Replaces Character.AI

Self-hosted AI coding assistant alternative to Copilot

Replaces GitHub Copilot

AI developer that writes apps with human oversight

Replaces Devin

Onyx

Self-Hosted AI

AI assistant connected to your company's knowledge

Replaces Glean, ChatGPT Enterprise

Memory and knowledge graph engine for AI agents

Replaces Mem0, Pinecone

Industry-leading face manipulation and swapping platform

Replaces DeepFaceLab

Autonomous agent for comprehensive online research reports

Replaces Perplexity, ChatGPT

Open-source embedding database for AI applications

Replaces Pinecone

Framework for building production-ready LLM applications

Replaces LangChain

Test, evaluate, and red-team LLM applications

Replaces LangSmith

Reimplementation of Whisper for fast local transcription

Replaces Google Speech-to-Text

Clean RAG UI for chatting with your documents

Replaces NotebookLM

Build stateful LLM agents with long-term memory

Replaces OpenAI Assistants

Remove image backgrounds automatically with AI

Replaces remove.bg

Fast Whisper transcription with word-level timestamps and diarization

Replaces Otter.ai, Rev

Generative audio and music models from Meta

Replaces Suno, ElevenLabs

Knowledge base question-answering system built on LLMs

Replaces Intercom Fin

Describe UI with text and see it rendered live

Replaces Vercel v0

Constrained generation language for controlling LLMs

Replaces OpenAI API

Multilingual document OCR and layout analysis toolkit

Replaces Google Cloud Vision, AWS Textract

Framework for building contextual text and voice assistants

Replaces Dialogflow, Amazon Lex

Language-model agent that resolves GitHub issues

Replaces Devin

Agent Zero

Self-Hosted AI

Personal organic agentic AI framework that grows with use

Replaces AutoGPT, Devin

Unit testing framework for LLM outputs

Replaces LangSmith, Braintrust

Framework for building controlled conversational AI agents

Replaces Voiceflow

Open-source GenBI agent for talking to your database

Replaces ThoughtSpot

Open-source framework for autonomous AI agents

Replaces AutoGPT

Open-source personal AI assistant you can self-host

Replaces Google Assistant, Alexa

Query multiple AI chatbots side by side at once

Replaces Poe

Customizable AI research agent connected to your knowledge

Replaces NotebookLM, Perplexity

Evaluation framework for retrieval-augmented generation

Replaces LangSmith

Structured text generation for language models

Replaces OpenAI Structured Outputs

Framework for enterprise RAG with small language models

Replaces OpenAI Assistants

Unified framework to benchmark language models on many tasks

Replaces OpenAI Evals

Recipes for pretraining and finetuning open LLMs

Replaces OpenAI Fine-tuning

All-in-one embeddings database for semantic search and RAG

Replaces Pinecone

Open LLM application platform for enterprise workflows

Replaces Dify

Open-source AI observability and evaluation platform

Replaces LangSmith, Helicone

Embedded vector database for AI applications

Replaces Pinecone

Build and evaluate LLM application flows

Replaces LangSmith, Vertex AI

High-performance inference serving for any model framework

Replaces Amazon SageMaker

Self-hosted offline ChatGPT-like chatbot powered by Llama

Replaces ChatGPT

All-in-one LLM CLI tool with chat-REPL and API server

Replaces ChatGPT

High-performance RLHF framework for training LLMs

Replaces OpenAI Fine-tuning

Distributed inference framework for LLMs and embeddings

Replaces OpenAI API, Hugging Face Inference Endpoints

Compact, high-quality open text-to-speech model

Replaces ElevenLabs, OpenAI TTS

Framework for building and serving AI model APIs

Replaces Amazon SageMaker, Vertex AI

Composable API server for building generative AI applications

Replaces OpenAI API

Production-ready RAG engine with a RESTful API

Replaces OpenAI Assistants

AI assistant that turns issues into pull requests

Replaces GitHub Copilot Workspace

High-quality multilingual text-to-speech library

Replaces ElevenLabs, Amazon Polly

Open-source observability for LLM applications

Replaces LangSmith, Datadog LLM Observability

Advanced all-in-one generative image and video studio

Replaces Midjourney

Run and fine-tune LLMs locally on Apple Silicon with MLX

Replaces OpenAI API

Manage GPU clusters for running AI models

Replaces OpenAI API

Workspace for training and evaluating local LLMs

Replaces OpenAI Playground

Open-source LLMOps platform for prompt and app management

Replaces LangSmith

Hub for many AI models with a personality system

Replaces ChatGPT

Visual programming environment for building AI agents

Replaces LangChain

Fast inference library for quantized LLMs on consumer GPUs

Replaces OpenAI API

Simple, hackable GraphRAG implementation in Python

Replaces Microsoft GraphRAG

Speaches

Self-Hosted AI

OpenAI-compatible speech-to-text and text-to-speech server

Replaces OpenAI Audio API, ElevenLabs

Framework for synthetic data generation and AI feedback

Replaces Scale AI

Self-hosted speech-to-text API powered by OpenAI Whisper

Replaces Google Speech-to-Text, Otter.ai

Willow

Self-Hosted AI

Open-source privacy-focused voice assistant hardware platform

Replaces Amazon Alexa, Google Assistant

Framework for building AI assistants with memory and plugins

Replaces OpenAI Assistants

Run AI models using OCI containers

Replaces Ollama

DSPy-inspired framework for building typed LLM programs

Replaces DSPy

Memory-efficient inference library for quantized Llama models

Replaces OpenAI API

Quickly deploy your own ChatGPT-style web service

Replaces ChatGPT

Self-hosted autonomous AI agent platform

Replaces AutoGPT

Polished web UI for ChatGPT, DALL-E and other AI models

Replaces ChatGPT

Crowdsourced distributed cluster for AI generation

Replaces Midjourney

Toolkit for tracking and evaluating LLM applications

Replaces LangSmith

Speech-to-text service for the Wyoming voice protocol

Replaces Google Speech-to-Text