llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
Best No-Database Local LLM Runners for self-hosting
The 6 best No-Database local llm runners you can self-host, ranked by community traction.
MLC LLM
Local LLM RunnersUniversal LLM deployment engine for any hardware
Replaces OpenAI API
KoboldCpp
Local LLM RunnersSingle-file local LLM runner for text and storytelling
Replaces ChatGPT
Petals
Local LLM RunnersRun large language models collaboratively in a swarm
Replaces OpenAI API
Aphrodite Engine
Local LLM RunnersHigh-throughput inference engine for large language models
Replaces OpenAI API
Wllama
Local LLM RunnersRun LLM inference directly in the browser with WebAssembly
Replaces OpenAI API
No apps match these filters.
Every option here is open-source and self-hostable, tagged No-Database within the local llm runners category. Compare them on the individual app pages for setup difficulty and resource requirements.