Self-hosted apps by ggml-org

llama.cpp

Local LLM Runners

High-performance LLM inference in plain C/C++

Replaces OpenAI API

Fast C++ port of OpenAI Whisper speech recognition

Replaces Otter.ai, Google Speech-to-Text