exo
Run your own AI cluster across everyday devices
exo is an open-source project that unifies multiple everyday devices into a single AI compute cluster for running large language models. It splits models across phones, laptops, and desktops and exposes an OpenAI-compatible API.
Key features
- Distributes models across devices
- OpenAI-compatible API
- Automatic device discovery
- No master node required
Pros & cons
Strengths
- Pools everyday devices
- OpenAI-compatible API
- Runs fully offline
Trade-offs
- Experimental and evolving
- Network limits performance
Is exo secure?
No known vulnerabilities affect exo's latest release (v1.0.71). OSV.dev lists 1 past advisory for the project; none of them applies to this release. No known vulnerabilities is not proof of security: it means none have been publicly catalogued.
- Most recent fixed advisory CVE-2026-14738, published 2026-07-05 (101 days ago)
Source: OSV.dev, checked 2026-10-14. How this is measured.
exo replaces
Health badge
Maintain exo? Add its health score to your README. The badge links back to this page.
Compare exo
15 head-to-head comparisons.
Similar local llm runners apps
Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4All
Local LLM RunnersPrivacy-first desktop chat with local language models
Replaces ChatGPT
LiteLLM
Local LLM RunnersUnified proxy and gateway for 100+ LLM APIs
Replaces OpenRouter
New API
Local LLM RunnersNext-gen LLM gateway and AI asset management system
Replaces OpenRouter, OpenAI API