Petals
Run large language models collaboratively in a swarm
Petals lets you run and fine-tune large language models in a distributed, BitTorrent-style network where each participant hosts part of the model. It enables self-hosting models too large for a single machine.
Key features
- Distributed model hosting
- Run models larger than one GPU
- Collaborative inference swarm
- Fine-tuning support
Strengths
- Released under the MIT license
- First-class Docker support for quick deployment
- Mature project with 10.6k GitHub stars
- Written in Python
Is Petals secure?
OSV.dev has no published security advisories for Petals's repository. No known vulnerabilities is not proof of security: it means none have been publicly catalogued.
Source: OSV.dev, checked 2026-10-14. How this is measured.
Petals replaces
Health badge
Maintain Petals? Add its health score to your README. The badge links back to this page.
The score is recomputed on every nightly rebuild from public repository data — see how it is calculated.
Compare Petals
15 head-to-head comparisons.
Similar local llm runners apps
Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4All
Local LLM RunnersPrivacy-first desktop chat with local language models
Replaces ChatGPT
LiteLLM
Local LLM RunnersUnified proxy and gateway for 100+ LLM APIs
Replaces OpenRouter
New API
Local LLM RunnersNext-gen LLM gateway and AI asset management system
Replaces OpenRouter, OpenAI API