RA

RamaLama

Run AI models using OCI containers

Self-Hosted AI ★ 3k stars Medium setup MIT

RamaLama makes working with AI models simple by packaging and running them as OCI containers. It detects available hardware, pulls models from registries, and serves them with a consistent command line.

Key features

  • Container-native model running
  • Automatic hardware detection
  • OCI registry distribution
  • Kubernetes generation

Strengths

  • Released under the MIT license
  • First-class Docker support for quick deployment
  • Kubernetes-ready with Helm charts available
  • Active community (3k GitHub stars)

RamaLama replaces

Compare RamaLama

10 head-to-head comparisons.

Similar self-hosted ai apps