Best Lightweight Self-Hosted AI for self-hosting

The 31 best Lightweight self-hosted ai you can self-host, ranked by community traction.

At a glance

AppDeploy effortDifficultyMin. RAMLicense★ Stars
screenshot-to-codeUnder-an-hour setupEasy1,024 MBMIT80,328
DoclingUnder-an-hour setupMedium4,096 MBMIT68,836
GPT4Free≈5-minute setupMedium512 MBGPL-3.066,839
whisper.cppRead-the-docs projectMedium1,024 MBMIT54,355
AiderRead-the-docs projectEasy512 MBApache-2.049,534
FabricRead-the-docs projectEasy512 MBMIT44,252
AgnoRead-the-docs projectMedium1,024 MBMPL-2.042,718
MarkerRead-the-docs projectMedium4,096 MBGPL-3.040,429
GraphRAGRead-the-docs projectHard4,096 MBMIT36,327
TabbyUnder-an-hour setupMedium8,192 MBApache-2.033,912

Quick picks

Every option here is open-source and self-hostable, tagged Lightweight within the self-hosted ai category. Deploy effort is graded from published container recipes, not vendor claims — see the methodology.

Keep exploring

Head-to-head: Lightweight self-hosted ai