BigHugger
GH Repository · Osmantic

ODS

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

stars
6,545
30-day movement
+12943/day
Related entries
60
Connections
3
Pythontext-to-speechstrix-halollmworkflow-automationllama-cppself-hostedn8nspeech-to-textagent-appcomfyuiai-agentsdockerlocal-aiamdnvidiaopen-webuirag

ODS is a self-hosted stack that turns a PC, Mac, or Linux machine into a local AI server. It bundles LLM inference, a chat UI, voice, agents, workflows, RAG, and image generation, deployable via Docker.

You want one packaged setup for running local AI services on your own hardware instead of assembling each component yourself.

Use it to

  • Run local LLM inference on NVIDIA or AMD hardware
  • Host a self-hosted chat UI with RAG
  • Add speech-to-text and text-to-speech to a local stack
  • Automate tasks with n8n workflows and agents
  • Generate images locally via ComfyUI

For Developers and hobbyists self-hosting AI on local hardware

Role
agent-app
Language
Python
Licence
Apache-2.0
Forks
944
Open issues
245
Last push
2026-09-17
Latest release
v1.0.0 · 2026-02-22
topicsself-hostedllmragdockervoiceworkflow-automation