GH Repository · mudler
LocalAI
LocalAI is the open-source AI engine. Run any model — LLMs, vision, voice, image, video — on any hardware. No GPU required.
- stars
- 49,141
- 30-day movement
- +9732/day
- Related entries
- 60
- Connections
- 4
nixgomakedockermcp-serveragentsmcplibp2pllamadecentralizedttsaiimage-generationstable-diffusionapillmmambaaudio-generationmusicgentext-generationrerankGoobject-detectiondistributed
LocalAI is an open-source AI engine that serves LLMs, vision, voice, image, video, and audio models behind an API, with support for running on CPU-only hardware. It also functions as an MCP server and includes distributed/decentralized features via libp2p.
Reach for it when you want to self-host a wide range of AI models locally without needing a GPU.
Use it to
- Serve LLMs behind a local OpenAI-style API
- Generate images with Stable Diffusion on CPU
- Run text-to-speech and audio generation locally
- Expose models as an MCP server for agents
- Deploy models across distributed nodes
For Developers self-hosting AI models on local hardware
- Role
- mcp-server
- Language
- Go
- Licence
- MIT
- Forks
- 4,455
- Open issues
- 98
- Last push
- 2026-09-17
- Latest release
- v1.15.0 · 2023-05-23
topicsllminferenceself-hostedmcpimage-generationtts