GH Repository · floneum
kalosm
Instant, controllable, local pre-trained AI models in Rust
- stars
- 2,230
- 30-day movement
- +10/day
- Related entries
- 60
- Connections
- 2
otheraillmrustkalosmllamacppcandlemistralllamadioxusRustconstrained-generationwhisperfloneum-v3transcription
Kalosm is a Rust library for running pre-trained AI models locally, described as instant and controllable. Its topics indicate support for LLMs via llama.cpp and candle (llama, mistral), constrained generation, and transcription with Whisper.
Reach for it when you want to run and control local pre-trained models like LLMs or Whisper transcription from Rust.
Use it to
- Run local LLMs in Rust
- Generate text with constrained generation
- Transcribe audio with Whisper
- Build local AI applications in Rust
For Rust developers building local AI applications
- Role
- other
- Language
- Rust
- Licence
- Apache-2.0
- Forks
- 133
- Open issues
- 43
- Last push
- 2026-09-14
- Latest release
- v0.1.0 · 2023-07-12
topicsrustllmlocal-modelsconstrained-generationtranscriptionwhisper