GH Repository · dusty-nv
NanoLLM
Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.
- stars
- 382
- 30-day movement
- starts with the next reading
- Related entries
- 60
- Connections
- 1
pythonPythonvector-databaseragspeechvision-transformermultimodalllm-inferenceedge-ai
- Role
- rag
- Language
- Python
- Licence
- MIT
- Forks
- 67
- Open issues
- 61
- Last push
- 2024-10-18