ollama

Use when running open-weight LLMs locally with Ollama — pulling and tagging models, calling the local API, picking a quantization or GGUF, writing Modelfiles, and sizing VRAM and RAM for the machine at hand. NOT remote or managed GPU serving and autoscaling (that is runpod), NOT downloading raw weights or datasets (that is huggingface), NOT retrieval pipeline design (that is rag).