#cluster

Shopping the secondary market without overspending on VRAM you cannot use.

Slower tokens, stronger air-gap story.

What `-ngl` / GPU layer sliders actually do.

Compose services for local chat without cloud relay.

Quant-specific VRAM bands for Meta Llama 3 8B class models.

Step-by-step Ollama install paths for the three major desktop OS families.

Compile with GPU backends for NVIDIA cards.

Leave the managed service when you need custom builds or flags.

Use the LM Studio catalog without guessing quant labels.

Network egress, logging, and backup habits for homelabs.

CUDA maturity vs ROCm tradeoffs for GGUF stacks.

Point agents and UIs at `http://localhost:11434/v1`.

Docker and bare-metal pairing for household chat.

From zero to a working chat with a small Ollama tag.

When to spend extra gigabytes on higher precision.

GGUF packs tensors and metadata for llama.cpp-compatible runners.