Short definitions for hardware and software terms used across WikiWayne guides.
GGUF is a file format that bundles model weights, metadata, and tokenizer data for efficient loading in local inference engines.
Quantization is the process of storing neural network weights in lower bit widths (such as 4-bit or 8-bit) so a model uses less VRAM while staying usable for local inference.
VRAM is the dedicated memory on your graphics card that holds model weights and key tensors during local LLM inference.