Glossary
Short definitions for terms used in this book.
- QAT (Quantization-Aware Training): the model trained with low precision in mind, so the small 4-bit form keeps more skill than plain post-training shrinking.
- MoE (Mixture-of-Experts): a model with many expert subnetworks where only some fire per token.
gemma4:26b-a4b-it-qatholds 26B parameters but only 4B activate per token, which buys speed. - Dense: a model where all parameters work on each token. Simpler behavior, higher cost per token than MoE at the same size.
- Active parameters: the parameters that compute a given token. The cost driver for speed, not the total count.
- Context length: how much text (code, logs, prompts) the model can hold at once. Set via
OLLAMA_CONTEXT_LENGTHin this book. Small values corrupt file writes. Large values cost RAM. - Skill: a Markdown file under
.pi/agent/skills/with tool invariants and rules that little-coder loads into the system prompt. - Headless: a command that runs to completion with no keyboard input, no REPL, and a clean exit. The opposite of interactive.
- Write-and-Notify: the strategy from
write-temp-strategy.md: the agent writes full code to newtmp_*files and tells you the path, and you merge by hand. - -it-: instruction trained. A model tuned to follow orders, not a raw base model.