LLM Engineering, from Component to Production

Description

Welcome to the Leanpub Launch video for LLM Engineering, from Component to Production https://leanpub.com/llm_engineering_from_component_to_production by Ali Aouf! 0:00 Ali introduces himself, his PhD research on nuclear waste disposal, and the book's premise 1:35 Overview of the book: scope, length, and assumed audience knowledge 2:26 LLMs as probabilistic components, not magical black boxes — the core engineering mindset 3:12 Context window myths debunked: lost-in-the-middle, context drift, and why big windows aren't a free solution 3:57 Security concerns: controlling what an LLM can see and execute, and preventing unauthorized data access 4:45 Build a strong foundation first — why adding fancy technologies on a weak platform is the wrong approach 6:20 The book's opinionated voice: every technique is evaluated by cost, not just capability 7:07 Why GraphRAG is discouraged: complexity, debugging difficulty, and low reproducibility for most applications 10:17 Access to computing resources for PhD researchers in Belgium and Europe in 2026 12:42 The book is free and open — Ali invites researchers and engineers to contribute About the Book LLM Engineering, from Component to Production is a practical, measurement-first guide to building a local-first agentic retrieval-augmented generation system. Across sixteen chapters, one evolving codebase, and a sequence of hands-on labs, it treats the language model as a fallible software component rather than a magical application layer. The central promise is not that the reader will memorize a framework, but that they will finish with a system they have built, measured, secured, observed, and prepared to deploy. The book begins at the component level. It explains tokenization, sampling, constrained decoding, tool calling, and context management from first principles. The reader writes the tool-calling loop by hand before using an orchestration framework, making the runtime contract explicit: the model proposes a structured action, ordinary code validates and executes it, and the result is returned to the model. This foundation supports a broader engineering principle repeated throughout the manuscript: inference should be used for judgment, while loops, conditionals, data transformation, validation, and orchestration belong in deterministic code. The retrieval section builds a strong baseline before introducing more elaborate techniques. It covers layout-aware document parsing, structural chunking, provenance, idempotent ingestion, dense and lexical retrieval, reciprocal rank fusion, cross-encoder reranking, and contextual retrieval. Particular emphasis is placed on silent failure modes: indexes built with the wrong embedding model, BM25 constructed over an empty store, lost page metadata, duplicated model calls, and retrieval pipelines that appear to work while returning weak evidence. GraphRAG and query expansion are assessed against measured costs rather than adopted as defaults. The agency section explains when an agent is justified and when a fixed pipeline is the better design. It covers current LangChain and LangGraph patterns, middleware, durable state, human-in-the-loop interrupts, Model Context Protocol, protocol alternatives, and tool-surface security. The recurring design constraint is containment: read-only tools should remain simple, privileged actions require narrow interfaces and validation, and untrusted model output must never be dispatched through unrestricted reflection or unchecked arguments. Evaluation, security, observability, and cost form the rigor layer. The book advocates a hand-written golden set, deterministic retrieval metrics such as recall at k and mean reciprocal rank as CI gates, and judged generation metrics as noisy monitoring signals rather than binary tests. It includes prompt pinning, embedding-index skew checks, injection regression tests, OpenTelemetry tracing, latency decomposition, token accounting, and cost-per-query measurement. The reader is repeatedly asked to record before-and-after numbers so that architectural claims remain falsifiable. The production chapters move from local development to serving and deployment. They cover vLLM, continuous batching, PagedAttention, KV-cache sizing, quantization, concurrency testing, blue-green index releases, canaries, rollback, on-premises and cloud options, data residency versus sovereignty, and EU AI Act implications. The final chapters turn the completed system into a capstone, a defensible CV project, and a set of technically precise interview explanations. Two appendices reinforce the book’s deeper lesson: audit confident technical advice critically, and prefer architectures whose behavior can be inspected, measured, and explained. The intended outcome is a working system and an evidence trail: a corpus chosen by the reader, a golden set written by hand, retrieval and generation metrics, trace data, security tests, deployment artifacts, and a concise record of which changes improved the system and which were not worth their cost. About the Author As a dedicated PhD Researcher at SCK CEN, my work on 3D reconstruction of complex soil materials is pivotal for advancing nuclear isolation strategies. Currently enrolled at Université catholique de Louvain, I am honing my expertise in Artificial Intelligence, particularly within generative AI applications. Previously, I led a team at Smart Drilling Operations, where I developed strong analytical skills and a keen attention to detail. My background in Smart Computational Systems from Université des Sciences et de la Technologie 'Houari Boumediène' underpins my technical competencies, enabling me to contribute effectively to complex multidisciplinary projects. Follow the author here! https://x.com/40uf411 Thank you for watching, please like and leave a comment, we'd love to hear from you! Please Subscribe and Follow! YouTube: https://www.youtube.com/leanpub X: https://x.com/leanpub Instagram: https://www.instagram.com/leanpub Facebook: https://www.facebook.com/leanpub Create Your Own Leanpub Book! You can create your own book anytime here: https://leanpub.com/create/book Here's the tutorial showing how to write and publish a Leanpub book in your browser (it's free!): http://help.leanpub.com/en/articles/2932527-getting-started-writing-a-book-in-the-web-browser-writing-mode If you're a Leanpub author and you'd like to submit your own Launch video for us to publish, or if you'd like to record a Launch video with Len, please go here: https://leanpub.com/launch. #books #leanpublishing #selfpublishing #leanpub #writing #largelanguagemodels #LLMEngineering #RAG #AIAgents #GenerativeAI #MLOps