Leanpub Header

Skip to main content

Filters

Category: "LLM Inference Framework"

Books

  1. How Transformers Actually Work
    How Transformers Actually Work
    From First Principles to Production Inference
    Steve Publications

    Go beyond calling transformer libraries and learn what actually happens under the hood. Starting from first principles, this book builds transformers from scratch with NumPy and PyTorch, then takes you through training, optimization and production inference. Along the way, you’ll work through the math, code and practical techniques behind modern transformer systems.

  2. Grokking LLMs: Build Your Own LLM from Scratch
    Grokking LLMs: Build Your Own LLM from Scratch
    Building a Bilingual LLM from Scratch with PyTorch
    Rexim

    Grokking LLMs makes the inner workings of large language models easier to understand, from the ideas that power them to how they learn and generate text. Build your knowledge step by step and discover what’s happening beneath the surface of today’s most exciting AI technology.

  3. Closed-Loop LLMOps
    Closed-Loop LLMOps
    Building Adaptive, Self-Improving, and Governed Enterprise AI Systems
    Zsolt L. Kocsis

    Build and operate LLMs on-premise environment that stay reliable, auditable, and compliant — not just after launch, but continuously. Closed-Loop LLMOps is not another framework for building models — it is a practical system for operating them reliably at scale. It treats language models as living, evolving capabilities rather than static artifacts. This is practitioner’s guide with RAG Ready appendices , to closed-loop LLMOps for regulated and on-prem environments.

  4. Programming Knowledge Graphs with Python
    Programming Knowledge Graphs with Python
    Model, Build, and Query AI-Ready Knowledge with Cypher, Neo4j, and AI Agents
    GitforGits | Asian Publishing House

    We'll start with nodes, relationships and Cypher, as it'll make everything else easier later on. Then, we design a schema, chunk documents, extract entities and add embeddings. Then, we'll mix vectors with structure, run graph algorithms, think about rules and ontologies, and connect AI agents through safe, traceable tools. We'll also keep the graph fresh, measured and recoverable, because if it's stale, users won't trust it.

  5. Inside DeepInfer
    Inside DeepInfer
    How an LLM Inference Engine Works
    Jianxin Zhao

    A generation loop fits in a few lines of Python, yet serving it to many users at once raises hard questions: who owns the cached state, when memory can be reused, and when a guessed token is worth checking. This book answers them through small experiments you can run on your laptop and the source code of DeepInfer, the open-source engine behind DeepSeek's production service.

  6. Strata: Fast Local Inference for Qwen3.8-Flash-Next (125B)
    Strata: Fast Local Inference for Qwen3.8-Flash-Next (125B)
    How to Run Massive Mixture-of-Experts Models on Consumer Hardware
    Steve Publications

    What if a 125B-parameter AI model could run locally on a gaming GPU with just 12 GB of VRAM? Strata makes it possible. This book takes you inside the techniques that make it work, from MoE sparsity and memory tiers to PCIe pipelining and speculative decoding, then shows you how to install, tune and troubleshoot it yourself.

  7. A Practical Guide to Inference Engineering
    A Practical Guide to Inference Engineering
    Architectures, Optimization Strategies, Performance, Reliability and Production Systems
    Steve Publications

    Inference engineering is now its own discipline, with unique challenges around speed, cost, reliability and scale. This practical guide takes you from core concepts to production systems, showing how modern inference architectures work, how to optimize them and how to make better engineering decisions through measurement and trade-off analysis.

  8. Agentic  AI: The Rise of Autonomous Goal Driven Intelligence

    What happens when AI moves beyond answering questions and begins to pursue goals?Agentic AI: The Rise of Autonomous, Goal-Driven Intelligence explores the emerging world of intelligent systems that can perceive, reason, plan, learn, collaborate, and act within defined environments.From the foundations of autonomous agents and multi-agent systems to robotics, finance, logistics, security, ethics, and future research, this book provides a structured journey through the rapidly evolving landscape of Agentic AI.Discover how goal-driven intelligence works, how autonomous agents make decisions, how multiple agents collaborate, and why safety, trust, accountability, and human oversight are essential to the future of autonomous systems.Understand the agents. Explore the architectures. Examine the applications. Think about the future.

  9. The LLM Cost Engineering Handbook
    The LLM Cost Engineering Handbook
    Measure, Model, and Cut AI Spend Without Losing Quality
    Nix

    This book shows you how.What you'll be able to do:Say what one resolved ticket, generated report, or active customer actually costs youFind where the money goes in a real system, in about an hourCut your bill by 40% to 70% without making the product worse, and prove it didn'tStop a code change from tripling your costs before it shipsWalk into a budget meeting with a number and an argument instead of an apologyWhat's inside: sixteen chapters. Measure what you're paying for. Apply six levers, ordered by how much they pay back. Then keep the savings from creeping away, which is the part that decides whether any of this survives the year.

  10. AI Watermarks
    AI Watermarks
    How a Model Signs What It Writes
    Ritesh Modi

    Every sentence an AI writes can carry a hidden signature, and the world's biggest models are already signing their output. AI Watermarking shows you exactly how it works, using a four-word vocabulary and arithmetic you can check with a pocket calculator. By the end you will know what a watermark can prove, what destroys it in seconds, and why short text can never be tested.

  11. The SGLang Production Handbook
    The SGLang Production Handbook
    Architecture, Deployment, and Optimization for Large Language Model Inference
    Steve Publications

    Take a practical journey through SGLang, from its core architecture to real-world deployment and optimization. Built for engineers who need to run LLM inference reliably at scale, this handbook breaks down the tools, techniques and operational know-how needed to build and maintain production-ready SGLang systems.