Leanpub Header

Skip to main content
Go to Leanpub.com

Filters

Category: "Inference Engineering"

Inference Engineering

New to Artificial Intelligence? Read the Artificial Intelligence article

  1. vLLM & SGLang: From First Request to Production
    vLLM & SGLang: From First Request to Production
    salman sajid

    vLLM and SGLang, side by side. Learn how LLM serving works, measure both engines fairly, tune them with evidence, and take a model from an empty GPU to a deployment with a cost per million tokens you can defend.

  2. Building AI Agents in Go
    Building AI Agents in Go
    Dayna Blackwell
    No Description Available
  3. Strata: Fast Local Inference for Qwen3.8-Flash-Next (125B)
    Strata: Fast Local Inference for Qwen3.8-Flash-Next (125B)
    How to Run Massive Mixture-of-Experts Models on Consumer Hardware
    Steve Publications

    What if a 125B-parameter AI model could run locally on a gaming GPU with just 12 GB of VRAM? Strata makes it possible. This book takes you inside the techniques that make it work, from MoE sparsity and memory tiers to PCIe pipelining and speculative decoding, then shows you how to install, tune and troubleshoot it yourself.

  4. A Practical Guide to Inference Engineering
    A Practical Guide to Inference Engineering
    Architectures, Optimization Strategies, Performance, Reliability and Production Systems
    Steve Publications

    Inference engineering is now its own discipline, with unique challenges around speed, cost, reliability and scale. This practical guide takes you from core concepts to production systems, showing how modern inference architectures work, how to optimize them and how to make better engineering decisions through measurement and trade-off analysis.