Leanpub Header

Skip to main content

Filters

Category: "LLM Inference Framework"

LLM Inference Framework

  1. AI Watermarks
    AI Watermarks
    How a Model Signs What It Writes
    Ritesh Modi

    Every sentence an AI writes can carry a hidden signature, and the world's biggest models are already signing their output. AI Watermarking shows you exactly how it works, using a four-word vocabulary and arithmetic you can check with a pocket calculator. By the end you will know what a watermark can prove, what destroys it in seconds, and why short text can never be tested.

  2. The SGLang Production Handbook
    The SGLang Production Handbook
    Architecture, Deployment, and Optimization for Large Language Model Inference
    Steve Publications

    Take a practical journey through SGLang, from its core architecture to real-world deployment and optimization. Built for engineers who need to run LLM inference reliably at scale, this handbook breaks down the tools, techniques and operational know-how needed to build and maintain production-ready SGLang systems.