Leanpub Header

Skip to main content

Filters

Category: "Eval Engineering"

Books

  1. Modern Code Review in the AI Era
    Modern Code Review in the AI Era
    A Comprehensive Guide to Building Better Software Through Collaborative Review and Intelligent Automation
    Steve Publications

    Great software is built through great reviews. This book shows you how to spot hidden bugs, improve design, strengthen security, and review AI-generated code with confidence. Packed with practical examples and proven techniques, it helps you write better software in a world where humans and AI build code together.

  2. Evaluation Engineering for AI Systems
    Evaluation Engineering for AI Systems
    Building Reliable Evaluations from Benchmarks to Production
    Steve Publications

    Evaluation Engineering for AI Systems is a practical guide to building reliable AI evaluations for production. Learn how to measure performance, compare models, detect regressions and create evaluation pipelines using real-world examples, modern Python and proven industry practices.

  3. AI Agent Evals
    AI Agent Evals
    How to Evaluate AI Agents Before Release: Traces, Tool Calls, LLM as a Judge, Graders and Regression Gates
    Thomas De Vos

    An agent's answer can look right while its actions are wrong. Learn to evaluate tasks, traces, tool calls and changed state with reproducible harnesses, tested graders and regression gates.

  4. Semantic Search from Scratch
    Semantic Search from Scratch
    Build a Working Semantic Search Engine with Pure Python and NumPy
    AhmedAdawy

    Build a fully functional semantic search engine from first principles using pure Python and NumPy—no heavy AI frameworks, no vector databases, just pure intuition and mathematics.

  5. If You Don't Understand Programming, You Don't Understand AI
    If You Don't Understand Programming, You Don't Understand AI
    The Code, Strategies, Systems, Strengths, Weaknesses and Future of Artificial Intelligence
    Steve Publications

    AI can write code, create images and make decisions, but do you really understand what happens behind the scenes? This book cuts through the hype to explore how AI works, where it falls short and what it takes to build reliable systems. If you want to understand AI beyond the chat window, start with the code.

  6. Models Make Things Up
    Models Make Things Up
    Building LLM Features That Survive Production
    Alwy

    The model is one box. This book is about every other box: retries, contracts, evals, budgets, guardrails and agents for backend engineers shipping LLM features to production.

  7. TOPOLOGY, GEOMETRY AND DEEP LEARNING
    TOPOLOGY, GEOMETRY AND DEEP LEARNING
    A Mathematics-to-AI Textbook
    Anshuman Mishra

    From Mathematical Foundations to the Future of AIMost deep learning still lives in flat, Euclidean space. Real-world data does not.This 15-chapter university textbook takes you from the basics of topology and geometry to the frontier of Geometric Deep Learning, Topological Data Analysis, equivariant networks, and optimization on manifolds.Clear explanations. Worked examples. Research roadmaps.

  8. Building Autonomous Coding Agents
    Building Autonomous Coding Agents
    Design, Safety, and Local-First Operation of Unattended AI Development Systems
    Yohan J. Rodríguez

    Build agents that write code, fix tests, and commit changes while you sleep — safely, cheaply, and entirely on your own hardware (622 manuscript pages).

  9. Governance Before Decision
    Governance Before Decision
    A Field Guide to Proof, Permission, and Human-Controlled AI Execution
    Kari Hyotyla

    AI can decide. That does not mean it is authorized to act. Governance Before Decision examines the missing control layer between intelligent systems and real-world consequences — where authority, scope, verification, and execution must meet.

  10. Agentic  AI: The Rise of Autonomous Goal Driven Intelligence

    What happens when AI moves beyond answering questions and begins to pursue goals?Agentic AI: The Rise of Autonomous, Goal-Driven Intelligence explores the emerging world of intelligent systems that can perceive, reason, plan, learn, collaborate, and act within defined environments.From the foundations of autonomous agents and multi-agent systems to robotics, finance, logistics, security, ethics, and future research, this book provides a structured journey through the rapidly evolving landscape of Agentic AI.Discover how goal-driven intelligence works, how autonomous agents make decisions, how multiple agents collaborate, and why safety, trust, accountability, and human oversight are essential to the future of autonomous systems.Understand the agents. Explore the architectures. Examine the applications. Think about the future.

  11. Mastering Artificial Intelligence & Machine Learning System Desig
    Mastering Artificial Intelligence & Machine Learning System Desig
    A Complete Interview Guide with Frameworks, Case Studies & Insider Strategies
    Anshuman Mishra

    Master AI/ML System Design with a Structured Interview FrameworkLearn how to approach complex ML system design interviews using a 20-step framework, architecture blueprints, real-world case studies, scalability strategies, data and model pipelines, deployment patterns, monitoring, and interview-ready templates.

  12. The Conversational AI Revolution: Building  Intelligent Chatbots and Voice Assistants

    Build Smarter Chatbots and Voice AssistantsExplore Conversational AI from fundamentals to real-world applications. Learn NLP, intent and context management, intelligent chatbots, voice assistants, speech technologies, multimodal interfaces, APIs, deployment, business integration, analytics, ethics, LLMs, and Generative AI.

  13. Cybersecurity in Artificial Intelligence: Attacks Defenses and Real World Application

    Secure AI. Understand the Threats. Build More Trustworthy Intelligent Systems.Explore adversarial attacks, data poisoning, model theft, AI-enabled cyber threats, secure AI development, adversarial defenses, trustworthy AI, MLOps security, governance, privacy, red teaming, and the future of AI cybersecurity through practical concepts and real-world case studies.

  14. Intelligent Machines: How AI is  Revolutionizing Robotics

    Explore the Future of AI-Powered RoboticsDiscover how Artificial Intelligence is transforming robots into intelligent machines capable of learning, seeing, communicating, navigating, and making decisions. Explore Machine Learning, Computer Vision, NLP, Deep Learning, autonomous systems, smart factories, healthcare robots, drones, humanoids, agricultural robotics, ethics, and future trends.

  15. Evaluating Local and Small Language Models
    Evaluating Local and Small Language Models
    A Practical Engineering Guide to Benchmarking, Optimization, and Production Deployment
    Steve Publications

    A practical guide to evaluating small and local language models in the real world. Learn how to benchmark reliably, compare models across hardware and runtimes, optimize performance and avoid misleading results. With practical code and rigorous methods, you can build your own evaluation setup and make confident deployment decisions.