Leanpub Header

Skip to main content

Filters

Category: "Data Engineering"

Books

  1. Databricks for Practitioners: Volume 2
    The AI Lakehouse and Agentic Playbook: Analytics, Mosaic AI, Agents, and Lakebase
    Ritesh Modi

    RAG, Agent Bricks, the Multi-Agent Supervisor with MCP, Lakebase, MLflow 3, Lakehouse Monitoring, Feature Store, Vector Search. Every AI surface Databricks shipped at GA in 2025 and 2026, taught by a practitioner, current to 2026. What you will learn - Build RAG pipelines with Vector Search, embedding models, and citation grounding- Ship Agent Bricks for classification and information extraction- Orchestrate specialist agents with the Multi-Agent Supervisor and MCP- Use Lakebase as the operational Postgres layer for AI apps and agents- Detect data and model drift with Lakehouse Monitoring; wire alerts to retraining- Manage the ML lifecycle with MLflow 3 and the UC Model Registry- Govern features across training and serving with Feature Store (offline + online)- Serve foundation and custom models with AI Gateway controls Who this book is for Data engineers, ML engineers, and AI/ML architects who know PySpark and the Databricks platform and now need to ship production AI. Volume 3 is the recommended prerequisite. Table of Contents 1. Databricks SQL in Production. Warehouses, materialized views, three latency signals (admission, compilation, execution), the full dashboard backend wiring.2. External BI: Tableau, Power BI, dbt. Performance tips that take a dashboard from sluggish to instant, dbt configuration at incremental scale, the seam between BI and the lakehouse.3. AI/BI Dashboards. Anatomy of a Lakeview dashboard, draft vs published flow, the Dashboard Agent's reliable patterns, the five-grant permission model.4. Genie: Natural-Language Analytics. Grounding sources, the priority rule, the SQL Genie actually writes, the questions Genie answers cleanly versus the ones that confuse it.5. AI SQL Functions. ai_query, ai_parse_document, ai_extract for PDFs and HTML, univariate forecasts, the daily cost math for production AI SQL pipelines.6. Model Serving. Endpoints, the three fields that decide capacity and cost, the chat-completion payload, the five moving pieces of a production recommender.7. Foundation Models. Five major providers, the External Models config, the vendor-swap pattern (Claude to Gemini in hours, not weeks), the three habits that keep swap cost low.8. Vector Search and RAG. Six delta-sync arguments, three chunking strategies compared, the RAG function your app imports, end-to-end answer evaluation with traces.9. MLflow 3 and UC Model Registry. Versions, aliases, tags (and what each is not for), five tracking calls and what each one writes, the experiment-to-production lifecycle.10. Feature Store. Why SDP is the right producer, the six-file project layout, four parity-failure classes between offline and online stores and what causes each.11. MLOps as a Practice. Seven sources every incident reads from, three deploy patterns (canary, shadow, blue-green), three retrain strategies, five golden signals for an ML endpoint.12. Lakehouse Monitoring: Drift Detection. Six monitor parameters, the loop from drift alert to retraining, what to do when the baseline table is missing.13. Distributed Deep Learning. Three signals that force distributed training, picking the flavor (data, model, hybrid) from the bottleneck, four pieces of GPU memory worked out for a 7B model.14. Agent Bricks. Declarative classification and information-extraction agents, eval-set ingredients, the pre-compute pattern that makes small seed sets work.15. Multi-Agent Supervisor and MCP. The supervisor build, synthetic-turn evaluation, three real conversations end to end, the auth-passthrough chain across child agents.16. Lakebase: Operational Postgres for AI. Five alternatives compared, sub-10ms reads for AI apps, the lineage from Delta source through SDP into Postgres and onward to the endpoint.17. Capstone: Retail Intelligence App. Ten stages, each anchored to an earlier chapter. The smoke test that confirms every stage of the platform is reachable, the new-data path through the recommender.18. Certification and What's Next. The certification paths that actually map to the book, and the reading list the on-call team uses when something breaks.

  2. Data platform interviews test CDC, streaming, warehouse modeling, and trade-offs two levels deep — no generic system-design book covers it. This one does: 50 full mock interviews, 122 rapid-fire Q&A, and the framework that turns a vague prompt into a hire.

  3. The behavioral interview is where senior data offers are won, lost, and leveled — and it's the round engineers prepare for least. This book turns your real career into answers that survive any follow-up: 7 competencies, 300+ real questions, company playbooks, 30 scored mock interviews, and AI-assisted preparation — built specifically for data engineers and architects.

  4. High-Performance Data Processing with Polars: From Beginner to Advanced
    A Practical Guide to Fast, Scalable, Memory-Efficient Data Analytics in Python
    Steve Publications

    Discover how to make Python data processing faster, leaner and ready to scale with Polars. Starting with the basics, this practical guide takes you all the way to production-grade pipelines for massive datasets, with clear explanations of how Polars works, why it is fast and how to get the best performance from it.

  5. Mastering Julia Programming
    From First Program to Production Systems
    Steve Publications

    Discover how to build fast, elegant and reliable software with Julia. Starting from the basics, this book guides you through real-world projects, performance optimization and production-ready techniques. Whether you work in data science, engineering or research, you'll gain the skills to write Julia code with confidence.

  6. R Programming Cookbook
    From First Steps to Advanced Data Science
    Steve Publications

    Whether you're opening R for the first time or ready to tackle real data projects, this book helps you build practical skills that stick. Follow clear lessons, hands-on examples and complete code as you progress from the basics to data visualization, machine learning, web apps and professional R workflows.

  7. Production SQLite
    Architecting Reliable Data Systems with the World's Most Deployed Database
    Steve Publications

    SQLite is everywhere but running it well in production takes more than flipping a few settings. This book goes beyond the basics to show how SQLite really works, then walks through the patterns, tools and tradeoffs behind reliable, high-performance deployments. Packed with practical examples, it's built for engineers who want confidence in production.

  8. Practical Data Engineering
    Pipelines, warehouses, and the modern data stack from scratch
    CAIO INCAU

    Build a complete data pipeline from scratch — no cloud signup needed. Fifteen chapters covering ingestion, loading, data modeling, dbt, Airflow, data quality, streaming, observability, and performance optimization. Everything runs locally with Python and DuckDB.

  9. The Market Is Not a List
    Building answerable markets from identity, evidence, relationships, and change
    Vineeth Veetil

    Markets are not static rows. This book shows how to turn fragmented public and private evidence into an answerable, versioned map of who exists, who fits, why now, and who to contact—without hiding uncertainty, provenance, or change.

  10. PyTorch Deep Dive
    From Foundations to Production: A Complete Guide to Modern Deep Learning
    Steve Publications

    PyTorch Deep Dive is a practical guide to mastering modern deep learning with PyTorch. From core concepts to advanced topics like transformers, diffusion models, and production deployment, it combines clear explanations, hands-on examples, and real-world best practices to help you build and scale AI applications with confidence.

  11. THE ARCHITECTURE OF THOUGHT Applied Mathematics in Large Language Models & GenAI
    Applied mathematics in large language Models &GenAI
    AhmedAdawy

    Move beyond the API. Dismantle the AI black box and build generative engines from scratch with pure Python and NumPy. Master the profound geometric principles and applied mathematics driving LLMs and Transformers. Transform from a mere consumer into an elite AI innovator by writing the core mathematical architecture yourself—no shortcuts, no frameworks, just pure engineering excellence.

  12. Practical Elasticsearch Query Language
    Query, Analyze, Filter, Aggregate, Join, and Search across Billions of Records with ES|QL
    GitforGits | Asian Publishing House

    ES|QL is a fresh, piped language with its own compute engine, built for the way people actually think. You start with a source, then chain small, clear steps with a single pipe, just like you would at a command line. Filter, transform, aggregate, search, enrich, and rank, all in one easy-to-read line that goes from top to bottom like a sentence.

  13. The Guardian Algorithms: Applied Mathematics in Cyber Defense
    The Mathematical Architecture of Modern Cybersecurity
    AhmedAdawy

    Behind every secure network lies an unbreakable mathematical truth. 'The Guardian Algorithms' bridges the gap between pure math and cutting-edge cyber defense. Step into the mind of a digital architect to decode the formulas that outsmart hackers, lock down infrastructure, and rewrite the rules of modern warfare. The future of security isn't coded—it is calculated.

  14. Behind the Black Box: Building Neural Networks From Scratch
    The Essential 5-Function Guide to Mastering AI Mathematics with Pure Python and NumPy. Stop copying code—become the architect.
    AhmedAdawy

    Unlock the secrets of artificial intelligence by mastering its core foundation. This practical guide teaches you how to design, code, and optimize neural networks from the ground up without relying on complex libraries. It is the ultimate resource for developers ready to truly understand the math and logic behind the code.

  15. Applied Statistics for Data Science
    from visual diagnostics to drift detection
    Gal Arav

    Today, AI and machine learning are driven by statistical thinking. As many leading experts emphasize, without a solid understanding of statistics, you cannot truly understand, evaluate, or safely use AI. This book gives you that edge.