Leanpub Header

Skip to main content

Filters

Category: "Data Engineering"

Data Engineering

New to Data Science? Read the Data Science article

  1. C++ Data-Oriented Design
    C++ Data-Oriented Design
    Cache-Line Mechanics, SoA Layouts, SIMD Vectorization, and Memory Access Optimization for High-Performance Systems
    Weston Ashgrove

    Your CPU is not slow. Your data is in the wrong place. Every cache miss your hot loop pays is not a hardware limitation, it is a layout decision that was never made consciously. The pointer your code chases, the struct field your loop skips over, the heap allocation that landed three megabytes from the last one: these are the real performance bottlenecks in CPU-bound systems, and none of them show up in a complexity analysis. This book teaches you to see your data the way the hardware sees it, measure what it costs, and redesign it so the memory system works with your code instead of against it.

  2. AI Engineering Visualized, Volume 3: RAG & Knowledge Systems
    AI Engineering Visualized, Volume 3: RAG & Knowledge Systems
    A Visual Guide to RAG and Knowledge Systems
    Prateek Singh

    RAG answers you can trace to a source: ingestion, permissions, hybrid search, reranking, evals and regression gates, drawn and built in Python.

  3. Blockchain Data Engineering Guide
    Blockchain Data Engineering Guide
    The hands-on guide for data and analytics engineers working with onchain data
    Vincent Charles

    How chain data is shaped, and how to index, stream, store and model it. 14 chapters, 22 hands-on exercises, 7 end-to-end projects and a private GitHub repo of runnable code

  4. Data Exploration and Visualisation with R: From Data Quality to Credible Evidence

    Explore data before you trust it. Data Exploration and Visualisation with R shows how to uncover structure, diagnose data-quality problems, challenge misleading patterns, and turn imperfect observations into credible evidence through thoughtful, reproducible visual analysis.

  5. High-Performance Python for AI & Data Engineering
    High-Performance Python for AI & Data Engineering
    The Ultimate Loop, Vectorization & Memory Optimization Blueprint
    AhmedAdawy

    The ultimate technical blueprint for developers and AI engineers to strip away execution overhead, leverage hardware-accelerated NumPy/PyTorch operations, and scale Python code effortlessly

  6. Database Engine Level Thinking
    Database Engine Level Thinking
    Building a mental model of PostgreSQL internals — written while learning
    Kareem Ashraf

    Stop only using databases — start understanding them. A living study of PostgreSQL internals for backend engineers: how pages, indexes, and WAL actually work, written clearly while learning, not after mastery.

  7. AI Prompt Reverse Engineering & Advanced Secrets: The Ultimate Guide to Mastering Prompt Architecture

    Stop guessing prompts. Start from the result you want.Why does AI give you generic answers? Because you start from the wrong end.A prompt that works the first time is not luck. It is a method.

  8. Mastering ELF: From Bytes to Execution

    A Deep Systems Engineering Guide to ELF64 Internals, Dynamic Linking, Kernel Loading, Binary Instrumentation, and Executable Runtime ArchitectureEvery executable binary contains more than machine instructions. It encodes the structural information, symbol relationships, relocation rules, memory mappings, and runtime metadata required to transform compiled code into a functioning process. Understanding this transformation requires looking beyond compiler output and examining the mechanisms that connect binary formats, operating-system loaders, dynamic linkers, virtual memory, and processor execution.Mastering ELF: From Bytes to Execution is a comprehensive, implementation-focused engineering reference to the Executable and Linkable Format (ELF), with a particular emphasis on ELF64 internals and low-level runtime behavior. Across 50 chapters, it follows the complete execution pipeline from raw binary structures and defensive parsing to kernel-space loading, dynamic symbol resolution, thread-local storage, exception unwinding, executable modification, and custom loader architecture.

  9. Snowflake Cost Optimization in Practice
    Snowflake Cost Optimization in Practice
    Beyond Warehouse Tuning: FinOps, Data Architecture, Apache Iceberg, AI, and Serverless
    Tatsuya Koreeda

    Optimize Snowflake costs through design, not just configuration: from warehouse tuning to your data architecture, with practical decision criteria and SQL you can run today.

  10. The Data Engineering Interview, Unlocked
    The Data Engineering Interview, Unlocked
    Volume 1: Foundations & Platforms
    Pankaj jain and Harendra Singh

    A visuals-first guide to cracking data engineering interviews — SQL, data modeling, PySpark, Spark, Kafka, Databricks and Snowflake — and doing the work in production.

  11. Data MODELING MASTERY
    Data MODELING MASTERY
    Sudhanshu Jaiswal

    Estimate honestly. Model fearlessly. This book turns T-shirt sizing into fast, team-friendly estimation and hands you a complete e-commerce warehouse build on BigQuery—star schemas, ETL pipelines, performance tuning and all. From decision frameworks to real-world trade-offs, you'll gain the confidence to plan realistically and architect data systems that scale.

  12. Migrating to Polars 2
    Migrating to Polars 2
    What breaks silently between 1.x and 2.0, shown with real runs under both versions
    Ground Truth Books

    Polars 2.0 changed defaults that don't raise errors: lazy queries now stream, and joins no longer keep row order. This short guide shows exactly what breaks when you upgrade from 1.x, with every example run under both 1.44.2 and 2.0.0 and the real output printed side by side.

  13. Deep Analysis with Pandas
    Deep Analysis with Pandas
    Transforming and Visualizing Data for Insights
    Joram Mutenge

    Learn pandas, the most widely used data analysis library.

  14. Parallel Python with Dask, Second Edition
    Parallel Python with Dask, Second Edition
    Scale pandas, NumPy, and Xarray across cores, clusters, and GPUs for terabyte-scale analytics and machine learning
    GitforGits | Asian Publishing House

    What I love about Dask is that it won't make us start from scratch. It doesn't ask us to learn a new language, adopt a new way of thinking, or rewrite five years of careful analysis into something completely different. It just takes the tools we've already got and quietly teaches them to work in parallel. The dataframe remains a dataframe. The array is still an array. The difference is that the work now spreads across eight cores, or eight hundred, and we barely had to change how we think.

  15. AI-Powered Smart Decision Making
    AI-Powered Smart Decision Making
    A Practical Guide to Using AI, Data & Analytics for Smarter Business Decisions
    Mohammad Kamrul Hassan

    AI can analyze the data. But who decides what the data means—and what to do next?Modern organizations have more information than ever, yet making good decisions remains difficult.AI-Powered Smart Decision Making shows how to combine AI, data, analytics, and human judgment to turn information into insight and insight into action.Discover a practical framework for making better decisions across strategy, marketing, sales, operations, finance, risk, and beyond.AI is not the decision. AI improves the decision process. Table of ContentsIntroduction—The New Era of AI-Powered Decision MakingChapter 1 — The Foundations of Better Business DecisionsChapter 2 — From Intuition to Data-Driven Decision MakingChapter 3 — Understanding Data for Better DecisionsChapter 4 — Business Analytics: Turning Data into InsightChapter 5 — How AI Changes Business Decision MakingChapter 6 — Building an AI-Powered Decision FrameworkChapter 7 — Asking the Right Questions: AI, Data & Decision ProblemsChapter 8 — Predictive Decision MakingChapter 9 — Prescriptive Analytics and Decision OptimizationChapter 10 — AI for Strategic Business DecisionsChapter 11 — AI for Marketing and Customer DecisionsChapter 12 — AI for Sales, Operations and Supply ChainChapter 13 — AI for Financial and Risk DecisionsChapter 14 — Human + AI: The New Decision-Making PartnershipChapter 15 — Bias, Uncertainty and the Limits of AI DecisionsChapter 16 — Trustworthy, Responsible and Explainable AI DecisionsChapter 17 — Measuring Decision Quality and Business ImpactChapter 18 — Building an AI-Powered Decision CultureChapter 19 — Designing an AI-Powered Decision SystemChapter 20 — The Future of Smart Decision MakingConclusion — From Data to Better DecisionsDisclaimer