GPU Programming

We'll be writing kernels in Rust and seeing how they match up with their C++ equivalents. If you feed a GPU properly, you'll see bandwidth quadruple from just one changed subscript. It'll get you working with thousands of threads, pricing a financial option based on an exact formula, and shipping an inference pipeline that outruns its Python equivalent for reasons you can name.

We will work in pure Rust, with no C++ shim or Python wrapper. We will build one small program that grows to cover the whole book. It begins as a loop that any of us could have written on a bad day. After gaining a kernel, it learns to stop waiting, grows streams and pinned memory, and ends as a pipeline fed by parallel producers through bounded channels. The device is busy almost every millisecond.

Learn CUDA programming from the ground up by understanding how GPUs really execute code. This book shows you how to write efficient kernels, optimize performance, and build high-performance applications for AI, scientific computing, image processing, and other demanding workloads on modern NVIDIA GPUs, including Blackwell.

Explore how modern GPU virtualization brings near-native performance to Linux virtual machines. From hardware and KVM/QEMU internals to virtio-nvgpu and NVIDIA's shared GPU architecture, this book takes you inside the stack with practical configurations, source code analysis and deployment patterns for real-world systems.

What I love about Dask is that it won't make us start from scratch. It doesn't ask us to learn a new language, adopt a new way of thinking, or rewrite five years of careful analysis into something completely different. It just takes the tools we've already got and quietly teaches them to work in parallel. The dataframe remains a dataframe. The array is still an array. The difference is that the work now spreads across eight cores, or eight hundred, and we barely had to change how we think.

Go beyond writing kernel modules and learn how real Linux GPU drivers are built. Starting with GPU architecture and the graphics stack, this hands-on guide walks you through creating a complete DRM driver, from a minimal module to memory management, command submission, display support and error recovery.

Unlock NVIDIA GPU performance from Rust. This practical guide takes you from GPU architecture and memory hierarchies to writing and optimizing real CUDA Rust kernels. Explore both official Rust CUDA approaches with runnable examples and learn how to build fast, production-ready GPU code without giving up Rust’s safety and clarity.

The Local AI Stack: Building a Sovereign Machine Learning Workstation with Hyper-V, WSL2, and GPU Virtualization Renting GPU time from AWS costs more than the GPU. Every prompt you send to a cloud API is a prompt someone else logs. If your ML work runs on hardware you don't own, on a network you don't control, then you don't own your ML work.

Mastering NVIDIA CUDA: Expert GPU Programming About the BookTo master NVIDIA CUDA at an expert level, you must discard the outdated notion of the GPU as a mere "parallel co-processor" and instead view it as a highly integrated, self-orchestrating compute fabric.

Discover Mojo, a language that pairs Python-friendly syntax with serious systems-level speed. This hands-on guide takes you from your first program to optimized CPU and GPU workloads, with practical techniques for debugging, profiling and building production-ready software for high-performance computing and AI.

Build serious AI systems on NVIDIA DGX Spark with a practical guide that goes far beyond setup. Learn to deploy LLMs, create RAG pipelines, orchestrate AI agents, and optimize performance for real production workloads. Whether you are experimenting or scaling enterprise AI, this book shows you how to get there.

Unlock the full power of modern GPU programming with Mastering the Vulkan API. This practical guide helps intermediate C++ developers build high-performance graphics and compute applications through clear explanations, hands-on examples, and production-inspired best practices.