Practical GPU Programming (This Book Only )
Practical GPU Programming
High-performance computing with CUDA, CuPy, and Python on modern GPUs
About the Book
If you're a Python pro looking to get the most out of your code with GPUs, then Practical GPU Programming is the right book for you. This book will walk you through the basics of GPU architectures, show you hands-on parallel programming techniques, and give you the know-how to confidently speed up real workloads in data processing, analytics, and engineering.
The first thing you'll do is set up the environment, install CUDA, and get a handle on using Python libraries like PyCUDA and CuPy. You'll then dive into memory management, kernel execution, and parallel patterns like reductions and histogram computations. Then, we'll dive into sorting and search techniques, but with a focus on how GPU acceleration transforms business data processing. We'll also put a strong emphasis on linear algebra to show you how to supercharge classic vector and matrix operations with cuBLAS and CuPy. Plus, with batched computations, efficient broadcasting, custom kernels, and mixed-library workflows, you can tackle both standard and advanced problems with ease.
Throughout, we evaluate numerical accuracy and performance side by side, so you can understand both the strengths and limitations of GPU-based solutions. The book covers nearly every essential skill and modern toolkit for practical GPU programming, but it's not going to turn you into a master overnight.
Key Learnings
Boost processing speed and efficiency for data-intensive tasks. Use CuPy and PyCUDA to write and execute custom CUDA kernels. Maximize GPU occupancy and throughput efficiency by using optimal thread block and grid configuration. Reduce global memory bottlenecks in kernels by using shared memory and coalesced access patterns. Perform dynamic kernel compilation to ensure tailored performance. Use CuPy to carry out custom, high-speed elementwise GPU operations and expressions. Implement bitonic and radix sort algorithms for large or batch integer datasets. Execute parallel linear search kernels to detect patterns rapidly. Scale matrix operations using Batched GEMM and high-level cuBLAS routines.
Table of Content
Introduction to GPU Fundamentals Setting up GPU Programming Environment Basic Data Transfers and Memory Types Simple Parallel Patterns Introduction to Kernel Optimization Working with PyCUDA and CuPy Features Practical Sorting and Search Linear Algebra Essentials on GPU
Packages
This Book Only
PDF
EPUB
English
This Book + Extras Downloadable (Python Data Science Cookbook)
Includes:
Python Data Science Cookbook
Practical solutions across fast data cleaning, processing, and machine learning workflows with pandas, NumPy, and scikit-learn
PDF
EPUB
English
This Book + Extras Downloadable (Parallel Python with Dask)
Includes:
Parallel Python with Dask
Make code reusable and deployed for high performance web apps
PDF
EPUB
English
This Book + Extras Downloadable (Practical Python Backend Programming)
Includes:
Practical Python Backend Programming
Build Flask and FastAPI applications, asynchronous programming, containerization and deploy apps on cloud
PDF
EPUB
English
Table of Contents
- Introduction to GPU Fundamentals
- Setting up GPU Programming Environment
- Basic Data Transfers and Memory Types
- Simple Parallel Patterns
- Introduction to Kernel Optimization
- Working with PyCUDA and CuPy Features
- Practical Sorting and Search
- Linear Algebra Essentials on GPU
The Leanpub 60 Day 100% Happiness Guarantee
Within 60 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
Now, this is technically risky for us, since you'll have the book or course files either way. But we're so confident in our products and services, and in our authors and readers, that we're happy to offer a full money back guarantee for everything we sell.
You can only find out how good something is by trying it, and because of our 100% money back guarantee there's literally no risk to do so!
So, there's no reason not to click the Add to Cart button, is there?
See full terms...
Earn $8 on a $10 Purchase, and $16 on a $20 Purchase
We pay 80% royalties on purchases of $7.99 or more, and 80% royalties minus a 50 cent flat fee on purchases between $0.99 and $7.98. You earn $8 on a $10 sale, and $16 on a $20 sale. So, if we sell 5000 non-refunded copies of your book for $20, you'll earn $80,000.
(Yes, some authors have already earned much more than that on Leanpub.)
In fact, authors have earnedover $14 millionwriting, publishing and selling on Leanpub.
Learn more about writing on Leanpub
Free Updates. DRM Free.
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers) and EPUB (for phones, tablets and Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
Learn more about Leanpub's ebook formats and where to read them