Practical GPU Programming (This Book Only )
$29.99
Minimum price
$29.99
Suggested price

Practical GPU Programming

High-performance computing with CUDA, CuPy, and Python on modern GPUs

About the Book

If you're a Python pro looking to get the most out of your code with GPUs, then Practical GPU Programming is the right book for you. This book will walk you through the basics of GPU architectures, show you hands-on parallel programming techniques, and give you the know-how to confidently speed up real workloads in data processing, analytics, and engineering.

The first thing you'll do is set up the environment, install CUDA, and get a handle on using Python libraries like PyCUDA and CuPy. You'll then dive into memory management, kernel execution, and parallel patterns like reductions and histogram computations. Then, we'll dive into sorting and search techniques, but with a focus on how GPU acceleration transforms business data processing. We'll also put a strong emphasis on linear algebra to show you how to supercharge classic vector and matrix operations with cuBLAS and CuPy. Plus, with batched computations, efficient broadcasting, custom kernels, and mixed-library workflows, you can tackle both standard and advanced problems with ease.

Throughout, we evaluate numerical accuracy and performance side by side, so you can understand both the strengths and limitations of GPU-based solutions. The book covers nearly every essential skill and modern toolkit for practical GPU programming, but it's not going to turn you into a master overnight.

Key Learnings

Boost processing speed and efficiency for data-intensive tasks. Use CuPy and PyCUDA to write and execute custom CUDA kernels. Maximize GPU occupancy and throughput efficiency by using optimal thread block and grid configuration. Reduce global memory bottlenecks in kernels by using shared memory and coalesced access patterns. Perform dynamic kernel compilation to ensure tailored performance. Use CuPy to carry out custom, high-speed elementwise GPU operations and expressions. Implement bitonic and radix sort algorithms for large or batch integer datasets. Execute parallel linear search kernels to detect patterns rapidly. Scale matrix operations using Batched GEMM and high-level cuBLAS routines.

Table of Content

Introduction to GPU Fundamentals Setting up GPU Programming Environment Basic Data Transfers and Memory Types Simple Parallel Patterns Introduction to Kernel Optimization Working with PyCUDA and CuPy Features Practical Sorting and Search Linear Algebra Essentials on GPU

  • Share this book

  • Categories

    • Computer Hardware
    • Python
    • Software Engineering
    • Graphics
  • Feedback

    Email the Author(s)

About the Author

GitforGits | Asian Publishing House
GitforGits | Asian Publishing House

GitforGits is an Asian publishing house where knowledgeable experts and open-source contributors collaborate to disseminate new ideas and innovations. We plan to provide niche, original, and useful content; we are a self-funded, independent publisher. We have books spanning the fields of computer science, cybersecurity, cloud computing, devops, deep learning, hardware programming, networking, the Internet of Things, and any other area of technology to which we can satisfactorily contribute.

Packages

This Book Only
  • PDF

  • EPUB

  • English

$29.99
Minimum price
$29.99
Suggested price
This Book + Extras Downloadable (Python Data Science Cookbook)

Includes:

  • extras
    Python Data Science Cookbook

    Practical solutions across fast data cleaning, processing, and machine learning workflows with pandas, NumPy, and scikit-learn

  • PDF

  • EPUB

  • English

$49.99
Minimum price
$56.99
Suggested price
This Book + Extras Downloadable (Parallel Python with Dask)

Includes:

  • extras
    Parallel Python with Dask

    Make code reusable and deployed for high performance web apps

  • PDF

  • EPUB

  • English

$49.99
Minimum price
$56.99
Suggested price
This Book + Extras Downloadable (Practical Python Backend Programming)

Includes:

  • extras
    Practical Python Backend Programming

    Build Flask and FastAPI applications, asynchronous programming, containerization and deploy apps on cloud

  • PDF

  • EPUB

  • English

$49.99
Minimum price
$56.99
Suggested price

Table of Contents

Table of Content
  1. Introduction to GPU Fundamentals
  2. Setting up GPU Programming Environment
  3. Basic Data Transfers and Memory Types
  4. Simple Parallel Patterns
  5. Introduction to Kernel Optimization
  6. Working with PyCUDA and CuPy Features
  7. Practical Sorting and Search
  8. Linear Algebra Essentials on GPU

The Leanpub 60 Day 100% Happiness Guarantee

Within 60 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.

Now, this is technically risky for us, since you'll have the book or course files either way. But we're so confident in our products and services, and in our authors and readers, that we're happy to offer a full money back guarantee for everything we sell.

You can only find out how good something is by trying it, and because of our 100% money back guarantee there's literally no risk to do so!

So, there's no reason not to click the Add to Cart button, is there?

See full terms...

Earn $8 on a $10 Purchase, and $16 on a $20 Purchase

We pay 80% royalties on purchases of $7.99 or more, and 80% royalties minus a 50 cent flat fee on purchases between $0.99 and $7.98. You earn $8 on a $10 sale, and $16 on a $20 sale. So, if we sell 5000 non-refunded copies of your book for $20, you'll earn $80,000.

(Yes, some authors have already earned much more than that on Leanpub.)

In fact, authors have earnedover $14 millionwriting, publishing and selling on Leanpub.

Learn more about writing on Leanpub

Free Updates. DRM Free.

If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).

Most Leanpub books are available in PDF (for computers) and EPUB (for phones, tablets and Kindle). The formats that a book includes are shown at the top right corner of this page.

Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.

Learn more about Leanpub's ebook formats and where to read them

Write and Publish on Leanpub

You can use Leanpub to easily write, publish and sell in-progress and completed ebooks and online courses!

Leanpub is a powerful platform for serious authors, combining a simple, elegant writing and publishing workflow with a store focused on selling in-progress ebooks.

Leanpub is a magical typewriter for authors: just write in plain text, and to publish your ebook, just click a button. (Or, if you are producing your ebook your own way, you can even upload your own PDF and/or EPUB files and then publish with one click!) It really is that easy.

Learn more about writing on Leanpub