Build Your First LLM
Build Your First LLM
A Hands-On Guide to Language Models—No PhD Required
About the Book
This book shows you how to build your own large language model from scratch. Not just use tools like ChatGPT, but actually understand and create the technology behind them.
It’s written for curious beginners: you don’t need a CS degree, advanced math, or prior programming experience—just a laptop, Google Colab, and the patience to follow along step by step.
The book is organized as one continuous, hands-on project:
- Foundations – what AI and LLMs really are, why they work, and where their limits are.
- Python Crash Course – just enough Python and essential libraries to understand and run real models.
- Build Your First LLM – implement tokenization, embeddings, attention, and the full Transformer architecture.
- Make It Useful – fine-tuning, prompt design, and building practical applications on top of your model.
- Ship It – options for deployment and running your model in the real world.
Every concept is explained in plain language, with analogies instead of jargon, and every line of code is walked through in detail. You’ll run existing models in minutes, then gradually replace the black box with pieces you built yourself.
All code is designed to run in Google Colab, with a dedicated notebook for each chapter linked directly inside the book. The notebooks are also available on GitHub at https://github.com/FirstLLM/code. To help you check your understanding, the book includes example answers to the review questions in an appendix.
⚠️ Early access notice: This is an in-progress book. Parts I and II are largely complete, and later chapters are being added and refined over time (including recent updates to Chapters 5–7). Buyers get all future updates for free.
Table of Contents
- Preface
- Part I: Foundations
- Chapter 1: What is AI, Really?
- Chapter 2: How Computers "Understand" Words
- Chapter 3: The Attention Mechanism
- Chapter 4: The Transformer Architecture
- Part II: Python Crash Course
- Chapter 5: Your First Python Program
- Chapter 6: NumPy & PyTorch Survival Guide
- Part III: Build Your First LLM
- Chapter 7: Preparing Your Data
- Chapter 8: Building the Tokenizer
- Chapter 9: The Embedding Layer
- Chapter 10: Attention Is All You Need
- Chapter 11: Building the Transformer
- Chapter 12: Training Your Model
- Part IV: Make It Actually Useful
- Chapter 13: Fine-Tuning Your Model
- Chapter 14: Prompt Engineering
- Chapter 15: Building Applications
- Part V: Share It With The World
- Chapter 16: Preparing for Production
- Chapter 17: Deployment Options
- Chapter 18: What’s Next
- Appendices
- Appendix A: Troubleshooting Guide
- Appendix B: Glossary
- Appendix C: Math Refresher
- Appendix D: Hardware Guide
- Appendix E: Review Question Answers
The Leanpub 60 Day 100% Happiness Guarantee
Within 60 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
Now, this is technically risky for us, since you'll have the book or course files either way. But we're so confident in our products and services, and in our authors and readers, that we're happy to offer a full money back guarantee for everything we sell.
You can only find out how good something is by trying it, and because of our 100% money back guarantee there's literally no risk to do so!
So, there's no reason not to click the Add to Cart button, is there?
See full terms...
Earn $8 on a $10 Purchase, and $16 on a $20 Purchase
We pay 80% royalties on purchases of $7.99 or more, and 80% royalties minus a 50 cent flat fee on purchases between $0.99 and $7.98. You earn $8 on a $10 sale, and $16 on a $20 sale. So, if we sell 5000 non-refunded copies of your book for $20, you'll earn $80,000.
(Yes, some authors have already earned much more than that on Leanpub.)
In fact, authors have earnedover $14 millionwriting, publishing and selling on Leanpub.
Learn more about writing on Leanpub
Free Updates. DRM Free.
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers) and EPUB (for phones, tablets and Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
Learn more about Leanpub's ebook formats and where to read them