Learn network programming and data structures by building a Redis-like server from scratch with C/C++.

Paperbacks

What Is This Book About?

This book contains a step-by-step walkthrough of a simple implementation of a Redis-like server. It is intended as a practical guide or tutorial to network programming and the implementation and application of basic data structures in C.

What to Learn From This Book?

Redis could be considered one of the building blocks of modern computing that stood the test of time. The knowledge required for building such a project is broader and deeper than usual application-level development. Learning from such projects is a good way for software developers to level up their skills.

Redis is a good target for learning because it covers two important subjects of software engineering: network programming and data structures.

• While there are many guides on socket APIs or high-level libraries, network programming is more than calling APIs or libraries. It is important to understand core concepts such as the event loop, protocols, timers, etc, which this book will cover. The lack of understanding can result in fatal mistakes even if you are just employing high-level networking libraries or frameworks in your applications.
• Although many people learned some basic data structures from textbooks, there is still something more to learn. Data structures implemented in real projects often have some practical considerations which are not touched by textbooks. Learning how data structures are used in a non-toy environment (especially in C) is a unique experience from building Redis.

Like most real-world projects, Redis is a complex project built with lots of effort, which can be hard to grasp for beginners. Instead, this book takes an opposite approach: learning by building things from scratch.

Why From Scratch?

A couple of points:

• To learn faster. By building things from scratch, concepts can be introduced gradually. Starting from the small, adding things incrementally, and getting the big picture in the end.
• To learn deeper. While there are many materials explaining how an existing stuff works, the understanding obtained by reading those materials is often not the same as building the stuff yourself. It is easy to mistake memorization for understanding, and it’s easier to pick up unimportant details than principles and basics.
• To learn more. The “from scratch” approach forces you to touch every aspect of the subject — there are no shortcuts to knowledge! And often not every aspect is known to you beforehand, you may discover “things I don’t know I don’t know” in the process.

Summarized in a quote from Feynman: “What I cannot create, I do not understand”.

Learn databases from the bottom up by coding your own, in small steps, and with simple Go code (language agnostic).

• Atomicity & durability. A DB is more than files!
• Persist data with fsync.
• Crash recovery.
• KV store based on B-tree.
• Disk-based data structures.
• Space management with a free list.
• Relational DB on top of KV.
• Learn how tables and indexes are related to B-trees.
• SQL-like query language; parser & interpreter.
• Concurrent transactions with copy-on-write data structures.

Paperback.

You may also like my other book: Build Your Own Redis.

Build a compiler to learn how programming languages work. Use low-level assembly to learn how computers work.

Walks through a minimal yet complete compiler implementation. Compiles a static-typed language into x64 ELF executables.

1. Simple interpreter. Get your own programming language up and running.
2. Bytecode compiler. A step closer to the machine.
3. x64 assembly & instruction encoding. Understand how the machine works.
4. Translate bytecode to x64 code. Bridging the virtual machine to the real machine.
5. Generate binary executables. Putting it all together.

Paperbacks.

Web version of the interpreter chapters.

You may also like: Build Your Own X Series