Build Your Own X — Books, Books Tutorials, and Paid Resources
A consolidated guide to books, paid tutorials, and 3rd-party courses that support each of the 26 Build Your Own X projects in this curriculum.
Every project has a free path in its tutorial (Theory & research section). This page is the purchase shortlist — what to buy when you want the polished, paginated, single-source version.
Reading order
Use this page as a shopping list, not a reading list. Pick the project you intend to build, find its row, decide whether the free or paid path fits your style, and stop. Do not buy more than two books at once. The risk of "expensive bookshelf, no shipped code" is real.
Featured: build-your-own.org (James Smith's book series)
The single most direct mapping to our curriculum. James Smith publishes a series of "Build Your Own ___" books, all available with free online Part I + paid eBook/paperback for the complete version. Site: build-your-own.org.
| Book | Maps to our tutorial | Notes |
|---|---|---|
| Build Your Own Redis with C/C++ | Database (Key-Value) | C/C++. Network programming + KV data structures. Free Part I on the web. |
| Build Your Own Database From Scratch | Database (Relational) | Go. From B+ Tree → SQL in 3,000 lines. Free Part I on the web. |
| From Source Code To Machine Code | Compiler | Python. Compiles to x64 ELF executables. Free Part I (interpreter) on the web. |
| Build Your Own Web Server From Scratch In Node.JS | Web Server | Node.js. Socket → HTTP → WebSocket. Free Part I on the web. |
Honest recommendation: if you intend to do the KV/database/compiler/web-server tutorials, James Smith's books are the cleanest single-author throughline you can buy. Otherwise, mix the alternatives below.
Featured: CodeCrafters paid challenges
codecrafters.io offers paid step-by-step graded challenges with the BYO-X branding. You write code locally; their test suite grades each stage. Subscription-based (~$30–40/month).
Maps to our tutorials:
Honest recommendation: CodeCrafters works well if you respond to graded incremental feedback. The challenges are intentionally underspec'd — you're expected to consult external resources. Pair with our tutorials (which name the resources) for the strongest learning loop.
Foundations phase
1. Neural Network from Scratch
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Andrej Karpathy, "Neural Networks: Zero to Hero" | YouTube series + GitHub | Free | Canonical primary path |
| Michael Nielsen, Neural Networks and Deep Learning | Online book | Free | Best free print-style coverage of backprop |
| Goodfellow, Bengio, Courville, Deep Learning | Free PDF + MIT Press paperback | Free / $50 | Textbook depth on theory |
| Sebastian Raschka, Machine Learning with PyTorch and Scikit-Learn | Packt paperback | ~$50 | Practical ML companion |
2. Build Your Own LLM (GPT from Scratch)
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Karpathy, "Let's build GPT: from scratch" + nanoGPT repo | YouTube + GitHub | Free | Canonical primary path. 2 hours of video. |
| Sebastian Raschka, Build a Large Language Model (From Scratch) | Manning, paperback + eBook | ~$40 eBook / ~$50 paperback | ⭐ Primary purchase recommendation. 7 chapters, full code on GitHub. Companion free 48-part YouTube series. |
| Karpathy, "Let's build the GPT Tokenizer" | YouTube | Free | BPE tokenizer companion to the GPT lecture |
| Hugging Face NLP Course | Online course | Free | Practical companion using HuggingFace tooling |
3. 3D Renderer (Ray Tracer)
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Peter Shirley, Ray Tracing in One Weekend series | Free web + Kindle eBook | Free / ~$3 Kindle tip | ⭐ Canonical primary path. Three books. |
| Pharr, Jakob, Humphreys, Physically Based Rendering: From Theory To Implementation (PBRT) | Free online + MIT Press paperback | Free / ~$110 paperback | ⭐ The textbook for production renderers. Massive but unparalleled. |
| Scratchapixel | Free online textbook | Free | First-principles derivations |
| Foley, van Dam, Feiner, Hughes, Computer Graphics: Principles and Practice (3rd ed) | Addison-Wesley | ~$110 | Comprehensive graphics textbook |
Systems phase
4. Memory Allocator
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Bryant & O'Hallaron, Computer Systems: A Programmer's Perspective (CSAPP, 3rd ed) | Pearson hardcover | ~$120 | ⭐ Chapter 9 (Virtual Memory) is the canonical allocator reference |
| Doug Lea, "A Memory Allocator" | Free essay | Free | The dlmalloc design notes — primary technical source |
| Marwan Burelle, "Malloc Tutorial" | Free PDF | Free | 30-page hands-on walkthrough |
5. Shell
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Stephen Brennan, "Tutorial - Write a Shell in C" | Free blog post | Free | Canonical primary path, ~250 lines |
| Michael Kerrisk, The Linux Programming Interface | No Starch Press, hardcover | ~$100 | ⭐ Definitive Linux systems programming reference. Chapters 27–28, 44 (fork, exec, pipes). |
| Stevens & Rago, Advanced Programming in the UNIX Environment (APUE, 3rd ed) | Addison-Wesley hardcover | ~$70 | The Unix systems bible. Chapters 8, 14, 15. |
| CodeCrafters "Build Your Own Shell" | Subscription | ~$30/mo | POSIX-compliance focused graded challenge |
6. Interpreter (Tree-Walking)
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Robert Nystrom, Crafting Interpreters | Free online + paperback (Genever Benning) | Free / ~$40 paperback | ⭐ Primary purchase recommendation. The canonical text. Part II = this tutorial. |
| Thorsten Ball, Writing An Interpreter In Go | eBook + paperback | ~$39 eBook | Excellent Go alternative. Smaller, more concentrated. |
| CodeCrafters "Build Your Own Interpreter" | Subscription | ~$30/mo | Graded Lox interpreter |
7. Compiler
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Robert Nystrom, Crafting Interpreters | Free + paperback | Free / ~$40 paperback | ⭐ Same book, Part III is bytecode VM compiler |
| Nora Sandler, Writing a C Compiler | No Starch Press paperback | ~$60 | ⭐ For the "compile to x86 assembly" path. Two-volume book. |
| Thorsten Ball, Writing A Compiler In Go | eBook | ~$29 eBook (or $50 bundled with interpreter book) | Go bytecode VM, builds on Ball's interpreter book |
| James Smith, From Source Code To Machine Code | build-your-own.org | Free Part I + eBook/paperback | Python, compiles to x64 ELF. |
| Aho, Sethi, Ullman, Compilers: Principles, Techniques, and Tools (Dragon Book, 2nd ed) | Pearson hardcover | ~$100 | The standard reference. Encyclopedic. |
8. Text Editor (kilo-style)
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Snaptoken, "Build Your Own Text Editor" | Free tutorial | Free | ⭐ Canonical primary path. 184 incremental steps. |
| Philipp Flenker, "Hecto" (Rust port) | Free tutorial | Free | Rust alternative, same structure |
No major paid book exists for terminal text editors. The free tutorials are sufficient.
9. Git
| Resource | Format | Price tier | Why |
|---|---|---|---|
| James Coglan, Building Git | eBook + paperback | ~$30 eBook | ⭐ Primary purchase recommendation. The single best book on Git internals. Ruby. |
| Scott Chacon & Ben Straub, Pro Git (2nd ed) | Free + Apress paperback | Free / ~$45 paperback | Chapter 10 (Git Internals) is the canonical free reference |
| Thibault Polge, "Write yourself a Git!" | Free tutorial | Free | Python walkthrough |
| CodeCrafters "Build Your Own Git" | Subscription | ~$30/mo | Graded challenge |
10. Emulator (CHIP-8 / Game Boy)
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Cowgod's CHIP-8 Technical Reference | Free | Free | Canonical spec |
| Tobias V. Langhoff, "Guide to making a CHIP-8 emulator" | Free | Free | Best modern guide |
| Pan Docs (Game Boy) | Free | Free | The Game Boy reverse-engineering bible |
| Steven Hugg, Making 8-bit Arcade Games in C | Paperback | ~$25 | For 8-bit / NES-adjacent retro game programming |
| Patterson & Hennessy, Computer Organization and Design | Morgan Kaufmann | ~$110 | The CPU architecture textbook. Chapter 4. |
11. Operating System
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Phil Opp, "Writing an OS in Rust" | Free blog series | Free | ⭐ Canonical primary path. Modern x86_64 + Rust. |
| Arpaci-Dusseau, Operating Systems: Three Easy Pieces (OSTEP) | Free + paperback | Free / ~$60 paperback | ⭐ The best modern OS textbook. Read in parallel with Phil Opp. |
| Tanenbaum & Bos, Modern Operating Systems (5th ed) | Pearson hardcover | ~$220 | Classic. Less hands-on. |
| Silberschatz, Operating System Concepts (10th ed) | Wiley hardcover | ~$150 | "Dinosaur book". Widely used in CS curricula. |
12. Network Stack (TCP/IP)
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Saminiir, "Let's code a TCP/IP stack" | Free 5-part blog | Free | ⭐ Canonical primary tutorial |
| Beej, Guide to Network Programming | Free online + Kindle | Free / ~$3 Kindle | Sockets fundamentals |
| Stevens, Fenner, Rudoff, Unix Network Programming, Volume 1 (3rd ed) | Addison-Wesley hardcover | ~$80 | The canonical sockets book |
| Stevens & Wright, TCP/IP Illustrated, Vol. 1: The Protocols (2nd ed) | Addison-Wesley hardcover | ~$70 | ⭐ Packet-by-packet protocol walkthrough |
| Peterson & Davie, Computer Networks: A Systems Approach | Free + paperback | Free / ~$80 paperback | Modern undergraduate networking textbook |
13. Docker / Container Runtime
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Liz Rice, "Containers from Scratch" | Free YouTube | Free | ⭐ The canonical 30-minute live-coded intro |
| Liz Rice, Container Security | O'Reilly paperback | ~$50 | ⭐ Definitive book on container internals + security |
| Liz Rice, Learning eBPF | O'Reilly paperback | ~$50 | Companion for the kernel-side of container observability |
14. BitTorrent Client
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Jesse Li, "Building a BitTorrent client from the ground up in Go" | Free blog | Free | ⭐ Canonical primary tutorial. No paid alternative needed. |
| BEP 3: BitTorrent Protocol Specification | Free | Free | The 6-page protocol spec |
| CodeCrafters "Build Your Own BitTorrent" | Subscription | ~$30/mo | Graded challenge |
15. Regex Engine
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Russ Cox, "Regular Expression Matching" series | Free articles | Free | ⭐ Canonical technical source. 4 articles. |
| Jeffrey Friedl, Mastering Regular Expressions (3rd ed) | O'Reilly paperback | ~$50 | Best book on using regex deeply (less about building an engine, but illuminates internals) |
| CodeCrafters "Build Your Own grep" | Subscription | ~$30/mo | Graded regex-engine-flavored challenge |
Architecture phase
16. Database (Key-Value)
| Resource | Format | Price tier | Why |
|---|---|---|---|
| James Smith, Build Your Own Redis with C/C++ | build-your-own.org | Free Part I + paid eBook/paperback | ⭐ Primary purchase recommendation. Step-by-step Redis-from-scratch. |
| Martin Kleppmann, Designing Data-Intensive Applications (DDIA) | O'Reilly paperback (2nd ed available on Early Release) | ~$60 | ⭐ Chapter 3 (Storage and Retrieval) is canonical for KV design. Useful across every Architecture project. |
| Alex Petrov, Database Internals | O'Reilly paperback | ~$50 | Storage engine deep dive |
| CodeCrafters "Build Your Own Redis" | Subscription | ~$30/mo | Graded Redis-protocol-compliant server |
17. Database (Relational / SQL)
| Resource | Format | Price tier | Why |
|---|---|---|---|
| James Smith, Build Your Own Database From Scratch | build-your-own.org | Free Part I + paid eBook/paperback | ⭐ Primary purchase recommendation. Go. B+ tree → SQL in 3,000 lines. |
| Connor Stack, "Let's Build a Simple Database" | Free tutorial | Free | Canonical C-based sqlite-clone walkthrough |
| Alex Petrov, Database Internals | O'Reilly | ~$50 | B+ tree, transactions, MVCC depth |
| Martin Kleppmann, DDIA | O'Reilly | ~$60 | Chapter 7 (Transactions) |
| Garcia-Molina, Ullman, Widom, Database Systems: The Complete Book | Pearson hardcover | ~$200 | Stanford's textbook. Comprehensive. |
| CodeCrafters "Build Your Own SQLite" | Subscription | ~$30/mo | Graded SQLite-clone challenge |
18. Search Engine
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Manning, Raghavan, Schütze, Introduction to Information Retrieval | Free online + Cambridge paperback | Free / ~$70 paperback | ⭐ The canonical IR textbook |
| Doug Turnbull & John Berryman, Relevant Search | Manning paperback | ~$50 | ⭐ Practical book on real-world relevance with Lucene/Solr/Elasticsearch |
| Bart de Goede, "How to Build a Search Engine" | Free GitHub repo | Free | Python walkthrough |
19. Web Server (HTTP from scratch)
| Resource | Format | Price tier | Why |
|---|---|---|---|
| James Smith, Build Your Own Web Server From Scratch In Node.JS | build-your-own.org | Free Part I + paid eBook/paperback | ⭐ Primary purchase recommendation. Node.js. Network programming + HTTP + WebSocket. |
| Ruslan Spivak, "Let's Build A Web Server" | Free 3-part blog | Free | Canonical Python tutorial on concurrency model progression |
| David Gourley & Brian Totty, HTTP: The Definitive Guide | O'Reilly paperback | ~$60 | HTTP protocol reference |
| CodeCrafters "Build Your Own HTTP Server" | Subscription | ~$30/mo | Graded HTTP server challenge |
20. Web Browser Engine
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Pavel Panchekha & Chris Harrelson, Web Browser Engineering | Free online + Oxford University Press paperback | Free / ~$50 paperback | ⭐ Primary purchase recommendation. The book on building browser engines. Python. |
| Matt Brubeck, "Let's build a browser engine!" | Free 8-part blog | Free | Rust alternative. Predecessor of Servo. |
21. Kafka-like Distributed Log
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Travis Jeffery, Distributed Services with Go | Pragmatic Bookshelf | ~$50 | ⭐ Primary purchase recommendation. Builds a Kafka-like service with gRPC + Raft + service discovery. |
| Shapira, Palino, Sivaram, Petty, Kafka: The Definitive Guide (2nd ed) | O'Reilly paperback | ~$60 | Real Kafka reference |
| Jay Kreps, "The Log: What every software engineer should know about real-time data's unifying abstraction" | Free essay | Free | The foundational essay by Kafka's co-creator |
| CodeCrafters "Build Your Own Kafka" | Subscription | ~$30/mo | Graded Kafka challenge |
22. Consensus / Raft
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Diego Ongaro, "Consensus: Bridging Theory and Practice" (PhD thesis) | Free PDF | Free | The Raft thesis. 250 pages. Section 4 covers every corner case. |
| Eli Bendersky, "Implementing Raft" | Free 5-part blog | Free | ⭐ Canonical Go tutorial |
| Martin Kleppmann, DDIA | O'Reilly paperback | ~$60 | Chapter 9 (Consistency and Consensus) |
| MIT 6.5840 Distributed Systems | Free course + labs | Free | ⭐ The graded Raft labs. Free video lectures on YouTube. |
23. Blockchain
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Andreas Antonopoulos, Mastering Bitcoin (3rd ed) | O'Reilly paperback + free on GitHub | Free / ~$55 paperback | ⭐ Primary purchase recommendation. The definitive Bitcoin book. |
| Satoshi Nakamoto, "Bitcoin: A Peer-to-Peer Electronic Cash System" | Free 9-page paper | Free | The original whitepaper |
| Daniel van Flymen, "Learn Blockchains by Building One" | Free article | Free | Canonical Python tutorial |
| Jeiwan, "Building Blockchain in Go" | Free 7-part blog | Free | Most thorough free tutorial |
| Princeton, "Bitcoin and Cryptocurrency Technologies" | Coursera | Free (audit) | Strong CS foundations course |
Production phase
24. Front-end Framework (React-like)
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Rodrigo Pombo, "Build your own React" | Free tutorial | Free | ⭐ Canonical primary path. 15 steps. |
| Tejas Kumar, Fluent React | O'Reilly paperback | ~$60 | ⭐ Primary purchase recommendation. Deep dive into React internals — VDOM, reconciliation, fibers. |
| Dan Abramov, "Overreacted" | Free blog | Free | Many posts on React internals by a core contributor |
| CodeCrafters "Build Your Own React" | Subscription | ~$30/mo | Graded React-like framework challenge |
25. 2D Game Engine
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Robert Nystrom, Game Programming Patterns | Free online + paperback (Genever Benning) | Free / ~$30 paperback | ⭐ Primary purchase recommendation. Same author as Crafting Interpreters. |
| Jason Gregory, Game Engine Architecture (3rd ed) | CRC Press hardcover | ~$80 | ⭐ The industrial game engine textbook. Comprehensive. |
| Glenn Fiedler, "Fix Your Timestep!" | Free essay | Free | The canonical game-loop article |
| Roguelike Dev "Complete Roguelike Tutorial" (Python) | Free | Free | Substantial roguelike walkthrough |
| bracketproductions, "Roguelike Tutorial in Rust" | Free book | Free | Rust alternative |
| Casey Muratori, Handmade Hero | Free videos | Free | The deepest "build everything from scratch" series; 1,000+ episodes |
26. Physics Engine
| Resource | Format | Price tier | Why |
|---|---|---|---|
| Randy Gaul, "How to Create a Custom Physics Engine" | Free 6-part tutorial | Free | ⭐ Canonical primary path |
| Ian Millington, Game Physics Engine Development (2nd ed) | CRC Press / Routledge paperback | ~$65 | ⭐ Primary purchase recommendation. The only book on building a complete physics engine from scratch. |
| Christer Ericson, Real-Time Collision Detection | Morgan Kaufmann hardcover | ~$95 | ⭐ The collision algorithm reference |
| Erin Catto's Box2D papers & GDC talks | Free PDFs | Free | Behind-the-scenes of the canonical 2D physics engine |
| Glenn Fiedler, "Gaffer on Games" | Free | Free | Networking + physics + prediction articles |
General-purpose CS textbooks (apply across multiple projects)
These reward purchase because they're referenced by many of our tutorials:
| Book | Covers projects | Price |
|---|---|---|
| Kleppmann, Designing Data-Intensive Applications | Database KV, Database Relational, Kafka-like, Consensus, Search Engine | ~$60 |
| Petrov, Database Internals | Database KV, Database Relational, Kafka-like | ~$50 |
| Kerrisk, The Linux Programming Interface (TLPI) | Shell, Docker, Network Stack, OS | ~$100 |
| Bryant & O'Hallaron, Computer Systems: A Programmer's Perspective (CSAPP) | Memory Allocator, OS, Emulator, Compiler | ~$120 |
| Nystrom, Crafting Interpreters | Interpreter, Compiler | ~$40 |
| Arpaci-Dusseau, Operating Systems: Three Easy Pieces (OSTEP) | OS, Memory Allocator, Docker | Free / ~$60 |
| Aho/Sethi/Ullman, Compilers (Dragon Book) | Interpreter, Compiler, Regex Engine | ~$100 |
| Stevens et al., Unix Network Programming | Network Stack, Web Server, BitTorrent | ~$80 |
| Nystrom, Game Programming Patterns | Game Engine, Physics Engine | ~$30 |
| Manning et al., Introduction to Information Retrieval | Search Engine, LLM (for RAG) | Free / ~$70 |
Suggested purchase tiers
If you want to start with a small budget and grow:
Tier 1 — Starter ($0–50)
- Crafting Interpreters (paperback ~$40) — covers Interpreter + Compiler
- OR the equivalent free online version + one James Smith book of your choice from build-your-own.org
Tier 2 — Foundational shelf (~$200)
Add the books that unlock multiple tutorials:
- Designing Data-Intensive Applications (Kleppmann) — Architecture-phase backbone
- Operating Systems: Three Easy Pieces (OSTEP paperback) — Systems-phase backbone
- The Linux Programming Interface (TLPI) — Systems-phase reference
Tier 3 — Project-specific deep dives
For each tutorial you actively work on, add the ⭐-marked book from that tutorial's row above. Add one at a time, not all at once.
Tier 4 — Subscription
CodeCrafters (~$30/month) if you respond well to graded feedback. Cancel between projects to control cost.
What this guide does not recommend
For the sake of honesty:
- Bootcamps that promise to teach you "to build your own X" in 4 weeks. Most ship surface-level material. The free + book combination above is better.
- YouTube series with no GitHub repo. The repo is the contract. If the code is missing, the tutorial is theatre.
- Anything called "Build Your Own X in 30 Minutes." 30 minutes is enough to learn what X is. Not enough to build it.
- Books on "system design" or "software architecture" as a substitute for building. Those books are useful alongside projects, not instead of them.
The Feynman quote that opens build-your-own-x's README — "What I cannot create, I do not understand" — is the entire pedagogy. Buy a book; build the thing; understand it.
Maintenance note
Prices and editions change. URLs are current as of the time of writing. If a book is out of print, check Amazon used or eBay; most of these have long shelf lives.
If you find a paid resource you'd recommend that isn't listed, the addition criteria are:
- Maps to one of our 26 tutorials, or is a general CS reference that supports 3+ of them.
- Has a clear author and publisher (no "AI-generated farm" books).
- Has an actual code repository or is a textbook of recognized standing.