Teaching LLM inference from first principles by building a small engine in C++ and CUDA.
The series follows what happens between a prompt and a generated token, from loading model weights to running each part of the transformer on the GPU.
Read Inference from Scratch (PDF) for 80+ pages of my handwritten notes and diagrams. I developed all of the writing in this PDF myself, with NO AI writing.
Companion notes for every video are in the study-notes index, with separate Markdown and PDF folders. You can also read the complete PDF collection.
