[{"_1":2,"_3":-5,"_4":-5},"loaderData",{"_5":6,"_7":8},"actionData","errors","root",{"_29":-5,"_39":-5,"_40":41,"_42":43,"_44":45,"_46":47,"_48":49,"_50":51,"_52":53,"_54":55,"_56":57,"_58":59},"routes/_store+/_readers+/email_author.$slug/route",{"_9":10,"_11":-5,"_12":-5},"book",{"_13":14,"_15":16,"_17":18,"_19":20,"_21":22,"_23":24},"currentUser","formToken","id","Z2lkOi8vbGVhbnB1Yi9TdG9yZTo6Qm9va1Byb2R1Y3QvODQ4NjM","title","Building High-Performance LLM Inference Engines in C","state","published","contactAuthorMethod","email","aboutText","

This book takes you from the mathematical foundations of transformer inference all the way to a complete, working large language model inference engine written in portable C. You will understand exactly how transformers generate text one token at a time, how weights are stored and loaded from SafeTensors format, how KV caching makes inference practical, and how to optimize every component for performance. By the final chapter you will have a genuinely executable program that loads a real TinyLlama-1.1B model from HuggingFace, tokenizes your prompt, runs the full transformer forward pass on your CPU, maintains the KV cache, and streams generated text to your terminal. No pseudocode, no placeholders, no exercises left for you to implement on your own: every line of code is provided, explained, and tested as a complete end-to-end system.

","authors",[25],{"_13":26,"_27":28,"_29":30},"Z2lkOi8vbGVhbnB1Yi9TdG9yZTo6UHJvZHVjdEF1dGhvci85MDUxOQ","name","Steve Publications","user",{"_31":32},"avatar",{"_33":34,"_35":36,"_37":38},"url","https://d39qdlcrvnra4b.cloudfront.net/avatars/3084982/medium/avatar.jpg?1784309602","styleName","medium","exists",true,"shoppingCartId","shoppingCart",{"_13":72,"_73":74,"_75":38,"_76":77,"_78":79,"_80":81,"_82":38},"locale","en","readerTheme","light","constants",{"_70":71},"publishers",{"_66":67,"_68":69},"learnerOrganizations",[],"needsLocaleCookieSync",false,"announcements",{"_60":61,"_62":-5},"sentryEnvironment","production","sentryRelease","7209a500138c944f01a543318390dfeb80e53e84","announcement_store",{"_63":53,"_64":65},"announcement_authors","flag","text","

Kick off your book project, get started with GhostAI, get better at marketing, or spend the day doing all three! Free live workshops on Zoom. Saturday, June 27, 2026.

\n","companies",[],"universities",[],"paypalClientId","AX53Cwz8jR6rVVzzZiZNWWXl0dGagi-GZrjG-S3Ua14E5nrKMn7DxDQ730O4R8LusLPp49ALn6aRVaEy","no-cart","count",0,"free","updatedAt","","paymentGateway","STRIPE","cartItems",[],"loading"]

Email the Author