The Leanpub 60 Day 100% Happiness Guarantee
Within 60 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
See full terms...
HPC Tradecraft Apprenticeship, Volume 4
In May 1905, Imperial Russian battleship Orel was still upright and still fighting, despite similar damage at the Battle of Tsushima, while her three identical sisters already lay at the ocean's bottom. She survived because one man's mathematics had been studied, aboard ship, all the way from the Baltic, around Africa, to the Pacific. This is the story of what Soviet supercomputing learned from making numbers answer for lives, and what a multi-billion-dollar industry forgot by 2019.
Interested in this course? Show your support by saying what you'd like to pay for it!
About the Course
The Imperial Russian battleship Orel (Eagle in English) should have capsized at the Battle of Tsushima. Her three Borodino-class sisters did, each turning keel-uppermost before sinking out of sight. Orel stayed upright because shipbuilder Vladimir Kostenko spent his voyage from the Baltic, around Africa and to the Pacific, studying Alexei N. Krylov's mathematics of unsinkability and prepared her for controlled flooding (to keep her upright).
When numbers decide who drowns, mathematics acquires a consequence that modern computing, with its rollbacks and do-overs, has largely forgotten.
Through the Eye of the Eagle follows that thread of consequence forward from Kostenko's battle report, which was heavily contested by those responsible for the disaster; through Krylov's 1906 lectures on approximate calculations; through Academician Viktor Glushkov and Candidate Ekaterina L. Yushchenko's Kiev computer (classified a State Secret) revealed in 1962; and into the reduced-precision arithmetic that powers today's machine learning.
The method throughout is the same: work directly from Soviet and pre-Soviet primary sources, reproduce the calculations ourselves, and lay the results side by side so you can see the through line for yourself, rather than taking it on trust.
Three ideas organize the journey:
Glushkov, in 1962, documented "the well-known rule of A.N. Krylov" to use an extra (decimal) digit of precision to encompass accumulating rounding errors. That rule can be derived from Krylov's published lectures, and Glushkov's phrasing suggests the rule was oral tradition.
This book's provocative example is that the West surfaced Krylov's rule twice in 2019: once via Higham and Mary's paper on probabilistic error analysis, and again with Sakr et al. writing about bit precision during deep-learning accumulation. Krylov's teaching on approximate calculations regained relevance because AI/ML floating-point arithmetic is not infinite precision, and therefore each calculation is an approximation.
When placing Krylov (1906), Glushkov (1962), Higham and Mary (2019), and Sakr et al. (2019) side by side, the difference is striking. All ask the same fundamental question concerning precision and validity of calculated results, state the same basic premise (rounding errors independent of each other, centered on zero, therefore tending to cancel each other out), with differing calculation models (manual calculations originating with shipbuilding; fixed-point digital arithmetic; floating-point mantissa; constrained coefficient/mantissa combinations), and differing conclusions. What, then, is the striking difference?
Both 2019 papers are well-respected, and rightly so. The striking difference is the shift away from remaining grounded in physical reality. This shift began in 1995 when we began hiding physical reality behind abstractions. We disconnected problem from solution, and both papers exemplify this shift. An entire generation has grown up on the assumption of infinite hardware availability. Not of infinite-precision hardware, but of the availability of more hardware to spin up as needed.
Unlike Soviet (and U.S.) supercomputing of the 1960s, modern AI/ML high-performance computing has become a frantic and supremely unnecessary buildout of countless new data centers: a multi-billion-dollar mistake in progress.
This century-wide comparison is not a priority dispute. Each mathematician was answering a slightly different question, demonstrating that the same invariant keeps surfacing. Technology changes, but the mathematics, and the physics, do not.
A board of stellar Academicians gathered in 1948 to issue the multi-volume Collected Works of Krylov. I caught two numeric errors in the 1911 Lectures on Approximate Calculations, Chapter V, Section 51 (page 189), so I checked the Collected Works. The Collected Works has both errors corrected to the values I expected (page 191).
About the Instructor
What was it like to stand in the breach, with nobody else to take the decisions, and do-overs are too late? Margaret Hamilton, the first programmer hired for the Apollo project at MIT, explained:
Because software was a mystery, a black box, upper management gave us total freedom and trust. We had to find a way and we did. Looking back, we were the luckiest people in the world; there was no choice but to be pioneers; no time to be beginners.
During the Cold War when it was "nobody but us," our decisions and solutions were shaped by constraints. At Cray Research constraints and barriers pointed us to the best point of leverage. To remain the best in the world, we had no other option. But before considering leverage, we carefully identified and proved relevant capabilities. Those capabilities showed us what solutions might be plausible. We also found that if it wasn't fun, it probably was not worth doing.
This forced way of working, where responsibility could not be abstracted away, has been mostly lost to time.
I am bringing you those skills because they were never passed to the next generation. I created a primary source document showing what it was like: Nobody but Us: A History of Cray Research's Software and the Building of the World's Fastest Supercomputer. But I wrote a second primary source, reproducing the Cray Research skills for you right now, in 2026. The Wizard's Lens: Learn to Think Like AI is an apprenticeship drawing you in to experience, not merely read about, how we continuously "achieved the impossible" at Cray Research.
Those Cray Research skills did not begin with software, or even hardware. They began outdoors. Experiential education, with real risks and real consequences, has also been abstracted away. That is where judgement is formed. For this I wrote Surviving Spring Break on the Mountain: The Power of Experiential Education.
If it isn't fun, it probably isn't worth doing. I continued practicing the most important debugging skill I know: spotting patterns and connections that others miss. I wrote Unexpected Histories to show you shifted perspectives, purely for entertainment, but showing real history that matters today. In each case, once you see it, you cannot "un-see" it.
Каково это — стоять на переднем крае, когда больше некому принимать решения и на повторные попытки уже нет времени? Маргарет Хэмилтон, первый программист, нанятый для проекта Apollo в MIT, объясняла это так:
Поскольку программное обеспечение было загадкой, «чёрным ящиком», высшее руководство предоставило нам полную свободу и доверие. Мы должны были найти выход — и мы его нашли. Оглядываясь назад, можно сказать, что мы были самыми везучими людьми в мире: у нас не было выбора, кроме как быть первопроходцами; не было времени на ученичество.
Во времена холодной войны, когда всё сводилось к принципу «никто, кроме нас», наши решения и подходы формировались под давлением жёстких ограничений. В Cray Research именно ограничения и барьеры указывали нам на наиболее эффективную точку приложения усилий. У нас просто не было иного пути, кроме как стать лучшими в мире. Но прежде чем прилагать усилия, мы тщательно искали и проверяли соответствующие компетенции. Именно они показывали, какие решения вообще могут быть осуществимы. Мы также поняли: если дело не приносит удовольствия — вероятно, не стоит им заниматься.
Этот вынужденный стиль работы, при котором ответственность нельзя переложить на других, почти утрачен со временем.
Я передаю вам эти навыки, потому что они так и не были переданы следующему поколению. Я написал книгу воспоминаний о том, как это было на самом деле: Nobody but Us: A History of Cray Research's Software and the Building of the World's Fastest Supercomputer. («Только мы: история программного обеспечения Cray Research и создания самого быстрого суперкомпьютера в мире»). Но я написал и вторую книгу, возрождающую стиль мышления Cray Research для вас прямо сейчас, в 2026 году. The Wizard's Lens: Learn to Think Like AI («Линза волшебника: научитесь думать как ИИ») — это учебник, который погружает вас в атмосферу и дает опыт, а не просто рассказывает о том, как мы постоянно «достигали невозможного» в Cray Research.
Истоки подхода Cray Research лежат не в программном обеспечении и даже не в железе, а в холодной реальности жизни. Обучение через опыт, с реальными рисками и реальными последствиями, подвергнутое переосмыслению. Именно так формируется суждение. Об этом я написал книгу Surviving Spring Break on the Mountain: The Power of Experiential Education («Выжить на весенних каникулах в горах: сила обучения через опыт»).
Если это не приносит удовольствия — вероятно, этим не стоит заниматься. Я продолжал практиковать самый важный навык профессионального отладчика, который знаю: замечать закономерности и связи, которые другие упускают. Я написал Unexpected Histories («Неожиданные истории»), чтобы показать вам смещенные перспективы — исключительно ради развлечения, но опираясь на реальную историю, которая имеет значение и сегодня. В любом случае, увидев это однажды, вы уже не сможете «развидеть» увиденное.
Episode 317
An Interview with Edward W. Barnard
Within 60 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
See full terms...
We pay 80% royalties on purchases of $7.99 or more, and 80% royalties minus a 50 cent flat fee on purchases between $0.99 and $7.98. You earn $8 on a $10 sale, and $16 on a $20 sale. So, if we sell 5000 non-refunded copies of your book for $20, you'll earn $80,000.
(Yes, some authors have already earned much more than that on Leanpub.)
In fact, authors have earned over $15 million writing, publishing and selling on Leanpub.
Learn more about writing on Leanpub
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers) and EPUB (for phones, tablets and Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
Learn more about Leanpub's ebook formats and where to read them
You can use Leanpub to easily write, publish and sell in-progress and completed ebooks and online courses!
Leanpub is a powerful platform for serious authors, combining a simple, elegant writing and publishing workflow with a store focused on selling in-progress ebooks.
Leanpub is a magical typewriter for authors: just write in plain text, and to publish your ebook, just click a button. (Or, if you are producing your ebook your own way, you can even upload your own PDF and/or EPUB files and then publish with one click!) It really is that easy.