Leanpub Header

Skip to main content

Through the Eye of the Eagle: Finding the Soviet Path to Supercomputing

HPC Tradecraft Apprenticeship, Volume 4

Through the Eye of the Eagle: Finding the Soviet Path to Supercomputing

In May 1905, Imperial Russian battleship Orel was still upright and still fighting, despite similar damage at the Battle of Tsushima, while her three identical sisters already lay at the ocean's bottom. She survived because one man's mathematics had been studied, aboard ship, all the way from the Baltic, around Africa, to the Pacific. This is the story of what Soviet supercomputing learned from making numbers answer for lives, and what a multi-billion-dollar industry forgot by 2019.

Interested in this book? Show your support by saying what you'd like to pay for it!

$
PDF
EPUB
About

About

About the Book

The Imperial Russian battleship Orel (Eagle in English) should have capsized at the Battle of Tsushima. Her three Borodino-class sisters did, each turning keel-uppermost before sinking out of sight. Orel stayed upright because shipbuilder Vladimir Kostenko spent his voyage from the Baltic, around Africa and to the Pacific, studying Alexei N. Krylov's mathematics of unsinkability and prepared her for controlled flooding (to keep her upright).

When numbers decide who drowns, mathematics acquires a consequence that modern computing, with its rollbacks and do-overs, has largely forgotten.

Through the Eye of the Eagle follows that thread of consequence forward from Kostenko's battle report, which was heavily contested by those responsible for the disaster; through Krylov's 1906 lectures on approximate calculations; through Academician Viktor Glushkov and Candidate Ekaterina L. Yushchenko's Kiev computer (classified a State Secret) revealed in 1962; and into the reduced-precision arithmetic that powers today's machine learning.

The method throughout is the same: work directly from Soviet and pre-Soviet primary sources, reproduce the calculations ourselves, and lay the results side by side so you can see the through line for yourself, rather than taking it on trust.

Three ideas organize the journey:

  • Economy of precision. Krylov's insight that a measurement only good to within 5% cannot honestly be reported to six decimal places, and his formula (derived from the Laplace theorem, direct ancestor of the Central Limit Theorem) showing how rounding error accumulates with the square root of the number of operations.
  • Overcoming the barrier. The Kiev computer's group instructions, which fold a loop's increment-and-test into a single hardware instruction, turn 4n instructions into 3n+1 instructions for a scalar product of two vectors. That seems pointless, being the same number of operations, but in first generation computers, instruction fetch was an order of magnitude slower than register-to-register operations. The Kiev computer converted the instruction-fetch barrier into a sharp advantage.
  • Economy of calculation. Academicians Gurii I. Marchuk and Andrei P. Ershov, and Dr. Mikhail R. Shura-Bura, exemplify what a computing culture builds when it invests in people rather than hardware. Ershov realized that multiplying by zero always produces zero, and multiplying by one always produces the operand, so his compiler completely removed instructions multiplying by zero or one before runtime.

Glushkov, in 1962, documented "the well-known rule of A.N. Krylov" to use an extra (decimal) digit of precision to encompass accumulating rounding errors. That rule can be derived from Krylov's published lectures, and Glushkov's phrasing suggests the rule was oral tradition.

This book's provocative example is that the West surfaced Krylov's rule twice in 2019: once via Higham and Mary's paper on probabilistic error analysis, and again with Sakr et al. writing about bit precision during deep-learning accumulation. Krylov's teaching on approximate calculations regained relevance because AI/ML floating-point arithmetic is not infinite precision, and therefore each calculation is an approximation.

When placing Krylov (1906), Glushkov (1962), Higham and Mary (2019), and Sakr et al. (2019) side by side, the difference is striking. All ask the same fundamental question concerning precision and validity of calculated results, state the same basic premise (rounding errors independent of each other, centered on zero, therefore tending to cancel each other out), with differing calculation models (manual calculations originating with shipbuilding; fixed-point digital arithmetic; floating-point mantissa; constrained coefficient/mantissa combinations), and differing conclusions. What, then, is the striking difference?

  • Krylov and Glushkov remain anchored in physical reality and produce engineering results directly applicable to the task at hand.
  • Higham and Mary begin with hardware-based premises and continue (section 3) "We now apply Theorem 2.4 within the error analysis of a variety of algorithms in numerical linear algebra." The opening sentence (section 1) addresses "the rise of large-scale, mixed-precision computations" but the ensuing discussion shifts from hardware to software, abstracting away from the hardware constraint in sharp contrast to Glushkov.
  • Sakr et al. begin (abstract, first sentence) "Efforts to reduce the numerical precision of computations" based in hardware, measure and graph three specific benchmarks, state "these are very encouraging signs" (last statement before conclusion), conclude (section 6) "our theoretical concepts are application agnostic" and claim (last statement of abstract) "Overall this analysis enables precise tailoring of computation hardware to the application, yielding area- and power-optimal systems."

Both 2019 papers are well-respected, and rightly so. The striking difference is the shift away from remaining grounded in physical reality. This shift began in 1995 when we began hiding physical reality behind abstractions. We disconnected problem from solution, and both papers exemplify this shift. An entire generation has grown up on the assumption of infinite hardware availability. Not of infinite-precision hardware, but of the availability of more hardware to spin up as needed.

Unlike Soviet (and U.S.) supercomputing of the 1960s, modern AI/ML high-performance computing has become a frantic and supremely unnecessary buildout of countless new data centers: a multi-billion-dollar mistake in progress.

This century-wide comparison is not a priority dispute. Each mathematician was answering a slightly different question, demonstrating that the same invariant keeps surfacing. Technology changes, but the mathematics, and the physics, do not.

A board of stellar Academicians gathered in 1948 to issue the multi-volume Collected Works of Krylov. I caught two numeric errors in the 1911 Lectures on Approximate Calculations, Chapter V, Section 51 (page 189), so I checked the Collected Works. The Collected Works has both errors corrected to the values I expected (page 191).

Share this book

Author

About the Author

Edward W. Barnard

No Time to Be Beginners

What was it like to stand in the breach, with nobody else to take the decisions, and do-overs are too late? Margaret Hamilton, the first programmer hired for the Apollo project at MIT, explained:

Because software was a mystery, a black box, upper management gave us total freedom and trust. We had to find a way and we did. Looking back, we were the luckiest people in the world; there was no choice but to be pioneers; no time to be beginners.

During the Cold War when it was "nobody but us," our decisions and solutions were shaped by constraints. At Cray Research constraints and barriers pointed us to the best point of leverage. To remain the best in the world, we had no other option. But before considering leverage, we carefully identified and proved relevant capabilities. Those capabilities showed us what solutions might be plausible. We also found that if it wasn't fun, it probably was not worth doing.

This forced way of working, where responsibility could not be abstracted away, has been mostly lost to time.

My Role as Custodian of Lost Skills

I am bringing you those skills because they were never passed to the next generation. I created a primary source document showing what it was like: Nobody but Us: A History of Cray Research's Software and the Building of the World's Fastest Supercomputer. But I wrote a second primary source, reproducing the Cray Research skills for you right now, in 2026. The Wizard's Lens: Learn to Think Like AI is an apprenticeship drawing you in to experience, not merely read about, how we continuously "achieved the impossible" at Cray Research.

Those Cray Research skills did not begin with software, or even hardware. They began outdoors. Experiential education, with real risks and real consequences, has also been abstracted away. That is where judgement is formed. For this I wrote Surviving Spring Break on the Mountain: The Power of Experiential Education.

Pure Entertainment

If it isn't fun, it probably isn't worth doing. I continued practicing the most important debugging skill I know: spotting patterns and connections that others miss. I wrote Unexpected Histories to show you shifted perspectives, purely for entertainment, but showing real history that matters today. In each case, once you see it, you cannot "un-see" it.

Эдвард Барнард

Когда нет времени быть новичком

Каково это — стоять на переднем крае, когда больше некому принимать решения и на повторные попытки уже нет времени? Маргарет Хэмилтон, первый программист, нанятый для проекта Apollo в MIT, объясняла это так:

Поскольку программное обеспечение было загадкой, «чёрным ящиком», высшее руководство предоставило нам полную свободу и доверие. Мы должны были найти выход — и мы его нашли. Оглядываясь назад, можно сказать, что мы были самыми везучими людьми в мире: у нас не было выбора, кроме как быть первопроходцами; не было времени на ученичество.

Во времена холодной войны, когда всё сводилось к принципу «никто, кроме нас», наши решения и подходы формировались под давлением жёстких ограничений. В Cray Research именно ограничения и барьеры указывали нам на наиболее эффективную точку приложения усилий. У нас просто не было иного пути, кроме как стать лучшими в мире. Но прежде чем прилагать усилия, мы тщательно искали и проверяли соответствующие компетенции. Именно они показывали, какие решения вообще могут быть осуществимы. Мы также поняли: если дело не приносит удовольствия — вероятно, не стоит им заниматься.

Этот вынужденный стиль работы, при котором ответственность нельзя переложить на других, почти утрачен со временем.

Моя роль как хранителя утраченных навыков

Я передаю вам эти навыки, потому что они так и не были переданы следующему поколению. Я написал книгу воспоминаний о том, как это было на самом деле: Nobody but Us: A History of Cray Research's Software and the Building of the World's Fastest Supercomputer. («Только мы: история программного обеспечения Cray Research и создания самого быстрого суперкомпьютера в мире»). Но я написал и вторую книгу, возрождающую стиль мышления Cray Research для вас прямо сейчас, в 2026 году. The Wizard's Lens: Learn to Think Like AI («Линза волшебника: научитесь думать как ИИ») — это учебник, который погружает вас в атмосферу и дает опыт, а не просто рассказывает о том, как мы постоянно «достигали невозможного» в Cray Research.

Истоки подхода Cray Research лежат не в программном обеспечении и даже не в железе, а в холодной реальности жизни. Обучение через опыт, с реальными рисками и реальными последствиями, подвергнутое переосмыслению. Именно так формируется суждение. Об этом я написал книгу Surviving Spring Break on the Mountain: The Power of Experiential Education («Выжить на весенних каникулах в горах: сила обучения через опыт»).

Чистое развлечение

Если это не приносит удовольствия — вероятно, этим не стоит заниматься. Я продолжал практиковать самый важный навык профессионального отладчика, который знаю: замечать закономерности и связи, которые другие упускают. Я написал Unexpected Histories («Неожиданные истории»), чтобы показать вам смещенные перспективы — исключительно ради развлечения, но опираясь на реальную историю, которая имеет значение и сегодня. В любом случае, увидев это однажды, вы уже не сможете «развидеть» увиденное.

The Leanpub Podcast

Podcast

Podcast Episode

The Leanpub 60 Day 100% Happiness Guarantee

Within 60 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.

See full terms...

Earn $8 on a $10 Purchase, and $16 on a $20 Purchase

We pay 80% royalties on purchases of $7.99 or more, and 80% royalties minus a 50 cent flat fee on purchases between $0.99 and $7.98. You earn $8 on a $10 sale, and $16 on a $20 sale. So, if we sell 5000 non-refunded copies of your book for $20, you'll earn $80,000.

(Yes, some authors have already earned much more than that on Leanpub.)

In fact, authors have earned over $15 million writing, publishing and selling on Leanpub.

Learn more about writing on Leanpub

Free Updates. DRM Free.

If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).

Most Leanpub books are available in PDF (for computers) and EPUB (for phones, tablets and Kindle). The formats that a book includes are shown at the top right corner of this page.

Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.

Learn more about Leanpub's ebook formats and where to read them

Write and Publish on Leanpub

You can use Leanpub to easily write, publish and sell in-progress and completed ebooks and online courses!

Leanpub is a powerful platform for serious authors, combining a simple, elegant writing and publishing workflow with a store focused on selling in-progress ebooks.

Leanpub is a magical typewriter for authors: just write in plain text, and to publish your ebook, just click a button. (Or, if you are producing your ebook your own way, you can even upload your own PDF and/or EPUB files and then publish with one click!) It really is that easy.

Learn more about writing on Leanpub