Operation Slowburn : A Forensic Reconstruction

https://leanpub.com/forensic-ai

Incident Premise and Cluster Configuration

https://leanpub.com/forensic-ai

What are these components ?

https://leanpub.com/forensic-aihttps://leanpub.com/forensic-ai
Two-Tier Leaf-Spine FAT-Tree (200 Gbps RoCE v2)
https://leanpub.com/forensic-ai
Single-Hop Rail-Optimized Nic-Switch Mapping
https://leanpub.com/forensic-ai
GPUDIRECT RDMA & KERNEL-BYPASS
https://leanpub.com/forensic-ai
O(N) Latency Scaling in NCCL Default Ring
https://leanpub.com/forensic-ai
Silent PCIe Link Downtraining (GEN 5 x16 → GEN 3 x4)
https://leanpub.com/forensic-ai
IEEE 802.1Qbb PFC Pause-Frame Cascades & HEAD-OF-LINE (HoL) Blocking
https://leanpub.com/forensic-ai

The Blind Spot of Single-Node Telemetry

https://leanpub.com/forensic-ai
Host CPU Telemetry and the RDMA Paradox
https://leanpub.com/forensic-ai
Node-Local Integrity vs. Cluster Coordination
https://leanpub.com/forensic-ai

The Forensic Investigation

https://leanpub.com/forensic-ai

Finding the Ring Topology Bottleneck

https://leanpub.com/forensic-ai

What did we learn & next steps

https://leanpub.com/forensic-ai

Implement In-Band & Switch-Level Telemetry (gNMI / INT)

https://leanpub.com/forensic-ai

Mandate Pre-Flight Synthetic Canaries

https://leanpub.com/forensic-ai

Shift from Static Thresholds to Statistical Tail Tracking

https://leanpub.com/forensic-ai

Decouple Containment from Hardware Replacement

https://leanpub.com/forensic-ai

Suggested Multi-Layer Monitoring Reference Matrix

https://leanpub.com/forensic-ai

From Reactive Firefighting to Architectural Discipline

https://leanpub.com/forensic-ai

Previous

The Synchronization Problem

Up next

Specialized Networking Technologies