Memory Dump Analysis Anthology, Volume 2, Revised Edition
Memory Dump Analysis Anthology, Volume 2, Revised Edition
About the Book
This reference volume consists of revised, edited, cross-referenced, and thematically organized articles from Software Diagnostics Institute and Software Diagnostics Library (former Crash Dump Analysis blog) written in January - September 2008. In addition to various corrections, this major revision updates relevant links and removes obsolete references. Some articles are preserved for historical reasons. Most of the content, especially memory analysis pattern language, is still relevant today and for the foreseeable future. The output of WinDbg commands is also remastered to include color highlighting. Crash dump analysis pattern names are also corrected to reflect the continued expansion of the catalog.
Compared to the first revised volume, the second revised volume features:
- 44 more crash dump analysis patterns
- Pattern interaction and case studies
- Fully cross-referenced with Volume 1
- New appendixes
The primary audience for Memory Dump Analysis Anthology reference volumes is: software engineers developing and maintaining products on Windows platforms, technical support, escalation, and site reliability engineers dealing with complex software issues, quality assurance engineers testing software on Windows platforms, security and vulnerability researchers, reverse engineers, malware and memory forensics analysts.
About the Author
Table of Contents
Preface 15
Acknowledgments 17
About the Author 18
PART 1: Crash Dumps for Beginners 19
The Time of the Crash 19
Stack Trace 20
EasyDbg 22
Citrix Symbol Server 27
PART 2: Professional Crash Dump Analysis 29
WinDbg Scripts 29
Introduction for C/C++ Users 29
Generating File Name for .dump Command 37
All at Once: Postmortem Logs and Dump Files 38
Common Mistakes 39
Not Looking at Full Stack Traces 39
Not Seeing Semantic and Pragmatic Inconsistencies 41
Pattern Interaction 43
Heuristic Stack Trace 43
Multiple Patterns 50
Exception and Deadlock 55
Heap and Spike 59
Hooksware 63
Heap and Early Crash Dump 65
WinDbg Shortcuts 67
WinDbg as a Binary Editor 67
Command Autocompletion 70
!envvar 71
.quit_lock 72
.dumpcab 73
.f+, .f- 74
.exptr 75
WinDbg as a Simple PE Viewer 76
.sound_notify 79
Signaled Objects 80
Memory Search Revisited 87
WDF and PNP BSOD: Case Study 95
Exploring NDIS Extension 105
The Hunt for the Debugger 109
Complete Dump: User Space Critical Sections 115
Microsoft DLL Help Database 116
What Does This Function Do? 118
What Was This Process Doing? 119
STL and WinDbg 122
WinDbg Cheat Sheet 125
How Old Is Your Application or System? 126
Demystifying First-chance Exceptions 129
.NET Managed Code Analysis in Complete Memory Dumps 131
Who Opened That File? 134
In Search of Lost CID 136
Large Heap Allocations 137
First-order and Second-order Memory Leaks 140
Hooked Modules 145
PART 3: Crash Dump Analysis Patterns 147
Wait Chain (Executive Resources) 147
Corrupt Dump 151
Dispatch Level Spin 154
No Process Dumps 157
No System Dumps 158
Insufficient Memory (PTE) 159
Suspended Thread 161
Special Process 164
Frame Pointer Omission 169
False Function Parameters 173
Message Box 177
Self-Dump 181
Blocked Thread (Software) 184
Zombie Processes 196
Wild Pointer 202
Dynamic Memory Corruption (Kernel Pool) 204
Insufficient Memory (Module Fragmentation) 210
Wild Code 219
Hardware Error 221
Handle Limit (GDI, Kernel Space) 226
Missing Component (General) 233
NULL Pointer (Code) 237
Execution Residue (Unmanaged Space) 239
Optimized VM Layout 267
Invalid Handle (General) 269
Overaged System 273
Thread Starvation (Realtime Priority) 274
Stack Overflow (User Mode) 279
Missing Component (Static Linkage, User Mode) 283
Duplicated Module 294
Not My Version (Software) 299
Data Contents Locality 300
Nested Exceptions (Unmanaged Code) 305
Nested Exceptions (Managed Code) 310
Affine Thread 314
Self-Diagnosis (User Mode) 318
Waiting Thread Time (User Dumps) 319
Inline Function Optimization (Unmanaged Code) 322
Critical Section Corruption 324
Lost Opportunity 332
Young System 335
Last Error Collection 337
Hidden Module 339
High Contention (Critical Sections) 341
PART 4: Crash Dump Analysis AntiPatterns 343
Debugging Architects 343
Symbolless Analysis 344
Myopic Troubleshooting and Debugging 345
PART 5: A Bit of Science 347
Memoretics 347
Memory Analysis 348
Memoidealism 349
Memiotics 350
PART 6: Fun with Crash Dumps 351
Music for Debugging 351
The Glory of Debugging 351
Memory Analysis Album 352
Biography of a Bug 354
Visual Computer Memories 355
The First Defect 356
The Songs for Remote Debugging 357
Thinking Out of the Box 358
Crash Dumps and Science Fiction 359
Colorimetric Computer Memory Dating 360
On CSI Abbreviation 362
The First Memory Dump Book 363
On SOS Abbreviation 365
Software Exceptions: a Paranormal View 366
Bug Entanglement (Bugtanglement) 367
The Standard Model of Debugging 368
Physics of Debugging 369
Can Computers Debug? 371
PART 7: Data Recovery 375
With the Help of Memory Dump Analysis 375
PART 8: Software Troubleshooting 377
Troubleshooter’s Block 377
Causal Models 378
Object-Oriented Debugging and Troubleshooting 379
Component-Based Debugging and Troubleshooting 380
Domain-Driven Debugging and Troubleshooting 381
Myths and Facts about Software Support 382
Ceteris Paribus in Comparative Troubleshooting 383
Dancing in Software Support Environment 384
PARTS: Problem Solving Power of Thought 385
The Hidden Tomb in Pyramid of Software Change 386
Tracing 387
CDF Traces: Analyzing Process Launch Sequence 387
ETW Tracing Tools 389
Lean Tracing 390
DebugWare Patterns 391
API Query 391
Tool Façade 392
Configuration Wrapper 393
Dual Interface 394
Tool Chain 395
Tool Box 396
PART 9: Security 397
Data Hiding in Crash Dumps 397
Hardening Dump Security: Beware of PEB Data 400
PART 10: The Origin of Crash Dumps 401
Memory Dumps from Xen-virtualized Windows 401
Bugchecks: SYSTEM_SERVICE_EXCEPTION 402
Bugcheck Callbacks 406
Application Verifier on x64 Platforms 413
Who Saved the Dump File? 414
ADPlus in 21 Seconds and 13 Steps 416
PART 11: Miscellaneous 425
Three Main Ideas of Debugging 425
Pseudo-corrupt Memory Dumps 426
Win32 Exception Frequencies 427
Bugcheck Frequencies 429
Time Travel Debugging 440
I/O and Memory Priority in Vista 441
Appendix A 443
Crash Dump File Examples 443
Appendix B 445
WinDbg.Org: WinDbg Quick Links 445
Appendix C 447
Dump2Wave Source Code 447
Appendix D 451
Dump2Picture Source Code 451
Appendix E 455
Crash Dump Analysis Checklist 455
CMDTREE.TXT 458
Appendix F 459
Index of WinDbg Commands 460
Cover Images 463
Other books by this author
Authors have earned$9,664,887writing, publishing and selling on Leanpub, earning 80% royalties while saving up to 25 million pounds of CO2 and up to 46,000 trees.
Learn more about writing on Leanpub
The Leanpub 45-day 100% Happiness Guarantee
Within 45 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
See full terms
Free Updates. DRM Free.
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers), EPUB (for phones and tablets) and MOBI (for Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
Learn more about Leanpub's ebook formats and where to read them
Top Books
- #1
El Manual del Manager
Keyvan Akbary, Félix López, and Álvaro Salazar¿Has deseado alguna vez el haber tenido una buena introducción al rol del Engineering Manager? En este libro aprenderás lo necesario para ejercer el rol de una manera efectiva: Expectativas y Responsabilidades del Rol, 1-1s, Ayudar a Crecer, Objetivos, Planes de Carrera, Cultura, Feedback, Contratación, Cultura de Producto y mucho más.
- #2
Functional Design and Architecture
Alexander GraninSoftware Design in Functional Programming, Design Patterns and Practices, Methodologies and Application Architectures. How to build real software in Haskell with less efforts and low risks. The first complete source of knowledge.
- #3
Ansible for Kubernetes
Jeff GeerlingAnsible is a powerful infrastructure automation tool. Kubernetes is a powerful application deployment platform. Learn how to use these tools to automate massively-scalable, highly-available infrastructure.
- #4
CCIE Service Provider Version 4 Written and Lab Exam Comprehensive Guide
Nicholas RussoThe service provider landscape has changed rapidly over the past several years. Networking vendors are continuing to propose new standards, techniques, and procedures for overcoming new challenges while concurrently reducing costs and delivering new services. Cisco has recently updated the CCIE Service Provider track to reflect these changes; this book represents the author's personal journey in achieving that certification.
- #5
CCIE SP v4.1 - Workbook
Łukasz Bromirski, Piotr Jablonski, and Nicholas RussoAre you striving to prepare to and pass CCIE SP lab exam? Take the opportunity and get this workbook! With the attached initial cfg files you will prepare yourself for the CCIE SP exam as well as learn SP technologies applicable to all kinds of today modern networks! This workbook covers blueprint topics and provides challenging examples.
- #6
Practical FP in Scala: A hands-on approach
Gabriel VolpeA practical book aimed for those familiar with functional programming in Scala who are yet not confident about architecting an application from scratch.
Together, we will develop a purely functional application using the best libraries in the Cats ecosystem, while learning about design patterns and best practices.
- #7
Ansible for DevOps
Jeff GeerlingAnsible is a simple, but powerful, server and configuration management tool. Learn to use Ansible effectively, whether you manage one server—or thousands.
- #8
C++ Best Practices
Jason TurnerLevel up your C++, get the tools working for you, eliminate common problems, and move on to more exciting things!
- #9
Tame your Work Flow
Steve Tendon and Daniel DoironDo you need a high performance enterprise governance approach improving management, execution and delivery while dealing with multiple projects/products, events, stakeholders and teams? Giving you better bottom line results, faster time to market, less work, better predictability, happier employees, and delighted clients? Then learn about TameFlow!
- #10
R Programming for Data Science
Roger D. PengThis book brings the fundamentals of R programming to you, using the same material developed as part of the industry-leading Johns Hopkins Data Science Specialization. The skills taught in this book will lay the foundation for you to begin your journey learning data science. Printed copies of this book are available through Lulu.
Top Bundles
- #1
Quality Software
11 Books
The Quality Software Bundle is for managers, would-be managers, and any of us who find themselves being managed and confused. This comprehensive bundle covers the entire span of software development approaches, from hacking through waterfall, cascade, prototyping, Iterative enhancement, reusable code, off-the-shelf, to Agile teams. The bundle... - #2
The Node.js Bundle
3 Books
This bundle combines three bestselling Leanpub Node.js books into a package that gives you everything you need to get started with developing Node.js applications at an unbeatable price. - #3
The Tester's Library
8 Books
The Tester's Library consists of eight five-star books that every software tester should read and re-read. As bound books, this collection would cost over $200. Even as e-books, their price would exceed $80, but in this bundle, their cost is only $49.99. Here are the books, and why they should be in your library: Perfect Software and Other... - #4
agile
11 Books
In this bundle, you will find 10 different agile books. They are about different aspects of being agile. - finding a job - doing coding dojo's - Retrospectives - Personal kanban - a non-typical coaching book and even a book that gives you an insight in the lives of some agile people. - #5
WTFlop 6M + HU - Beta Bundle
6 Books
- #6
Growing Agile: Coach's Guide Series
4 Books
This bundle provides a collection of training and workshop plans for a variety of agile topics. The series is aimed at agile coaches, trainers and ScrumMasters who often find themselves needing to help teams understand agile concepts. Each book in the series provides the plans, slides, handouts and activity instructions to run a number of... - #7
Marionette.js A to Z
3 Books
Marionette.js has become a popular Backbone-based javascript library, because it helps you avoid boiler-plate code and focus on what makes your app special. But how do you get started?Whether you want to finally get started with dynamic client-side programming (like one reader did), or are an experienced front-end dev who has inherited a... - #8
Complete Scala Bundle
3 Books
Scala is a general-purpose programming language and it's getting extremely popular these days. Some say that learning Scala could be a challenging task. My experience, however, suggests that this is actually a myth that has very little to do with reality. With the right approach, learning Scala can be easy, fun and rewarding.The first book from... - #9
Build A Better Backbone App
3 Books
The best way to learn new development skills is through experience, but that takes time you don't have.Get the best of both worlds with this bundle: you'll learn how to produce modern web applications by learning from experienced developers like Derick Bailey and David Sulc. BackboneJS is one of the favorite tools on the web today, but it... - #10
People Skills—Soft but Difficult
7 Books
Perhaps you've been told that "lack of people skills" has been holding you back. No wonder: you may have had hundreds of hours of technical training, but little or no "people skills" guidance.You've heard it said that people skills are "soft," whereas technical skills are "hard." For you, though, technical skills are "easy," but people skills...
