Rapid Forecasting Likely Staff, Cost and Delivery Dates of Agile Software Projects
About the Book
Ever since writing computer software became a profession, people have asked how long it will take; And for this entire time, the answers given haven't matched reality as much as hoped. Due to the demand to improve this skill, a myriad of processes have been developed trying to put some rigor into getting accurate date and cost forecasts, and this book describes my thoughts on such a process called Lean Forecasting.
Assuming estimation of software projects upfront will resemble reality is like expecting a long haul flight with multiple connections will only take as long as the in-air flying time. By ignoring the time taken to travel to and from the airport, checking in, passing through multiple security checkpoints, dealing with immigration officers, waiting baggage arrival we would severely underestimate the total travel time. Throw in a few weather delays, headwinds, equipment failure, or other mishap causing a missed connection, and the concept of “just the flying time” for travel time is obviously an underestimate. Given we can understand there is more to flying than just air-time, why do we persist in thinking software “development and testing time” equates to software deliver time? We make this assumption every time we estimate software upfront using story points or any other process that largely ignores the complexity of the underlying delivery system. Lean Forecasting doesn't suffer from this assumption.
What is Lean Forecasting? Lean Forecasting is a set of techniques that help you perform rapid and accurate modeling of a software delivery system in order to answer tough questions about the odds of certain delivery dates, risk, staff size and skill ratios. This is a lightweight approach that adapts to any team and project size.
Traditional agile forecasting techniques are time consuming, erroneous (especially early estimates) and don't offer any substantial guidance into staffing levels and skill set balance. Any measure of certainty is also lacking in current methods. Either there is a single date with the assumption of 100% certainty, or a range that is so large (with the high date so far into the future) that projects get cancelled before they begin. The process described here outperforms standard forecasting in accuracy and level of detail with less effort. Lean Forecasting not only gives delivery dates and cost, it provides the likelihood of hitting those targets, and the impact of various staff level and skill set balance on these forecasts. Finding a staffing and budget forecast solution is easier than ever before. Tracking progress and departure from plan is easier than before.
Lean Forecasting uses simple models and historical data (when available) to forecast likely future outcomes. These models allow rapid what-if experiments to be performed in order to judge the impact of changes to staffing, requirements and quality. I decided to call this technique Lean Forecasting after reading The Lean Startup: How Today's Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses by Eric Ries. His methodical process for performing experiments and altering course (what he calls pivoting) a business based on the quantitative results and customer feedback (data) resonated with my own thoughts. It was clear the same techniques applied to running a software project and process where the experiments were based on modeling would also yield significant benefit. In Lean Forecasting, I take the same principles and apply them to the planning, staffing and forecasting aspects of software development.
The concept of Lean Forecasting is simple: through early and continual small experiments you make validated changes to a process and team with confidence. Small experiments allow you to reduce the risk and initial pain of change. Early improvements have more impact because they gather benefit for a longer period of time. Pretty simple concepts, and I hope you can quickly grasp, benefit and expand my initial ideas.
What does Lean forecasting offer -
- Rapid early life cycle forecasting of project date and cost (determine viability, compare options)
- Ongoing tracking of plan versus actual project status (determine likelihood of on-time, prioritize problem areas)
- Match staffing levels and skill set to a project at multiple phases and stages of a project (balance skill sets, ramp up and down at the right time, who to hire next)
- Risk management integration with forecasting likelihood (is risk growing or shrinking, what is its potential impact of delay, what is the cost of that delay)
Lean Forecasting offers these benefits by using a variety of proven mathematical and statistical techniques, although much of this complexity is hidden from you. It achieves accuracy by eliminating conversion errors from various units of size measure (points, ideal hours, etc) to calendar time, and by modeling often missed effort. There is an emphasis on modeling the entire software delivery system rather than just the development and test time. Software delivery systems are complex systems, and perform in chaotic ways (small changes of inputs can have a non-linear impact on result). In an attempt to make software estimation easier and less time consuming a variety of techniques have been invented. However, in reducing the time to estimate, they also lost a significant portion of their accuracy.
This book has three parts -
- The forecasting problems to be solved (Chapter 1)
- The current forecasting techniques and where they fall short (Chapter 2)
- All about Lean Forecasting (Chapter 3 onwards)
Chapter 1 introduces the need for forecasting. A lot has been written on estimation effort and waste, and this chapter outlines the broader business need and use of forecasts. A lot of passion surrounds this subject, and the thrust of this chapter is: If you are saying estimation is waste because it's hard and we are bad at it, then keep an open mind for a process that makes it easier and gives usable results.
Chapter 2 looks at the current methods used for estimating and forecasting software projects. It isn’t intended to bash current processes needlessly. In order to understand why current forecasts are inadequate, the cause of errors and inaccuracies in need to be understood and contrasted.
Chapter 3 defines Lean Forecasting and the benefits (cost and certainty) by employing it in your company. By the end of this chapter you will understand the goals and how to quantify the benefits of Lean Forecasting to your peers and managers.
Chapter 4 demonstrates in detail how to use Lean Forecasting for delivery date and cost forecasting. This is the entry level of the Lean Forecasting techniques, and is a great starting point to understand implementation and use.
Chapter 5 shows how more detail about projects can be captured and incorporated into forecasts. Whilst the initial forecasts built in Chapter 4 are accurate, there is little guidance as to what project factors/levers have the most impact. This chapter shows you how to model in more detail and build an ordered list of factors from most impacting to least impacting and to quantify these in time and cost.
Chapter 6 introduces how to make important decisions on staffing size and skill sets. Modeling the impact of work throughput (flow) because of staff skill imbalance within a team offers major schedule and cost improvements. By the end of this chapter you will understand how to analyze this and quantify the impact of different staffing solutions over different phases of a project.
The Leanpub 45-day 100% Happiness Guarantee
Within 45 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
See full terms
Free Updates. DRM Free.
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers), EPUB (for phones and tablets) and MOBI (for Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
El Manual del ManagerKeyvan Akbary, Félix López, and Álvaro Salazar
¿Has deseado alguna vez el haber tenido una buena introducción al rol del Engineering Manager? En este libro aprenderás lo necesario para ejercer el rol de una manera efectiva: Expectativas y Responsabilidades del Rol, 1-1s, Ayudar a Crecer, Objetivos, Planes de Carrera, Cultura, Feedback, Contratación, Cultura de Producto y mucho más.
Functional Design and ArchitectureAlexander Granin
Software Design in Functional Programming, Design Patterns and Practices, Methodologies and Application Architectures. How to build real software in Haskell with less efforts and low risks. The first complete source of knowledge.
Ansible for KubernetesJeff Geerling
Ansible is a powerful infrastructure automation tool. Kubernetes is a powerful application deployment platform. Learn how to use these tools to automate massively-scalable, highly-available infrastructure.
Ansible for DevOpsJeff Geerling
Ansible is a simple, but powerful, server and configuration management tool. Learn to use Ansible effectively, whether you manage one server—or thousands.
Practical FP in Scala: A hands-on approachGabriel Volpe
A practical book aimed for those familiar with functional programming in Scala who are yet not confident about architecting an application from scratch.
Together, we will develop a purely functional application using the best libraries in the Cats ecosystem, while learning about design patterns and best practices.
Tame your Work FlowSteve Tendon and Daniel Doiron
Do you need a high performance enterprise governance approach improving management, execution and delivery while dealing with multiple projects/products, events, stakeholders and teams? Giving you better bottom line results, faster time to market, less work, better predictability, happier employees, and delighted clients? Then learn about TameFlow!
C++ Best PracticesJason Turner
Level up your C++, get the tools working for you, eliminate common problems, and move on to more exciting things!
Cloud StrategyGregor Hohpe
“Strategy is the difference between making a wish and making it come true.” A successful migration to the cloud shouldn’t be driven by wishes, but guided by a sound strategy, frameworks, and decision models. This book tells you how—without becoming superficial nor getting lost in technology and product details.
Machine Learning EngineeringAndriy Burkov
"If you intend to use machine learning to solve business problems at scale, I'm delighted you got your hands on this book."
—Cassie Kozyrkov, Chief Decision Scientist at Google
"Foundational work about the reality of building machine learning models in production."
—Karolis Urbonas, Head of Machine Learning and Science at Amazon
Composing SoftwareEric Elliott
All software design is composition: the act of breaking complex problems down into smaller problems and composing those solutions. Most developers have a limited understanding of compositional techniques. It's time for that to change.
11 BooksThe Quality Software Bundle is for managers, would-be managers, and any of us who find themselves being managed and confused. This comprehensive bundle covers the entire span of software development approaches, from hacking through waterfall, cascade, prototyping, Iterative enhancement, reusable code, off-the-shelf, to Agile teams. The bundle...
The Node.js Bundle
3 BooksThis bundle combines three bestselling Leanpub Node.js books into a package that gives you everything you need to get started with developing Node.js applications at an unbeatable price.
The Tester's Library
8 BooksThe Tester's Library consists of eight five-star books that every software tester should read and re-read. As bound books, this collection would cost over $200. Even as e-books, their price would exceed $80, but in this bundle, their cost is only $49.99. Here are the books, and why they should be in your library: Perfect Software and Other...
11 BooksIn this bundle, you will find 10 different agile books. They are about different aspects of being agile. - finding a job - doing coding dojo's - Retrospectives - Personal kanban - a non-typical coaching book and even a book that gives you an insight in the lives of some agile people.
WTFlop 6M + HU - Beta Bundle
Marionette.js A to Z
Complete Scala Bundle
3 BooksScala is a general-purpose programming language and it's getting extremely popular these days. Some say that learning Scala could be a challenging task. My experience, however, suggests that this is actually a myth that has very little to do with reality. With the right approach, learning Scala can be easy, fun and rewarding.The first book from...
Build A Better Backbone App
3 BooksThe best way to learn new development skills is through experience, but that takes time you don't have.Get the best of both worlds with this bundle: you'll learn how to produce modern web applications by learning from experienced developers like Derick Bailey and David Sulc. BackboneJS is one of the favorite tools on the web today, but it...
People Skills—Soft but Difficult
7 BooksPerhaps you've been told that "lack of people skills" has been holding you back. No wonder: you may have had hundreds of hours of technical training, but little or no "people skills" guidance.You've heard it said that people skills are "soft," whereas technical skills are "hard." For you, though, technical skills are "easy," but people skills...
SurviveJS - Webpack + React
2 BooksGet both SurviveJS - Webpack and SurviveJS - React for a single price!