The DevOps 2.5 Toolkit: Monitoring, Logging, and Auto-Scaling Kubernetes
The DevOps 2.5 Toolkit: Monitoring, Logging, and Auto-Scaling Kubernetes
Making Resilient, Self-Adaptive, And Autonomous Kubernetes Clusters
About the Book
Kubernetes is probably the biggest project we know. It is vast, and yet many think that after a few weeks or months of reading and practice they know all there is to know about it. It's much bigger than that, and it is growing faster than most of us can follow. How far did you get in Kubernetes adoption?
From my experience, there are four main phases in Kubernetes adoption.
In the first phase, we create a cluster and learn intricacies of Kube API and different types of resources (e.g., Pods, Ingress, Deployments, StatefulSets, and so on). Once we are comfortable with the way Kubernetes works, we start deploying and managing our applications. By the end of this phase, we can shout "look at me, I have things running in my production Kubernetes cluster, and nothing blew up!" I explained most of this phase in The DevOps 2.3 Toolkit: Kubernetes.
The second phase is often automation. Once we become comfortable with how Kubernetes works and we are running production loads, we can move to automation. We often adopt some form of continuous delivery (CD) or continuous deployment (CDP). We create Pods with the tools we need, we build our software and container images, we run tests, and we deploy to production. When we're finished, most of our processes are automated, and we do not perform manual deployments to Kubernetes anymore. We can say that things are working and I'm not even touching my keyboard. I did my best to provide some insights into CD and CDP with Kubernetes in The DevOps 2.4 Toolkit: Continuous Deployment To Kubernetes.
The third phase is in many cases related to monitoring, alerting, logging, and scaling. The fact that we can run (almost) anything in Kubernetes and that it will do its best to make it fault tolerant and highly available, does not mean that our applications and clusters are bulletproof. We need to monitor the cluster, and we need alerts that will notify us of potential issues. When we do discover that there is a problem, we need to be able to query metrics and logs of the whole system. We can fix an issue only once we know what the root cause is. In highly dynamic distributed systems like Kubernetes, that is not as easy as it looks.
Further on, we need to learn how to scale (and de-scale) everything. The number of Pods of an application should change over time to accommodate fluctuations in traffic and demand. Nodes should scale as well to fulfill the needs of our applications.
Kubernetes already has the tools that provide metrics and visibility into logs. It allows us to create auto-scaling rules. Yet, we might discover that Kuberentes alone is not enough and that we might need to extend our system with additional processes and tools. This phase is the subject of this book. By the time you finish reading it, you'll be able to say that your clusters and applications are truly dynamic and resilient and that they require minimal manual involvement. We'll try to make our system self-adaptive.
I mentioned the fourth phase. That, dear reader, is everything else. The last phase is mostly about keeping up with all the other goodies Kubernetes provides. It's about following its roadmap and adapting our processes to get the benefits of each new release.
Table of Contents
- Preface
- Overview
- About the Author
- Dedication
- Audience
- Requirements
-
Autoscaling Deployments and StatefulSets Based On Resource Usage
- Creating A Cluster
- Observing Metrics Server Data
- Auto-Scaling Pods Based On Resource Utilization
- To Replicas Or Not To Replicas In Deployments And StatefulSets?
- What Now?
-
Auto-Scaling Nodes Of A Kubernetes Cluster
- Creating A Cluster
- Setting Up Cluster Autoscaling
- Scaling Up The Cluster
- The Rules Governing Nodes Scale-Up
- Scaling Down The Cluster
- The Rules Governing Nodes Scale-Down
- Can We Scale Up Too Much Or De-Scale To Zero Nodes?
- Cluster Autoscaler Compared in GKE, EKS, and AKS
- What Now?
-
Collecting And Querying Metrics And Sending Alerts
- Creating A Cluster
- Choosing The Tools For Storing And Querying Metrics And Alerting
- A Quick Introduction To Prometheus And Alertmanager
- Which Metric Types Should We Use?
- Alerting On Latency-Related Issues
- Alerting On Traffic-Related Issues
- Alerting On Error-Related Issues
- Alerting On Saturation-Related Issues
- Alerting On Unschedulable Or Failed Pods
- Upgrading Old Pods
- Measuring Containers Memory And CPU Usage
- Comparing Actual Resource Usage With Defined Requests
- Comparing Actual Resource Usage With Defined Limits
- What Now?
-
Debugging Issues Discovered Through Metrics And Alerts
- Creating A Cluster
- Facing A Disaster
- Using Instrumentation To Provide More Detailed Metrics
- Using Internal Metrics To Debug Potential Issues
- What Now?
-
Extending HorizontalPodAutoscaler With Custom Metrics
- Creating A Cluster
- Using HorizontalPodAutoscaler Without Metrics Adapter
- Exploring Prometheus Adapter
- Creating HorizontalPodAutoscaler With Custom Metrics
- Combining Metric Server Data With Custom Metrics
- The Complete HorizontalPodAutoscaler Flow Of Events
- Reaching Nirvana
- What Now?
-
Visualizing Metrics And Alerts
- Creating A Cluster
- Which Tools Should We Use For Dashboards?
- Installing And Setting Up Grafana
- Importing And Customizing Pre-Made Dashboards
- Creating Custom Dashboards
- Creating Semaphore Dashboards
- A Better Dashboard For Big Screens
- Prometheus Alerts vs. Grafana Notifications vs. Semaphores vs. Graph Alerts
- What Now?
-
Collecting And Querying Logs
- Creating A Cluster
- Exploring Logs Through kubectl
- Choosing A Centralized Logging Solution
- Exploring Logs Collection And Shipping
- Exploring Centralized Logging Through Papertrail
- Combining GCP StackDriver With A GKE Cluster
- Combining AWS CloudWatch With An EKS Cluster
- Combining Azure Log Analytics With An AKS Cluster
- Exploring Centralized Logging Through Elasticsearch, Fluentd, and Kibana
- Switching To Elasticsearch For Storing Metrics
- What Should We Expect From Centralized Logging?
- What Now?
- What Did We Do?
- Contributions
Authors have earned$10,261,184writing, publishing and selling on Leanpub, earning 80% royalties while saving up to 25 million pounds of CO2 and up to 46,000 trees.
Learn more about writing on Leanpub
The Leanpub 45-day 100% Happiness Guarantee
Within 45 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
See full terms
Free Updates. DRM Free.
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers), EPUB (for phones and tablets) and MOBI (for Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
Learn more about Leanpub's ebook formats and where to read them
Top Books
C++20
Rainer GrimmC++20 is the next big C++ standard after C++11. As C++11 did it, C++20 changes the way we program modern C++. This change is, in particular, due to the big four of C++20: ranges, coroutines, concepts, and modules.
500 QUIZ MMG COMMENTATI
ALS Medicina Generale500 Quiz degli ULTIMI Concorsi di Medicina Generale (2014/2016/2017/2018/2019)
Riassunti e suddivisi per area con Griglia risposte vuota e Griglia risposte esatte Ministeriale
Commentati con link alla fonte per approfondimento e ausilio allo studio
R Programming for Data Science
Roger D. PengThis book brings the fundamentals of R programming to you, using the same material developed as part of the industry-leading Johns Hopkins Data Science Specialization. The skills taught in this book will lay the foundation for you to begin your journey learning data science. Printed copies of this book are available through Lulu.
Ansible for DevOps
Jeff GeerlingAnsible is a simple, but powerful, server and configuration management tool. Learn to use Ansible effectively, whether you manage one server—or thousands.
Atomic Kotlin
Bruce Eckel and Svetlana IsakovaFor both beginning and experienced programmers! From the author of the multi-award-winning Thinking in C++ and Thinking in Java together with a member of the Kotlin language team comes a book that breaks the concepts into small, easy-to-digest "atoms," along with exercises supported by hints and solutions directly inside IntelliJ IDEA!
Continuous Delivery Pipelines
Dave FarleyThis practical handbook provides a step-by-step guide for you to get the best continuous delivery pipeline for your software.
C++ Best Practices
Jason TurnerLevel up your C++, get the tools working for you, eliminate common problems, and move on to more exciting things!
Visualise, document and explore your software architecture
Simon BrownA short guide to visualising, documenting and exploring your software architecture.
Discrete Mathematics for Computer Science
Alexander Shen, Alexander S. Kulikov, Vladimir Podolskii, and Aleksandr GolovnevThis book supplements the DM for CS Specialization at Coursera and contains many interactive puzzles, autograded quizzes, and code snippets. They are intended to help you to discover important ideas in discrete mathematics on your own. By purchasing the book, you will get all updates of the book free of charge when they are released.
Functional Design and Architecture
Alexander GraninSoftware Design in Functional Programming, Design Patterns and Practices, Methodologies and Application Architectures. How to build real software in Haskell with less efforts and low risks. The first complete source of knowledge.
Top Bundles
- #1
Software Architecture for Developers: Volumes 1 & 2 - Technical leadership and communication
2 Books
"Software Architecture for Developers" is a practical and pragmatic guide to modern, lightweight software architecture, specifically aimed at developers. You'll learn:The essence of software architecture.Why the software architecture role should include coding, coaching and collaboration.The things that you really need to think about before... - #2
Software Architecture and Design Practice Reference
2 Books
Dive deeper in Software Architecture with the Design Practice Reference. Learn all about software architecture and design from the books in this bundle:Software Architecture covers topics from quality attributes to designing and modeling components, interfaces, connectors, and containers, all the way to services and microservices. The Design... - #6
Linux Administration Complet
4 Books
Ce lot comprend les quatre volumes du Guide Linux Administration :Linux Administration, Volume 1, Administration fondamentale : Guide pratique de préparation aux examens de certification LPIC 1, Linux Essentials, RHCSA et LFCS. Administration fondamentale. Introduction à Linux. Le Shell. Traitement du texte. Arborescence de fichiers. Sécurité... - #7
The Python Craftsman
3 Books
The Python Craftsman series comprises The Python Apprentice, The Python Journeyman, and The Python Master. The first book is primarily suitable for for programmers with some experience of programming in another language. If you don't have any experience with programming this book may be a bit daunting. You'll be learning not just a programming... - #8
All the Books of The Medical Futurist
6 Books
We put together the most popular books from The Medical Futurist to provide a clear picture about the major trends shaping the future of medicine and healthcare. Digital health technologies, artificial intelligence, the future of 20 medical specialties, big pharma, data privacy, digital health investments and how technology giants such as Amazon... - #10
Mastering Containers
2 Books
Docker and Kubernetes are taking the world by storm! These books will get you up-to-speed fast! Docker Deep Dive is over 400 pages long, and covers all objectives on the Docker Certified Associate exam.The Kubernetes Book includes everything you need to get up and running with Kubernetes!