Python Combat Guide
$5.00
Minimum price
$25.00
Suggested price
Python Combat Guide
A comprehensive manual about tricks, good practices and coding style for hands on Software Developer Managers and Developers
About the Book
Python Combat Guide
Is a practical guide, to setup projects from zero, or to improve existing ones.
V. 1.01 (101) across 405 pages DIN A4, in PDF format, provides comprehensive explanations with code samples, tips and trick, nice to do and don't-do-this.
Is a very practical guide, covering many aspects, talking superficially about many things interesting things to know like using Docker, Jenkins, Puppet, Infrastructure as code, Blue/green, canary deployment, git... and going in deep to some good practices, with a lot of source code samples.
Explain how to setup Unit Testing with pytest from the scratch, PyCharm and does some practical TDD with examples.
Make easy to use Virtual Environments and how to create your own PIP Packages.
What is it?
A very practical hands on manual for companies working with Python 3 (and moving from Python 2.7 to Python 3).
I explain my experience working in several actual projects, different sizes and teach good practices.
Like the title suggest is a Combat Guide: read it and start crushing it!.
Is the Master Class that your best friend working in a multinational will teach you to help to improve how you and your Team work.
Having in consideration Operations Engineers, SRE and SysAdmins, it explains how to move from Procedural code to OOP, and how and why to use Interfaces and Base classes (Parent) and children (subclasses).
I use practical examples, and compare Bash and Python for different scenarios, and I show pytest Unit Testing from the scratch.
Probably you'll love it if you know Java or PHP cause in 5 hours will enable you to write code in Python.
I also provide a very simple Flask Web Application, so you see how easy it is, a mini OOP application working against MySQL in Docker, a simple SQLITE3 example, a simple GUI TKinter LDAP application, Cron Jobs that send email, Sorting Data Structures using .sort(), sorted() and lambdas, Docker samples...
When possible instructions are provided for Ubuntu Linux, Mac Os X and Windows.
Price
Price is $5 USD, as minimum, and $25 suggested.
I decided to set the price to the minimum ($5), at least during covid, in order to help people that want to learn and improve. (this is not a manual for novices, but for people that actually know Python, SysAdmins, Architects and Managers)
Special Covid-19
I release this guide during coronavirus quarantine, in Ireland.
This is a technical guide, intended to serve to all level of Developers and to SDMs (SDM - Software Development Managers).
Also useful for Team Leads and Project Managers..
It is not a basic manual, however I want to give a chance to non-tech people to learn how to program in Python, so they can get a good life or in the case of the scientists and academics that lost their jobs in the universities and need to go back to the market. Many of them use tools like Jupyter Notebook with Python, so they only need a Master Class to empower them to work in modern projects, with Git, Unit Testing, nice good practices, Team work...
What is not?
A typical manual to learn Python for beginners.
If you're looking for this, this is not your book.
Is focused on writing CLI programs, Crons, Unit Testing and shows some Flask but does not cover Django.
It is not a manual to learn specific Python language features in deep. Does not cover Python 3.7, 3.8, 3.9 or 3.10 new features as the code I write tries to work across many different versions of Python (and Servers running them).
Neither explain Architecture Patterns like Event Queues or Microservices. Or how to write API's, there are many books for that.
It just go for pointing the effective way to build CMD Line applications, Crons, use Dependency Injection, and Unit Testing in a very professional way.
Also cover certain common sense aspects for working in Team, good practices, and some Scaling tricks.
So basically allowing SRE, DevOps and Managers to improve the way they run Command Line Appications, Server side scripting, Server Monitoring...
Currently I don't cover Google Cloud Python Engine or Amazon AWS lambda with Python, although I have plans to do it.
I think you will learn many useful things, but if you buy it and you are not satisfied, please feel free to return it. When you buy it you have a period of time to return it, which at the moment of this writing is 10 days. I only had one return, and it was a professional editorial that wanted to sell the book in the States and world wide. But honestly, I like to keep all the rights and to be able to communicate with you and to update the book often. ;)
Is the code in gitlab?
Yes, most of the code is in gitlab, so you can download and just run it.
However is better to follow the book, as there are some errors intended, in order to show what not to do, and without reading the book you'll not understand it.
Even if you didn't buy the book, feel free to download the source code in gitlab:
https://gitlab.com/carles.mateo/python_combat_guide
The Python with MySQL in Docker sample application can be downloaded from here:
https://gitlab.com/carles.mateo/python-mysql-example
About the Author
Bundles that include this book
Suggested Price
$7.00
Bundle Price
Table of Contents
- Index per version 0.97 published on 2021-03-31
- Dedication.............................................................................................................................. 2
- Thanks................................................................................................................................... 2
- About this Combat guide......................................................................................................11
- About the author................................................................................................................... 11
- Disclaimer............................................................................................................................. 11
- About coronavirus................................................................................................................. 12
- For the very beginners.......................................................................................................... 12
- Hacker Rank.................................................................................................................... 13
- About Floating point / decimals and Locale (international users).....................................14
- Why Python versus Bash (reasons for SRE)........................................................................15
- OOP vs Procedural code (SRE)...........................................................................................15
- A practical sample of OOP for the SRE world: SSH Server Automation......................17
- SSH Server improved with Paramiko SSH Libraries....................................................21
- OOP small explanations recap....................................................................................22
- Why not Python 2.7?............................................................................................................ 23
- Few differences between Python 2 and 3........................................................................23
- print()............................................................................................................................... 24
- Use a printing method instead of calling directly print()....................................................25
- Use of raw_input in classes.............................................................................................25
- Floats............................................................................................................................... 25
- Floats in Databases and Currencies................................................................................26
- Things I don’t like from Python.............................................................................................29
- Tools.................................................................................................................................... 30
- IDE: PyCharm Professional.............................................................................................30
- CVS: GIT......................................................................................................................... 30
- Unit Testing: PyTest.........................................................................................................30
- Google Docs and google drive.........................................................................................31
- Directories used................................................................................................................... 31
- File names............................................................................................................................ 31
- File names for Classes....................................................................................................32
- Classes inside files, one file per class..............................................................................32
- File extensions................................................................................................................. 33
- File paths......................................................................................................................... 35
- Working with GIT.................................................................................................................. 36
- Gitlab............................................................................................................................... 36
- Commit messages........................................................................................................... 36
- Commit messages for Gitlab.......................................................................................37
- Branches.......................................................................................................................... 39
- Branching Strategy......................................................................................................40
- Git flow........................................................................................................................ 42
- GitHub flow.................................................................................................................. 44
- Production branch with GitLab flow.............................................................................45
- Environment branches with GitLab flow......................................................................46
- Release branches with GitLab flow.............................................................................47
- Merge/Pull requests....................................................................................................48
- Feature branches........................................................................................................ 49
- Closing or Linking issues using comments in GitLab...................................................49
- Removing feature branches after merge.....................................................................50
- Have always backups from Master..............................................................................50
- Git rebase.................................................................................................................... 50
- Git submodules................................................................................................................ 51
- Fetch................................................................................................................................ 53
- Pull from the repo............................................................................................................. 53
- Pushing to the repo.......................................................................................................... 53
- Keep an eye to new changes in commits through the Log section...................................54
- Never ever submit to the repo local changes you want to test.........................................54
- Never commit Debug Lines..............................................................................................54
- Development Environment...................................................................................................55
- Use Linux......................................................................................................................... 55
- Coding.................................................................................................................................. 57
- General Style................................................................................................................... 57
- Structure...................................................................................................................... 57
- Comments................................................................................................................... 58
- Use @TODO............................................................................................................... 58
- PEP-8.......................................................................................................................... 58
- MT Notation................................................................................................................. 59
- Short Code in Methods is preferred.............................................................................61
- About ' or " (apostrophe or double quote)........................................................................61
- Return.............................................................................................................................. 62
- Error code in return.......................................................................................................... 63
- Predictability in return: Return always the same..............................................................63
- Files................................................................................................................................. 63
- Operators......................................................................................................................... 64
- Tabs or spaces................................................................................................................ 64
- Space to breath................................................................................................................ 65
- Too much compressed code............................................................................................65
- Use parentheses, Luke....................................................................................................67
- Use Parenthesis on if evaluation as much as possible................................................68
- Short-circuiting behavior in Chained Comparison........................................................69
- Avoid using short-circuiting with methods....................................................................69
- Variables and Names.......................................................................................................72
- Do not use Global variables.............................................................................................72
- Class variables are Static or not, depending on the context.............................................73
- Declare variables on top of the Class and Method...........................................................76
- Declaring variables on top in Methods and Functions.................................................76
- Declaring variables on top in Classes..........................................................................77
- Do not modify arrays and variables passed by reference (unless you want to do that)....79
- How variables are passed to a method/function?.............................................................80
- String, our immutable friend........................................................................................80
- Mutable and Immutable variables....................................................................................81
- Class Names................................................................................................................... 82
- Class Constants............................................................................................................... 83
- Comparing with constants................................................................................................84
- Properties........................................................................................................................ 84
- Properties and variables defined on top of the Method....................................................84
- Functions and Methods....................................................................................................85
- Do not print inside classes, use the capacity of Python to return more than a parameter
- instead......................................................................................................................... 85
- Warning: Do not repeat Method of Function names....................................................86
- Function/Method Parameters with a default value (Keywords)....................................86
- Keyword Argument for a Method/Function..................................................................87
- Type Hinting and Annotations.....................................................................................90
- Lists, Arrays, Dicts, Tuple................................................................................................91
- Mixed power of Lists, Dicts..........................................................................................91
- Dynamic grow.............................................................................................................. 92
- “in” very important check to do....................................................................................92
- Convenience of having a method for checking “in”......................................................93
- Default dict, to save memory.......................................................................................93
- Sort a List by key.........................................................................................................95
- Arrays and index -1.......................................................................................................... 95
- Expect the unexpected....................................................................................................95
- The Happy Path.......................................................................................................... 95
- Use getters and setters....................................................................................................96
- Use update_ for methods that update Objects, not get_..................................................97
- Jumps of line \n to the end...............................................................................................98
- If / else............................................................................................................................. 99
- Else in loops.............................................................................................................. 100
- Careful String evaluations.........................................................................................100
- Calling variables by name in Methods or Functions.......................................................101
- If for text properties........................................................................................................101
- Avoid repeating code.....................................................................................................102
- Comments..................................................................................................................... 103
- Python doc..................................................................................................................... 103
- Document...................................................................................................................... 103
- No dead code................................................................................................................. 104
- We avoid Magic Methods...............................................................................................104
- The power of range........................................................................................................105
- Avoid using yield, avoid using lambdas..........................................................................106
- Avoid using list comprehensions....................................................................................107
- Avoid using Regular Expressions, unless you know what you are doing.......................107
- Creating Web Applications / Web Services with Flask...................................................108
- The most simple Web Flask Application....................................................................108
- A more cool Flask Application...................................................................................109
- For using in Production..............................................................................................113
- Files for holding Data Structures and Databases...........................................................114
- Collation.................................................................................................................... 114
- Data types in the Database.......................................................................................114
- Data serialization........................................................................................................... 115
- Some tricks to Scale Production....................................................................................118
- A real case of Serialization in the world of the videogames.......................................118
- Adding compression..................................................................................................118
- Database Sharding....................................................................................................119
- Advice: Do not allow Marketing to query Production Servers....................................121
- Use of the Slaves for reading....................................................................................121
- Load Balancing..........................................................................................................122
- Redis cache............................................................................................................... 122
- Cache on local webservers.......................................................................................122
- NGINX, CDNs........................................................................................................... 123
- Python Virtual Environments..........................................................................................123
- Creating a Virtual Environment in Python 3...............................................................123
- Creating a Virtual Environment in Python 2...............................................................124
- Activating the Virtual Environment.............................................................................124
- Deactivating the Virtual Environment.........................................................................124
- Knowing what Python Packages are installed................................................................125
- Python Threads.............................................................................................................. 126
- Prefixes: MT Notation....................................................................................................127
- Expect the Unexpected..................................................................................................129
- Corner cases and assumptions......................................................................................131
- Do no escape to shell to run a program, if you can do it from Python............................131
- Escaping to shell, when really needed...........................................................................132
- An example of things that could be wrong.................................................................132
- Try to have Common Libraries for the Common Tasks..................................................136
- OOP................................................................................................................................... 137
- Bug fixing............................................................................................................................ 141
- Focus, make sure you don’t do mistakes.......................................................................141
- Better Quality than Quantity...........................................................................................141
- Cross Testing................................................................................................................. 141
- Check the Logs.............................................................................................................. 142
- Methodology....................................................................................................................... 145
- Methodology serves a purpose......................................................................................145
- We are modern heroes..............................................................................................145
- Deploying to Production.................................................................................................145
- Create a Deploy or Launch or Change Request Document in the issue tracker........145
- Deploying to Production using immutable Docker Containers and/or Microservices. 146
- Requirements.txt.......................................................................................................148
- In Dockerfile do not use FROM latest........................................................................150
- Running in Production....................................................................................................150
- Check for Log Errors regularly in Production Servers................................................150
- Profiling.......................................................................................................................... 150
- Forensics / Postmortem analysis...................................................................................150
- Do not use Database Stored Procedures.......................................................................150
- Webservices and API are good, microservices are not always the wisest choice..........151
- Blue green Deployment vs Canary, and Rolling Upgrade..............................................152
- Automated Code Testing Quick Overview..........................................................................154
- Unit Testing Framework.................................................................................................154
- py.test versus unittest?..............................................................................................154
- Tests are not optional....................................................................................................154
- Run the Unit Tests......................................................................................................... 155
- Run tests frequently..................................................................................................155
- Do not reuse other Tests...........................................................................................155
- Importance of running good Tests (Unit Testing Tests)..................................................155
- Problems from Bash invoking parameters with quotes or without..............................156
- Emails in the Tests.........................................................................................................157
- Testing Infrastructure as Code...........................................................................................158
- Managing the Team............................................................................................................ 159
- Managing takes time......................................................................................................159
- Synchronizing the knowledge of the Team.....................................................................159
- Demos and Share the Pain............................................................................................159
- Be always fair................................................................................................................. 160
- Allow to learn and creativity...........................................................................................161
- New members join the Team.........................................................................................162
- Kick Off Meeting........................................................................................................162
- Concentrated advice for my Team.................................................................................162
- Methodology for the Development, Presentations, Documents and Demos.......................163
- Prepare Demos: name Objects and Variables...............................................................163
- Prepare Demos: prepare it in advance and test that everything works...........................163
- Take care of the details..................................................................................................163
- We don’t avoid confronting problems.............................................................................164
- We document and write Functional Analysis..................................................................164
- Checking the Functional Analysis before starting programming.....................................165
- We reply the emails.......................................................................................................165
- We do Stand up Meetings..............................................................................................165
- Exercises for Candidates / New Recruitments....................................................................165
- Tools to discuss remotely (screener).............................................................................166
- First, the FooBar exercise..............................................................................................166
- Second, Power of 2 exercise.........................................................................................166
- What we take in consideration from the candidate?.......................................................166
- Being nice...................................................................................................................... 167
- Fair Questions for Developers.......................................................................................167
- Working with pytest Unit Testing........................................................................................168
- Installing py.test in Ubuntu.............................................................................................168
- Installing py.test for Python2.....................................................................................168
- Installing py.test for Python3.....................................................................................169
- Running the Tests in a Virtual Machine like VirtualBox..................................................169
- Running the Tests in a Docker container.......................................................................169
- Location of the code samples and tests.........................................................................170
- Writing the first test........................................................................................................ 170
- Using classes for testing................................................................................................171
- Testing a real class...................................................................................................172
- Extending our first test...............................................................................................174
- Extending a bit more and getting errors.....................................................................175
- Fixing our Test using TDD.............................................................................................178
- Advantages and disadvantages of having everything in one single method...................179
- Reusability..................................................................................................................... 182
- Adding improvements discussed....................................................................................182
- Creating unit testing for DiskUtils...................................................................................184
- Do not reuse variables in Unit Testing Code..................................................................186
- Adding pytest to PyCharm Community Edition...............................................................186
- Code Coverage.............................................................................................................. 189
- Adding Dependency Injection........................................................................................192
- Stubs and Mocks and Monkeypatching..........................................................................197
- Putting all together......................................................................................................... 202
- Exercises................................................................................................................... 209
- Refactors....................................................................................................................... 210
- How to do a Refactor of legacy code.........................................................................210
- Fixtures.......................................................................................................................... 212
- Fixture to patch time.sleep........................................................................................212
- Pytest config file conftest.py...........................................................................................214
- Testing Exceptions.........................................................................................................216
- Catching an expected Exception...............................................................................216
- Code Coverage on Exceptions..................................................................................216
- Test Helper for OS calls testing.................................................................................217
- Testing STDOUT, print, and Fixture capsys...................................................................222
- A Refactor from CSV reader spaghetti code to OOP with Unit Testing..........................223
- CSV format................................................................................................................ 223
- CSV reader code (spaghetti code)............................................................................224
- Problems with this code spaghetti-code2.py..............................................................224
- Addressing some errors more. spaghetti_code3.py...................................................227
- Do not use dash in file names...................................................................................227
- Use if __name__ == "__main__":..............................................................................227
- Magic Attributes.........................................................................................................228
- Extracting the functionality. spaghetti_code4.py........................................................229
- Unit Testing for spaghetti_code4.py test_spaghetti_code4.py...................................231
- Converting spaghetti_code4.py to OOP code............................................................234
- The Unit Testing for the OOP code...........................................................................236
- Converting a simple script to list drive to a well tested program with Unit Testing.....240
- When to use Data Objects and when to use just Arrays or Dictionaries?..................277
- Tricks and Appendix........................................................................................................... 278
- Creating PIP Packages..................................................................................................278
- A mix: Unit Testing on actual Hardware.........................................................................281
- Convert a Python program to a Cron.............................................................................282
- Using Crontab........................................................................................................... 286
- Using Python Scheduler Class and Docker...............................................................287
- Catching CTRL + C inside your Python programs.....................................................289
- Class FileUtils................................................................................................................ 290
- Class SmtpUtils.............................................................................................................. 296
- Exercises................................................................................................................... 299
- Different ways of doing things........................................................................................299
- Exercises................................................................................................................... 302
- Printing in color to the Linux Terminal............................................................................303
- Working with SQLITE3...................................................................................................306
- Thinking about the decision of designing Interfaces and Base Classes extended..........312
- The boring theory......................................................................................................312
- Practical approach.....................................................................................................313
- Practical approach for SRE.......................................................................................320
- Handling parameters from Command Line.....................................................................321
- ....................................................................................................................................... 323
- Printing to STDERR.......................................................................................................324
- LDAPGUI a tkinter GUI program to query LDAP............................................................325
- CTOP.py A CLI program that includes all these lessons................................................332
- cmemgzip.py A CLI program that includes all these lessons..........................................333
- How to add your library as a package in PIP..................................................................334
- Bibliography................................................................................................................... 339
Other books by this author
The Leanpub 45-day 100% Happiness Guarantee
Within 45 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
See full terms
Do Well. Do Good.
Authors have earned$10,628,331writing, publishing and selling on Leanpub, earning 80% royalties while saving up to 25 million pounds of CO2 and up to 46,000 trees.
Learn more about writing on Leanpub
Free Updates. DRM Free.
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers), EPUB (for phones and tablets) and MOBI (for Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
Learn more about Leanpub's ebook formats and where to read them
Top Books
- #1
Jetpack Compose internals
Jorge CastilloJetpack Compose is the future of Android UI. Master how it works internally and become a more efficient developer with it. You'll also find it valuable if you are not an Android dev. This book provides all the details to understand how the Compose compiler & runtime work, and how to create a client library using them.
- #2
Functional Programming Made Easier
Charles ScalfaniA Functional Programming book from beginner to advanced without skipping a single step along the way.
In my 40 years of programming, I've felt that programming books always let me down, especially Functional Programming books. So, I wrote the book I wish I had 5 years ago.
Functional Programming will never be easy, but it can be easier.
- #3
Fifty Quick Ideas to Improve your User Stories
Gojko Adzic and David Evans - #4
Stratospheric
Tom Hombergs, Björn Wilmsmann, and Philip RiecksFrom Zero to Production with Spring Boot and AWS. All you need to know to get a Spring Boot application into production with AWS. No previous AWS knowledge required.
- #5
Technical leadership and the balance with agility
Simon BrownA developer-friendly, practical and pragmatic guide to lightweight software architecture, technical leadership and the balance with agility.
- #6
Thinking with Types
Sandy MaguireThis book aims to be the comprehensive manual for type-level programming. It's about getting you from here to there---from a competent Haskell programmer to one who convinces the compiler to do their work for them.
- #7
A Practical Guide to Testing in DevOps Japanese Edition
Katrina Clokie, Yuya Kazama, and Masanori KawaradaKatrina Clokieによる2017年8月発行の書籍『A Practical Guide to Testing in DevOps』の日本語翻訳版です。実装前や実装中でのテストだけでなく、本番環境でのテストについて、数多くの事例を用いて語られています。
- #8
Continuous Delivery Pipelines
Dave FarleyThis practical handbook provides a step-by-step guide for you to get the best continuous delivery pipeline for your software.
- #9
Developing A Computer Operating System From Scratch
TINU TOMThe first ever Book trying to introduce Operating System Development to Absolute Beginners where the topic starts from Programming In C , Programming In Assembly to Practical OS Development.
This book only uses Simple Methods so that Only Less Topics in Programming In C and Assembly should be covered.
- #10
Composing Software
Eric ElliottAll software design is composition: the act of breaking complex problems down into smaller problems and composing those solutions. Most developers have a limited understanding of compositional techniques. It's time for that to change.
Top Bundles
- #1
CCIE Service Provider Ultimate Study Bundle
2 Books
Piotr Jablonski, Lukasz Bromirski, and Nick Russo have joined forces to deliver the only CCIE Service Provider training resource you'll ever need. This bundle contains a detailed and challenging collection of workbook labs, plus an extensively detailed technical reference guide. All of us have earned the CCIE Service Provider certification... - #2
Software Architecture for Developers: Volumes 1 & 2 - Technical leadership and communication
2 Books
"Software Architecture for Developers" is a practical and pragmatic guide to modern, lightweight software architecture, specifically aimed at developers. You'll learn:The essence of software architecture.Why the software architecture role should include coding, coaching and collaboration.The things that you really need to think about before... - #4
The Python Craftsman
3 Books
The Python Craftsman series comprises The Python Apprentice, The Python Journeyman, and The Python Master. The first book is primarily suitable for for programmers with some experience of programming in another language. If you don't have any experience with programming this book may be a bit daunting. You'll be learning not just a programming... - #5
Retromat eBook Bundle for Agile Retrospectives
2 Books
If you facilitate retrospectives this bundle is for you: "Plans for Retrospectives" helps beginners learn the lay of the land with tried-and-true plans. Once you know your way around, "Run great agile retrospectives" contains all 135+ activities in Retromat for you to mix and match. - #8
9 Books-Bundle: Shut Up and Code!
9 Books
"Shut up and code." Laughter in the audience. The hacker had just plugged in his notebook and started sharing his screen to present his super-smart Python script. "Shut up and code" The letters written in a white literal coding font on black background was the hackers' home screen background mantra. At the time, I was a first-year computer...
