Data Engineering Best Practices
Data Engineering Best Practices
Architect robust and cost-effective data solutions in the cloud era
About the Book
Revolutionize your approach to data processing in the fast-paced business landscape with this essential guide to data engineering. Discover the power of scalable, efficient, and secure data solutions through expert guidance on data engineering principles and techniques. Written by two industry experts with over 60 years of combined experience, it offers deep insights into best practices, architecture, agile processes, and cloud-based pipelines.
You’ll start by defining the challenges data engineers face and understand how this agile and future-proof comprehensive data solution architecture addresses them. As you explore the extensive toolkit, mastering the capabilities of various instruments, you’ll gain the knowledge needed for independent research. Covering everything you need, right from data engineering fundamentals, the guide uses real-world examples to illustrate potential solutions. It elevates your skills to architect scalable data systems, implement agile development processes, and design cloud-based data pipelines. The book further equips you with the knowledge to harness serverless computing and microservices to build resilient data applications.
By the end, you'll be armed with the expertise to design and deliver high-performance data engineering solutions that are not only robust, efficient, and secure but also future-ready.
About the Author
Table of Contents
- Overview of the Business Problem Statement
- A Data Engineer's Journey – Background Challenges
- A Data Engineer's Journey – IT's Vision and Mission
- Architecture Principles
- Architecture Framework – Conceptual Architecture Best Practices
- Architecture Framework – Logical Architecture Best Practices
- Architecture Framework – Physical Architecture Best Practices
- Software Engineering Best Practice Considerations
- Key Considerations for Agile SDLC Best Practices
- Key Considerations for Quality Testing Best Practices
- Key Considerations for IT Operational Service Best Practices
- Key Considerations for Data Service Best Practices
- Key Considerations for Management Best Practices
- Key Considerations for Data Delivery Best Practices
- Other Considerations – Measures, Calculations, Restatements, and Data Science Best Practices
- Machine Learning Pipeline Best Practices and Processes
- Takeaway Summary – Putting It All Together
- Appendix and Use Cases
About the Publisher
This book is published on Leanpub by Packt Publishing Ltd
Packt Publishing are an established global technical learning content provider, founded in Birmingham, UK with over twenty years’ experience in delivering premium rich content from ground-breaking authors on a wide range of emerging and popular technologies. Our titles have global relevance our multimedia portfolio includes over 9,000 books, e-books, audiobooks and video courses. www.packtpub.com
The Leanpub 60 Day 100% Happiness Guarantee
Within 60 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
Now, this is technically risky for us, since you'll have the book or course files either way. But we're so confident in our products and services, and in our authors and readers, that we're happy to offer a full money back guarantee for everything we sell.
You can only find out how good something is by trying it, and because of our 100% money back guarantee there's literally no risk to do so!
So, there's no reason not to click the Add to Cart button, is there?
See full terms...
Earn $8 on a $10 Purchase, and $16 on a $20 Purchase
We pay 80% royalties on purchases of $7.99 or more, and 80% royalties minus a 50 cent flat fee on purchases between $0.99 and $7.98. You earn $8 on a $10 sale, and $16 on a $20 sale. So, if we sell 5000 non-refunded copies of your book for $20, you'll earn $80,000.
(Yes, some authors have already earned much more than that on Leanpub.)
In fact, authors have earnedover $14 millionwriting, publishing and selling on Leanpub.
Learn more about writing on Leanpub
Free Updates. DRM Free.
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers) and EPUB (for phones, tablets and Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
Learn more about Leanpub's ebook formats and where to read them
