31 days of Drupal migrations
31 days of Drupal migrations
About the Book
This book covers Migrate API concepts for Drupal 8/9 and beyond. Examples include migrating from different sources into different destination types. It also includes tips on running migration projects and debugging issues. You can read the full series online at https://understanddrupal.com/31-days-of-migrations If you are able to pay for the eBook version of the series, your purchase will support keeping the content and examples up to date.
About the Author
Table of Contents
-
Understand Drupal Migrations Course
- Content
- Testimonials
-
Drupal migrations: Understanding the ETL process
- Understanding the ETL process
- Drupal migrations: a two step process
-
Writing your first Drupal migration
- Writing the migration definition file
- Running the migration
-
Using process plugins for data transformation in Drupal migrations
- Syntactic sugar
- Providing default values
- Concatenating values
- Chaining process plugins
-
Migrating data into Drupal subfields
- Getting the example code
- Migrating formatted text
- Migrating images
- Which subfields are available?
- Default subfields
-
Using constants and pseudofields as data placeholders in the Drupal migration process pipeline
- Setting and using source constants
- Setting and using pseudofields
- Understanding Drupal Migrate API process pipeline
- Migrating images using the image_import plugin
-
Tips for writing Drupal migrations and understanding their workflow
- Importing and rolling back migrations
- Stopping and resetting migrations
- What happens when you rollback a Drupal migration?
- Re-import or update migrations
- Tips for writing Drupal migrations
-
Migrating files and images into Drupal
- File entity migrate destination
- Source section definition
- Process section definition
- Skipping invalid records
- Creating the destination URI
- Creating the source URI
- Copying the image file to Drupal
-
Introduction to migration dependencies in Drupal
- Breaking up migrations
- Writing the source and destination definition
- Using previously imported files in image fields
- Being explicit about migration dependencies
- Tagging migrations
-
Migrating taxonomy terms and multivalue fields into Drupal
- Getting the code
- Migrating taxonomy terms and their hierarchy
- Migrating multivalue taxonomy terms fields
- More syntactic sugar
-
Migrating users into Drupal - Part 1
- Getting the code
- Understanding the source
- Configuring the destination and dependencies
- Processing the fields
-
Migrating users into Drupal - Part 2
- Getting the code
- Migrating user creation date
- Migrating user roles
- Migrating profile pictures
-
Migrating dates into Drupal
- Getting the code
- PHP date format characters
- Date format conversions
- Node creation time migration
- Date only migration
- Date range migration
- Datetime migration
- Things to consider
-
Migrating addresses into Drupal
- Getting the code
- Source and destination sections
- Available subfields
- Address subfield mappings
- Finding expected values
- The commerceguys addressing library
- Migrating country and zone fields
-
Introduction to paragraphs migrations in Drupal
- Getting the code
- Understanding the example set up
- The paragraph migration
- The node migration
- Paragraph field mappings
- Do migrated paragraphs disappear upon node rollback?
-
Migrating CSV files into Drupal
- Getting the code
- Understanding the example set up
- Migrating CSV files with a header row
- Migrating CSV files without a header row
- CSV file location
- CSV source plugin configuration
-
Migrating JSON files into Drupal
- Getting the code
- Understanding the example set up
- Migrating nodes from a JSON file
- Migrating paragraphs from a JSON file
- Migrating images from a JSON file
- JSON file location
- Migrating remote JSON files
-
Migrating XML files into Drupal
- Getting the code
- Understanding the example set up
- Migrating nodes from a XML file
- Migrating paragraphs from a XML file
- Migrating images from a XML file
- XML file location
- Migrating remote XML files
- XMLReader vs SimpleXML in Drupal migrations
-
Adding HTTP request headers and authentication to remote JSON and XML in Drupal migrations
- Migrate Plus architecture for remote data fetching
- JSON and XML Drupal migrations with HTTP request headers and Basic authentication.
- JSON and XML Drupal migrations with HTTP request headers and Digest authentication.
- JSON and XML Drupal migrations with HTTP request headers and OAuth2 authentication
-
Migrating Google Sheets into Drupal
- Getting the code
- Understanding the example set up
- Migrating nodes from Google Sheets
- Publishing a Google Sheet in JSON format
- Understanding the published Google Sheet JSON export
- Configuring the Migrate Google Sheets source plugin
-
Migrating Microsoft Excel and LibreOffice Calc files into Drupal
- Getting the code
- Understanding the example set up
- Understanding the source document and plugin configuration
- Migrating spreadsheet files with a header row
- Migrating spreadsheet files without a header row
-
Defining Drupal migrations as configuration entities with the Migrate Plus module
- Drupal migrations: code or configuration?
- Transitioning to configuration entities
- UUIDs for migration configuration entities
- Automatically deleting migration configuration entities
-
Workflows and benefits of managing Drupal migrations as configuration entities
- What is the benefit of managing migration as configurations?
- Are there any drawbacks?
- Workflow for managing migrations as configuration entities
-
Using migration groups to share configuration among Drupal migrations
- Understanding migration groups
- Creating a migration group
- Organizing and executing migrations
- Sharing configuration with migration groups
-
What is the difference between migration tags and migration groups in Drupal?
- What is the difference between migration tags and migration groups?
- What do migration tags and groups have in common?
- Can groups only be used for migrations defined as configuration entities?
- Setting migration tags inside migration groups
-
Executing Drupal migrations from the user interface with Migrate Tools
- Getting the example code
- Importing configuration entities from the user interface
- Executing configuration entities from the user interface
- Limitations of the user interface
-
Understanding the entity_lookup and entity_generate process plugins from Migrate Tools
- What is the difference among the migration_lookup, entity_lookup, entity_generate plugins?
- Getting the example code
- Using the entity_lookup to assign the node author
- Using the entity_generate to assign and create taxonomy terms
- More configuration options
- Compromises and limitations
-
How to debug Drupal migrations? - Part 1
- Minimizing the surface for errors
- What to check first?
- Migration messages
- The log process plugin
-
How to debug Drupal migrations? - Part 2
- The migrate_devel module
- The debug process plugin
- Using the right tool for the job: a debugger
- If it is not broken, break it on purpose
- The migrate:fields-source Drush command
-
How to configure XDebug, PHPStorm, and DrupalVM to debug Drupal migrations via Drush commands and the browser?
- Getting DrupalVM
- Configuring PHPStorm
- Triggering the breakpoint
- Debugging from the user interface
-
List of migration related Drupal modules
- Core modules
- Migration runners
- Source plugins
- Destination plugins
- Development related
- Field and module related
- Modules created by Tess Flynn (socketwench)
- Miscellaneous
-
Introduction to Drupal 8 upgrades
- What is a Drupal upgrade?
- Preparing your migration
- Customizing your migration
- Performing the upgrade
- Known issues and limitations
- Upgrade paths for contributed modules
- Upgrade strategies
- What about upgrading to Drupal 9?
- Notes
The Leanpub 60-day 100% Happiness Guarantee
Within 60 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
See full terms
Do Well. Do Good.
Authors have earned$11,597,977writing, publishing and selling on Leanpub, earning 80% royalties while saving up to 25 million pounds of CO2 and up to 46,000 trees.
Learn more about writing on Leanpub
Free Updates. DRM Free.
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers), EPUB (for phones and tablets) and MOBI (for Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
Learn more about Leanpub's ebook formats and where to read them
Top Books
- #1
C++20 - The Complete Guide
Nicolai M. JosuttisAll new language and library features of C++20 (for those who know previous C++ versions).
The book presents all new language and library features of C++20. Learn how this impacts day-to-day programming, to benefit in practice, to combine new features, and to avoid all new traps.
Buy early, pay less, free updates.
Other books:
- #2
Jetpack Compose internals
Jorge CastilloJetpack Compose is the future of Android UI. Master how it works internally and become a more efficient developer with it. You'll also find it valuable if you are not an Android dev. This book provides all the details to understand how the Compose compiler & runtime work, and how to create a client library using them.
- #3
Ansible for DevOps
Jeff GeerlingAnsible is a simple, but powerful, server and configuration management tool. Learn to use Ansible effectively, whether you manage one server—or thousands.
- #4
SignalR on .NET 6 - the Complete Guide
Fiodar SazanavetsLearn everything there is to learn about SignalR and how to integrate it with the latest .NET 6 and C# 10 features. Learn how to connect any type of client to SignalR, including plain WebSocket client. Learn how to build interactive applications that can communicate with each other in real time without making excessive calls.
- #5
R Programming for Data Science
Roger D. PengThis book brings the fundamentals of R programming to you, using the same material developed as part of the industry-leading Johns Hopkins Data Science Specialization. The skills taught in this book will lay the foundation for you to begin your journey learning data science. Printed copies of this book are available through Lulu.
- #6
Functional event-driven architecture: Powered by Scala 3
Gabriel VolpeExplore the event-driven architecture (EDA) in a purely functional way, mainly powered by Fs2 streams in Scala 3!
Leverage your functional programming skills by designing and writing stateless microservices that scale, powered by stateful message brokers.
- #7
The easiest way to learn design patterns
Fiodar SazanavetsLearn design patterns in the easiest way possible. You will no longer have to brute-force your way through each one of them while trying to figure out how it works. The book provides a unique methodology that will make your understanding of design patterns stick. It can also be used as a reference book where you can find design patterns in seconds.
- #8
Cronache di Domain-Driven Design
Francesco Strazzullo, Matteo Baglini, Gianluca Padovani, Emanuele DelBono, Marco Consolaro, Alessandro Colla, Uberto Barbini, Alberto Acerbis, Julie Camosseto, DDD Open, and Alberto BrandoliniCronache di Domain-Driven Design: un libro corale in italiano fatto di storie indipendenti tra loro, che sono il risultato dell’applicazione di Domain-Driven Design su progetti reali.
- #9
OpenIntro Statistics
David Diez, Christopher Barr, Mine Cetinkaya-Rundel, and OpenIntroA complete foundation for Statistics, also serving as a foundation for Data Science.
Leanpub revenue supports OpenIntro (US-based nonprofit) so we can provide free desk copies to teachers interested in using OpenIntro Statistics in the classroom and expand the project to support free textbooks in other subjects.
More resources: openintro.org.
- #10
CCIE Service Provider Version 4 Written and Lab Exam Comprehensive Guide
Nicholas RussoThe service provider landscape has changed rapidly over the past several years. Networking vendors are continuing to propose new standards, techniques, and procedures for overcoming new challenges while concurrently reducing costs and delivering new services. Cisco has recently updated the CCIE Service Provider track to reflect these changes; this book represents the author's personal journey in achieving that certification.
Top Bundles
- #1
Software Architecture for Developers: Volumes 1 & 2 - Technical leadership and communication
2 Books
"Software Architecture for Developers" is a practical and pragmatic guide to modern, lightweight software architecture, specifically aimed at developers. You'll learn:The essence of software architecture.Why the software architecture role should include coding, coaching and collaboration.The things that you really need to think about before... - #2
Practical FP in Scala + Functional event-driven architecture
2 Books
Practical FP in Scala (A hands-on approach) & Functional event-driven architecture, aka FEDA, (Powered by Scala 3), together as a bundle! The content of PFP in Scala is a requirement to understand FEDA so why not take advantage of this bundle!? - #3
All the Books of The Medical Futurist
6 Books
We put together the most popular books from The Medical Futurist to provide a clear picture about the major trends shaping the future of medicine and healthcare. Digital health technologies, artificial intelligence, the future of 20 medical specialties, big pharma, data privacy, digital health investments and how technology giants such as Amazon... - #4
CCIE Service Provider Ultimate Study Bundle
2 Books
Piotr Jablonski, Lukasz Bromirski, and Nick Russo have joined forces to deliver the only CCIE Service Provider training resource you'll ever need. This bundle contains a detailed and challenging collection of workbook labs, plus an extensively detailed technical reference guide. All of us have earned the CCIE Service Provider certification... - #6
Pattern-Oriented Memory Forensics and Malware Detection
2 Books
This training bundle for security engineers and researchers, malware and memory forensics analysts includes two accelerated training courses for Windows memory dump analysis using WinDbg. It is also useful for technical support and escalation engineers who analyze memory dumps from complex software environments and need to check for possible... - #7
Modern C++ Collection
3 Books
Get All about Modern C++C++ Standard Library, including C++20Concurrency with Modern C++, including C++20C++20Each book has about 200 complete code examples. Updates are included. When I update one of the books, you immediately get the updated bundle. You can expect significant updates to each new C++ standard (C++23, C++26, .. ) and also... - #9
Retromat eBook Bundle for Agile Retrospectives
2 Books
If you facilitate retrospectives this bundle is for you: "Plans for Retrospectives" helps beginners learn the lay of the land with tried-and-true plans. Once you know your way around, "Run great agile retrospectives" contains all 135+ activities in Retromat for you to mix and match.
