31 days of Drupal migrations
31 days of Drupal migrations
About the Book
This book covers Migrate API concepts for Drupal 8/9 and beyond. Examples include migrating from different sources into different destination types. It also includes tips on running migration projects and debugging issues. You can read the full series online at https://understanddrupal.com/31-days-of-migrations If you are able to pay for the eBook version of the series, your purchase will support keeping the content and examples up to date.
About the Author
Table of Contents
-
Understand Drupal Migrations Course
- Content
- Testimonials
-
Drupal migrations: Understanding the ETL process
- Understanding the ETL process
- Drupal migrations: a two step process
-
Writing your first Drupal migration
- Writing the migration definition file
- Running the migration
-
Using process plugins for data transformation in Drupal migrations
- Syntactic sugar
- Providing default values
- Concatenating values
- Chaining process plugins
-
Migrating data into Drupal subfields
- Getting the example code
- Migrating formatted text
- Migrating images
- Which subfields are available?
- Default subfields
-
Using constants and pseudofields as data placeholders in the Drupal migration process pipeline
- Setting and using source constants
- Setting and using pseudofields
- Understanding Drupal Migrate API process pipeline
- Migrating images using the image_import plugin
-
Tips for writing Drupal migrations and understanding their workflow
- Importing and rolling back migrations
- Stopping and resetting migrations
- What happens when you rollback a Drupal migration?
- Re-import or update migrations
- Tips for writing Drupal migrations
-
Migrating files and images into Drupal
- File entity migrate destination
- Source section definition
- Process section definition
- Skipping invalid records
- Creating the destination URI
- Creating the source URI
- Copying the image file to Drupal
-
Introduction to migration dependencies in Drupal
- Breaking up migrations
- Writing the source and destination definition
- Using previously imported files in image fields
- Being explicit about migration dependencies
- Tagging migrations
-
Migrating taxonomy terms and multivalue fields into Drupal
- Getting the code
- Migrating taxonomy terms and their hierarchy
- Migrating multivalue taxonomy terms fields
- More syntactic sugar
-
Migrating users into Drupal - Part 1
- Getting the code
- Understanding the source
- Configuring the destination and dependencies
- Processing the fields
-
Migrating users into Drupal - Part 2
- Getting the code
- Migrating user creation date
- Migrating user roles
- Migrating profile pictures
-
Migrating dates into Drupal
- Getting the code
- PHP date format characters
- Date format conversions
- Node creation time migration
- Date only migration
- Date range migration
- Datetime migration
- Things to consider
-
Migrating addresses into Drupal
- Getting the code
- Source and destination sections
- Available subfields
- Address subfield mappings
- Finding expected values
- The commerceguys addressing library
- Migrating country and zone fields
-
Introduction to paragraphs migrations in Drupal
- Getting the code
- Understanding the example set up
- The paragraph migration
- The node migration
- Paragraph field mappings
- Do migrated paragraphs disappear upon node rollback?
-
Migrating CSV files into Drupal
- Getting the code
- Understanding the example set up
- Migrating CSV files with a header row
- Migrating CSV files without a header row
- CSV file location
- CSV source plugin configuration
-
Migrating JSON files into Drupal
- Getting the code
- Understanding the example set up
- Migrating nodes from a JSON file
- Migrating paragraphs from a JSON file
- Migrating images from a JSON file
- JSON file location
- Migrating remote JSON files
-
Migrating XML files into Drupal
- Getting the code
- Understanding the example set up
- Migrating nodes from a XML file
- Migrating paragraphs from a XML file
- Migrating images from a XML file
- XML file location
- Migrating remote XML files
- XMLReader vs SimpleXML in Drupal migrations
-
Adding HTTP request headers and authentication to remote JSON and XML in Drupal migrations
- Migrate Plus architecture for remote data fetching
- JSON and XML Drupal migrations with HTTP request headers and Basic authentication.
- JSON and XML Drupal migrations with HTTP request headers and Digest authentication.
- JSON and XML Drupal migrations with HTTP request headers and OAuth2 authentication
-
Migrating Google Sheets into Drupal
- Getting the code
- Understanding the example set up
- Migrating nodes from Google Sheets
- Publishing a Google Sheet in JSON format
- Understanding the published Google Sheet JSON export
- Configuring the Migrate Google Sheets source plugin
-
Migrating Microsoft Excel and LibreOffice Calc files into Drupal
- Getting the code
- Understanding the example set up
- Understanding the source document and plugin configuration
- Migrating spreadsheet files with a header row
- Migrating spreadsheet files without a header row
-
Defining Drupal migrations as configuration entities with the Migrate Plus module
- Drupal migrations: code or configuration?
- Transitioning to configuration entities
- UUIDs for migration configuration entities
- Automatically deleting migration configuration entities
-
Workflows and benefits of managing Drupal migrations as configuration entities
- What is the benefit of managing migration as configurations?
- Are there any drawbacks?
- Workflow for managing migrations as configuration entities
-
Using migration groups to share configuration among Drupal migrations
- Understanding migration groups
- Creating a migration group
- Organizing and executing migrations
- Sharing configuration with migration groups
-
What is the difference between migration tags and migration groups in Drupal?
- What is the difference between migration tags and migration groups?
- What do migration tags and groups have in common?
- Can groups only be used for migrations defined as configuration entities?
- Setting migration tags inside migration groups
-
Executing Drupal migrations from the user interface with Migrate Tools
- Getting the example code
- Importing configuration entities from the user interface
- Executing configuration entities from the user interface
- Limitations of the user interface
-
Understanding the entity_lookup and entity_generate process plugins from Migrate Tools
- What is the difference among the migration_lookup, entity_lookup, entity_generate plugins?
- Getting the example code
- Using the entity_lookup to assign the node author
- Using the entity_generate to assign and create taxonomy terms
- More configuration options
- Compromises and limitations
-
How to debug Drupal migrations? - Part 1
- Minimizing the surface for errors
- What to check first?
- Migration messages
- The log process plugin
-
How to debug Drupal migrations? - Part 2
- The migrate_devel module
- The debug process plugin
- Using the right tool for the job: a debugger
- If it is not broken, break it on purpose
- The migrate:fields-source Drush command
-
How to configure XDebug, PHPStorm, and DrupalVM to debug Drupal migrations via Drush commands and the browser?
- Getting DrupalVM
- Configuring PHPStorm
- Triggering the breakpoint
- Debugging from the user interface
-
List of migration related Drupal modules
- Core modules
- Migration runners
- Source plugins
- Destination plugins
- Development related
- Field and module related
- Modules created by Tess Flynn (socketwench)
- Miscellaneous
-
Introduction to Drupal 8 upgrades
- What is a Drupal upgrade?
- Preparing your migration
- Customizing your migration
- Performing the upgrade
- Known issues and limitations
- Upgrade paths for contributed modules
- Upgrade strategies
- What about upgrading to Drupal 9?
- Notes
The Leanpub 60-day 100% Happiness Guarantee
Within 60 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
See full terms
Do Well. Do Good.
Authors have earned$11,974,502writing, publishing and selling on Leanpub, earning 80% royalties while saving up to 25 million pounds of CO2 and up to 46,000 trees.
Learn more about writing on Leanpub
Free Updates. DRM Free.
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers) and EPUB (for phones, tablets and Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
Learn more about Leanpub's ebook formats and where to read them
Top Books
- #1
A Guide To The Future Of Hospitals
Dr. Bertalan MeskoFor centuries, scientists have been trying to envision the future of hospitals. Following the recent shift towards digital health technologies, in part precipitated by COVID-19, it is natural for one to wonder how these developments will impact hospitals. What can we expect from them in the future? Will there be hospitals at all in a decade’s time?
- #2
OpenIntro Statistics
David Diez, Christopher Barr, Mine Cetinkaya-Rundel, and OpenIntroA complete foundation for Statistics, also serving as a foundation for Data Science.
Leanpub revenue supports OpenIntro (US-based nonprofit) so we can provide free desk copies to teachers interested in using OpenIntro Statistics in the classroom and expand the project to support free textbooks in other subjects.
More resources: openintro.org.
- #3
CCIE SP v5.0
Łukasz Bromirski, Piotr Jablonski, and Nicholas RussoAre you striving to prepare to and pass CCIE SP lab exam? Take the opportunity and get this workbook! With the attached initial cfg files you will prepare yourself for the CCIE SP exam as well as learn SP technologies applicable to all kinds of today modern networks! This workbook covers blueprint topics and provides challenging examples.
- #4
Ansible for DevOps
Jeff GeerlingAnsible is a simple, but powerful, server and configuration management tool. Learn to use Ansible effectively, whether you manage one server—or thousands.
- #5
EZ Tools Manuals
Eric Zimmerman and Andrew RathbunEric Zimmerman's Tools are free, open-source, widely taught around the world. This is the official manual for all of his command line and GUI tools.
- #6
R Programming for Data Science
Roger D. PengThis book brings the fundamentals of R programming to you, using the same material developed as part of the industry-leading Johns Hopkins Data Science Specialization. The skills taught in this book will lay the foundation for you to begin your journey learning data science. Printed copies of this book are available through Lulu.
- #7
C++20 - The Complete Guide
Nicolai M. JosuttisAll new language and library features of C++20 (for those who know previous C++ versions).
The book presents all new language and library features of C++20. Learn how this impacts day-to-day programming, to benefit in practice, to combine new features, and to avoid all new traps.
Buy early, pay less, free updates.
Other books:
- #8
Introducing EventStorming
Alberto BrandoliniThe deepest tutorial and explanation about EventStorming, straight from the inventor.
- #9
Design and Reality
Rebecca Wirfs-Brock and Mathias Verraes - #10
D3 Start to Finish
Peter CookD3 Start to Finish shows you how to build a custom, interactive and beautiful data visualisation using the JavaScript library D3.js (versions 6 & 7).
The book covers D3.js concepts such as selections, joins, requests, scale functions, events & transitions. You'll put these concepts into practice by building a custom, interactive data visualisation.
Top Bundles
- #1
CCIE Service Provider Ultimate Study Bundle
2 Books
Piotr Jablonski, Lukasz Bromirski, and Nick Russo have joined forces to deliver the only CCIE Service Provider training resource you'll ever need. This bundle contains a detailed and challenging collection of workbook labs, plus an extensively detailed technical reference guide. All of us have earned the CCIE Service Provider certification... - #2
Software Architecture
2 Books
"Software Architecture for Developers" is a practical and pragmatic guide to modern, lightweight software architecture, specifically aimed at developers. You'll learn:The essence of software architecture.Why the software architecture role should include coding, coaching and collaboration.The things that you really need to think about before... - #3
Pattern-Oriented Memory Forensics and Malware Detection
2 Books
This training bundle for security engineers and researchers, malware and memory forensics analysts includes two accelerated training courses for Windows memory dump analysis using WinDbg. It is also useful for technical support and escalation engineers who analyze memory dumps from complex software environments and need to check for possible... - #5
Practical FP in Scala + Functional event-driven architecture
2 Books
Practical FP in Scala (A hands-on approach) & Functional event-driven architecture, aka FEDA, (Powered by Scala 3), together as a bundle! The content of PFP in Scala is a requirement to understand FEDA so why not take advantage of this bundle!? - #6
All the Books of The Medical Futurist
6 Books
We put together the most popular books from The Medical Futurist to provide a clear picture about the major trends shaping the future of medicine and healthcare. Digital health technologies, artificial intelligence, the future of 20 medical specialties, big pharma, data privacy, digital health investments and how technology giants such as Amazon... - #9
Statistics - All Lee Baker's Books
10 Books
This bundle includes all of the statistics books that Lee Baker has published at LeanPub 13 Statistics Books*1 PlaceNo Hassle! All in both epub and mobi formats - perfect for all devices and screen sizes. --------------------------------------------------------- *The book listed as Getting Started With Statistics is a bundle of 4 books...
