31 days of Drupal migrations
31 days of Drupal migrations
About the Book
This book covers Migrate API concepts for Drupal 8/9 and beyond. Examples include migrating from different sources into different destination types. It also includes tips on running migration projects and debugging issues. You can read the full series online at https://understanddrupal.com/31-days-of-migrations If you are able to pay for the eBook version of the series, your purchase will support keeping the content and examples up to date.
About the Author
Table of Contents
-
Understand Drupal Migrations Course
- Content
- Testimonials
-
Drupal migrations: Understanding the ETL process
- Understanding the ETL process
- Drupal migrations: a two step process
-
Writing your first Drupal migration
- Writing the migration definition file
- Running the migration
-
Using process plugins for data transformation in Drupal migrations
- Syntactic sugar
- Providing default values
- Concatenating values
- Chaining process plugins
-
Migrating data into Drupal subfields
- Getting the example code
- Migrating formatted text
- Migrating images
- Which subfields are available?
- Default subfields
-
Using constants and pseudofields as data placeholders in the Drupal migration process pipeline
- Setting and using source constants
- Setting and using pseudofields
- Understanding Drupal Migrate API process pipeline
- Migrating images using the image_import plugin
-
Tips for writing Drupal migrations and understanding their workflow
- Importing and rolling back migrations
- Stopping and resetting migrations
- What happens when you rollback a Drupal migration?
- Re-import or update migrations
- Tips for writing Drupal migrations
-
Migrating files and images into Drupal
- File entity migrate destination
- Source section definition
- Process section definition
- Skipping invalid records
- Creating the destination URI
- Creating the source URI
- Copying the image file to Drupal
-
Introduction to migration dependencies in Drupal
- Breaking up migrations
- Writing the source and destination definition
- Using previously imported files in image fields
- Being explicit about migration dependencies
- Tagging migrations
-
Migrating taxonomy terms and multivalue fields into Drupal
- Getting the code
- Migrating taxonomy terms and their hierarchy
- Migrating multivalue taxonomy terms fields
- More syntactic sugar
-
Migrating users into Drupal - Part 1
- Getting the code
- Understanding the source
- Configuring the destination and dependencies
- Processing the fields
-
Migrating users into Drupal - Part 2
- Getting the code
- Migrating user creation date
- Migrating user roles
- Migrating profile pictures
-
Migrating dates into Drupal
- Getting the code
- PHP date format characters
- Date format conversions
- Node creation time migration
- Date only migration
- Date range migration
- Datetime migration
- Things to consider
-
Migrating addresses into Drupal
- Getting the code
- Source and destination sections
- Available subfields
- Address subfield mappings
- Finding expected values
- The commerceguys addressing library
- Migrating country and zone fields
-
Introduction to paragraphs migrations in Drupal
- Getting the code
- Understanding the example set up
- The paragraph migration
- The node migration
- Paragraph field mappings
- Do migrated paragraphs disappear upon node rollback?
-
Migrating CSV files into Drupal
- Getting the code
- Understanding the example set up
- Migrating CSV files with a header row
- Migrating CSV files without a header row
- CSV file location
- CSV source plugin configuration
-
Migrating JSON files into Drupal
- Getting the code
- Understanding the example set up
- Migrating nodes from a JSON file
- Migrating paragraphs from a JSON file
- Migrating images from a JSON file
- JSON file location
- Migrating remote JSON files
-
Migrating XML files into Drupal
- Getting the code
- Understanding the example set up
- Migrating nodes from a XML file
- Migrating paragraphs from a XML file
- Migrating images from a XML file
- XML file location
- Migrating remote XML files
- XMLReader vs SimpleXML in Drupal migrations
-
Adding HTTP request headers and authentication to remote JSON and XML in Drupal migrations
- Migrate Plus architecture for remote data fetching
- JSON and XML Drupal migrations with HTTP request headers and Basic authentication.
- JSON and XML Drupal migrations with HTTP request headers and Digest authentication.
- JSON and XML Drupal migrations with HTTP request headers and OAuth2 authentication
-
Migrating Google Sheets into Drupal
- Getting the code
- Understanding the example set up
- Migrating nodes from Google Sheets
- Publishing a Google Sheet in JSON format
- Understanding the published Google Sheet JSON export
- Configuring the Migrate Google Sheets source plugin
-
Migrating Microsoft Excel and LibreOffice Calc files into Drupal
- Getting the code
- Understanding the example set up
- Understanding the source document and plugin configuration
- Migrating spreadsheet files with a header row
- Migrating spreadsheet files without a header row
-
Defining Drupal migrations as configuration entities with the Migrate Plus module
- Drupal migrations: code or configuration?
- Transitioning to configuration entities
- UUIDs for migration configuration entities
- Automatically deleting migration configuration entities
-
Workflows and benefits of managing Drupal migrations as configuration entities
- What is the benefit of managing migration as configurations?
- Are there any drawbacks?
- Workflow for managing migrations as configuration entities
-
Using migration groups to share configuration among Drupal migrations
- Understanding migration groups
- Creating a migration group
- Organizing and executing migrations
- Sharing configuration with migration groups
-
What is the difference between migration tags and migration groups in Drupal?
- What is the difference between migration tags and migration groups?
- What do migration tags and groups have in common?
- Can groups only be used for migrations defined as configuration entities?
- Setting migration tags inside migration groups
-
Executing Drupal migrations from the user interface with Migrate Tools
- Getting the example code
- Importing configuration entities from the user interface
- Executing configuration entities from the user interface
- Limitations of the user interface
-
Understanding the entity_lookup and entity_generate process plugins from Migrate Tools
- What is the difference among the migration_lookup, entity_lookup, entity_generate plugins?
- Getting the example code
- Using the entity_lookup to assign the node author
- Using the entity_generate to assign and create taxonomy terms
- More configuration options
- Compromises and limitations
-
How to debug Drupal migrations? - Part 1
- Minimizing the surface for errors
- What to check first?
- Migration messages
- The log process plugin
-
How to debug Drupal migrations? - Part 2
- The migrate_devel module
- The debug process plugin
- Using the right tool for the job: a debugger
- If it is not broken, break it on purpose
- The migrate:fields-source Drush command
-
How to configure XDebug, PHPStorm, and DrupalVM to debug Drupal migrations via Drush commands and the browser?
- Getting DrupalVM
- Configuring PHPStorm
- Triggering the breakpoint
- Debugging from the user interface
-
List of migration related Drupal modules
- Core modules
- Migration runners
- Source plugins
- Destination plugins
- Development related
- Field and module related
- Modules created by Tess Flynn (socketwench)
- Miscellaneous
-
Introduction to Drupal 8 upgrades
- What is a Drupal upgrade?
- Preparing your migration
- Customizing your migration
- Performing the upgrade
- Known issues and limitations
- Upgrade paths for contributed modules
- Upgrade strategies
- What about upgrading to Drupal 9?
- Notes
Authors have earned$9,539,843writing, publishing and selling on Leanpub, earning 80% royalties while saving up to 25 million pounds of CO2 and up to 46,000 trees.
Learn more about writing on Leanpub
The Leanpub 45-day 100% Happiness Guarantee
Within 45 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
See full terms
Free Updates. DRM Free.
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers), EPUB (for phones and tablets) and MOBI (for Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
Learn more about Leanpub's ebook formats and where to read them
Top Books
- #1
Algebra-Driven Design
Sandy MaguireA how-to field guide on building leak-free abstractions and algebraically designing real-world applications.
- #2
Production Haskell
Matt ParsonsAre you excited about Haskell, but don't know where to begin? Are you thrilled by the technical advantages, but worried about the unknown pitfalls? This book has you covered.
- #3
Ansible for DevOps
Jeff GeerlingAnsible is a simple, but powerful, server and configuration management tool. Learn to use Ansible effectively, whether you manage one server—or thousands.
- #4
The Hundred-Page Machine Learning Book
Andriy BurkovEverything you really need to know in Machine Learning in a hundred pages.
- #5
Machine Learning Engineering
Andriy Burkov"If you intend to use machine learning to solve business problems at scale, I'm delighted you got your hands on this book."
—Cassie Kozyrkov, Chief Decision Scientist at Google
"Foundational work about the reality of building machine learning models in production."
—Karolis Urbonas, Head of Machine Learning and Science at Amazon
- #6
Cloud Strategy
Gregor HohpeWhile most enterprises are moving to the cloud these days, many initiatives are driven by wishes or promises rather than a sound strategy. Harvested from half a decade of cloud migrations, this book shares frameworks, strategies, and anecdotes for a structured and decision-centric path to cloud success.
- #7
OpenIntro Statistics
David Diez, Christopher Barr, Mine Cetinkaya-Rundel, and OpenIntroA complete foundation for Statistics, also serving as a foundation for Data Science.
Leanpub revenue supports OpenIntro (US-based nonprofit) so we can provide free desk copies to teachers interested in using OpenIntro Statistics in the classroom and expand the project to support free textbooks in other subjects.
More resources: openintro.org.
- #8
CCIE Service Provider Version 4 Written and Lab Exam Comprehensive Guide
Nicholas RussoThe service provider landscape has changed rapidly over the past several years. Networking vendors are continuing to propose new standards, techniques, and procedures for overcoming new challenges while concurrently reducing costs and delivering new services. Cisco has recently updated the CCIE Service Provider track to reflect these changes; this book represents the author's personal journey in achieving that certification.
- #9
CCIE SP v4.1 - Workbook
Łukasz Bromirski, Piotr Jablonski, and Nicholas RussoAre you striving to prepare to and pass CCIE SP lab exam? Take the opportunity and get this workbook! With the attached initial cfg files you will prepare yourself for the CCIE SP exam as well as learn SP technologies applicable to all kinds of today modern networks! This workbook covers blueprint topics and provides challenging examples.
- #10
Sockets and Pipes
Type ClassesSockets and Pipes is not an introduction to Haskell; it is an introduction to writing software in Haskell. Using a handful of everyday Haskell libraries, this book walks through reading the HTTP specification and implementing it to create a web server.
Top Bundles
- #1
The Node.js Bundle
3 Books
This bundle combines three bestselling Leanpub Node.js books into a package that gives you everything you need to get started with developing Node.js applications at an unbeatable price. - #2
The Tester's Library
8 Books
The Tester's Library consists of eight five-star books that every software tester should read and re-read. As bound books, this collection would cost over $200. Even as e-books, their price would exceed $80, but in this bundle, their cost is only $49.99. Here are the books, and why they should be in your library: Perfect Software and Other... - #3
agile
11 Books
In this bundle, you will find 10 different agile books. They are about different aspects of being agile. - finding a job - doing coding dojo's - Retrospectives - Personal kanban - a non-typical coaching book and even a book that gives you an insight in the lives of some agile people. - #4
WTFlop 6M + HU - Beta Bundle
6 Books
- #5
Node Patterns
6 Books
- #6
Fifty Quick Ideas
3 Books
Get all three books for the price of two! Fifty Quick Ideas books are full of practical, real-world techniques that you can use to improve teamwork, build better products and build them in a better way. - #7
Growing Agile: Coach's Guide Series
4 Books
This bundle provides a collection of training and workshop plans for a variety of agile topics. The series is aimed at agile coaches, trainers and ScrumMasters who often find themselves needing to help teams understand agile concepts. Each book in the series provides the plans, slides, handouts and activity instructions to run a number of... - #8
Marionette.js A to Z
3 Books
Marionette.js has become a popular Backbone-based javascript library, because it helps you avoid boiler-plate code and focus on what makes your app special. But how do you get started?Whether you want to finally get started with dynamic client-side programming (like one reader did), or are an experienced front-end dev who has inherited a... - #9
Complete Scala Bundle
3 Books
Scala is a general-purpose programming language and it's getting extremely popular these days. Some say that learning Scala could be a challenging task. My experience, however, suggests that this is actually a myth that has very little to do with reality. With the right approach, learning Scala can be easy, fun and rewarding.The first book from... - #10
Build A Better Backbone App
3 Books
The best way to learn new development skills is through experience, but that takes time you don't have.Get the best of both worlds with this bundle: you'll learn how to produce modern web applications by learning from experienced developers like Derick Bailey and David Sulc. BackboneJS is one of the favorite tools on the web today, but it...
