31 days of Drupal migrations
31 days of Drupal migrations
About the Book
This book covers Migrate API concepts for Drupal 8/9 and beyond. Examples include migrating from different sources into different destination types. It also includes tips on running migration projects and debugging issues. You can read the full series online at https://understanddrupal.com/31-days-of-migrations If you are able to pay for the eBook version of the series, your purchase will support keeping the content and examples up to date.
About the Author
Table of Contents
-
Understand Drupal Migrations Course
- Content
- Testimonials
-
Drupal migrations: Understanding the ETL process
- Understanding the ETL process
- Drupal migrations: a two step process
-
Writing your first Drupal migration
- Writing the migration definition file
- Running the migration
-
Using process plugins for data transformation in Drupal migrations
- Syntactic sugar
- Providing default values
- Concatenating values
- Chaining process plugins
-
Migrating data into Drupal subfields
- Getting the example code
- Migrating formatted text
- Migrating images
- Which subfields are available?
- Default subfields
-
Using constants and pseudofields as data placeholders in the Drupal migration process pipeline
- Setting and using source constants
- Setting and using pseudofields
- Understanding Drupal Migrate API process pipeline
- Migrating images using the image_import plugin
-
Tips for writing Drupal migrations and understanding their workflow
- Importing and rolling back migrations
- Stopping and resetting migrations
- What happens when you rollback a Drupal migration?
- Re-import or update migrations
- Tips for writing Drupal migrations
-
Migrating files and images into Drupal
- File entity migrate destination
- Source section definition
- Process section definition
- Skipping invalid records
- Creating the destination URI
- Creating the source URI
- Copying the image file to Drupal
-
Introduction to migration dependencies in Drupal
- Breaking up migrations
- Writing the source and destination definition
- Using previously imported files in image fields
- Being explicit about migration dependencies
- Tagging migrations
-
Migrating taxonomy terms and multivalue fields into Drupal
- Getting the code
- Migrating taxonomy terms and their hierarchy
- Migrating multivalue taxonomy terms fields
- More syntactic sugar
-
Migrating users into Drupal - Part 1
- Getting the code
- Understanding the source
- Configuring the destination and dependencies
- Processing the fields
-
Migrating users into Drupal - Part 2
- Getting the code
- Migrating user creation date
- Migrating user roles
- Migrating profile pictures
-
Migrating dates into Drupal
- Getting the code
- PHP date format characters
- Date format conversions
- Node creation time migration
- Date only migration
- Date range migration
- Datetime migration
- Things to consider
-
Migrating addresses into Drupal
- Getting the code
- Source and destination sections
- Available subfields
- Address subfield mappings
- Finding expected values
- The commerceguys addressing library
- Migrating country and zone fields
-
Introduction to paragraphs migrations in Drupal
- Getting the code
- Understanding the example set up
- The paragraph migration
- The node migration
- Paragraph field mappings
- Do migrated paragraphs disappear upon node rollback?
-
Migrating CSV files into Drupal
- Getting the code
- Understanding the example set up
- Migrating CSV files with a header row
- Migrating CSV files without a header row
- CSV file location
- CSV source plugin configuration
-
Migrating JSON files into Drupal
- Getting the code
- Understanding the example set up
- Migrating nodes from a JSON file
- Migrating paragraphs from a JSON file
- Migrating images from a JSON file
- JSON file location
- Migrating remote JSON files
-
Migrating XML files into Drupal
- Getting the code
- Understanding the example set up
- Migrating nodes from a XML file
- Migrating paragraphs from a XML file
- Migrating images from a XML file
- XML file location
- Migrating remote XML files
- XMLReader vs SimpleXML in Drupal migrations
-
Adding HTTP request headers and authentication to remote JSON and XML in Drupal migrations
- Migrate Plus architecture for remote data fetching
- JSON and XML Drupal migrations with HTTP request headers and Basic authentication.
- JSON and XML Drupal migrations with HTTP request headers and Digest authentication.
- JSON and XML Drupal migrations with HTTP request headers and OAuth2 authentication
-
Migrating Google Sheets into Drupal
- Getting the code
- Understanding the example set up
- Migrating nodes from Google Sheets
- Publishing a Google Sheet in JSON format
- Understanding the published Google Sheet JSON export
- Configuring the Migrate Google Sheets source plugin
-
Migrating Microsoft Excel and LibreOffice Calc files into Drupal
- Getting the code
- Understanding the example set up
- Understanding the source document and plugin configuration
- Migrating spreadsheet files with a header row
- Migrating spreadsheet files without a header row
-
Defining Drupal migrations as configuration entities with the Migrate Plus module
- Drupal migrations: code or configuration?
- Transitioning to configuration entities
- UUIDs for migration configuration entities
- Automatically deleting migration configuration entities
-
Workflows and benefits of managing Drupal migrations as configuration entities
- What is the benefit of managing migration as configurations?
- Are there any drawbacks?
- Workflow for managing migrations as configuration entities
-
Using migration groups to share configuration among Drupal migrations
- Understanding migration groups
- Creating a migration group
- Organizing and executing migrations
- Sharing configuration with migration groups
-
What is the difference between migration tags and migration groups in Drupal?
- What is the difference between migration tags and migration groups?
- What do migration tags and groups have in common?
- Can groups only be used for migrations defined as configuration entities?
- Setting migration tags inside migration groups
-
Executing Drupal migrations from the user interface with Migrate Tools
- Getting the example code
- Importing configuration entities from the user interface
- Executing configuration entities from the user interface
- Limitations of the user interface
-
Understanding the entity_lookup and entity_generate process plugins from Migrate Tools
- What is the difference among the migration_lookup, entity_lookup, entity_generate plugins?
- Getting the example code
- Using the entity_lookup to assign the node author
- Using the entity_generate to assign and create taxonomy terms
- More configuration options
- Compromises and limitations
-
How to debug Drupal migrations? - Part 1
- Minimizing the surface for errors
- What to check first?
- Migration messages
- The log process plugin
-
How to debug Drupal migrations? - Part 2
- The migrate_devel module
- The debug process plugin
- Using the right tool for the job: a debugger
- If it is not broken, break it on purpose
- The migrate:fields-source Drush command
-
How to configure XDebug, PHPStorm, and DrupalVM to debug Drupal migrations via Drush commands and the browser?
- Getting DrupalVM
- Configuring PHPStorm
- Triggering the breakpoint
- Debugging from the user interface
-
List of migration related Drupal modules
- Core modules
- Migration runners
- Source plugins
- Destination plugins
- Development related
- Field and module related
- Modules created by Tess Flynn (socketwench)
- Miscellaneous
-
Introduction to Drupal 8 upgrades
- What is a Drupal upgrade?
- Preparing your migration
- Customizing your migration
- Performing the upgrade
- Known issues and limitations
- Upgrade paths for contributed modules
- Upgrade strategies
- What about upgrading to Drupal 9?
- Notes
The Leanpub 60-day 100% Happiness Guarantee
Within 60 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
See full terms
80% Royalties. Earn $16 on a $20 book.
We pay 80% royalties. That's not a typo: you earn $16 on a $20 sale. If we sell 5000 non-refunded copies of your book or course for $20, you'll earn $80,000.
(Yes, some authors have already earned much more than that on Leanpub.)
In fact, authors have earned$12,307,240writing, publishing and selling on Leanpub.
Learn more about writing on Leanpub
Free Updates. DRM Free.
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers) and EPUB (for phones, tablets and Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
Learn more about Leanpub's ebook formats and where to read them
Top Books
- #1
OpenIntro Statistics
David Diez, Christopher Barr, Mine Cetinkaya-Rundel, and OpenIntroA complete foundation for Statistics, also serving as a foundation for Data Science.
Leanpub revenue supports OpenIntro (US-based nonprofit) so we can provide free desk copies to teachers interested in using OpenIntro Statistics in the classroom and expand the project to support free textbooks in other subjects.
More resources: openintro.org.
- #2
Personal Finance
Jason AndersonThis textbook provides an in-depth analysis on personal finance that is both practical and straightforward in its approach. It has been written in such a way that the readers can gain knowledge without getting overwhelmed by the technical terms. Suitable for both beginners and advanced learners.
- #3
Getting to Know IntelliJ IDEA
Trisha Gee and Helen ScottIf we treat our IDE as a text editor, we are doing ourselves a disservice. Using a combination of tutorials and a questions-and-answers approach, Getting to Know IntelliJ IDEA will help you find ways to use IntelliJ IDEA that enable you to work comfortably and productively as a professional developer.
- #4
C++20 - The Complete Guide
Nicolai M. JosuttisAll new language and library features of C++20 (for those who know previous C++ versions).
The book presents all new language and library features of C++20. Learn how this impacts day-to-day programming, to benefit in practice, to combine new features, and to avoid all new traps.
Buy early, pay less, free updates.
Other books:
- #5
Mastering STM32 - Second Edition
Carmine NovielloWith more than 1200 microcontrollers, STM32 is probably the most complete ARM Cortex-M platform on the market. This book aims to be the most complete guide around introducing the reader to this exciting MCU portfolio from ST Microelectronics and its official CubeHAL and STM32CubeIDE development environment.
- #6
R Programming for Data Science
Roger D. PengThis book brings the fundamentals of R programming to you, using the same material developed as part of the industry-leading Johns Hopkins Data Science Specialization. The skills taught in this book will lay the foundation for you to begin your journey learning data science. Printed copies of this book are available through Lulu.
- #7
Machine Learning Q and AI
Sebastian Raschka, PhDHave you recently completed a machine learning or deep learning course and wondered what to learn next? With 30 questions and answers on key concepts in machine learning and AI, this book provides bite-sized bits of knowledge for your journey to becoming a machine learning expert.
- #8
Stats One
William Foote - #9
The Rails 7 Way
Obie Fernandez, Lucas Dohmen, and Tom Henrik AadlandThe Rails™ 7 Way is the comprehensive, authoritative reference guide for professionals delivering production-quality code using modern Ruby on Rails. It illuminates the entire Rails 7 API, its most powerful idioms, design approaches, and libraries. Building on the previous editions, this edition has been heavily refactored and updated.
- #10
Gradual Modularization for Ruby and Rails
Stephan HagemannGet yourself a new tool to manage your Rails application and your growing engineering organization! Prevent the ball-of-mud (and fix it!). Go for microservices or SOA if it makes sense not just because you don't have any other tool. Do all this through a low-overhead tool: packages. Enable better conversations to make practical changes today.
Top Bundles
- #1
Software Architecture
2 Books
"Software Architecture for Developers" is a practical and pragmatic guide to modern, lightweight software architecture, specifically aimed at developers. You'll learn:The essence of software architecture.Why the software architecture role should include coding, coaching and collaboration.The things that you really need to think about before... - #2
CCIE Service Provider Ultimate Study Bundle
2 Books
Piotr Jablonski, Lukasz Bromirski, and Nick Russo have joined forces to deliver the only CCIE Service Provider training resource you'll ever need. This bundle contains a detailed and challenging collection of workbook labs, plus an extensively detailed technical reference guide. All of us have earned the CCIE Service Provider certification... - #3
1500 QUIZ COMMENTATI (3 libri)
3 Books
Tre libri dei QUIZ MMG Commentati al prezzo di DUE! I QUIZ dei concorsi ufficiali di Medicina Generale relativi agli anni: 2000-2001-2003-2012-2013-2014-2015-2016-2017-2018-2019-2020-2021 +100 inediti Raccolti in unico bundle per aiutarvi nello studio e nella preparazione al concorso. All'interno di ogni libro i quiz sono stati suddivisi per... - #4
Pattern-Oriented Memory Forensics and Malware Detection
2 Books
This training bundle for security engineers and researchers, malware and memory forensics analysts includes two accelerated training courses for Windows memory dump analysis using WinDbg. It is also useful for technical support and escalation engineers who analyze memory dumps from complex software environments and need to check for possible... - #5
Practical FP in Scala + Functional event-driven architecture
2 Books
Practical FP in Scala (A hands-on approach) & Functional event-driven architecture, aka FEDA, (Powered by Scala 3), together as a bundle! The content of PFP in Scala is a requirement to understand FEDA so why not take advantage of this bundle!? - #6
Modern C++ Collection
3 Books
Get All about Modern C++C++ Standard Library, including C++20Concurrency with Modern C++, including C++20C++20Each book has about 200 complete code examples. Updates are included. When I update one of the books, you immediately get the updated bundle. You can expect significant updates to each new C++ standard (C++23, C++26, .. ) and also... - #7
Linux Administration Complet
4 Books
Ce lot comprend les quatre volumes du Guide Linux Administration :Linux Administration, Volume 1, Administration fondamentale : Guide pratique de préparation aux examens de certification LPIC 1, Linux Essentials, RHCSA et LFCS. Administration fondamentale. Introduction à Linux. Le Shell. Traitement du texte. Arborescence de fichiers. Sécurité... - #9
Development and Deployment of Multiplayer Online Games, Part ARCH. Architecture (Vol. I-III)
3 Books
What's the Big Idea? The idea behind this book is to summarize the body of knowledge that already exists on multiplayer games but is not available in one single place.And quite a fewof the issues discussed within this series (planned as three nine volumes ~300 pages each), while known in the industry, have not been published at all (except for... - #10
Growing Agile: The Complete Coach's Guide
7 Books
Growing Agile: Coach's Guide Series This bundle provides a collection of training and workshop plans for a variety of agile topics. The series is aimed at agile coaches, trainers and ScrumMasters who often find themselves needing to help teams understand agile concepts. Each book in the series provides the plans, slides, handouts and activity...
