Metadata Recycling into Graph Data Models
Metadata Recycling into Graph Data Models
The Guide to Data Model Recycling using Neo4j
About the Book
What if the database died some years ago, but you still have an old UML or XML file with the model in it. And you need to model the same domain for graph data bases? This is one of the scenarios this book intends to help you with.
There are 70+ ERD-supporting tools and 50+ UML tools, many of which are also used for data modeling. That translates to a lot of data models. Can they be "recycled", also in agile projects? There must be hundreds of thousands of good, reusable data models! Why waste such a large resource of business metadata?
Much similar to data science we have a need to (call it "Metadata Science") read, transform, scope / reduce / enhance and adapt data models to modern database technologies. Not least graph databases, if you ask me.
This book explains how to do that. Cypher®-scripts are included for Concept Maps (CmapTools®), CSDL, XML Schemas, StarUML v1 and UML® via various XMI® formats. The most recent addition is FileMaker® data models.
The book also explains how to optionallay build a simple graph-based metadata repository, which has full lineage back to the source data model, and it supports identities, uniqueness, mandatory fields and basic datatypes.
Cypher-scripts for repository handling are indeed also part of the book (under a MIT license).
We suggest a choice of two approaches:
- Fast Track Data Models (agile)
- Super Data Models (crafted, using the repository.
Looking for a graph database modeling tool? Now, everything you need for recycling of data models is available inside this book. 50+ scripts (and growing) plus the repository model providing data lineage.
Missing a data modeling tool on the list? Suggestions of other formats to be supported can be sent to @VizDataModeler (info at graphdatamodeling dot com).
About the Author
Table of Contents
- Introduction
- Acknowledgements
-
Overview of the Value Proposition of Recycling Metadata
- Concerns Drive Full Scale Data Modeling
- Full Scale Data Architecture
-
The Atoms and Molecules of Data Models
- Entity-Relationship Modeling
- Relational and SQL
- Object Orientation and UML®
- Graph Data Models
- Object Role Modeling (a.k.a. Fact Modeling)
- The Key Things
- The Universal Constituent Parts of Data Models
-
The Process of Generating Data Models
- The Mechanics
- Designing a Flexible Approach
-
Super Data Models
- Load & Transform
- Subset to get the Solution Model
- Extend the Solution Model
- Transform to get a Physical Model
- Optimize the Database
-
Fast Track Data Models
- Load & Transform
- Auto-generate a Physical Model
- Optimize the Database
-
Build Your Own Metadata Repository
- The Repository on One Page
- Concept Models
- Solution Models
- Physical Models
- Lineage in the repository
- Metadata details
-
Concept Maps (CmapTools®) as Graph Data Models
- About Concept Maps
- Load & Transform Concept Maps
- The Cookbook for Concept Maps
- From Concept Model to Super Data Model or Fast Track?
-
Conceptual Schemas in OData CSDL Format
- About CDSL, Common Schema Definition Language from OASIS
- Looking at the CSDL file
- Building the Concept Model from the CSDL Model
-
FileMaker® Database Report in XML
- About FileMaker® and XML
- Looking at the XML-file
- Final adjustments
-
XML Schemas from the W3C
- About XML Schemas
- Looking at the XSD (XML) file
- Building the Concept Model from the XSD Model
-
StarUML ERD Models
- About StarUML
- Looking at the UML (XML) file
- Building the Concept Model from the UML® ERD Model
-
UML® as XMI® the Eclipse UML 2.0 Way
- About UML® and XMI® and Eclipse UML
- The example: A Github Project about Carparks
- Looking at the XMI®-file
- Building the concept model from the UML® model
-
UML® as XMI® the EA Way
- About UML® and XMI® and EA
- The example: Open, Public Data
- Looking at the XMI®-file
- Building the concept model from the UML® model
-
Addendum: Improving Metadata Quality
- The Business is King
- Data Names Matter
- Finding Standard Data Structures
- Establishing Identity and Uniqueness
- Presenting the Business Flow
- Presenting the Keys
- Presenting State Changes
- Presenting Versions of Data
- Housekeeping Proper
- Scalar Data Types
- Time Zones
- Design is Decisions
- Which Objects and Which Relationships?
- Presenting Relationships and Missing References
- Presenting the Right Level of Detail
- Good Relationships
- Identity, Uniqueness and Keys Revisited
- Missing Information
- Other books by Thomas Frisendal
Authors have earned$9,690,775writing, publishing and selling on Leanpub, earning 80% royalties while saving up to 25 million pounds of CO2 and up to 46,000 trees.
Learn more about writing on Leanpub
The Leanpub 45-day 100% Happiness Guarantee
Within 45 days of purchase you can get a 100% refund on any Leanpub purchase, in two clicks.
See full terms
Free Updates. DRM Free.
If you buy a Leanpub book, you get free updates for as long as the author updates the book! Many authors use Leanpub to publish their books in-progress, while they are writing them. All readers get free updates, regardless of when they bought the book or how much they paid (including free).
Most Leanpub books are available in PDF (for computers), EPUB (for phones and tablets) and MOBI (for Kindle). The formats that a book includes are shown at the top right corner of this page.
Finally, Leanpub books don't have any DRM copy-protection nonsense, so you can easily read them on any supported device.
Learn more about Leanpub's ebook formats and where to read them
Top Books
- #1
Ansible for Kubernetes
Jeff GeerlingAnsible is a powerful infrastructure automation tool. Kubernetes is a powerful application deployment platform. Learn how to use these tools to automate massively-scalable, highly-available infrastructure.
- #2
Practical FP in Scala: A hands-on approach
Gabriel VolpeA practical book aimed for those familiar with functional programming in Scala who are yet not confident about architecting an application from scratch.
Together, we will develop a purely functional application using the best libraries in the Cats ecosystem, while learning about design patterns and best practices.
- #3
Functional Design and Architecture
Alexander GraninSoftware Design in Functional Programming, Design Patterns and Practices, Methodologies and Application Architectures. How to build real software in Haskell with less efforts and low risks. The first complete source of knowledge.
- #4
Production Haskell
Matt ParsonsAre you excited about Haskell, but don't know where to begin? Are you thrilled by the technical advantages, but worried about the unknown pitfalls? This book has you covered.
- #5
Tame your Work Flow
Steve Tendon and Daniel DoironDo you need a high performance enterprise governance approach improving management, execution and delivery while dealing with multiple projects/products, events, stakeholders and teams? Giving you better bottom line results, faster time to market, less work, better predictability, happier employees, and delighted clients? Then learn about TameFlow!
- #6
Ansible for DevOps
Jeff GeerlingAnsible is a simple, but powerful, server and configuration management tool. Learn to use Ansible effectively, whether you manage one server—or thousands.
- #7
Machine Learning Engineering
Andriy Burkov"If you intend to use machine learning to solve business problems at scale, I'm delighted you got your hands on this book."
—Cassie Kozyrkov, Chief Decision Scientist at Google
"Foundational work about the reality of building machine learning models in production."
—Karolis Urbonas, Head of Machine Learning and Science at Amazon
- #8
C++ Best Practices
Jason TurnerLevel up your C++, get the tools working for you, eliminate common problems, and move on to more exciting things!
- #9
Composing Software
Eric ElliottAll software design is composition: the act of breaking complex problems down into smaller problems and composing those solutions. Most developers have a limited understanding of compositional techniques. It's time for that to change.
- #10
El Manual del Manager
Keyvan Akbary, Félix López, and Álvaro Salazar¿Has deseado alguna vez el haber tenido una buena introducción al rol del Engineering Manager? En este libro aprenderás lo necesario para ejercer el rol de una manera efectiva: Expectativas y Responsabilidades del Rol, 1-1s, Ayudar a Crecer, Objetivos, Planes de Carrera, Cultura, Feedback, Contratación, Cultura de Producto y mucho más.
Top Bundles
- #1
The Tester's Library
8 Books
The Tester's Library consists of eight five-star books that every software tester should read and re-read. As bound books, this collection would cost over $200. Even as e-books, their price would exceed $80, but in this bundle, their cost is only $49.99. Here are the books, and why they should be in your library: Perfect Software and Other... - #2
agile
11 Books
In this bundle, you will find 10 different agile books. They are about different aspects of being agile. - finding a job - doing coding dojo's - Retrospectives - Personal kanban - a non-typical coaching book and even a book that gives you an insight in the lives of some agile people. - #3
WTFlop 6M + HU - Beta Bundle
6 Books
- #4
Marionette.js A to Z
3 Books
Marionette.js has become a popular Backbone-based javascript library, because it helps you avoid boiler-plate code and focus on what makes your app special. But how do you get started?Whether you want to finally get started with dynamic client-side programming (like one reader did), or are an experienced front-end dev who has inherited a... - #5
Build A Better Backbone App
3 Books
The best way to learn new development skills is through experience, but that takes time you don't have.Get the best of both worlds with this bundle: you'll learn how to produce modern web applications by learning from experienced developers like Derick Bailey and David Sulc. BackboneJS is one of the favorite tools on the web today, but it... - #6
General Systems Thinker Bundle
5 Books
The General Systems Thinker Bundle is just that: a bundle of five books to advance the reader one giant step toward improved thinking, based on General Systems principles. Four of the books are the complete General Systems Series. The fifth is fictional piece which shows some general systems thinkers in action. It's a mystery in which a group of... - #7
Experiential Learning Bundle
4 Books
This bundle provides all four volumes of the popular Experiential Learning Series at a savings of $20 over the price if purchased separately. - #8
Ansible Bundle
2 Books
After getting up and running with Ansible in Jeff Geerling's Ansible for DevOps, strengthen your skills managing tens to thousands of instances and services in Amazon's AWS cloud with Yan Kurniawan's Ansible for AWS. - #9
Learn ECMAScript 6 inside and out
2 Books
For any technology, it helps to get multiple points of view on the functionality to get the best possible understanding. For ECMAScript 6/2015, no two resources are recommended more frequently thanExploring ES6by Dr. Axel Rauschmayer andUnderstanding ECMAScript 6by Nicholas C. Zakas. These two points of view, investigating the specification and... - #10
Software architecture, for systems old and new
2 Books
This bundle includes books about hands-on software architecture.
