Data Mesh, Data Fabric
Unravelling Digital Information Systems
The Data Warehouse is over thirty years old. Business intelligence around twenty. The Data Lake just turned ten. So, is it time for something new? In fact, two new frameworks have recently emerged: Data Fabric and Data Mesh.
But what are they? Are they truly novel or simply marketing hype? Are they the same thing? How do they relate to the Data Warehouse, Lake, Hub, or even Lakehouse? What are their benefits and drawbacks? Should you be planning a Mesh or a Fabric? If so, where would you start?
All these new and old terms, with overlapping scopes and different promoters, are types of Digital Information Systems, designed to manage and deliver data/information to all digital business processes in today’s complex distributed and network-centric environments.
Dr. Barry Devlin explains and positions Data Fabric and Mesh, as well as other concepts, old and new, using as a foundation the Digital Information Systems Architecture (DISA) first defined in “Business Unintelligence”. Existing and emerging technologies for Data Storage, Preparation, and Virtualization; Data Catalogs; and other tools, both on-premises and Cloud, are described. Also explored are a variety of organisational issues, methodologies, and implementation approaches.
What you will learn
- History, meaning, and detailed functionality of Data Fabric
- History, meaning, and detailed functionality of Data Mesh
- An introduction to the Digital Information Systems Architecture (DISA) and its business and technical uses
- Technical rationale, structure and components of the DISA conceptual and logical architectures
- An in-depth comparison of Data Fabric and Mesh with Data Warehouse, Lake, Hub, and Lakehouse using DISA as a basis
- Possibilities and challenges of new database and data management technologies in Cloud, on-premises, and hybrid environments
- The central role of context-setting information and metadata
- Adaptive Processes as the basis for data preparation, information creation, and insight discovery
- Using data virtualization and preparation as tools for integration of all types of content and data in Cloud, on-premises, and hybrid environments
- Practical planning and implementation steps from Data Warehouse/Lake to Data Fabric or Mesh
- Introduction to Digital Information Systems and their evolution
- Digital Information Systems Architecture
- Deep dive: Data Fabric
- Deep dive: Data Mesh
- Shallow dives: Data Warehouse, Lake, Lakehouse, Hub etc.
- Information Storage Management (including metadata) technology review
- Information preparation and distribution technology review
- Planning and implementation considerations