No video

How to Make a Data Mesh; Not Data Mess. MIT CDOIQ 2021

  Рет қаралды 9,911

Caserta

Caserta

Күн бұрын

A fairly new concept in the industry, Data Mesh is an exciting new approach for designing and developing data architectures that challenges the status quo of centralized data platforms and advocates for a decentralized domain-driven design. Joe Caserta, thought-leader and authority on enterprise data solutions, shares information you need to decide if a Data Mesh is right for your business, and how to lead your company through a transformation without creating a data mess. Questions answered in this session include:
Will my data organization have to change to support data mesh?
How do I apply data governance to a data mesh?What does it mean to treat data as a product?
What does domain-driven design look like for data?
Do I still need a data lake or a data warehouse?
As a CDO, the trend of data mesh architecture cannot be ignored, and with little to no real fully-baked information publicly available, this session wrestles key issues to the ground and provides an honest assessment of the disruption being caused by the data mesh approach. Business executives and technical leaders will benefit from the practical use cases shared throughout this session.

Пікірлер: 9
@vespeerr
@vespeerr 2 жыл бұрын
By far one of the best analysis on the topic
@asishjoshi5774
@asishjoshi5774 Жыл бұрын
Bingo- ''Data as a code''! is going to come sooner than later. Great insight by Joe! Thanks Joe for sharing this wonderful session on Data Mesh.
@risebyliftingothers
@risebyliftingothers Жыл бұрын
Excellent, honest, practical and no BS ♥️
@vespeerr
@vespeerr 2 жыл бұрын
"Data Performance" is I think the elephant in the room of data mesh. Putting DWH on the failure-pattern side is confusing implementation/development with technology. I think this exposes soon issues when physics constraints become stronger than software needs. For example: how to deal with strong consistency or massive cross domain/product aggregation on frequently changing data ? Dealing with that with an application-centric approach will not work. The solution is to co-locate loosely coupled data products on RDBMS/MPP systems. No one prevent those data product to evolve autonomously still avoiding the communication overhead of physically isolated deployments. Am I missing something?
@vespeerr
@vespeerr 2 жыл бұрын
When you discuss virtualization technologies, what do you mean by "data prod need lower level control" ? thnx a lot
@zieddatascientist546
@zieddatascientist546 4 ай бұрын
Can i get the slides please ?
@matnardone5529
@matnardone5529 3 жыл бұрын
"You need to be able to attach the code to the data"...I interpret that as the code being metadata attached to the data. Would this include governance type rules and the contract between producer and consumer?
@CasertaConcepts
@CasertaConcepts 2 жыл бұрын
Yes. The idea is to ensure that your data product can stand alone. To stand alone, it needs to be self documenting. It should provide metadata, governance/usage rules, and details of the data contract via the control port. How you implement that is up to you, but it's probably easiest to imagine these things being delivered up by a RESTful service. The trick is to ensure there's a common standard for how that description service behaves and what it provides so that other data consumers and data products can interact with these data products across the organization.
@angelahoward8462
@angelahoward8462 2 жыл бұрын
What is the software that you reference #1 and #2 on the opportunities for innovation slide…?
Data Mesh and Governance
1:29:08
Thoughtworks
Рет қаралды 9 М.
Introduction to Data Mesh - Zhamak Dehghani
34:52
Thoughtworks
Рет қаралды 87 М.
Каха заблудился в горах
00:57
К-Media
Рет қаралды 10 МЛН
WORLD'S SHORTEST WOMAN
00:58
Stokes Twins
Рет қаралды 165 МЛН
Kids' Guide to Fire Safety: Essential Lessons #shorts
00:34
Fabiosa Animated
Рет қаралды 10 МЛН
Son ❤️ #shorts by Leisi Show
00:41
Leisi Show
Рет қаралды 10 МЛН
What Is Data Mesh, and How Does it Work? ft. Zhamak Dehghani
34:57
Supply Chain Models in Action - with MIT and Intel
56:35
MIT Center for Transportation & Logistics
Рет қаралды 17 М.
Data Mesh, Data Fabric, Data Lakehouse - SQLBits 2022
56:26
James Serra
Рет қаралды 51 М.
Data Mesh: an Architectural Deep Dive
38:03
InfoQ
Рет қаралды 7 М.
The Promise of Modern Data Ecosystems
58:28
Caserta
Рет қаралды 393
MIT economists Esther Duflo and Abhijit Banerjee win Nobel Prize (press conference)
52:32
Massachusetts Institute of Technology (MIT)
Рет қаралды 819 М.
Data Mesh and Domain Ownership
1:24:18
Thoughtworks
Рет қаралды 14 М.
Каха заблудился в горах
00:57
К-Media
Рет қаралды 10 МЛН