Building a Data Mesh Architecture with AWS Lake Formation

Building a Data Mesh Architecture with AWS Lake Formation - AWS Online Tech Talks

Рет қаралды 28,317

Күн бұрын

Many organizations are modernizing to become more data driven. To be successful, lines of business and teams need to have more control and autonomy over their data, platform, and how their data is used by the organization. A new data mesh design pattern has emerged that allows companies to organize into data domains, each owning their data and technology stack. In this tech talk, we will dive deep into AWS Lake Formation and show how it can be used to enable a data mesh pattern with the benefit of central data discovery and governance.
Learning Objectives:
*Understand how AWS Lake Formation can enable you to build a data mesh architecture
*Understand how AWS Lake Formation can be used to govern and enforce permissions in a data mesh architecture
*Explore a reference architecture to help you get started building your own data mesh
***To learn more about the services featured in this talk, please visit: aws.amazon.com/lake-formation/ Subscribe to AWS Online Tech Talks On AWS:
www.youtube.com/@AWSOnlineTec...
Follow Amazon Web Services:
Official Website: aws.amazon.com/what-is-aws
Twitch: / aws
Twitter: / awsdevelopers
Facebook: / amazonwebservices
Instagram: / amazonwebservices
☁️ AWS Online Tech Talks cover a wide range of topics and expertise levels through technical deep dives, demos, customer examples, and live Q&A with AWS experts. Builders can choose from bite-sized 15-minute sessions, insightful fireside chats, immersive virtual workshops, interactive office hours, or watch on-demand tech talks at your own pace. Join us to fuel your learning journey with AWS.
#AWS

Пікірлер: 9

@davidpratr Жыл бұрын

Is there any place with a tutorial of how to create the federated data governance with the lake formation from different aws accounts ?

@aprrt 2 жыл бұрын

Without Lake formation, can't we achieve the data mesh architecture using Other AWS products?

@pattyflisher854 2 жыл бұрын

A Data Domain is not the same as a Line of Business.

@kulveersinghdhanoa 2 жыл бұрын

AWS is selling datamart in form of data mesh. Old wine in new bottle.

@cyclogenisis 2 жыл бұрын

Exactly this, it's like going back in time.

@Pnchmstr Жыл бұрын

The key difference between this architecture and a conventional DWH architecture, based on datamarts, is the distributed nature of this architecture. Instead of ingesting data from different domains into a central system (losing all data ownership in the process) the idea of data mesh is to maintain the ownership by distributing the storage and analytical capabilities over all domains in a microservice environment. For me this idea is ground breaking, because it fundamentally challenges the idea of a central business intelligence platform, seperated from the business applications.

@PouyaAtaei 2 жыл бұрын

minute 17, I'd argue that a startup should not even embark on a big data endeavor in 2022.

@bcbvcbvcbcvb Ай бұрын

In the name of solving an already solved problem , you just need to rename it !

@vio4jesus Жыл бұрын

Hilarious..... oh yeah, it was some tech guy, after a late night of drinking who decided which data was put into the warehouse. Uh, no - it HAS ALWAYS BEEN the consumers (the business), or at least the funded consumer who decided what data got put into the warehouse. It's hilarious how distorted your understanding of centralized IT is. and NOW, now that we have some new methodology - the data has good quality. Dude, you be smokin' something.