AWS re:Invent 2021 - Building a data lake on Amazon S3

Рет қаралды 30,536

Күн бұрын

Flexibility is key when building and scaling a data lake, and by choosing the right storage architecture, you will have the agility to quickly experiment and migrate to AWS. This session explores best practices for building a data lake on Amazon S3, which allows you to leverage industry-leading AWS, open-source, and third-party analytics and ML tools and gain insights from your data. This session also explores how to optimize your storage on Amazon S3 for data lakes, including information on storage classes, S3 access points, and running HPC workloads with Amazon FSx for Lustre.
Learn more about re:Invent 2021 at bit.ly/3IvOLtK
Subscribe:
More AWS videos bit.ly/2O3zS75
More AWS events videos bit.ly/316g9t4
ABOUT AWS
Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts.
AWS is the world’s most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers-including the fastest-growing startups, largest enterprises, and leading government agencies-are using AWS to lower costs, become more agile, and innovate faster.
#AWS #AmazonWebServices #CloudComputing

Пікірлер: 16

@MrDottyrock Жыл бұрын

This is very eye opening. I used AWS for several years and never thought S3 could serve such purpose. this is fantastic!

@awssupport Жыл бұрын

We're glad to see you enjoyed it, Jamiu! 👀 ^SA

@djohnjimmy 2 жыл бұрын

This is a very helpful intro into days lake design with S3. Thank you

@samuel_william Жыл бұрын

This video clearly explains about the storage-s3. Very good video to learn about s3

@umairqamar2672 Жыл бұрын

This was super duper amazingly wonderful to watch !

@AWSEventsChannel Жыл бұрын

Thank you 😀 👍

@mbaapohelviszonepoh1284 Жыл бұрын

This is very helpful. Thanks very much

@alexfaith5562 2 жыл бұрын

What an awesome video!

@severtone263 2 жыл бұрын

Thank you for this, this was very helpful

@masterek1998 Жыл бұрын

Ijiibjj😅jiiiihbiijiiiiijiibijiiiiiiii

@user-sw9kd9pv4n 2 жыл бұрын

24:24

@rifkiamil Жыл бұрын

We had 200gb of data in MS OLAP in 2008 coming out of terabyte ERP system. Not sure where getting his numbers from. 9:46

@yogenderpal 2 жыл бұрын

Hadoop replicates data in three different nodes, so we need to lose 2 nodes before we start to worry about data loss. He said we need to lose 3 data nodes.:)

@rbr951 Жыл бұрын

Good catch

@lordlee6473 2 жыл бұрын

Not much on data lake, more of a talk about S3 features for what it’s intended for, data storage. Actual data analysis and reporting is done with other AWS services.

@rbr951 Жыл бұрын

True that. To that extent a little disappointing. Datalake != s3