Amazon EMR Deep Dive and Best Practices - AWS Online Tech Talks

  Рет қаралды 56,323

AWS Developers

AWS Developers

Күн бұрын

Amazon EMR is the industry-leading cloud big data platform for processing vast amounts of data using open source tools such as Apache Spark, Apache Hive, Apache HBase, Apache Flink, Apache Hudi, and Presto. In this tech talk, we introduce you to Amazon EMR design patterns and architectural best practices. We show how EMR can help you run Petabyte-scale analysis at less than half of the cost of traditional on-premises solutions and over 3x faster than standard Apache Spark. You'll learn how to spin up and spin down clusters as needed for short jobs and how to create highly available clusters that automatically scale to meet demand. Discover how Apache Hudi simplifies building data pipelines. You will also learn how to run EMR clusters on AWS Outposts for on-premises or hybrid deployments.
Learning Objectives:
*Learn how to design a big data environment using best practices
*Find out the best way to support Apache Spark, Hive, HBase and other open source applications
*See how to choose the right approach for both short- and long-running jobs
***To learn more about the services featured in this talk, please visit: aws.amazon.com/emr Subscribe to AWS Online Tech Talks On AWS:
www.youtube.com/@AWSOnlineTec...
Follow Amazon Web Services:
Official Website: aws.amazon.com/what-is-aws
Twitch: / aws
Twitter: / awsdevelopers
Facebook: / amazonwebservices
Instagram: / amazonwebservices
☁️ AWS Online Tech Talks cover a wide range of topics and expertise levels through technical deep dives, demos, customer examples, and live Q&A with AWS experts. Builders can choose from bite-sized 15-minute sessions, insightful fireside chats, immersive virtual workshops, interactive office hours, or watch on-demand tech talks at your own pace. Join us to fuel your learning journey with AWS.
#AWS

Пікірлер: 20
@friends4lives
@friends4lives 3 жыл бұрын
Great Video. To the point, clear and very helpful. THANK YOU!
@thekaders3535
@thekaders3535 2 жыл бұрын
This is an excellent presentation providing concise depth on a number of critical features
@giovani345
@giovani345 3 жыл бұрын
Rich content. Thank you!
@mohitpandey5190
@mohitpandey5190 2 жыл бұрын
In scaling comparison time scale is different for both of the graphs(12h vs 14 days), I believe the graph will be much smoother in higher time frames.
@saleembasha1131
@saleembasha1131 3 жыл бұрын
Fantastic demo and the presentation is rich and cool one ..... its more helpful to design productioniged solutions
@oldoctopus393
@oldoctopus393 Жыл бұрын
thanks for demo and presentation, it's rare to find such a professionally structured materials!
@amazonwebservices
@amazonwebservices Жыл бұрын
Happy to help you with the best resources! 🤝 ❤️ 😎
@gunjankhandelwal1586
@gunjankhandelwal1586 2 жыл бұрын
This is amazing, appreciate it. :)
@leandromana
@leandromana 3 жыл бұрын
great presentation, covering key features, well explained and showing demos as well.. thanks very much ; )
@avitabayansarma1011
@avitabayansarma1011 11 ай бұрын
Very informative!As EMR File system provides provisioning s3 services. Can I use EMR FS as the storage and on top of it running spark for handling big data? Is it possible to replace hadoop with s3?
@mwont
@mwont 3 жыл бұрын
Is the step function code open sourced?
@vigneshvit
@vigneshvit Жыл бұрын
Am quite intrigued about the small file problem.. .say thr is a table and has 10 recs and we the convert them we create a parquet ifile..whr.woukd it cause problems? While say external table creation or while we run any inquiry or during any analytics job performing complex calculation...
@bugzi11a
@bugzi11a 3 жыл бұрын
great video. Can we get that Step Functions code ?
@Larry21924
@Larry21924 5 ай бұрын
This is a marvel. I read a book with similar content, and it was a marvel to behold. "Mastering AWS: A Software Engineers Guide" by Nathan Vale
@kkanu3833
@kkanu3833 2 жыл бұрын
AWESOME
@sanooosai
@sanooosai 2 жыл бұрын
brilliant
@justindebo997
@justindebo997 3 жыл бұрын
Diddo on the step functions code. Great video though!
@wasimbagwan6771
@wasimbagwan6771 2 жыл бұрын
Helpful video. Link to ASL code?
@manjuchoudhary6318
@manjuchoudhary6318 3 жыл бұрын
A lot of information for sure but not explained well to actually understand it
@zucbsivrtcpegapjzwrf2056
@zucbsivrtcpegapjzwrf2056 2 жыл бұрын
text
Getting Started with Amazon Redshift - AWS Online Tech Talks
46:39
AWS Developers
Рет қаралды 56 М.
AWS EMR Tutorial [FULL COURSE in 60mins]
1:01:06
Johnny Chivers
Рет қаралды 58 М.
WHAT’S THAT?
00:27
Natan por Aí
Рет қаралды 13 МЛН
New model rc bird unboxing and testing
00:10
Ruhul Shorts
Рет қаралды 23 МЛН
Эффект Карбонаро и нестандартная коробка
01:00
История одного вокалиста
Рет қаралды 9 МЛН
Intro to Amazon EMR - Big Data Tutorial using Spark
22:02
jayzern
Рет қаралды 20 М.
AWS re:Invent 2023 - Dive deep on Amazon S3 (STG314)
51:25
AWS Events
Рет қаралды 8 М.
Amazon EMR on Amazon EKS Deep Dive - AWS Online Tech Talks
59:59
AWS Developers
Рет қаралды 7 М.
AWS Tutorials - Absolute Beginners Tutorial for Amazon EMR
46:35
AWS Tutorials
Рет қаралды 29 М.
Собери ПК и Получи 10,000₽
1:00
build monsters
Рет қаралды 2,8 МЛН
Easy Art with AR Drawing App - Step by step for Beginners
0:27
Melli Art School
Рет қаралды 15 МЛН
تجربة أغرب توصيلة شحن ضد القطع تماما
0:56
صدام العزي
Рет қаралды 57 МЛН
Копия iPhone с WildBerries
1:00
Wylsacom
Рет қаралды 612 М.