AWS re:Invent 2018: Building Serverless Analytics Pipelines with AWS Glue (ANT308)

  Рет қаралды 28,737

Amazon Web Services

Amazon Web Services

5 жыл бұрын

Organizations need to gain insight and knowledge from a growing number of IoT, APIs, clickstreams, and unstructured and log data sources. However, organizations are also often limited by legacy data warehouses and ETL processes that were designed for transactional data. In this session, we introduce key ETL features of AWS Glue, we cover common use cases ranging from scheduled nightly data warehouse loads to near real-time, event-driven ETL pipelines for your data lake. We also discuss how to build scalable, efficient, and serverless ETL pipelines using AWS Glue. Please join us for a speaker meet-and-greet following this session at the Speaker Lounge (ARIA East, Level 1, Willow Lounge). The meet-and-greet starts 15 minutes after the session and runs for half an hour.

Пікірлер: 6
@hxz116
@hxz116 4 жыл бұрын
Mehul Shah gets it right. He explains Glue very well.
@varunsood8509
@varunsood8509 5 жыл бұрын
How to manage incremental loading while reading the data from relational database? Is there a way to create a filter/parameter on date while reading from source database? Thank you!
@ND-gn8tc
@ND-gn8tc 3 жыл бұрын
You can do that by choosing a bookmark column (last updated date for example). It is a good idea to make sure that column is indexed in your source database.
@sundaraanga3916
@sundaraanga3916 4 жыл бұрын
Glue execution model explanation is not clear
@bestentertainment2728
@bestentertainment2728 5 жыл бұрын
Another pretty powerpoint slides webinar! No real demo on howto! Typical AWS.
Slow motion boy #shorts by Tsuriki Show
00:14
Tsuriki Show
Рет қаралды 7 МЛН
마시멜로우로 체감되는 요즘 물가
00:20
진영민yeongmin
Рет қаралды 31 МЛН
Happy 4th of July 😂
00:12
Alyssa's Ways
Рет қаралды 65 МЛН
Looks realistic #tiktok
00:22
Анастасия Тарасова
Рет қаралды 105 МЛН
Observability vs. APM vs. Monitoring
9:41
IBM Technology
Рет қаралды 153 М.
Top AWS Services A Data Engineer Should Know
13:11
DataEng Uncomplicated
Рет қаралды 156 М.
Delta Live Tables A to Z: Best Practices for Modern Data Pipelines
1:27:52
What is Middleware?
10:11
IBM Technology
Рет қаралды 91 М.
Slow motion boy #shorts by Tsuriki Show
00:14
Tsuriki Show
Рет қаралды 7 МЛН