AWS Glue & Avoiding Rookie Mistakes

  Рет қаралды 4,370

Mission Cloud

Mission Cloud

Күн бұрын

AWS Glue is a managed service that offers click-through ETL job generation enabling users to quickly set up an ETL pipeline in the AWS ecosystem.
However, there are a few mistakes that customers commonly make whether new to the service or even if they have already been using it for some time. The goal of this event is to enable Glue users to effectively utilize the Glue service and avoid common customer pitfalls.
Join us as we answer a few key questions about AWS Glue such as:
- What do you need to know to get started using Glue?
- What do you need to avoid in Glue jobs to ensure a successful run?
- What do you need to consider for your source data?
- How can you automate data discovery successfully with Glue crawlers?
- How can you deal with a large number of files successfully?
Presenters:
- Dr. Ryan Ries, Practice Lead, Data, Analytics, & Machine Learning, Mission
- Amber Runnels, Big Data Consultant, Mission

Пікірлер: 6
@vashishtarora6163
@vashishtarora6163 Жыл бұрын
This was really good and informative. Thank you
@Missioncloud
@Missioncloud Жыл бұрын
Glad this was helpful! Let us know if you have any questions.
@marcosfarahnagato4886
@marcosfarahnagato4886 11 ай бұрын
Nice tips, thanks for sharing! I have a question for Amber... I find that glue workflows take quite long to transition between jobs, which can be harmful in scenarios with many jobs in a workflow. Is there any tip to optimize these transitions?
@dwight0g
@dwight0g Жыл бұрын
excellent video thank you
@Missioncloud
@Missioncloud Жыл бұрын
Glad you enjoyed it. Let us know if you have any questions!
@hamzaehsankhan
@hamzaehsankhan 2 жыл бұрын
AWS Workflow maybe powerful, but UI is highly unfriendly for devs. Need waste improvment. I just coded the crawler and job execution using boto3 rather than using workflow.
AWS re:Invent 2021 - Serverless data integration with AWS Glue
1:00:20
2021 07 06 AWS PartnerCast  Mastering AWS Glue Series 1 of 2
1:34:50
AWS Partner Network
Рет қаралды 6 М.
Sigma Girl Past #funny #sigma #viral
00:20
CRAZY GREAPA
Рет қаралды 31 МЛН
когда повзрослела // EVA mash
00:40
EVA mash
Рет қаралды 3,8 МЛН
Children deceived dad #comedy
00:19
yuzvikii_family
Рет қаралды 8 МЛН
AWS Tutorials - Using Job Bookmarks in AWS Glue Jobs
36:14
AWS Tutorials
Рет қаралды 11 М.
AWS Tutorials - Data Quality Check in AWS Glue ETL Pipeline
41:33
AWS Tutorials
Рет қаралды 8 М.
AWS Glue Tutorial for Beginners [FULL COURSE in 45 mins]
41:30
Johnny Chivers
Рет қаралды 249 М.
PySpark For AWS Glue Tutorial [FULL COURSE in 100min]
1:36:49
Johnny Chivers
Рет қаралды 80 М.
Interview with a Meta EM: AI Impact on SWEs, Team Match, Ramp-Up, How to Learn
45:14
Hello Interview - Tech Interview Preparation
Рет қаралды 498
AWS Tutorials - Partition Data in S3 using AWS Glue Job
36:09
AWS Tutorials
Рет қаралды 17 М.
AWS re:Invent 2020: Serverless data preparation with AWS Glue
31:36
Как слушать музыку с помощью чека?
0:36
Best mobile of all time💥🗿 [Troll Face]
0:24
Special SHNTY 2.0
Рет қаралды 2,5 МЛН