AWS Glue Studio - Lets Get Hands On!

Рет қаралды 17,078

Күн бұрын

📁 github.com/johnny-chivers/glu...
❔www.thequestionbank.io
ℹ️ johnnychivers.co.uk
• Working with AWS Glue ...
00:00 - Intro
01:26 - Setting Up The Sample Data
04:55 - Configuring The IAM Role
06:13 - Setting Up The Crawler
08:41 - The Glue Studio Console
11:17 - Create Visual Job 1
20:41 - Create Job 2 with Join
27:35 - Create Job 3 with Custom Code
In this video we get hands on with AWS Glue Studio with a full tutorial. We start by setting up a datasource to use for the tutorial and then register the data in our data catalog. Using this data we created three AWS Glue Work flows using the visual editor provided to us by AWS Glue Studio. We store the outputted data to S3 where we use S3 Select to look at our results.
😎 About me
I have spent the last decade being immersed in the world of big data working as a consultant for some the globe's biggest companies. My journey into the world of data was not the most conventional. I started my career working as performance analyst in professional sport at the top level's of both rugby and football. I then transitioned into a career in data and computing. This journey culminated in the study of a Masters degree in Software development. Alongside many a professional certification in AWS and MS SQL Server.

Пікірлер: 30

@sukhishdhawan Жыл бұрын

i love you man,, you are making one of the best AWS courses and helping many Data Engineers

@charleslyonga1661 2 жыл бұрын

Wow!!!!! keep enriching us Johnny Chivers difficult to find real-life content like yours. Kudos

@JohnnyChivers 2 жыл бұрын

Thanks Charles! Glad it was helpful.

@brunonog9985 Жыл бұрын

Great tutorial! Especially helpful when talking about IAM role workarounds. Thank you

@petrodyak 2 жыл бұрын

Thanks for this video. It was really useful for beginner who just started to learn AWS Glue. Special thanks for to read Captions. It's really important for not native English persons.

@JohnnyChivers Жыл бұрын

You're very welcome!

@muhammadnurhafiznoormohama7605 Жыл бұрын

This is very good! Thank you for doing this.

@midhunrajaramanatha5311 2 жыл бұрын

Superb video on AWS glue studio

@JohnnyChivers 2 жыл бұрын

Thanks Midhunraja!

@bobhaffner5902 2 жыл бұрын

Congrats on hitting 1K subs!

@JohnnyChivers 2 жыл бұрын

Thanks Bob.

@p-a5603 Жыл бұрын

Hi, this is a second tutorial from you about Glue from you I am watching, very nice work!. It seems pretty easy and straightforward if your input data are in csv but what solution would you suggest, if the input data are nested jsons and I want them in Data catalogue? In this visual job settings there is stated, that "Data Catalog update options are not supported when using schemas with nested data structures." Thanks in advance.

@kaedien 2 жыл бұрын

fantastic stuff as usual Johnny, well done 🎉

@JohnnyChivers 2 жыл бұрын

Thanks for watching as always.

@SincereLe-nr3ue Жыл бұрын

Thank you very much, John. I really enjoyed and appreciated your videos. By any chance you can do a video with the target as SQL Server on the RDS. Or the AWS SCT?