How to create RDS Data Source in AWS Glue

Рет қаралды 4,760

Fun With ETL

3 жыл бұрын

This video is to demonstrate how to create RDS Data Source in AWS Glue

Пікірлер: 33

@garunakt6081 3 жыл бұрын

Music is very very annoying and unnecessary. Thanks for the video!!

@rohitbhatnagar7599 Жыл бұрын

I agree. The purpose of training is to get information to viewers. I can not hear what your saying. Defeats the whole purpose of the training.

@FlameOfAnor9 2 жыл бұрын

I could not get my connection to work. Is your RDS in a Private Subnet or Public subnet ? if it is in a private subnet, you must have done some configuration for the connection to work. did you create and s3 endpoint or is your db instance in a public subnet?

@sandeeptiwari196 3 жыл бұрын

Thanks for making this video. Can you please show how you created this Role 'ETL'? Most preferable how to create a Role for Glue so that Glue can read from S3 and load to RDS (MySQL). I saw your other video too where this is being done but how the Role 'ETL' is created is not shown. Kindly make a video on this. Also, please lower the background music or remove it altogether.

@funwithetl6085 2 жыл бұрын

@Sandeep Tiwari, Please watch this video for creating the Role, kzfaq.info/get/bejne/gtuGedCklbDOXac.html

@amitdash1089 3 жыл бұрын

Can AWS Glue handle real-time processing?

@funwithetl6085 3 жыл бұрын

Yes AWS Glue can handle real-time processing using spark streaming

@iamdare 2 жыл бұрын

Please how did you create the Oracle instance?

@funwithetl6085 2 жыл бұрын

Hi, This is to create PostgreSql instance. You can follow same process to create Oracle. kzfaq.info/get/bejne/fJ9gadKYlZjJmoE.html

@ramalingamvarkala1571 3 жыл бұрын

I configured Rds MySQL database of version 5.7.31 is not getting connected from glue

@funwithetl6085 3 жыл бұрын

What error are you getting?

@VipinKumar-wq5tz 2 жыл бұрын

UPSERT is possible on Oracle db (Source is S3)....

@funwithetl6085 2 жыл бұрын

Yes Upsert is absolutely possible

@VipinKumar-wq5tz 2 жыл бұрын

@@funwithetl6085 we have a default script that was created after the mapping of the source and destination ..... And enabled the bookmark as well.... Does it is enough to avoid the duplicate entries?

@funwithetl6085 2 жыл бұрын

@@VipinKumar-wq5tz Yes its possibly sufficient

@VipinKumar-wq5tz 2 жыл бұрын

@@funwithetl6085 we have implemented it but sometimes the the data got duplicated multiple times ....

@funwithetl6085 2 жыл бұрын

@@VipinKumar-wq5tz What is the logic you have implemented?

@miranahmed1926 Жыл бұрын

why music??? :(

@giasamin6568 Жыл бұрын

Music is very very annoying and terribly disturbingly unnecessary. Thanks for the video!!

@rohitbhatnagar7599 Жыл бұрын

Agreed. Loses the meaning of the training, since you can not hear and understand things. Great video !!

@rohitbhatnagar7599 Жыл бұрын

It was great - I danced in my room and did AWS - all at the same time🤣

@johngwheeler 2 жыл бұрын

Please get rid of the music - it adds nothing and is extremely distracting.

@funwithetl6085 2 жыл бұрын

Sure, will do that

@RafaelFarias 2 ай бұрын

@@funwithetl6085 You didn't do it. Unwatchable.

@penniesshillings 3 жыл бұрын

These tutorials always skip the most difficult/annoying part: setting up the VPC, the security group and all that nonsense. Anyone can click through a wizard.

@funwithetl6085 3 жыл бұрын

Setting up VPC and security group is completely dependent on the handshakes you required. It is a AWS cloud administration process, which should be keenly incorporated. Mostly the tutorials on development will not have explanations on administrations