AWS Glue ETL with Python shell
Read data from S3 and insert into Redshift using Python Shell script
AWS Glue is a fully managed ETL service that makes it easy for customers to prepare and load their data. it have two option we can create glue script using python as well as spark.
Using AWS Glue I have create Python script and store data into Redshift table.
library used :
boto3
pandas
psycopg2
github.com/saurabhgarg013/My_...
AWS GLUE ETL AND REDSHIFT RELATED DATA ENGINEERING VIDEOS.
(Create Redshift Cluster and Load Data using Python)
• Create Redshift Cluste...
(AWS Glue ETL with Python shell |Read data from S3 and insert Redshift)(Not using Pyspark with glue)
• AWS Glue ETL with Pyth...
(AWS GLUE Complete ETL Project Demo| Load Data from AWS S3 to Amazon RedShift)(Data engineer Project)
• AWS GLUE Complete ETL ...
(Redshift using Python| Load and insert and copy data into redshift using psycopg2 )
• Redshift using Python|...
(Aws Redshift tutorial |Amazon Redshift Architecture | Data Warehouse Concept)
• Aws Redshift tutorial ...
(Building ETL Pipeline using AWS Glue and Step Functions)
• Building ETL Pipeline ...
(AWS GLUE CRAWLER TUTORIAL with DEMO| Learn AWS GLUE)
• AWS GLUE CRAWLER TUTOR...
(AWS GLUE CONCEPT|GLUE DATA CATALOG|GLUE TUTORIAL)
• AWS GLUE CONCEPT|GLUE ...
AWS ATHENA AND LAMBDA RELATED
• ATHENA COMPLETE TUTORI... (ATHENA COMPLETE TUTORIAL WITH DEMO |AWS ATHENA TABLE PARTITION|DEMO)
• How to run Athena quer... (How to run Athena query from AWS Lambda DEMO|AWS ATHENA FROM LAMBDA)
• Athena using Python f... (Athena using Python for Beginners)
In case of any query, you can contact us directly on WhatsApp 8800502668
and you can write mail technodevs13@gmail.com
Request you to subscribe my channel Techno Devs with Saurabh and Press Bell icon & get regular updates on videos.