Query Redshift Table with SQL in Python

Query Redshift Table with SQL in Python | AWS SDK for Pandas

Рет қаралды 2,440

Күн бұрын

This is a hands-on tutorial which walks through the step-by-step process on how to query data in a redshift database using a SQL statement. In this video, I'm going to first cover how we can connect to our redshift cluster in python, use sql to pull values from a single table, use a where statement to limit how much data we are querying,
use python variables in our sql statements, and how to query multiple redshift tables with a join and return the results.
Github Repo: github.com/AdrianoNicolucci/d...
Add Redshift Data Source In AWS Glue Catalog: • Add Redshift Data Sour...
Buy me a coffee: www.buymeacoffee.com/dataengu
timeline:
00:00 Overview
00:37 Prerequisites
01:02 Connect to redshift cluster in python
02:55 Query single table
03:54 Query table with where statement
04:28 Query table with python variables
06:01 Query multiple tables with inner join
#aws #dataengineering #awswrangler

Пікірлер: 3

@BI-Rahul Жыл бұрын

This is awesome!

@grok_coder 11 ай бұрын

Can you explain how this compares with Redshift Data API where we use execute_statement()? Is there a limit on how much data we can read at once? How does it compare to JDBC connection?

@DataEngUncomplicated 11 ай бұрын

That's a good question, I'm not sure what the technical differences are of using this api Instead. The limit of how much data you can pull is dependant on your machine. For example if using a lambda function you are going to hit memory issues quicker than I'd you were using a machine with 32gb of memory.