AWS Redshift Query Tuning and Performance Optimization

  Рет қаралды 43,927

Aurobindo Saha

Aurobindo Saha

5 жыл бұрын

This is 1 hour 45 minutes presentation compiled from Amazon documentation to understand AWS Redshift query tuning and performance optimization.
The presentation has 4 sections -
1. Overview of AWS Redshift
2. AWS Query Tuning and Performance optimization
3. Best Practices and Tools
4. Tutorials

Пікірлер: 19
@sud9318
@sud9318 3 жыл бұрын
This is solid gold! Very well explained.
@sachingupta6575
@sachingupta6575 2 жыл бұрын
Amazing Video, Exactly what I was looking for...Thank you , great work....
@krishnathyagarajan9174
@krishnathyagarajan9174 3 жыл бұрын
Nice !. You have accounted most of it.
@priyankashekhawat6174
@priyankashekhawat6174 3 жыл бұрын
A very captivate and full of knowledge tutorial. Request you to make some more videos on AWS service like Redshift Spectrum , Athena , RDS and DynamoDB. Thanks a lot :)
@AurobindoSaha
@AurobindoSaha 3 жыл бұрын
Sure, I will try create more such videos on Spectrum, RDS, Athena, Dynamo etc.
@avi3926
@avi3926 4 жыл бұрын
Quite concise and crisp w.r.t the content..excellent Sir..Would request you to share such crisp content over Redshift Spectrum..Thanks in advance.. :)
@AurobindoSaha
@AurobindoSaha 4 жыл бұрын
Thank you very much. Sure I will create a content for spectrum. The credit goes to AWS team for their so well organised documentation. I marely narrated what is there in their documentations.
@arunvignesh3245
@arunvignesh3245 2 жыл бұрын
Hello Aurobindo.. it was a great content to be honest.. Whether you can share the PPT with us please. it would be more helpful.
@AurobindoSaha
@AurobindoSaha 2 жыл бұрын
Unfortunately I do not have the PPT with me anymore. However you will find the entire content from AWS Redshift User Guide
@rankopchovski2518
@rankopchovski2518 5 жыл бұрын
How can i get the Presentation?
@AurobindoSaha
@AurobindoSaha 3 жыл бұрын
@@chundrugopalakrishnachowda4228 The content presented here is everything from AWS Redshift database user guide (docs.aws.amazon.com/redshift/latest/dg/welcome.html). All I did here is to colate that 900+ page PDF document in few hours video. My response to the previous commenters question was the presentation is no longer with me, since it was built when I was with my previous organization.
@munnapaswan8248
@munnapaswan8248 Жыл бұрын
Hello sir, I watched your presentation. It was wonderful. I have some questions on this topic. I have four big Redshift queries, each takes approx 12-15 sec when I run them one by one, and all are accessing the same table. But when all are executing parallel using API calls through UI, each takes 40-60 sec. I wanted to know the reason behind that. Please give your suggestion on this.
@AurobindoSaha
@AurobindoSaha 6 ай бұрын
APIs are not the best protocol to handle large data. API payloads are generally very small. Please try JDBC or ODBC instead
@rishab0B
@rishab0B 3 жыл бұрын
24:00
@sumathim8154
@sumathim8154 3 жыл бұрын
Please help me with this query! What will happen will leader node fails?
@AurobindoSaha
@AurobindoSaha 3 жыл бұрын
As far as I know Leader Node failure is single point of failure in case of Redshift. I am sure AWS has measures to handle such failure. You can run cloudwatch metrics on Redshift to monitor the nodes ( docs.aws.amazon.com/redshift/latest/mgmt/metrics-listing.html ) and take corrective actions on failures.
@sumathimidathala4517
@sumathimidathala4517 3 жыл бұрын
Thank you sir
@joerokcz
@joerokcz Жыл бұрын
Yes, the leader node in Amazon Redshift can be considered a single point of failure. The leader node is responsible for managing client connections, query coordination, and metadata management in the Redshift cluster. If the leader node becomes unavailable due to a failure or any other reason, it can impact the cluster's overall availability and the ability to perform certain administrative tasks. However, it's important to note that the compute nodes in a Redshift cluster are separate from the leader node and continue to function independently. The compute nodes store and process the data, allowing queries to execute even if the leader node is unavailable. Queries that are already running will continue to execute, and new queries can be submitted to the compute nodes directly. In the event of a leader node failure, Amazon Redshift automatically provisions a new leader node to resume the cluster's normal operation. The new leader node assumes the responsibilities of the previous leader node, establishes client connections, and continues to coordinate query execution and cluster management. To minimize the impact of a leader node failure and enhance cluster availability, it is recommended to design applications with appropriate retry and error handling mechanisms. Additionally, Amazon Redshift provides automated backups and allows you to create snapshots to protect your data and cluster configuration, further ensuring recovery options in the event of a failure. Overall, while the leader node represents a potential single point of failure in Amazon Redshift, the impact can be mitigated through automated recovery mechanisms and proper application design.
@supplycopiainc5770
@supplycopiainc5770 25 күн бұрын
@aurobindosaha hi
Data Warehousing on AWS with Redshift - with a demo!
39:16
Cloud Architects in Africa
Рет қаралды 18 М.
What it feels like cleaning up after a toddler.
00:40
Daniel LaBelle
Рет қаралды 61 МЛН
Who has won ?? 😀 #shortvideo #lizzyisaeva
00:24
Lizzy Isaeva
Рет қаралды 64 МЛН
Llegó al techo 😱
00:37
Juan De Dios Pantoja
Рет қаралды 22 МЛН
🤔Какой Орган самый длинный ? #shorts
00:42
Top AWS Services A Data Engineer Should Know
13:11
DataEng Uncomplicated
Рет қаралды 156 М.
AWS Databases - Difference between RDS, DynamoDB, Redshift - Comparison
16:43
knowledgeindia - LearnCloud
Рет қаралды 101 М.
Amazon EMR Deep Dive and Best Practices - AWS Online Tech Talks
40:32
AWS Developers
Рет қаралды 56 М.
Database vs Data Warehouse vs Data Lake | What is the Difference?
5:22
Alex The Analyst
Рет қаралды 747 М.
SQL performance tuning and query optimization using execution plan
49:23
Amazon Redshift for Beginners (Full Course)
32:33
ETL-SQL
Рет қаралды 22 М.
SQL Server Performance Tuning Made Easy - Pinal Dave | Craft 2019
47:13
IL’HAN - Pai-pai (lyric video) 2024
3:24
Ilhan Ihsanov
Рет қаралды 457 М.
LISA - ROCKSTAR (Official Music Video)
2:48
LLOUD Official
Рет қаралды 121 МЛН
Nurmuhammed Jaqyp  - Nasini el donya (cover)
2:57
Nurmuhammed Jaqyp
Рет қаралды 189 М.
Say mo & QAISAR & ESKARA ЖАҢА ХИТ
2:23
Ескара Бейбітов
Рет қаралды 2,4 МЛН