AWS Redshift Query Tuning and Performance Optimization

  Рет қаралды 44,192

Aurobindo Saha

Aurobindo Saha

5 жыл бұрын

This is 1 hour 45 minutes presentation compiled from Amazon documentation to understand AWS Redshift query tuning and performance optimization.
The presentation has 4 sections -
1. Overview of AWS Redshift
2. AWS Query Tuning and Performance optimization
3. Best Practices and Tools
4. Tutorials

Пікірлер: 19
@sud9318
@sud9318 3 жыл бұрын
This is solid gold! Very well explained.
@priyankashekhawat6174
@priyankashekhawat6174 3 жыл бұрын
A very captivate and full of knowledge tutorial. Request you to make some more videos on AWS service like Redshift Spectrum , Athena , RDS and DynamoDB. Thanks a lot :)
@AurobindoSaha
@AurobindoSaha 3 жыл бұрын
Sure, I will try create more such videos on Spectrum, RDS, Athena, Dynamo etc.
@sachingupta6575
@sachingupta6575 2 жыл бұрын
Amazing Video, Exactly what I was looking for...Thank you , great work....
@krishnathyagarajan9174
@krishnathyagarajan9174 3 жыл бұрын
Nice !. You have accounted most of it.
@avi3926
@avi3926 4 жыл бұрын
Quite concise and crisp w.r.t the content..excellent Sir..Would request you to share such crisp content over Redshift Spectrum..Thanks in advance.. :)
@AurobindoSaha
@AurobindoSaha 4 жыл бұрын
Thank you very much. Sure I will create a content for spectrum. The credit goes to AWS team for their so well organised documentation. I marely narrated what is there in their documentations.
@arunvignesh3245
@arunvignesh3245 2 жыл бұрын
Hello Aurobindo.. it was a great content to be honest.. Whether you can share the PPT with us please. it would be more helpful.
@AurobindoSaha
@AurobindoSaha 2 жыл бұрын
Unfortunately I do not have the PPT with me anymore. However you will find the entire content from AWS Redshift User Guide
@munnapaswan8248
@munnapaswan8248 Жыл бұрын
Hello sir, I watched your presentation. It was wonderful. I have some questions on this topic. I have four big Redshift queries, each takes approx 12-15 sec when I run them one by one, and all are accessing the same table. But when all are executing parallel using API calls through UI, each takes 40-60 sec. I wanted to know the reason behind that. Please give your suggestion on this.
@AurobindoSaha
@AurobindoSaha 6 ай бұрын
APIs are not the best protocol to handle large data. API payloads are generally very small. Please try JDBC or ODBC instead
@rankopchovski2518
@rankopchovski2518 5 жыл бұрын
How can i get the Presentation?
@AurobindoSaha
@AurobindoSaha 3 жыл бұрын
@@chundrugopalakrishnachowda4228 The content presented here is everything from AWS Redshift database user guide (docs.aws.amazon.com/redshift/latest/dg/welcome.html). All I did here is to colate that 900+ page PDF document in few hours video. My response to the previous commenters question was the presentation is no longer with me, since it was built when I was with my previous organization.
@rishab0B
@rishab0B 3 жыл бұрын
24:00
@sumathim8154
@sumathim8154 3 жыл бұрын
Please help me with this query! What will happen will leader node fails?
@AurobindoSaha
@AurobindoSaha 3 жыл бұрын
As far as I know Leader Node failure is single point of failure in case of Redshift. I am sure AWS has measures to handle such failure. You can run cloudwatch metrics on Redshift to monitor the nodes ( docs.aws.amazon.com/redshift/latest/mgmt/metrics-listing.html ) and take corrective actions on failures.
@sumathimidathala4517
@sumathimidathala4517 3 жыл бұрын
Thank you sir
@joerokcz
@joerokcz Жыл бұрын
Yes, the leader node in Amazon Redshift can be considered a single point of failure. The leader node is responsible for managing client connections, query coordination, and metadata management in the Redshift cluster. If the leader node becomes unavailable due to a failure or any other reason, it can impact the cluster's overall availability and the ability to perform certain administrative tasks. However, it's important to note that the compute nodes in a Redshift cluster are separate from the leader node and continue to function independently. The compute nodes store and process the data, allowing queries to execute even if the leader node is unavailable. Queries that are already running will continue to execute, and new queries can be submitted to the compute nodes directly. In the event of a leader node failure, Amazon Redshift automatically provisions a new leader node to resume the cluster's normal operation. The new leader node assumes the responsibilities of the previous leader node, establishes client connections, and continues to coordinate query execution and cluster management. To minimize the impact of a leader node failure and enhance cluster availability, it is recommended to design applications with appropriate retry and error handling mechanisms. Additionally, Amazon Redshift provides automated backups and allows you to create snapshots to protect your data and cluster configuration, further ensuring recovery options in the event of a failure. Overall, while the leader node represents a potential single point of failure in Amazon Redshift, the impact can be mitigated through automated recovery mechanisms and proper application design.
@supplycopiainc5770
@supplycopiainc5770 Ай бұрын
@aurobindosaha hi
Llegó al techo 😱
00:37
Juan De Dios Pantoja
Рет қаралды 59 МЛН
Double Stacked Pizza @Lionfield @ChefRush
00:33
albert_cancook
Рет қаралды 115 МЛН
Slow motion boy #shorts by Tsuriki Show
00:14
Tsuriki Show
Рет қаралды 10 МЛН
Getting Started with Amazon Redshift - AWS Online Tech Talks
46:39
AWS Developers
Рет қаралды 57 М.
Design a Data Warehouse | System Design
14:08
Interview Pen
Рет қаралды 20 М.
Top AWS Services A Data Engineer Should Know
13:11
DataEng Uncomplicated
Рет қаралды 158 М.
SQL performance tuning and query optimization using execution plan
49:23
Data Warehousing on AWS with Redshift - with a demo!
39:16
Cloud Architects in Africa
Рет қаралды 18 М.
Amazon Redshift Optimization
1:26:57
LatentView Analytics Ltd.
Рет қаралды 4,4 М.
Amazon EMR Deep Dive and Best Practices - AWS Online Tech Talks
40:32
AWS Developers
Рет қаралды 56 М.
Snowflake Query Optimization
35:04
AICG
Рет қаралды 8 М.
Duman - мен болмасам кім? (Mood Video)
2:35
Duman Marat
Рет қаралды 200 М.
Malohat
3:35
Xamdam Sobirov - Topic
Рет қаралды 1,3 МЛН
Jaloliddin Ahmadaliyev - Erta indin (Official Music Video)
4:32
NevoMusic
Рет қаралды 2,4 МЛН
Jaloliddin Ahmadaliyev - Kuydurgi (Official Music Video)
4:49
NevoMusic
Рет қаралды 12 МЛН