Optimising Redshift DataWarehouse using DIST and SORT Key

  Рет қаралды 14,593

Darshil Parmar

Darshil Parmar

2 жыл бұрын

In this video, we go over the concept of DISTKEY and SORTKEY. If you're a MySQL or PostgreSQL user who is used to indexes, these two Redshift concepts might seem a bit strange.
Redshift's DISTKEY and SORTKEY are powerful tools that are easy to use. By using these options, you can avoid issues that can be caused by Redshift's compression. Such issues include slow queries, wrong results, missing results, and more.
In fact, the way Redshift uses them, you'll probably never have a need for a fully-fledged index. Indexes are great, but they have a cost, so it's important to understand when indexes are appropriate for your workload.
In this video, we go over the basics of DISTKEY and SORTKEY by looking at a basic example.
Dataset used in the video - docs.aws.amazon.com/redshift/...
Redshift Whitepaper - docs.aws.amazon.com/whitepape...
I have also created playlists for the data engineering roadmap and projects
Data Engineering Complete Roadmap - • Data Engineer Complete...
Data Engineering Project Series - • Data Engineering Proje...
Also, you can
Join Discord Channel - / discord
===================Follow Me Here===================
👦🏻 My Linkedin - / darshil-parmar
📷 Instagram - / darshilparmarr
🎯Twitter - / parmardarshil07
===================About Me===================
Freelance Data Engineer and Solution Architect.
I love learning about technology and teaching thing I know to other people. The goal of creating this channel was to teach everything I know to the world, I have spent most of my time learning things online and I want to share all my learning on this youtube channel.
I will be posting content related to data engineering, architecting systems, data science, machine learning, and interview preparation.
Thank you for watching the video, see you in the next video :)
My Accessories
🎙 Mic -amzn.to/3Bnu53n
📱 Camera (I use my phone) - amzn.to/3wOogIU
🎧 Headphone - amzn.to/3BsJxLB
⌨ Mouse and Keyboard - amzn.to/3zeF1yq
🖥 Monitor - amzn.to/3zk0Dts

Пікірлер: 17
@shaleenarora2894
@shaleenarora2894 2 жыл бұрын
Your videos are really helpful. Rarely find such content related to DE. Thank you
@atchuthsurisetti2484
@atchuthsurisetti2484 Жыл бұрын
If a person who watch the video and then like,subscribe at the very first time , then we know we are good enough.Simple and clear👌
@udayale4768
@udayale4768 Жыл бұрын
Excellent way of explaining. Thankyou :)
@nikhildhand6096
@nikhildhand6096 2 жыл бұрын
Really great series, pls bring more such series on big data projects on cloud in future Thanks for the great explanation👍
@DarshilParmar
@DarshilParmar 2 жыл бұрын
Sure
@VishalSharma-hv6ks
@VishalSharma-hv6ks 2 жыл бұрын
Kindly keep doing such excellent work.
@DarshilParmar
@DarshilParmar 2 жыл бұрын
Thank you, I will
@VishalSharma-hv6ks
@VishalSharma-hv6ks 2 жыл бұрын
Very Informative video.
@DarshilParmar
@DarshilParmar 2 жыл бұрын
Glad it was helpful!
@rohithsaivemula3200
@rohithsaivemula3200 2 жыл бұрын
Very helpful
@DarshilParmar
@DarshilParmar 2 жыл бұрын
Glad it helped
@chgeetanjali7919
@chgeetanjali7919 10 ай бұрын
can share your code?
@SurajKumar-vr2nu
@SurajKumar-vr2nu Жыл бұрын
could you share your ppt please?
@DarshilParmar
@DarshilParmar Жыл бұрын
Here - docs.google.com/presentation/d/185uuzP46flvhbPINktI7YL37kxAnlLgDRnryvVGk0kA/edit?usp=sharing
@SurajKumar-vr2nu
@SurajKumar-vr2nu Жыл бұрын
Thanks Darshil bro
@SurajKumar-vr2nu
@SurajKumar-vr2nu Жыл бұрын
@@DarshilParmar Could upload your others stuffs PPT at end of the playlist. it would be very helpful and also people will get it after full completion
@supernaturallover7
@supernaturallover7 Жыл бұрын
@@DarshilParmar Thanks a lot for your good work
COVID 19 - Build End to End Data Engineering Project | PART 1
31:53
Darshil Parmar
Рет қаралды 64 М.
AWS Redshift Query Tuning and Performance Optimization
1:45:40
Aurobindo Saha
Рет қаралды 44 М.
Heartwarming Unity at School Event #shorts
00:19
Fabiosa Stories
Рет қаралды 25 МЛН
What it feels like cleaning up after a toddler.
00:40
Daniel LaBelle
Рет қаралды 89 МЛН
AWS Tutorials - Access Glue Catalog using Amazon Redshift Spectrum
32:34
Amazon Redshift Operations - Utilizing Vacuum & Deep Copy
13:53
Data Tech
Рет қаралды 1,4 М.
Amazon Redshift Optimization
1:26:57
LatentView Analytics Ltd.
Рет қаралды 4,4 М.
AWS Redshift Service Overview
7:41
Be A Better Dev
Рет қаралды 56 М.
Database vs Data Warehouse vs Data Lake | What is the Difference?
5:22
Alex The Analyst
Рет қаралды 756 М.