Scaled Dot Product Attention | Why do we scale Self Attention?

Рет қаралды 13,560

Күн бұрын

Scaling Self Attention in Scaled Dot Product Attention is crucial for stabilizing training, optimizing dataset utilization, and improving the model's ability to focus on relevant information within sequences by standardizing the variance of dot products.
============================
Did you like my teaching style?
Check my affordable mentorship program at : learnwith.campusx.in/s/store
============================
📱 Grow with us:
CampusX' LinkedIn: / campusx-official
CampusX on Instagram for daily tips: / campusx.official
My LinkedIn: / nitish-singh-03412789
Discord: / discord
E-mail us at support@campusx.in
💭Share your thoughts, experiences, or questions in the comments below. I love hearing from you!
✨ Hashtags✨
#ScaledDotproductAttention #DeepLearning #campusx
⌚Time Stamps⌚
00:00 - Intro
00:45 - Revision
05:00 - The Why
07:25 - The What
42:32 - Summarizing the concept
49:49 - Outro

Пікірлер: 168

@kayyalapavankumar2711 3 ай бұрын

In future This playlist will be the most viewed playlist for deep learning

@mentalgaming2739 3 ай бұрын

Yes

@ashutoshpatidar3288 2 ай бұрын

INDEED

@Amanullah-wy3ur 4 күн бұрын

yes

@KumR 3 ай бұрын

No one else can explain this concept this way. And if anyone does... he/she follows you. Please don't shorten content. We need this level.

@gopeshsahu 3 ай бұрын

Nitish!!! .. truly awesome!! .. outstanding!! ... remarkable !! ....rare to find a gem like you who illuminates the intricate world of Artificial Intelligence (AI), Machine Learning (ML), and Deep Learning (DL) but also makes it accessible to both novices and professionals alike is rare. Explanation of transformers with self-attention mechanisms is a standout. It's a concept that lies at the heart of many modern AI breakthroughs. This video is out of the world explanation .. why to divid QKV by root of d_k .. no one can explain this level of details .. truly truly truly hat-off ... outstanding beyond the expectation ... Keep doing Nitish and Keep this momentum !!!

@sachink9102 9 күн бұрын

Nitish Sir .... your knowledge is like MIT equivalent.. really outstanding !!

@tiwari45621 3 ай бұрын

Sir, one small request please if it is possible please increase the frequency of video upload. I was waiting your lecture video since last 20 days.

@aj_ai 3 ай бұрын

In our NIT everyone following your channel for Data Science content even professors also Thanks, sir🖤

@ashutoshpatidar3288 2 ай бұрын

which nit are you from btw

@TheVarshita 17 күн бұрын

It was an amazing explanation, so thorough and still so simple to understand such complex topic. I have followed courses from NPTEL, Stanford, Deep learning but yet this was the smoothest explanation! Your content is highly underrated. I wish I had found your channel sooner! Thanks 🙂

@1111Shahad 15 күн бұрын

I have seen many tutorials and explanation's of transformers and its architecture. I have never seen a detailed explanation like this in crisp and precise way. Thanks Nitish

@ggggdyeye 3 ай бұрын

I always wanted a teacher who could explain the hard concepts simply and in detail. I have that kind of teacher like you. Thank you sir for this awesome and detailed video.

@tarun94060sharma 3 ай бұрын

Chote-2 concepts ko details me samjhana hi mujhe is channel ko daily open karne ko majboor karta h.

@akshitnaranje7426 3 ай бұрын

this type of explaination we need to make our concept strong.. thank you sir...

@kayyalapavankumar2711 3 ай бұрын

Thank you so much for restarting this playlist

@Simpleecute 3 ай бұрын

thank you so much for restarting..this is gem playlist!

@nakulmali1413 3 ай бұрын

Hi sir first upon thanking you for all your videos and teaching. Sir i request you please upload one detail video on YoloV8, it's file structure how to create our own files in this architecture.

@Deepak-ip1se 12 күн бұрын

Sir you really teach very well we definitely want these type of explanations!!!!

@muhammadfarrukhshafeeq1955 5 күн бұрын

Truly, a marvelous effort and a superb way of explaining as you said.

@jaiminjariwala5 3 ай бұрын

WOW WOW WOW, BEST EXPLAINED VIDEO I HAVE EVER WATCHED ON KZfaq! Honestly, Your way of explanation is D best Sir! ♾🌟

@omprakashnisad3666 3 ай бұрын

loved it the way way you explained this self attention its superb.

@shariq021 Ай бұрын

thank you sir , we need such explanation , the idea of first principle and explaining things , so that we can interpret and understand future things , you are not just a teacher of what content you are teaching us , but beyond that you are teaching us how can we further understand things if we work through your methodology . thank you for breaking down things to so simple that even a nursery child can understand . you are like Raghuram rajan of Deep Learning .

@renoy29985 3 ай бұрын

Waw!!! No words!! I can imagine the amount of effort, day in day out, you have put to have as much knowledge. You are an inspiration!!

@fastfacts9898 2 ай бұрын

We do not need to read research paper guys , campusx is enough to explain the whole concept , big salute to king of Data science

@krutikashimpi626 Ай бұрын

"For in the flow of knowledge, true growth shall show." The phrase suits you. can never be grateful enough. Thank you very much Sir.

@hilmangukiya1390 3 ай бұрын

Your efforts are grooming us Thank you so much 🙏🏻😊

@rb4754 10 күн бұрын

I wish I could like 👍 his videos unlimited times!!!!! This is a masterpiece series on DL and Language Models... Still the likes are less than 1000... You deserve a lot Nitish... #CampusX

@AIAlchemistLab 3 ай бұрын

I just say in simple words great teaching.

@surajitsasmal8030 3 ай бұрын

If you can please upload transformer lectures this week .it will be helpful.

@kowshik-deb-nath 3 ай бұрын

Nitish sir is all you need 😊

@ashishmalhotra2230 3 ай бұрын

it is criminal to have this level of explanation for free. 😍

@ashutoshpatidar3288 2 ай бұрын

CRIME*

@sandeeppolaki664 26 күн бұрын

Thank yo Nitish sir, you have given an amazing explanation of these concepts. Appreciate your time and efforts into this. Will soon clear interviews.

@TemporaryForstudy 3 ай бұрын

nice, I knew that we divide by root d to handle the softmax but didn't know the concept of why root d.

@aiforeveryone 3 ай бұрын

Amazing👍

@himanshu788 3 ай бұрын

Long waited video sir, please upload the videos more frequently.

@waseemrandhawa5658 Ай бұрын

Must hai... main ne abi tak itni detailed say koi b video nahi dekhi transformer pay.

@ShubhamAware18 3 ай бұрын

This person is similar to Ironman❤ Your explanation is incredible. I watched many videos, but no one could clear this topic. You always think creatively and clear up any confusion. Thank you for always being there. Love you 3000❤🫂

@top10collection88 2 ай бұрын

mind boggling teaching experience with you sir, i always first lie your videos and than watch your videos. thank you so much for providing us this wonderful free lectures for us.

@sachink9102 6 күн бұрын

Good .. this detailed way of Explanation is good

@pujamehta9755 Ай бұрын

Great explanation, many coaching institutes teachers are copying your content and teaching students. They dont have there own contents and concepts clear. I dont think anyone can explain these concepts in such a easy manner. You are a great teacher!

@ayushrathore2570 3 ай бұрын

Thank you, Nitish sir, for your clear explanation of Scaled Dot Product Attention, especially regarding the variance issue. Your insights were incredibly helpful, and I appreciate your commitment to simplifying complex concepts. I really enjoyed your teaching style. Keep up the fantastic work!

@rishabhbhardwajiitb178 3 ай бұрын

great explanation.. loved it

@ansariarbaz3374 3 ай бұрын

Finally he's back

@harshitdaga2225 2 ай бұрын

Its Truly Amazing to experience how beautifully you make us understand the concepts and give us a crystal clear intuition.. Hats-off to your level of patience/calmness. That soothing explanations...🤌😲

@LohithReddy-dq9ud 3 ай бұрын

Amazing insight combined with a thorough analysis of the research paper's minute nuances! Thanks for providing such a clear explanation. Your videos provide priceless knowledge! 🌟👏

@SyedLokman 3 ай бұрын

Please keep making this kind of videos. Love from Bangladesh

@rutvikkapuriya2033 3 ай бұрын

Best Playlist for deep learning ever Thank you so much for great explanation

@sayvaish9078 2 ай бұрын

First approach videos are perfect! Sir, please keep on continuing this method.

@avijitpaul9702 3 ай бұрын

Insanely good content When I was listening to the contents, I had the feeling of learning from the real Swaraswati devi. It's really uncomparable. Truly I reinvented the self attention architecture. I didn't know that reinventing the wheel would give me such a joyous moment in my life. I owe a lot to you sir. ❤👃

@tiwari45621 3 ай бұрын

Yes sir, we like this detail explanation

@mrityunjaykumar2893 Ай бұрын

Hi @Nitish, All videos on Transformer are truly remarkable. KZfaq pe bhut sare videos hai iss topic pe, but your's are GEM, Main yaha explanation ke liye he aaya tha, and deep down I am Satisfied. Keep making this type of videos with explanation, warna ajkal har koi short me just for view video bana deta hai. Truly appreciating your hard work .

@kaivalyakulkarni4250 3 ай бұрын

No words...just fabulous..! and Thanks a lot..!

@Facts23799 3 ай бұрын

hi sir, i am completing my 100 days of machine learning course. just notification i see your full video. And thankyou . this lecture was clear understand .

@user-dy4rp1ye4n 3 ай бұрын

explanation is very good it helped me get interested in how things work, and after watching it was the inspiration for the research field. Thanks, a lot

@AshishKumar-rm6ns 2 ай бұрын

CampusX is all we need!

@rahulkumawat4601 3 ай бұрын

sir i don't think, i can forget you, you are the shaper of my life, thanks a lot

@barryallen5243 3 ай бұрын

Detailed explanation is the best explanation.

@LearnWithMe-a1 4 күн бұрын

Sir, its the best detailed explanation

@just__arif 3 ай бұрын

Keep it up Sir! 💯

@VikasKumar-kx8xk 3 ай бұрын

i always prefer depth understanding over the shallow one. and i m really thankful to you sir the way you teach all the hard concept in simple way. I m ready for the depth understanding that you r providing and even i want to study all the things in more detailed as much as possible. So i m ready for complex and depth understanding. Thank You Sir

@user-eo9ko7pd3i 3 ай бұрын

The best playlist for deep learning thank you very much sir

@mentalgaming2739 3 ай бұрын

No Sir This is Great Explanation Ever , the Content your are providing , I think No One is Providing this type of Content With Same Effort and Same Energy . And The Best Part is that you explanation makes the Topic Simple and Easy

@KiyotakaAyanokoji1 3 ай бұрын

ye zyda variance ko solve krne ki approach thi na ki koi timepass explanation , so its good ki aap ne sikha diya ye , aage kahi aur kam aa jayenga aisa hi kuch . . . 😃

@kunalmakwana4451 13 күн бұрын

Truly awesome! Eagerly waiting for more videos!

@ParthivShah Ай бұрын

Thank You Sir. You Are Great Teacher. my fav and best.

@not_amanullah 3 ай бұрын

This course is helpful ❤

@sagarbhagwani7193 3 ай бұрын

Finally a video is here thankuuuuu sir ❤

@Gotit-ne4qb 3 ай бұрын

keep continuing your masterpiece sir for deep leaning and MLops...it is extraordinary showcase of brilliance in explaining Thank you sir !!

@user-pd1gy8xh4y 3 ай бұрын

It was not too much , very much needed. Thanks

@lokeshsharma4177 2 ай бұрын

Loved the DETAILED video , keep it up

@hardiksharma4219 3 ай бұрын

Great explanation. Love it! Please continue to make such detailed videos.

@mentalgaming2739 3 ай бұрын

I am Doing this Playlist Deeply and Sir Your Efforts Are Amazing ! When ever someone Ask me to Suggest Him/her a Best Channel For DS , i always Recommend them your Channel . Your Content is Amazing ! The Way you Explain Everything is amazing , Love From Pakistan Sir ..

@utkarshtripathi9118 3 ай бұрын

Thank you so much for this video Sir....

@gautamjha2645 3 ай бұрын

hands down ...the best !!!

@animatrix1631 3 ай бұрын

Bestest

@sauravkapadiya684 3 ай бұрын

loved ur explanation !!!!

@soumiksaha5495 2 ай бұрын

Loved the detailed approach 👍

@barunkaushik7015 2 ай бұрын

Superb explanation. Loved the video.

@sagarbhagwani7193 3 ай бұрын

thanks for the example of class and students it helps me lot in understanding . Actually i am not coming from maths background but your teaching skill help us a lot Thanks sir

@swakshandprasad5040 11 күн бұрын

Loved the approach❤

@SourabhDaate Ай бұрын

My friend got interview question how VGP and EGP problem is solved in transformer.....This is my 3rd time I'm seeing this playlist...it is the one stop solution for DL ....Love u Nitish Bhai.....Love from Maharashtra

@neetikashree5098 29 күн бұрын

hi! I am going through this masterpiece video by Nitish sir(all my love to him), wanted to ask what do you mean by VGP and EGP here?

@jayanthkothapalli9.2 3 ай бұрын

Great Video sir, After this video I understood that you are a very curious teacher sir!

@bhavikpunmiya9641 2 ай бұрын

Sir this is really nice approach, I would love to learn the topics in this detailed, One request please increase the frequency of videos and complete this playlist

@harinadhpatamsetti Ай бұрын

Thankyou sir, the best explanation

@minaxisharma7630 Ай бұрын

Sir too well explained/. We want such kind of detail. This is the potential that makes you different from others. Could you keep it up? Every time get a solution from your channel sir.