Self Attention in Transformers | Deep Learning | Simple Explanation with Code!

  Рет қаралды 24,993

CampusX

CampusX

Күн бұрын

Self Attention works by computing attention scores for each word in a sequence based on its relationship with every other word. These scores determine how much focus each word receives during processing, allowing the model to prioritize relevant information and capture complex dependencies across the sequence.
============================
Do you want to learn from me?
Check my affordable mentorship program at : learnwith.campusx.in/s/store
============================
📱 Grow with us:
CampusX' LinkedIn: / campusx-official
CampusX on Instagram for daily tips: / campusx.official
My LinkedIn: / nitish-singh-03412789
Discord: / discord
E-mail us at support@campusx.in
✨ Hashtags✨
#SelfAttention #DeepLearning #CampusX #Transformers #NLP #GENAI
⌚Time Stamps⌚
00:00 - Intro
02:37 - Revision [What is Self Attention]
07:00 - How does Self Attention work?
24:45 - Parallel Operations
29:40 - No Learning Parameters Involved
39:10 - Progress Summarization
50:15 - Query, Key & Value Vectors
52:28 - A Relatable Example
01:07:52 - How to build vectors based on Embedding vector
01:20:08 - Summarized Matrix Attention
01:22:45 - Outro

Пікірлер: 267
@ankitbhatia6736
@ankitbhatia6736 4 ай бұрын
This is a gem, don't know even if the authors of "Attention is all you need" would be able to explain this concept with such fluidity. Hats off 😊.
@ajinkyamohite3836
@ajinkyamohite3836 4 ай бұрын
Par sir initially word embeding ki value kya Gigi
@ShubhamSingh-iq5kj
@ShubhamSingh-iq5kj 3 ай бұрын
​@@ajinkyamohite3836it can be calculated with word2vec or glove . Read about it you will understand
@Findout1882
@Findout1882 Ай бұрын
@@ajinkyamohite3836 random
@mehulsuthar7554
@mehulsuthar7554 16 күн бұрын
@@ajinkyamohite3836 that will be any static embedding like GloVe, Fasttext, or your own trained embedding
@rohitdahiya6697
@rohitdahiya6697 4 ай бұрын
The self attention mechanism best explained by the best teacher in the world. This makes you unique from other tutors around the world ❤
@d1pranjal
@d1pranjal 20 күн бұрын
This video is hands down, THE BEST video on self attention in transformers. I have been following you and learning from you since long. We all are truly blessed to have a mentor like you. 🙏
@_TheDataScienceGuy_
@_TheDataScienceGuy_ 4 ай бұрын
Pata nehi sir, apko 14 din kyun laga... Topic to bohot simple tha..❤❤
@dnyaneshsable1512
@dnyaneshsable1512 3 ай бұрын
are bhai uske bahut part he 1 video banaya he so uske wajase bol rahe the or waise bhi sir batate he to konsabhi topic easy hi lagata he.
@vidhikumar1664
@vidhikumar1664 3 ай бұрын
bhai have some patience, itna aasan laga tumhe toh khud seekhlo. Let Nitish do the work. It is by the efforts of Nitish sir that i'm able to understand these topics so well.
@vidhikumar1664
@vidhikumar1664 3 ай бұрын
acha i got your point XD. thanksss Maine abhi dekha jab sir bole😂😂
@arri5812
@arri5812 4 ай бұрын
🌟 **Nitish Singh, You're a Beacon of Clarity!** 🌟 Dear Nitish Singh, I am utterly captivated by your enlightening video on self-attention in transformers! Your ability to distill complex concepts into digestible nuggets of wisdom is nothing short of magical. 🪄✨ As I watched your tutorial, I felt like I was sipping from the fountain of knowledge itself. Your lucid explanations flowed seamlessly, unraveling the intricacies of self-attention with grace. 📚🔍 The way you effortlessly wove together the threads of mathematics, intuition, and practical application left me in awe. Itna asaan tha yeh! 🤯🙌 Nitish, you're not just an educator; you're a sorcerer who conjures understanding out of thin air. Your passion for teaching radiates through the screen, igniting curiosity in every viewer. 🌟🔥 Thank you, from the depths of my neural network, for sharing your brilliance. You've made self-attention feel like a warm hug from an old friend. 🤗🧠 So here's to you, Nitish Singh, the maestro of clarity, the guru of transformers, and the architect of "itna asaan tha yeh." 🎩👏 May your tutorials continue to illuminate minds, one self-attention head at a time! 🌟🤓 With heartfelt gratitude, Your Devoted Learner 🙏
@saipoojalakkoju6009
@saipoojalakkoju6009 4 ай бұрын
This Lecture is an absolute Mater piece
@nikhileshnarkhede7784
@nikhileshnarkhede7784 21 күн бұрын
The way you explain the topic is Epic. Keep it up. And never stop because the way you explain really help in building the intuition. I believe not only for me for other also and that will definitely will bring change. Thank you.🙏
@ravikanur
@ravikanur 18 күн бұрын
One of the best explanation by Nitish sir. We are lucky to have teachers like you sir
@sachink9102
@sachink9102 7 күн бұрын
OMG.... THE BEST video on self attention in transformers
@cool12345687
@cool12345687 4 ай бұрын
WoW.. God bless you. Have never seen someone who could explain this process so well.
@sangram7153
@sangram7153 4 ай бұрын
Best Teacher ever ! 😊
@ariousvinx
@ariousvinx 4 ай бұрын
Last videos were amazing! Have been waiting for the next one. The hard work you do and explain in such a depth ... Thank you ❤
@harsh_sharma260
@harsh_sharma260 4 ай бұрын
Sir ji tu si great ho, ❤❤❤ jai ho aapki
@Deepak-ip1se
@Deepak-ip1se 10 күн бұрын
One of the best examples to make us understand such a hard concept!! Hats off to you sir👏👏
@NabidAlam360
@NabidAlam360 4 ай бұрын
Thank you so much for the video! You teach so well that I feel that your tutorial video does not end! Please do not change this teaching style! Please continue uploading the other parts! And we really appreciate the efforts you gave to make the tutorial!
@user-jb5vm2uo4u
@user-jb5vm2uo4u 3 ай бұрын
Bhai, 2-3 saal lag gye, samjhne me... finally, finally that eureka moment... thanks a lot bro... keep going....
@T3NS0R
@T3NS0R 4 ай бұрын
I know enough of transformers to handle stuffs I needed, but I never understand the self attention and all in this detail.... such a good video 🛐
@somdubey5436
@somdubey5436 4 ай бұрын
very nice way to make anyone understand what self-attention is. Your examples make it really simple and intuitive to grasp the core concepts. Thanks lot :)
@nileshgupta543
@nileshgupta543 4 ай бұрын
Outstanding explanation of such a concept!!!
@teksinghayer5469
@teksinghayer5469 4 ай бұрын
goosebumps ❤ waiting for more
@sagarbhagwani7193
@sagarbhagwani7193 4 ай бұрын
Appreciate all your efforts sir❤
@UPSCTHINKER
@UPSCTHINKER 4 ай бұрын
बहुत wait kara diya sir...❤❤
@mimansamaheshwari4664
@mimansamaheshwari4664 Ай бұрын
Lectures I can never get enough off. The best content I discovered so far. Kudos to you, Nitish Sir. Life is easy when you are the mentor.♥♥♥
@EMWave
@EMWave 4 ай бұрын
Great explanation!
@himanshukale9684
@himanshukale9684 4 ай бұрын
Best explanation till date ❤
@khushipatel2574
@khushipatel2574 4 ай бұрын
I am deeply grateful for the incredible deep-learning video you shared with us. It brought me immense joy and excitement to watch, and I can't thank you enough for taking the time to create and share such valuable content. The clarity and depth of your explanations have greatly enriched my understanding and passion for this subject.
@shreeganeshak6346
@shreeganeshak6346 4 ай бұрын
Thank you sir 🙏 you are really great 👍
@mohitjoshi8818
@mohitjoshi8818 3 ай бұрын
This is indeed one of your best lectures and your teaching skills are exceptional sir. You make everything easy. Nitish Sir is all we need.🙏🙏
@mallemoinagurudarpanyadav4937
@mallemoinagurudarpanyadav4937 4 ай бұрын
Great lecture 🎉
@subhankarghosh1233
@subhankarghosh1233 2 ай бұрын
Sir, dil se... You are a blessing to the community. I really respect your hard work and dedication. You have the aura to change someone's life journey and perspective. Pranam app ko and your complete team.
@rahulgaikwad5058
@rahulgaikwad5058 4 ай бұрын
It was amazing video learnt a lot from this video. Keep it up the good work God bless you. Thank you
@bimalpatrapatra7742
@bimalpatrapatra7742 4 ай бұрын
Super mind-blowing class sir its really heart touching 😮
@syedhassan158
@syedhassan158 Ай бұрын
The Master Piece of Deep Learning. We will love if there could be an playlist of full Projects OF deep learning. Love From Pakistan....
@akshitnaranje7426
@akshitnaranje7426 4 ай бұрын
very good lecture waiting for other parts.. please release as soon as possible.
@arpitsinghal07
@arpitsinghal07 2 ай бұрын
I've watched almost all videos on this topic from channels like serrano, statquest and recently 3blue1brown. I found this to be the best explanation out of all. But the videos from other mentioned channels are also valuable, they provide a different perspective to attention mechanism.
@MrSat001
@MrSat001 4 ай бұрын
Great sir जी 👍
@suryasiripurapu4954
@suryasiripurapu4954 4 ай бұрын
thank you 🙏
@fact_ful
@fact_ful 4 ай бұрын
Teaching at its peak.
@izainonline
@izainonline 4 ай бұрын
Much awaited Video thumbs up for your work. Want to clear my concepts. 1.How the probability assign on sentence for context means why 0.7 why not 0.6. 2.Dynamic context can it check the database like River Bank use as single word not River and Bank separated word
@kayyalapavankumar2711
@kayyalapavankumar2711 4 ай бұрын
Sir Please Keep Uploading further videos also as early as possible.
@shivombhargava2166
@shivombhargava2166 4 ай бұрын
No words for this video. This content is unmatched, no one even comes close to this quality of content. Keep it up, Sir !!
@rog0079
@rog0079 4 ай бұрын
Great as always!! it would be super amazing if you could code along like implement the same...
@Killerisback10
@Killerisback10 2 күн бұрын
Bro what a way to explain. Hats off!
@pratapsurwase7428
@pratapsurwase7428 2 ай бұрын
Dear Nitish, you explained a tough topic in a simple manner , i appreciated your effort and thanks for the same.
@saifshamil4690
@saifshamil4690 4 ай бұрын
Great experience ❤ from pak
@not_amanullah
@not_amanullah 4 ай бұрын
Thanks ❤
@ParthivShah
@ParthivShah Ай бұрын
Thank You Sir. Super Explanation. Greatest on this topic on internet I guesse
@adityanagodra
@adityanagodra 4 ай бұрын
It was a most simple and great explanation it was better than the blog of jay alammar and other KZfaq videos... you should write a book as there are none as simple as this
@nileshpandey7776
@nileshpandey7776 Ай бұрын
Thank you so much sir, this video is more interesting than any web-series/movie on Netflix. This is quality content!!
@rohitshere5328
@rohitshere5328 Ай бұрын
you have explained whole concept like this is piece of cake You are Great Nitish sir
@DeyozRayamajhi
@DeyozRayamajhi Ай бұрын
Bhaisaab you are one of the greatest data science teachers.
@AbhijeetKumar-cj4fe
@AbhijeetKumar-cj4fe 4 ай бұрын
i am at the 2:29 time stamp and i am pretty sure that you gave us best explanation .that's how our faith on you sir
@arijitgoswami7388
@arijitgoswami7388 2 ай бұрын
probably the best video on self attention
@UnbeaX
@UnbeaX Ай бұрын
What a smooth learning experience!! I got lots of value from this....one suggestion when I searched to learn this i searched transformer so this video did not ranked so sir it's a suggestion u see what keywords are most used and then add them to the title...so easy approach just see what your competitors are using as titles.
@SipahEScience
@SipahEScience 4 ай бұрын
Hi Nithis, I am from Pakistan and studying in US and I should say that you are THE BEST teacher in the world. Thanks a lot brother. God bless you.
@ankanmazumdar5000
@ankanmazumdar5000 4 ай бұрын
Where are you, I'm in Chicago
@akshayshelke5779
@akshayshelke5779 3 ай бұрын
Best video I have seen on this topic till date....Please Upload more videos we are following you sir.
@apnaadda73
@apnaadda73 3 ай бұрын
i dont know ,ap ise acknowledge kroge ya nahi ,East Aur West you are the BEST❤❤❤
@pavangoyal6840
@pavangoyal6840 3 ай бұрын
You amazing teacher who is taking ownership to teach your students. World needs more teachers like you :)
@AyushGupta-bd2mx
@AyushGupta-bd2mx 20 күн бұрын
loved the simple way and explainations in which you taught this topic Sir.
@rutvikkapuriya2033
@rutvikkapuriya2033 3 ай бұрын
Hats off for this type of explanation 😍😍😍
@saurabhbadole821
@saurabhbadole821 3 ай бұрын
Sir, comments dekhke video dekhnesei pehle hi dhak dhak horha hai ki aaj kuch bawaal sikhne ko milega
@kalyanikadu8996
@kalyanikadu8996 4 ай бұрын
Thank You soo much !
@WIN_1306
@WIN_1306 3 күн бұрын
r u single?
@sreekanthbezzanki528
@sreekanthbezzanki528 28 күн бұрын
Absolutely loved the explanation…thank you very much for investing your time into creation of this masterpiece 🙏
@TalibYoutube
@TalibYoutube 4 ай бұрын
wow , wow ,woooooooooooooooooooooooooooooooooow, what a great teacher, what a great teaching style, hats off to you. thank you.
@nagendraharish6026
@nagendraharish6026 4 ай бұрын
Hidden gem - Nitish sir, you have no idea how many students have benefited from your videos. Hats off, love to subscribe if there are any courses related to Deep learning or NLP
@himanshujoshi5908
@himanshujoshi5908 2 ай бұрын
Author example 💥💥💥💥. very informative video.
@ankitkumar-iitbombay186
@ankitkumar-iitbombay186 4 ай бұрын
One of the best content on Self attention so far.
@mentalgaming2739
@mentalgaming2739 3 ай бұрын
Your explanations on self-attention mechanism are truly remarkable. I came across your channel randomly when I started my data science journey in August 2023, and since then, I have been learning from your content. Your ability to articulate complex topics is exceptional, and your explanations are incredibly insightful. I greatly appreciate the depth of context you provide in your tutorials, which sets your content apart from others. Your dedication to helping learners understand difficult concepts is admirable. Much love and gratitude from Pakistan. You are a true gem in the field of data science education. Whenever someone needs help with any topic in data science, I always recommend your channel for the best intuition and explanations. Also one important think " pata nahi sir apko 14 din kyun lage ... Topic to bht simple tha "
@abhijitrai1349
@abhijitrai1349 3 ай бұрын
Hardest concept got the best example 😁. Thank you sir for explaining us this beautiful concept.
@koushik7604
@koushik7604 2 ай бұрын
Why are people like you not in the universities? It’s a true gem. ❤
@NikhilKumar-yu3zh
@NikhilKumar-yu3zh 2 ай бұрын
May be you are/were in wrong university then😅
@Akuma7499
@Akuma7499 4 ай бұрын
Great Experience ❤ from Mars
@sagemaker
@sagemaker 4 ай бұрын
I am paying full Attention to your video. Very well made :)
@ankitgupta1806
@ankitgupta1806 3 ай бұрын
To be honest , i have studies same with other videos but here now i got proper understanding , hats off nitish
@ali75988
@ali75988 4 ай бұрын
Your words regarding demand of GAN's are so true. My background is in mechanical and at this very stage, i have seen 4-5 graduates working on both MS & PhD thesis on GAN's in one of the most top rank universities in korea.
@epkomarla1943
@epkomarla1943 3 ай бұрын
Very very nicely done! Thanks a lot. You have taken a complex concept and explained it very beautifully.
@Findout1882
@Findout1882 2 ай бұрын
bhai please ek anser dedo .. itna deep me kahan se samjh lete ho har chij ko and usko explain bhi step by step story build karke samjha dete ho.. salute hai bhai ..gajjab
@oo_wais
@oo_wais 2 ай бұрын
i have been trying to clarify the attention concept for the last few days and i have to admit this is one of the most valuable and informative videos that i found on the topic on youtube.
@velloer
@velloer 4 ай бұрын
Awesome
@amitabhgupta9475
@amitabhgupta9475 4 ай бұрын
By far the best and simplest explanation. Kudos to you. If you provide the audio in English, it will become even more popular. Thanks
@jangiramitkumar439
@jangiramitkumar439 4 ай бұрын
easy toh nhi tha, pr explaination great tha toh smj aa gya♥♠
@swarnpriyaswarn
@swarnpriyaswarn 2 ай бұрын
Goodness!!!! Till now I have not seen such a good explanation of this... I have no words to express my gratitude. Thanks a tonn.
@Findout1882
@Findout1882 2 ай бұрын
bhai kamal hai yarr ..topic toh bahut simple tha but aapko itna time kaise laga
@ShubhamAware18
@ShubhamAware18 4 ай бұрын
Learning about the transformer mechanism was a struggle for me, but this person explained it in an amazing way. I just want to say that "EK Hii Toh DIL hai HAMARA Kitne BAAR JITOGEY!!!"🤎
@surajhulke6196
@surajhulke6196 4 ай бұрын
Osm sir ❤❤❤❤❤
@priyanshushukla1295
@priyanshushukla1295 28 күн бұрын
this will be the best video ever on transformers
@rajsuds
@rajsuds Ай бұрын
You deserve a national category award... truly spellbound! 🙏🙏
@darshanv1748
@darshanv1748 3 ай бұрын
You are truly one of the most amazing teacher / data scientist You truly have an amazing grasp over the concepts
@akashdutta6211
@akashdutta6211 4 ай бұрын
you explain such a difficult concept so simply. even after watching nptel or here and there, i have so many doubts. you have cleared those in one video.
@haz5248
@haz5248 4 ай бұрын
Handsdown the most simple and comprehensible explanation.
@ParthivShah
@ParthivShah Ай бұрын
God Level Teaching is here.
@DevasheeshMishra
@DevasheeshMishra 4 ай бұрын
Best video
@aditiseetha1
@aditiseetha1 Ай бұрын
One of the best videos I have seen so far👍🏻
@user-hv2uu8vp9m
@user-hv2uu8vp9m 23 күн бұрын
Great video and What a great example at 52:24 👏👏
@basabsaha6370
@basabsaha6370 2 ай бұрын
im literally spell bound after this explanation....i have watched 100s of foreign youtube channel for this attention mechanism ....they are no where closer to you.....Sir you are really amazing....please please please continue this series....and teach up to LLMS , gpt , llama2 all stuffs😊,....I'm very very eager to learn from you
@siddiqe-td8ts
@siddiqe-td8ts Ай бұрын
fun fact! jub sir camera par ajata hay tho woh topic khud ba khud asan hojata hay lot's of love from Pakistan.
@chandankumarraxit2938
@chandankumarraxit2938 3 ай бұрын
Pata nehi sir, apko 14 din kyun laga... Topic to bohot simple tha. love from Odisha jay jagannath.🙏🙏🙏
@byotikram4495
@byotikram4495 4 ай бұрын
Wow, what a great explanation! I am truly impressed the you have explained the concepts of q, k, and v. I have watched numerous videos, and I can guarantee that nowhere else will people find such a clear explanation. I feel proud that we have such a talented teacher in our country. Your teaching explanation and analogies are very similar to Khan Sir, who teach UPSC syllabus with simple words 😄. Best wishes, Sir. I am hopeful that you and your channel will achieve even greater heights in the coming future.
@vimalshrivastava6586
@vimalshrivastava6586 4 ай бұрын
This lecture is a demonstration of how a great teacher can make a very complicated topic so easy. Thank you so much..!!!
@P.PaulAkash
@P.PaulAkash 2 ай бұрын
I have tried different attention tutorial to learn. But it's best and easy tutorial I got.
@chandank5266
@chandank5266 4 ай бұрын
I was knowing that you will make it simple.........but at this level....man I wasn't expecting that.....bawaal explaination sir🙇‍♂
@aienthu2071
@aienthu2071 2 ай бұрын
I had a huge doubt in Q, K, V part, now it is clarified. Please continue the transformers architecture especially the mathematical parts. e.g. positional embedding, multi headed attention etc. You are the beacon of Education in Data Science.
Introduction to Transformers | Transformers Part 1
1:00:05
CampusX
Рет қаралды 37 М.
Which one is the best? #katebrush #shorts
00:12
Kate Brush
Рет қаралды 27 МЛН
OMG🤪 #tiktok #shorts #potapova_blog
00:50
Potapova_blog
Рет қаралды 17 МЛН
Please be kind🙏
00:34
ISSEI / いっせい
Рет қаралды 160 МЛН
Understanding How Vector Databases Work!
12:25
The ML Tech Lead!
Рет қаралды 14 М.
CS480/680 Lecture 19: Attention and Transformer Networks
1:22:38
Pascal Poupart
Рет қаралды 339 М.
Positional Encoding in Transformers | Deep Learning | CampusX
1:13:15
Transformer Neural Networks, ChatGPT's foundation, Clearly Explained!!!
36:15
StatQuest with Josh Starmer
Рет қаралды 602 М.
Which one is the best? #katebrush #shorts
00:12
Kate Brush
Рет қаралды 27 МЛН