The KL Divergence : Data Science Basics

  Рет қаралды 41,765

ritvikmath

ritvikmath

Күн бұрын

understanding how to measure the difference between two distributions
Proof that KL Divergence is non-negative : • Jensen's Inequality : ...
My Patreon : www.patreon.com/user?u=49277905
0:00 How to Learn Math
1:57 Motivation for P(x) / Q(x)
7:21 Motivation for Log
11:43 Motivation for Leading P(x)
15:59 Application to Data Science

Пікірлер: 228
@szymonk.7237
@szymonk.7237 Жыл бұрын
Wow... 😳 I've never seen more genius, easy and intuitive explanation of KL-div 😳👏👏👏👏👏 Big thanks good man ! ❤️
@ritvikmath
@ritvikmath Жыл бұрын
Glad you liked it!
@anilaxsus6376
@anilaxsus6376 10 ай бұрын
I agree,
@murkyPurple123
@murkyPurple123 Жыл бұрын
Your bottom-up (instead of top-down) approach that you mentioned in the beginning of the video would be really great to see for all kinds of differrent concepts!
@ritvikmath
@ritvikmath Жыл бұрын
Great idea!
@DS-vu5yo
@DS-vu5yo 10 ай бұрын
That was the best description of why we use log that I have ever seen. Good work, man.
@zafersahinoglu5913
@zafersahinoglu5913 6 ай бұрын
I am a research scientist. You provide a clear and concise treatment of KL-Divergence. The best I have seen to date. Thanks.
@user-li5lh1qs6s
@user-li5lh1qs6s Жыл бұрын
I'm in the middle of a $2,500 course, BUT → KZfaq → your video... 👏🏻👏🏻👏🏻👏🏻👏🏻 Thank you for starting with the "why", and appealing to my brains desire to understand, not just do.
@JBoy340a
@JBoy340a Жыл бұрын
That was great. I have struggled to understand certain aspects of KL Divergence, and this is a great way to think about it without getting bogged down in symbology.
@ritvikmath
@ritvikmath Жыл бұрын
Glad it was helpful!
@varadpuntambekar8895
@varadpuntambekar8895 2 ай бұрын
I don't think I'm ever going to forget this. Thanks so much.
@tanvirazhar
@tanvirazhar 11 ай бұрын
Amazing. The pace you have explained, the approach...everything is just top-notch.
@asimosman3428
@asimosman3428 11 ай бұрын
This video is absolutely mind-blowing! The way it breaks down such a complex concept into an intuitive understanding is truly remarkable. Thank you!
@andrashorvath2411
@andrashorvath2411 Жыл бұрын
Fantastically clearly explained, congrats.
@markozege
@markozege Жыл бұрын
Thank you for this, the best explanation of KL divergence that I have seen. Love how you approach it building gradually, really inspiring for how to learn math.
@trungphan9137
@trungphan9137 Жыл бұрын
This is mind blowing.... I love the way you go from the problem to the solution, it's clever way to understand this KL divergence
@ritvikmath
@ritvikmath Жыл бұрын
thanks!
@tayyibulhassan6227
@tayyibulhassan6227 11 ай бұрын
One of the BEST tutorials for sure
@anujadassanayake6202
@anujadassanayake6202 Жыл бұрын
Great explanation, this is the first time I'm learning about KL divergence and it was very easy to grasp because of the way you taught it
@mrcaljoe1
@mrcaljoe1 Жыл бұрын
I think you're channel and teaching style is brilliant. I wish I knew about this channel when I was doing my undergrad.
@0hexe
@0hexe Жыл бұрын
Amazing video, love the format!
@somdubey5436
@somdubey5436 6 ай бұрын
superb...I believe this is the best explanation I have ever come across for K L Divergence. Thanks a tonne.
@thankyouthankyou1172
@thankyouthankyou1172 7 ай бұрын
I found out this professor is very good at explaining every tough concept! respect and many appreciations!
@somethingness
@somethingness 6 күн бұрын
What an excellent teacher you are! Thank you for all your videos.
@danscherb4130
@danscherb4130 Жыл бұрын
Another amazing video! Please keep them coming!
@julianwebb9222
@julianwebb9222 2 ай бұрын
That was great! Not just dumping the formula on you but walking you through its logic with simple steps. Loved it! ❤
@tampopo_yukki
@tampopo_yukki 9 ай бұрын
I love how you approach to the KL divergence!
@trentbolt2006
@trentbolt2006 10 ай бұрын
You've really made my day with ur explanation. Thank you so much :D
@paigecarlson1742
@paigecarlson1742 3 ай бұрын
Outstanding. Really helping me through this info retrieval course!
@godlyradmehr2004
@godlyradmehr2004 2 ай бұрын
The best explanation I've ever seen about KL divergence ❤
@seansullivan6986
@seansullivan6986 Ай бұрын
Excellent intuitive explanation!
@Mars.2024
@Mars.2024 5 ай бұрын
Everytime i have a math question your hannel is my first choice! Amazing ✅ thanks a million 🎉
@shamarbauyrzhan7997
@shamarbauyrzhan7997 Жыл бұрын
Let's celebrate a new video on this amazing chanel!!! Love your work!
@ritvikmath
@ritvikmath Жыл бұрын
🎉
@eagermage3157
@eagermage3157 Жыл бұрын
Best Math Teacher ever. So clearly explained the design and thinking process of how the algo comes out. Many video just explain the formula which confused me why we should do this way... Thank you!
@ChocolateMilkCultLeader
@ChocolateMilkCultLeader Жыл бұрын
This is the perfect video in Math. Love it. Shared with all my readers
@AdeOlubummo
@AdeOlubummo Ай бұрын
Just fantastic! Even if I forget the formula for KL divergence, I can "re-engineer" it on demand.
@hpp496videos
@hpp496videos Жыл бұрын
This was incredibly illustrative!
@Hobbies_forkids
@Hobbies_forkids Жыл бұрын
Excellent way to explain it. Makes maths sounds logical and approachable 🎉
@MagmaMusen
@MagmaMusen Ай бұрын
Thanks!
@midnightwanders5876
@midnightwanders5876 Жыл бұрын
Great work! I've been a fan of your ,material for some time and in this video you have truly mastered your craft.
@ritvikmath
@ritvikmath Жыл бұрын
Wow, thank you!
@momcilomrkaic2214
@momcilomrkaic2214 4 ай бұрын
Your videos are great just keep going, I watched you for few years already
@joesavage9077
@joesavage9077 Ай бұрын
Wow!!! This approach to explaining was mind "opening". I got it! Thanks so much
@vaibhavnakrani2983
@vaibhavnakrani2983 6 ай бұрын
Awesome! Very intuitive
@yhoang6674
@yhoang6674 Жыл бұрын
In the 'Motivation for log,' you said that taking a simple average is not the right way to go, and then you try to find a function that makes f(4) and f(1/4) have opposite signs. That means you are trying to make two very different distributions have the smallest distance possible (canceling each other out), which is contradictory to what we expected. We expected them to be large.
@razgaon3680
@razgaon3680 Жыл бұрын
Best video I've seen in a while!
@ritvikmath
@ritvikmath Жыл бұрын
Thanks!
@Justin-zw1hx
@Justin-zw1hx Жыл бұрын
dude, the explanation is so good, you rock!
@ritvikmath
@ritvikmath Жыл бұрын
Glad it helped!
@kasyaci
@kasyaci Жыл бұрын
That was one of the best explanations I have ever heard! Great job and many thanks!
@ritvikmath
@ritvikmath Жыл бұрын
Thanks!!
@mehmetozkan1479
@mehmetozkan1479 8 ай бұрын
I have never seen complex math explained this good Thank you very much!
@sandipmehta2950
@sandipmehta2950 10 ай бұрын
amazing explanation. not many can do this. well done.
@user-vb1no5lq1e
@user-vb1no5lq1e 5 ай бұрын
me not know some of the fundamentals after listening to your explanation made a lot of sense, and I felt I understood the concept well. I am willing to watch your videos more often.
@akhileshpandey123
@akhileshpandey123 Жыл бұрын
very nice explanation. Thanks for the work.
@kaanefe4266
@kaanefe4266 8 ай бұрын
God level explanation thank you!!!
@manducchuc915
@manducchuc915 9 ай бұрын
Thanks, exactly the explanation I have been looking for!
@yb801
@yb801 Жыл бұрын
This is an amzing explanation, thanks!
@ritvikmath
@ritvikmath Жыл бұрын
Glad it was helpful!
@keyvan4680
@keyvan4680 7 ай бұрын
thank you for the clear explanation.
@aisniper4095
@aisniper4095 Жыл бұрын
Amazing explanation!
@winstongraves8321
@winstongraves8321 Жыл бұрын
This was awesome. Really helpful to think through it backwards and “redevelop” our own function
@sparkgin
@sparkgin Ай бұрын
That was amazing. Thank you so much!
@s.prakash7869
@s.prakash7869 Жыл бұрын
Awesome explaination. Thanks for this video
@ritvikmath
@ritvikmath Жыл бұрын
Glad it was helpful!
@brandonkim4675
@brandonkim4675 Жыл бұрын
I recently got interested in learning machine learning and stumbled upon the stable diffusion, the current state of art open source image generation ai. That's where I encountered the KL divergence. The more I try to understand it, more complicated concepts and formulas are thrown at me. I managed to find some videos that explains how to derive it, but none of them explained why the hell logarithm is present in it for gods sake! And here you are, explaining every missing details from other videos and blog posts in a way that the person who knows very little about the subject can understand in a very satisfying and easy to follow way. Hats off to you, sir. I wish every teachers are like you.
@ritvikmath
@ritvikmath Жыл бұрын
Thanks and godspeed for your journey through machine learning !
@talsveta
@talsveta 10 ай бұрын
Great explanation
@marka5968
@marka5968 Жыл бұрын
Wow. This is the best explanation of KL-divergence I've ever heard. So many over-complicated stuff out there but yours is absolutely genius.
@ritvikmath
@ritvikmath Жыл бұрын
Glad it was helpful!
@tom199520000
@tom199520000 3 ай бұрын
wahh.. i am studying computer science master degree. Your video really helps me a lot! please keep on doing such great work for us!
@seyyedmahdihoseini3084
@seyyedmahdihoseini3084 7 ай бұрын
very very very very well explained, Thanks
@Andy-qi5nh
@Andy-qi5nh Жыл бұрын
Amazing teaching. It helps a lot in my process of data shift covariate detection project. Thanks
@ritvikmath
@ritvikmath Жыл бұрын
Glad it was helpful!
@devindoinmonkmode
@devindoinmonkmode 3 ай бұрын
Wonderful man. Thank you so much.
@jtkklb
@jtkklb 2 ай бұрын
Very good explanation
@aliksargsyan2035
@aliksargsyan2035 Жыл бұрын
Thank you. As usual, great and very intuitive explanation.
@ritvikmath
@ritvikmath Жыл бұрын
No problem !
@mariusschmidt6883
@mariusschmidt6883 Жыл бұрын
Wow. Just wow! This is brilliant🤩
@ritvikmath
@ritvikmath Жыл бұрын
Thanks!
@barbaraalexandrova6680
@barbaraalexandrova6680 Ай бұрын
thank you for the best expanation on this topic
@user-co6pu8zv3v
@user-co6pu8zv3v Жыл бұрын
Thank you! This is the best explanation of KL divergence wich i've seen
@ritvikmath
@ritvikmath Жыл бұрын
Glad it was helpful!
@sunset6109
@sunset6109 11 ай бұрын
Bro is a legend
@PrajwalSingh15
@PrajwalSingh15 Жыл бұрын
Thank you so much for this explanation and also got a new insight about the log :)
@ritvikmath
@ritvikmath Жыл бұрын
Happy to help!
@vorushin
@vorushin 5 ай бұрын
Thank you for the great explanation! I totally agree that math is not given from above, but invented by people. And showing how the invention can be done is the best way to teach the new concepts. Thanks a lot!
@rishi2504
@rishi2504 10 ай бұрын
You just got a subscriber. Thank You! 😊
@yorker0507
@yorker0507 4 ай бұрын
Super clear !
@fh3652
@fh3652 Жыл бұрын
Great stuff... Learning a way to teach maths to my kid... A constructivist method... While learning about stats... I really appreciate your work.
@ritvikmath
@ritvikmath Жыл бұрын
Glad it was helpful!
@afsanarabeya4417
@afsanarabeya4417 Жыл бұрын
thank you. this really helped !!
@orenkoriat
@orenkoriat Жыл бұрын
great explanation!
@ritvikmath
@ritvikmath Жыл бұрын
Glad you think so!
@ingenierocivilizado728
@ingenierocivilizado728 3 ай бұрын
Thank you very much for your valuable videos!!
@ritvikmath
@ritvikmath 3 ай бұрын
Glad you like them!
@sikalee415
@sikalee415 Жыл бұрын
You are great in explaining this! Thanks!
@ritvikmath
@ritvikmath Жыл бұрын
Glad it was helpful!
@ringo8530
@ringo8530 10 ай бұрын
you are way more better than my school's professor. thank you
@SSJVNN
@SSJVNN 7 ай бұрын
The comments didn't lie you actually explained this so well. I watched the ads all the way through btw.
@chandrashekaravula1292
@chandrashekaravula1292 Жыл бұрын
Amazing explanation
@ritvikmath
@ritvikmath Жыл бұрын
Glad you liked it
@s.m.tahsinzaman_2720
@s.m.tahsinzaman_2720 Жыл бұрын
Thank you SO much! God bless you Sir, keep up the great work 😊
@ritvikmath
@ritvikmath Жыл бұрын
You are very welcome
@shadabalam2122
@shadabalam2122 3 ай бұрын
Great explanation 👏
@ritvikmath
@ritvikmath 3 ай бұрын
Glad you think so!
@qiguosun129
@qiguosun129 Жыл бұрын
Thanks for the lecture, your work is always so intuitive.
@ritvikmath
@ritvikmath Жыл бұрын
You are very welcome
@nanthawatanancharoenpakorn6649
@nanthawatanancharoenpakorn6649 8 ай бұрын
Love problem solving perspective
@anonymousiguana168
@anonymousiguana168 Жыл бұрын
You're just phenomenal
@ritvikmath
@ritvikmath Жыл бұрын
Thanks!
@RAHUDAS
@RAHUDAS Жыл бұрын
That was really awesome
@DataScienceAI-rf4kx
@DataScienceAI-rf4kx 4 ай бұрын
Thank you :) for valuable content
@abironnoy3115
@abironnoy3115 Жыл бұрын
Thank you so much for the explanation. it was really helpful👍👍
@ritvikmath
@ritvikmath Жыл бұрын
Thanks!
@jackritwik09
@jackritwik09 7 ай бұрын
mad respect for Ritvik from Ritwik for acing the subtle art of intuitive explanation:)) If only professors could master the same art.
@prakashbabuni
@prakashbabuni 3 ай бұрын
simply Excellent
@ritvikmath
@ritvikmath 3 ай бұрын
Thank you! Cheers!
@physicsfaith
@physicsfaith 11 ай бұрын
Great job
@komuna5984
@komuna5984 11 ай бұрын
Thanks a lot for sharing the underlying motivation behind the K-L divergence! I really needed such deep insights! JAJAKALLAH...
@ritvikmath
@ritvikmath 11 ай бұрын
You're so welcome!
@gingerderidder8665
@gingerderidder8665 3 ай бұрын
Taking the MITx Stats class, but I find that you explain the concepts so much better!
@ritvikmath
@ritvikmath 3 ай бұрын
Glad to hear!
@shuweiPeng-id4xv
@shuweiPeng-id4xv 4 ай бұрын
讲的真好,谢谢
@jijie133
@jijie133 Жыл бұрын
Great video!
@ritvikmath
@ritvikmath Жыл бұрын
Glad you enjoyed it!
@vzinko
@vzinko Жыл бұрын
Thank you as always for sharing your brilliant teachings, Ritvik. Could you please do a video on the Gram-Schmidt process and how orthonormal basis matrices are relevant to data science?
@andrew-qf4xl
@andrew-qf4xl 6 ай бұрын
the thing you said in the first minute, is something ive been saying for a while now. As students we arent told what problem drove scientists or engineers into constructing new formulas or ways of thinking.
@ResilientFighter
@ResilientFighter Жыл бұрын
Love this homie! Better than university.
@ritvikmath
@ritvikmath Жыл бұрын
😊
@MuzammilZahidJahangiri
@MuzammilZahidJahangiri Жыл бұрын
Subscribed! just from this one video
@ritvikmath
@ritvikmath Жыл бұрын
Woo welcome!
@MrCEO-jw1vm
@MrCEO-jw1vm 17 күн бұрын
Thank you for a good explanation of a seemingly weird looking formula. It would be hard to forget this formula now that I got it from here.
@ritvikmath
@ritvikmath 15 күн бұрын
Thanks!
@davidthehudson
@davidthehudson 7 ай бұрын
You are a god send.
Jensen's Inequality : Data Science Basics
18:04
ritvikmath
Рет қаралды 11 М.
DO YOU HAVE FRIENDS LIKE THIS?
00:17
dednahype
Рет қаралды 54 МЛН
터키아이스크림🇹🇷🍦Turkish ice cream #funny #shorts
00:26
Byungari 병아리언니
Рет қаралды 29 МЛН
孩子多的烦恼?#火影忍者 #家庭 #佐助
00:31
火影忍者一家
Рет қаралды 40 МЛН
Entropy (for data science) Clearly Explained!!!
16:35
StatQuest with Josh Starmer
Рет қаралды 582 М.
Gaussian Mixture Model
15:07
ritvikmath
Рет қаралды 101 М.
KL Divergence - CLEARLY EXPLAINED!
11:35
Kapil Sachdeva
Рет қаралды 26 М.
Introduction to KL-Divergence | Simple Example | with usage in TensorFlow Probability
15:29
Machine Learning & Simulation
Рет қаралды 15 М.
Bayes theorem, the geometry of changing beliefs
15:11
3Blue1Brown
Рет қаралды 4,2 МЛН
Every Distance in Data Science (Almost 100K Subs!)
21:25
ritvikmath
Рет қаралды 11 М.
The Planet Fitness Problem : Improved Markov Chains
16:37
ritvikmath
Рет қаралды 2,7 М.
The Most Important Curve in Data Science
14:10
ritvikmath
Рет қаралды 7 М.
DO YOU HAVE FRIENDS LIKE THIS?
00:17
dednahype
Рет қаралды 54 МЛН