Principal Component Analysis (PCA)

  Рет қаралды 400,867

Serrano.Academy

Serrano.Academy

Күн бұрын

Announcement: New Book by Luis Serrano! Grokking Machine Learning. bit.ly/grokkingML
40% discount code: serranoyt
A conceptual description of principal component analysis, including:
- variance and covariance
- eigenvectors and eigenvalues
- applications
As usual, very little formulas, lots and lots of pictures!
0:00 Introduction
0:46 Taking a picture
1:13 Dimensionality Reduction
2:02 Housing Data
5:09 Mean
7:46 Variance?
12:47 Covariance matrix
13:58 Linear Transformations
18:12 Eigenstuff
19:16 Eigenvalues
19:53 Eigenvectors
20:51 Principal Component Analysis (PCA)
26:05 Thank you!

Пікірлер: 944
@rutger5983
@rutger5983 5 жыл бұрын
I haven't seen any clearer explanation of PCA on the internet than this one. Many thanks!
@joaquimfilho2227
@joaquimfilho2227 3 жыл бұрын
I agree!
@Antonio-lt1sp
@Antonio-lt1sp 3 жыл бұрын
I second this - great channel!
@li-pingho1441
@li-pingho1441 2 жыл бұрын
agreeeeeeeeee
@dwaynemcdowell2073
@dwaynemcdowell2073 2 жыл бұрын
Completely Agree!
@mfatihaydogdu7
@mfatihaydogdu7 Жыл бұрын
+1
@AdamTibi
@AdamTibi 3 жыл бұрын
Judging by how much you simplified the lesson without sacrificing the actual concept, I trust you have spent good time preparing for your lesson and animation. Thank you very much
@varsharathnam9844
@varsharathnam9844 5 жыл бұрын
I haven't seen a better explanation for PCA. Love it! And I always had trouble to conceptually understand covariance. I knew it was related to direction but always found it difficult to conceptualize. Thank you for your explanation.
@zilezile4942
@zilezile4942 4 жыл бұрын
@@rishabhkapoor3338 www.amazon.com/Data-Analysis-functional-principal-regression/dp/B088BM4FCB/ref=sr_1_6?dchild=1&keywords=nizar+soilihi&qid=1589823715&sr=8-6
@1amitnagar
@1amitnagar 3 жыл бұрын
Excellent video. Very intuitive. Thanks
@satyamsubhash4569
@satyamsubhash4569 3 жыл бұрын
hi
@ArvindDevaraj1
@ArvindDevaraj1 4 жыл бұрын
we may be aware of terms like mean, variance, covariance, linear-transforms, eigenvectors and eigenvalues, PCA. This video puts together all the relationships in an amazing way
@manan4436
@manan4436 5 жыл бұрын
I have confusion even after watching videos of 2+ hours... 26 minutes solved all doubts. I like the way how you put all the concepts together. Thanks.
@chanwoo1143
@chanwoo1143 4 жыл бұрын
lol this cracks me up
@scikick
@scikick 5 жыл бұрын
You are the tutor we all need but don't deserve.
@anonymouse221
@anonymouse221 Жыл бұрын
This is how you teach!! I wish my professors from university could do even 1% of this... I am paying thousands of dollars for something I get for free on youtube!! Very good job!!
@Justjemming
@Justjemming 9 ай бұрын
I would literally clap for you if you gave this lecture in person. Thanks for this man. Keep doing what u do
@srishtikumar5544
@srishtikumar5544 4 жыл бұрын
This was AMAZING!!! You reconciled so many disparate concepts I had learned in college...I understand how it fits together now. Very down-to-earth explanation, and amazing animations!
@haoyiwang6869
@haoyiwang6869 5 жыл бұрын
This is the best PCA video ever seen, it's quite easy to follow and understand deeply.Thanks!
@omkarghadge8432
@omkarghadge8432 3 жыл бұрын
This is without a doubt the best explanation on youtube.
@sidneyaburi
@sidneyaburi 18 күн бұрын
I am yet to see a clearer explanation of PCA in my life! Thank you so much!
@alekseihaidukevich3697
@alekseihaidukevich3697 5 жыл бұрын
That arguably might be the best tutorial I've ever watched on KZfaq. Thanks.
@AndresGonzalez-hn6mz
@AndresGonzalez-hn6mz 5 жыл бұрын
Great explanation Luis! It took me a whole class and a conversation after with an instructor to get PCA, and still your video cleared up so much uncertainty/misconceptions I had on the subject.
@mosunchao
@mosunchao 7 ай бұрын
This is the best PCA explanation. If only I had this explanation 11 years ago...
@manojpaul4377
@manojpaul4377 6 ай бұрын
have never seen a better explanation of pca than this
@davibelo
@davibelo 4 жыл бұрын
far better PCA explanation on youtube, I saw a lot of videos, but only learned with this one.
@caronkanareck6250
@caronkanareck6250 5 жыл бұрын
wow! this was VERY worthwhile. thank you! so many lights switched on
@pramitthapa283
@pramitthapa283 8 ай бұрын
PCA, that I couldn’t really understand in five years (although I have been using in analysis without being clear), I am now crystal clear. There are so many articles and videos. Those are like a parroting. This lesson is the best.
@li-pingho1441
@li-pingho1441 2 жыл бұрын
i search all the pca tutorial on youtube, and this is the best one.
@patrikhora
@patrikhora 4 жыл бұрын
well thats the best explanation i have ever seen, great job sir, thank you so much !
@SantosEnoque
@SantosEnoque Жыл бұрын
I am impresed with the level of information you were able to put together in a 20 minutes video. I mean you summarized a whole semester in such a way that a beginner could follow. Thats amazing
@chyldstudios
@chyldstudios 5 жыл бұрын
One of the most lucid presentations on PCA I've ever seen. Nice work!
@rVnikov
@rVnikov 5 жыл бұрын
Well Luis, that's the best and most intuitive PCA tutorial I've seen so far. Bravo!
@Pidgey95
@Pidgey95 5 жыл бұрын
This is the clearest explanation of PCA I've ever seen. As a wannabe analytical chemist, this is pure gold because it gives you hints about the true meaning of PCA without excessively digging into statistics and pure mathematics which just blows your mind. Congrats for the amazing explanation and the effort to make this video!
@anudeepk7390
@anudeepk7390 4 жыл бұрын
Thank you for taking time to explain small detail
@batuhanbaykara2003
@batuhanbaykara2003 5 жыл бұрын
By far the best conceptual and visual explanation online. Great work. Thanks!
@skoppisetti
@skoppisetti 5 жыл бұрын
I watched many videos on PCA over the last year and by far this is the best. Thank you.
@yashu25shetty
@yashu25shetty 5 жыл бұрын
Awesome explanation for PCA beats any in youtube tilll date
@clementchidozie4009
@clementchidozie4009 4 жыл бұрын
EXACTLY!!!!
@Antonio-lt1sp
@Antonio-lt1sp 3 жыл бұрын
Agree, even the one from 3Blue1Brown
@vivek2319
@vivek2319 5 жыл бұрын
Most comprehensive explanation, thank you so much. Tomorrow, I have interview for big tech company and now after watching whole video, I feel confident to answer questions on PCA. \m/
@SerranoAcademy
@SerranoAcademy 5 жыл бұрын
Thank you! I hope your interview went great!
@rajivpanda4189
@rajivpanda4189 5 жыл бұрын
One of best explanation after going through lot of PCA videos. Now it will make sense to drill down further. Thanks!
@meghakalal4264
@meghakalal4264 5 жыл бұрын
Best ever explanation on PCA. You put so much effort into this. Thanks!!
@clementchidozie4009
@clementchidozie4009 4 жыл бұрын
HIT THE LIKE BUTTON IF YOU LOVE THIS VIDEO!!! You did it! You nailed it!! You killed it!!! Just when I was about to give up on this topic after watching a series on PCA, I ran into yours and BOOM!!! IT WAS THE BEST THING I DID!!!! I am going to watch it again because you gave me an ideal explanation of the topic. You started off with related background knowledge necessary for perfect understanding. THANKS A LOT!
@andresrojas8486
@andresrojas8486 5 жыл бұрын
This excellent, Luis. My only thought to improve the video would be to pull the thread through using your original example of housing data. Good job, and thank you!
@anilboppuri2067
@anilboppuri2067 5 жыл бұрын
Awesome Luis! very informative graphics to understand the complex concepts. Great Job :)
@suryag7408
@suryag7408 4 жыл бұрын
Only explanation which has core PCA explained in a very simple yet effective and useful manner. His teaching skills are exemplary.
@footfalcon
@footfalcon 5 жыл бұрын
Recognizing your name from your Udacity lectures, I was thrilled to have stumbled upon your youtube channel today - really gentle, concise, intuitive explanation of a complex topic. Nice shout out to 3blue1brown - watching this reminded me of his videos and style (though his visualizations are insane :] ). One question: from the end of your video, it seems to me that eigenvalues can be thought of as measures of feature importance, but in your housing example, multiple similar features (size, #rooms, etc) become a new single representative feature. How do we know what the features are that we are left with after PCA in much higher dimensional examples? Say we reduce a 100 dimensional data set to 10 dimensions, how do we know what those 10 dimensions represent? Thanks again - looking forward to diving into your channel.
@SerranoAcademy
@SerranoAcademy 5 жыл бұрын
footfalcon thank you for the kind message! (And sorry for the late reply). The new features are combinations of previous ones, but in general they may not mean much. However, since you know what combinations they are, you can look for example at the biggest coefficients in the linear combination, and see if you find trends. For example, if the top feature has big coefficients for several features that are size related (in a house) and small coefficients for other features that are not related to size, you can associate that feature with size in general. But it’s more of an observation than a mathematical way to do it.
@RANJEETTHAKUR1983
@RANJEETTHAKUR1983 5 жыл бұрын
This is great tutorial. Can you make a similar video about - Markov Chain Monte Carlo, since its too complicated to understand why are we doing what we do?
@ZeeshanAli-tv8gu
@ZeeshanAli-tv8gu 5 жыл бұрын
f
@teegnas
@teegnas 5 жыл бұрын
Same here, really would love a video on this topic
@spideronline4836
@spideronline4836 5 жыл бұрын
up
@macmac1283
@macmac1283 5 жыл бұрын
I second that
@chyldstudios
@chyldstudios 4 жыл бұрын
One of the best descriptions of PCA I've seen. Bravo!
@vatsal_gamit
@vatsal_gamit 3 жыл бұрын
Best explanation available on KZfaq for PCA!! Amazing work Luis :)
@giuliomattolin517
@giuliomattolin517 4 жыл бұрын
Thank you! This is the most comprehensible and complete video about PCA I've found!
@j9779398758
@j9779398758 3 жыл бұрын
Thank you for making this video!! PCA and linear algebra have never been so easy and understandable to beginners, but you’ve made things clear and logical!
@prajjwalsingh6490
@prajjwalsingh6490 5 жыл бұрын
You're a hero! Great explanation! Probably the best video kn PCA on KZfaq.
@swetajoshi6557
@swetajoshi6557 3 жыл бұрын
Luis, I have seen so many videos for PCA but this one is the best that I came across. Really appreciate your work and thank you for making the video. It's really awesome.
@haoteli2122
@haoteli2122 4 жыл бұрын
There are so many videos on the internet but none explained to this detailed and fundamental level as you did! Thank you sir!
@prahaladprabhakar6275
@prahaladprabhakar6275 3 жыл бұрын
This is by far the best PCA video i have come across. Thank You!!
@akankshamaurya8419
@akankshamaurya8419 2 ай бұрын
Quite literally the best video on PCA. You explained everything without skipping the math and the basics, amazing!
@ayushimittal6496
@ayushimittal6496 Жыл бұрын
Thank you so much for this amazing explanation Luis!! This is the best and most intuitive explanation of PCA I've found on the internet! I was literally struggling to understand this concept for weeks! :')
@qingdai40
@qingdai40 5 жыл бұрын
Best PCA explanation I have ever seen. Thank you so much Luis.
@lonewolf2547
@lonewolf2547 4 жыл бұрын
This was by far the best explanation that I found on youtube. Keep up the good work man
@neelanjanmanna6292
@neelanjanmanna6292 3 жыл бұрын
Never have I understood PCA in such a simplified and intuitive way. You're a magician! ❤️
@Drichou_
@Drichou_ 5 жыл бұрын
This explantation is better than my one year course , thanks a lot
@steveholland7165
@steveholland7165 4 жыл бұрын
Well done, Luis. The recap at the end brought it all together. Thank you for posting.
@wandag3684
@wandag3684 3 жыл бұрын
Luis, thank you so much for sharing your knowledge. I've seen countless videos on data science and this PCA explanation is one of (if not the) best ones out there! This is the first of your videos that I've seen, but I'm excited to find others now. Again, thank you!
@carlavirhuez4785
@carlavirhuez4785 4 жыл бұрын
Dear Sir, you are the best at explaining PCA!. I thank you very much.
@castro_hassler
@castro_hassler 5 жыл бұрын
I appreciate the way you decompose hard topics in a way easy to understand, but PLEASE, more videos with math and intuition like this one, thank you very much again, Sr.
@petros-estin-petra-
@petros-estin-petra- 5 жыл бұрын
By far the very best PCA explanation! Very clear and understandable for everyone!
@ashrithchandramouli6735
@ashrithchandramouli6735 4 жыл бұрын
I spent so many hours looking at other videos and content online and could not make sense of it. This video really helped me a lot. Especially in understanding the role of eigenvectors and eigenvalues. Thank you so much!
@dannymatsuo2531
@dannymatsuo2531 4 жыл бұрын
Thank you!! Out of all the videos I watched on KZfaq this one helped me understand the most about what PCA is, how it works, and when to use it.
@taluunal745
@taluunal745 5 жыл бұрын
Great explanation, focussing only on the necessary things and giving hints to look further if necessary. Thank you for your efforts!
@javiergonzalezarmas8250
@javiergonzalezarmas8250 Жыл бұрын
The best explanation of PCA on KZfaq!! Thank you very much!
@tanim980
@tanim980 Жыл бұрын
This is the best explanation of PCA in the whole KZfaq!Thanks so much!!
@priyangijain1356
@priyangijain1356 Жыл бұрын
Just amazing. I have an exam and I have gone through so much material already but nothing could have summed PCA better than you did. Thank you!
@ad2181
@ad2181 Жыл бұрын
Now, I can keep the PCA idea in my head without forgetting it. Thanks, the best PCA tutorial on YT, excellent.
@kanchanpoudel3133
@kanchanpoudel3133 3 жыл бұрын
This has to be the best, yet so simple to understand explanation of PCA I have ever come across!
@amrohassan5942
@amrohassan5942 2 жыл бұрын
One of the best explanation to PCA on youtube , amazing video
@puiyincheung2476
@puiyincheung2476 3 жыл бұрын
This video is amazing! Many students in college are taught how to compute the eigenvector and eigenvalue but the college seldom explained its geometrical meaning, but you did this which helped me a lot! Thank you!
@kpmaynard
@kpmaynard 3 жыл бұрын
You are a gifted lecturer. You know how to motivate the theory and provide that understanding of WHY we're taking all the computational steps. That is rare!
@LeastKnownFacts
@LeastKnownFacts 4 жыл бұрын
One of the best explanation I have ever come across. Thank you very much
@osamaakhtar6525
@osamaakhtar6525 3 жыл бұрын
I cannot state how intuitive this video is! Even a layman can now understand this! Loved it, subscribed and looking for more!!
@emrullahcelik7704
@emrullahcelik7704 2 жыл бұрын
This was fantastic. You made the concept so intuitive and easy to understand. Thank you.
@rice3855
@rice3855 5 жыл бұрын
Great explanation! It's always easy to find these things with complicated math but then you lose the idea, your video was easy to follow and I felt like I actually understood these concepts :D Thank you!
@sandhyaranidash2429
@sandhyaranidash2429 Жыл бұрын
This is the best explanation of PCA, individual components broken down, emphasis on visualization instead of just the method and then all the components put together for the big picture. I cant thank you enough for the fantastic teaching style that clicks with me.
@fernandomercado7792
@fernandomercado7792 5 жыл бұрын
Very well done! I have seen many of these type of tutorial, but this one beats the rest. I am glad you did put some math into it, which give a better understanding of why things work as they do. Bravo!
@nikhilraikar88
@nikhilraikar88 4 жыл бұрын
By far the best video on PCA. Explanation was top notch! Thank You!
@kitayuan9842
@kitayuan9842 3 жыл бұрын
All of Luis' videos are spectacularly understandably and convey so much useful information!
@malikadabare3719
@malikadabare3719 4 жыл бұрын
This is the best explanation for PCA. I have tried with so many videos, but this saves me. Thank you
@muskanvij4811
@muskanvij4811 3 жыл бұрын
This is the best video on PCA I have come across. Its so well explained
@yalslaus
@yalslaus 2 жыл бұрын
You have a very intuitive way of teaching things that's hard to infer when reading or watching lectures from other teachers.
@soffipiven8757
@soffipiven8757 4 жыл бұрын
The most informative but graspable explanation of PCA I have encountered online ever. Thanks so much!
@modishubham12
@modishubham12 4 жыл бұрын
Out of the world explanation for PCA. Never seen so simple and easy elaboration of this concept. Tons of thanks.
@rohitnath5545
@rohitnath5545 2 жыл бұрын
the best PCA video on the internet. i always struggled with eigen value and eigen vectors thanks man
@likhithreddy1339
@likhithreddy1339 4 жыл бұрын
This is the best of all lectures about PCA! Thanks a lot.
@jeff-9179
@jeff-9179 4 жыл бұрын
bro, the clearest explanation i 've seen so far. good work. thank you so much :)
@PeymanSayyadi
@PeymanSayyadi 3 жыл бұрын
The best PCA tutorial I have seen anywhere on youtube. Thanks.
@HitAndMissLab
@HitAndMissLab 12 күн бұрын
Just discovered it. Phenomenally perfect balance between intuition and quantitative explanation.
@alimehmood8654
@alimehmood8654 4 жыл бұрын
I have had struggled visualizing co-variance and PCA, you have done it so marvelously, literally out of words for the gratitude after seeing this video, now I have understood PCA by heart. Kudos!
@myweg7806
@myweg7806 2 жыл бұрын
Amazing. Perhaps the best PCA explanation video in the internet.
@CrypticPulsar
@CrypticPulsar Жыл бұрын
The best and neatest explanation of PCA.. bravo, and you’ve earned a lifelong fan and follower!!
@ramielkady938
@ramielkady938 6 ай бұрын
I have spent 3 days chasing eigenvectors and eigenvalues, and then I found you video. It puts it all together very nice, and mentally delivers it with ease - like a boss. I was very close to spending two weeks on Khan academy to understand what you delivered in 26 minutes. Thank you so much.
@ashokmahato6870
@ashokmahato6870 6 ай бұрын
Best video i have even seen about PCA. Thank you so much sir.
@beatricenatividadmendoza752
@beatricenatividadmendoza752 3 жыл бұрын
God bless your soul, sir! This filled in the gaps for so many topics that were just brushed over at school. Really helpful and very much appreciate the time and energy you put into creating this video :) I am sure you have just saved and helped hundreds of lost students with your video/s
@meizhiju9686
@meizhiju9686 3 жыл бұрын
This is the most clear video that I have watched. Many thanks!!
@alis5893
@alis5893 3 жыл бұрын
Fantastic, absolutely the best simple, straight to the point presentation of the PCA . Thank you
@shawazeahmer8103
@shawazeahmer8103 2 жыл бұрын
This is one the simplest and most precise explanation of PCA. Thanks !!
@Wasserwerk
@Wasserwerk Жыл бұрын
by far the best video on PCA out there! Thanks a lot!
@lakshminarayan1155
@lakshminarayan1155 Жыл бұрын
I went over at-least 30+ videos + materials , articles from 2 weeks , At last you made it so clear . You are wonderful teacher 🙏
@maheshpatidar5663
@maheshpatidar5663 3 жыл бұрын
oh my god! this is unbelievable stuff. I wasted around a day on many lectures and books still can't able to grasp a shit about PCA. but this man explains it in such a beautiful way. You're a legend sir
@andyn6053
@andyn6053 9 ай бұрын
Thanks! Very good explanation of how projections, eigenvectors and eigenvalues all come together in PCA analysis!
@ozielh
@ozielh Жыл бұрын
The best PCA explanation in KZfaq! felicidades Luis!
How does Netflix recommend movies? Matrix Factorization
32:46
Serrano.Academy
Рет қаралды 333 М.
Principal Component Analysis (PCA) clearly explained (2015)
20:16
StatQuest with Josh Starmer
Рет қаралды 1 МЛН
Final muy inesperado 🥹
00:48
Juan De Dios Pantoja
Рет қаралды 19 МЛН
БОЛЬШОЙ ПЕТУШОК #shorts
00:21
Паша Осадчий
Рет қаралды 3,8 МЛН
MEU IRMÃO FICOU FAMOSO
00:52
Matheus Kriwat
Рет қаралды 35 МЛН
The covariance matrix
13:57
Serrano.Academy
Рет қаралды 93 М.
Singular Value Decomposition (SVD) and Image Compression
28:56
Serrano.Academy
Рет қаралды 89 М.
Clustering: K-means and Hierarchical
17:23
Serrano.Academy
Рет қаралды 195 М.
Principal Component Analysis (PCA) - easy and practical explanation
10:56
Data Analysis 6: Principal Component Analysis (PCA) - Computerphile
20:09
StatQuest: Principal Component Analysis (PCA), Step-by-Step
21:58
StatQuest with Josh Starmer
Рет қаралды 2,8 МЛН
Gaussian Mixture Models
17:27
Serrano.Academy
Рет қаралды 68 М.
Principal Component Analysis (PCA)
6:28
Visually Explained
Рет қаралды 191 М.
StatQuest: PCA main ideas in only 5 minutes!!!
6:05
StatQuest with Josh Starmer
Рет қаралды 1,2 МЛН
Cadiz smart lock official account unlocks the aesthetics of returning home
0:30
Main filter..
0:15
CikoYt
Рет қаралды 12 МЛН