Andrew Ng: Deep Learning, Education, and Real-World AI

Andrew Ng: Deep Learning, Education, and Real-World AI | Lex Fridman Podcast #73

Рет қаралды 551,320

Күн бұрын

Andrew Ng is one of the most impactful educators, researchers, innovators, and leaders in artificial intelligence and technology space in general. He co-founded Coursera and Google Brain, launched deeplearning.ai, Landing.ai, and the AI fund, and was the Chief Scientist at Baidu. As a Stanford professor, and with Coursera and deeplearning.ai, he has helped educate and inspire millions of students including me.
This episode is presented by Cash App. Download it & use code "LexPodcast":
Cash App (App Store): apple.co/2sPrUHe
Cash App (Google Play): bit.ly/2MlvP5w
PODCAST INFO:
Podcast website:
lexfridman.com/podcast
Apple Podcasts:
apple.co/2lwqZIr
Spotify:
spoti.fi/2nEwCF8
RSS:
lexfridman.com/feed/podcast/
Full episodes playlist:
• Lex Fridman Podcast
Clips playlist:
• Lex Fridman Podcast Clips
EPISODE LINKS:
Andrew Twitter: / andrewyng
Andrew Facebook: / andrew.ng.96
Andrew LinkedIn: / andrewyng
deeplearning.ai: www.deeplearning.ai
landing.ai: landing.ai
AI Fund: aifund.ai/
AI for Everyone: www.coursera.org/learn/ai-for...
The Batch newsletter: www.deeplearning.ai/thebatch/
OUTLINE:
0:00 - Introduction
2:23 - First few steps in AI
5:05 - Early days of online education
16:07 - Teaching on a whiteboard
17:46 - Pieter Abbeel and early research at Stanford
23:17 - Early days of deep learning
32:55 - Quick preview: deeplearning.ai, landing.ai, and AI fund
33:23 - deeplearning.ai: how to get started in deep learning
45:55 - Unsupervised learning
49:40 - deeplearning.ai (continued)
56:12 - Career in deep learning
58:56 - Should you get a PhD?
1:03:28 - AI fund - building startups
1:11:14 - Landing.ai - growing AI efforts in established companies
1:20:44 - Artificial general intelligence
CONNECT:
- Subscribe to this KZfaq channel
- Twitter: / lexfridman
- LinkedIn: / lexfridman
- Facebook: / lexfridmanpage
- Instagram: / lexfridman
- Medium: / lexfridman
- Support on Patreon: / lexfridman

Пікірлер: 467

@lexfridman 4 жыл бұрын

I really enjoyed this conversation with Andrew. Here's the outline: 0:00 - Introduction 2:23 - First few steps in AI 5:05 - Early days of online education 16:07 - Teaching on a whiteboard 17:46 - Pieter Abbeel and early research at Stanford 23:17 - Early days of deep learning 32:55 - Quick preview: deeplearning.ai, landing.ai, and AI fund 33:23 - deeplearning.ai: how to get started in deep learning 45:55 - Unsupervised learning 49:40 - deeplearning.ai (continued) 56:12 - Career in deep learning 58:56 - Should you get a PhD? 1:03:28 - AI fund - building startups 1:11:14 - Landing.ai - growing AI efforts in established companies 1:20:44 - Artificial general intelligence

@dayanandak4667 4 жыл бұрын

Thank you very much

@zeitgeisttv5312 4 жыл бұрын

The reason why hand writing is fundamentally different and more powerful because you are in the act of recalling and creating neural pathways. It's like drawing you are creating something from nothninness

@avimohan6594 4 жыл бұрын

About time! ( 😂)

@aheinstein291 4 жыл бұрын

I think you forgot: 1:22:02 How to throw shade at Elon Musk without mentioning his name. Jk, thanks for another great interview!

@jf9229 4 жыл бұрын

Absolutely loved this one!

4 жыл бұрын

I'm just a tradesman painting houses for a living but I stream these discussions in my headphones all day long while working. Even a luddite like me can gain so much from a guy like Andrew Ng - it's a quasi-spiritual process contemplating AI and how it relates to how I think and see the world. Even those not educated in this area ought to take an interest as its so intellectually enriching.

@jeromedeleon1226 4 жыл бұрын

you’re an inspiration! everyone has humble beginnings

@josh_rdgrs 4 жыл бұрын

I do construction and I do the same thing lol. Cool to see I'm not the only one.

@refactoredcodes 3 жыл бұрын

The work you do for money and your knowledge should not have to match. They are two different things. I am a software engineer and I want to learn to paint house. Because, that is a skill and activates different parts of brain. Education is everyones right. And, they should have access to it.

@simokokko7550 8 ай бұрын

@@refactoredcodes Well said. Everyone should try to learn as much as possible. And like you said 'job's status level' should not define people. There are smart people everywhere.

@kattmeating8315 7 ай бұрын

Bunch of good will huntings over here

@shamsuddeen2004 4 жыл бұрын

Whenever someone uses the word "It turns out", I remember Andrew Ng. I love Andrew Ng.

@Max-lr6dk 4 жыл бұрын

@@99dynasty i will buy it

@bobblum2000 4 жыл бұрын

@@99dynasty 1

@re1konn 3 жыл бұрын

@Potato Potato was gonna type the same thing haha

@s.tahsin.r2288 3 жыл бұрын

yes have heard those before every time a topic came up that Andrew feared might be too much for his students.

@BingLi224 3 жыл бұрын

recall his lectures

@prof_shixo 4 жыл бұрын

I have a PhD in AI and I can say that Andrew is THE BEST machine learning/AI educator I have ever seen on the field! The deeplearning specialization is just invaluable for any interested learner in DL.

@pranav3658 3 жыл бұрын

Hey, is it a Ph.D in standalone AI or is it Ph.D in CS with a concentration in AI? (PhD AI or PhD CS with AI concentration).

@prof_shixo 3 жыл бұрын

@@pranav3658 Hi, there is no such a PhD in AI as the specialization. Usually, it would be PhD in CS, Stats, or EE with a focus on AI and machine learning.

@pranav3658 3 жыл бұрын

Sherif Mosaad aah, thanks a lot for the reply! Also, I have an admit into the masters program in AI @ Boston University, AI is definitely what iam passionate about and a Ph.D is definitely a part of the bigger picture for me. Would you recommend I take it or rather settle for a more traditional MS in CS with focus on AI?

@shravani9106 3 жыл бұрын

@@prof_shixo hey I am 17 still in high school. I did some courses in machine learning and some data science courses.Topics like Neural Networks intimidate me. I wanna ask which major should I pick as my undergraduate degree. CS, electrical and electronics, or economics degree?

@ivannav 3 жыл бұрын

@@shravani9106 CS

@Reve101 Жыл бұрын

I teared up when Andrew said “someone allow me the good fortune of helping them a little bit on their path to their dreams”. It restores my faith in humanity when I hear influential people like him with this much humility.

@TheRobertjoellewis 4 жыл бұрын

I took Ng's class on Coursera years ago. It switched my career trajectory from academic to industry, and spurred my interest in making things. Awesome to see this interview!

@stanrock8015 4 жыл бұрын

Robert Lewis I’m late to the show and going thru it now but yes. Changing my career direction now

@unreactive 4 жыл бұрын

Hi, I take the same class. Can you recommend some next course or anything else?

@TheRobertjoellewis 4 жыл бұрын

@@unreactive I really enjoyed reading DataSmart by John Foreman. I also recommend the website "fast.ai" (I found out from Lex). Finally, there are good courses on specific techniques, programming languages, etc, on how to use ML on udemy.com. Udemy seems more practical, and has taught me how to actually implement some things and deploy them for use in the cloud.

@unreactive 4 жыл бұрын

Awesome, thanks!

@Sui_Generis0 4 жыл бұрын

How much is it?

@danielfirebanksquevedo891 4 жыл бұрын

One of the people that inspired me to do artificial intelligence in areas that matter. Without Coursera I would have not gotten where I am today. Thank you for this conversation Lex!

@usaintl8456 4 жыл бұрын

Splendid!

@Lumcoin 3 жыл бұрын

did you finish it? I'm at course 4 week 4 in deeplearning.ai

@Aesthetic_Euclides 3 жыл бұрын

Is it really that good?

@dra.adrianadomingosromer4968 4 жыл бұрын

Im a physician from Brazil learning ai and this fine man helped me a lot thank you sir I salute you

@zeitgeisttv5312 4 жыл бұрын

53:30 Andrew's Recommendation on how to learn more deeply with handwritten notes

@Sui_Generis0 4 жыл бұрын

Handwritten notes is better than typing but I thought that is not surprising. That being said, taking notes In itself is not that good for revision/recall. Active recall and spaced repetition are the best for that

@aegystierone8505 4 жыл бұрын

I have to agree with this, even while learning programming, writing things down actually helps a lot.

@adognamedsally 4 жыл бұрын

I found this basic technique very useful for studying kanji while learning Japanese. My theory at the time was that the extra effort I had to expend was forcing my brain to focus more on the content rather than going into autopilot mode. However, I also found that intervalled repetition was a big part in the learning process.

@datasciyinfo5133 4 жыл бұрын

Agreed. Active recall (trying to answer own questions with the solution covered) and spaced repetitions are best. But trying to summarize a point in your own words in almost as good. I think Andrew was pointing to that aspect.

@arunramji 4 жыл бұрын

Andrew NG has lot of fans in INDIA 😊

@TechOutAdam 4 жыл бұрын

This man got a great voiceover career available at anytime.

@vijayabhaskarj3095 4 жыл бұрын

Both are wearing their iconic dresses! XD

@BasharAlkhalili 4 жыл бұрын

Those are their super hero suits

@matthewchunk3689 4 жыл бұрын

@@BasharAlkhalili brilliant people seem creatures of habbit. what to wear is not just a distraction, it's irrelevent to them (i'm thinking of einstein in those effeminate sandals)

@Oblivic 4 жыл бұрын

You’re making these vids almost as fast as I can watch them! Thanks so much my favorite podcast and my favorite thing on youtube.

@chaidaro 4 жыл бұрын

27:34 "If you want to make a breakthrough, you sometimes have to do something before it becomes popular". What a humble man :)

@aishwaryamuchandi9005 4 жыл бұрын

He's the best teacher I have met so far. He teaches all the concepts to its very core and many times even predicts his student's doubts and clears it(really felt as if i was into his class where all my doubts were getting cleared) . His teaching made me realize my passion for AI, ML which decided the trajectory of my career. He teaches such complex concepts in such a simplified way (that's the beauty of teacher).At one point of time I could literally visualize statistics making my foundations clear(especially gradient descent) . It will truly be my fortune and blessing to ever meet my mentor in person. Thanks Lex Fridman for this video where we all could know more about Prof Andrew Ng.

@joshryan4387 4 жыл бұрын

I currently work as a computer vision engineer. I got hired having only a BS in Math and zero ML experience. My first assignment was to take Andrew's ML/DL classes on Coursera. Invaluable. Thank you!!

@seetsamolapo5600 2 ай бұрын

Would you still recommend it for beginners today?

@SudipBishwakarma 4 жыл бұрын

Man I love your podcasts..Andrew Ng is such a great educator. His deep learning specialization on coursera is what got me into machine learning. His Stanford machine learning lecture playlist on KZfaq is awesome as well.

@Michael-Gill 4 жыл бұрын

As a GenX'er I enjoyed this interview so much. It made me actually feel like I was experiencing the internet we were promised decades ago. A well thought out and intelligent conversation that, in the end, leaves the viewer in a state better than when they first pressed the play button. Well done.

@MiroslawHorbal 4 жыл бұрын

Thank you so much for making this available Lex. Andrew literally changed the direction of my life with his Stanford ML course and subsequent work with Coursera (which happened to introduce me to Geoffrey Hinton's deep learning course). His work ethic and drive to help the most people has helped reshape the face of education and I don't doubt it will leave a lasting positive impact on this world.

@mmughal 4 жыл бұрын

This one I will listen full!

@iamhandk 4 жыл бұрын

This is so awesome! Thanks for having Andrew on.

@Niki007hound 4 жыл бұрын

Fantastic interview. I took Andrew's ML course and am still deeply impressed by his pedagogical abilities. He is very observant and masters the art of passing on his knowledge. What an enrichtment these new distance learning WBT methods are for society! Perhaps the biggest improvement in this still new century for quality of life and fairness regarding access to knowledge and skills. Thank you from a humble admirer.

@iirolenkkari9564 2 жыл бұрын

I have taken several of Andrew Ng's courses. I have thoroughly enjoyed them and learned so much. He is a great teacher and a very likeable person.

@thecanopenerpodcast8575 4 жыл бұрын

Lex, thank you for educating the world for free, I am grateful beyond belief.

@eidios6871 4 жыл бұрын

I've been waiting for this!!! Thanks bro!

@nurgisaandasbek Жыл бұрын

Thank you so much for making this available Lex.

@neuroling 4 жыл бұрын

This is a very inspirational interview. Thanks for it, Lex!

@ivanpineda258 3 жыл бұрын

This is one of the most impactful podcasts I've heard! Thanks so much, Lex & Andrew!

@jahyegor 4 жыл бұрын

Единственный подкаст, который я могу слушать постоянно. Лекс, спасибо за первоклассный контент! В сети вряд ли найдется другой такой же впечатляющий источник философского анализа темы искусственного интеллекта. Как говорится, instant classic )

@imraulemmaka511 4 жыл бұрын

I was long waiting for you to bring him!!

@sakthiks777 4 жыл бұрын

Andrew Ng is a great teacher, great person, great(to the power of n) to me and my friends. I request this great human being to build systems in healthcare and life sciences that would transform the lives of people around the world, particularly the poor-needy and under privileged.

@romandorosh8473 4 жыл бұрын

This man has pulled some strings of my soul. And it's really motivate me for dive in this field. Thank you, Lex

@jentazim 3 жыл бұрын

Thanks for being considerate in the way you do ads. Much appreciated.

@Ramlingamr 4 жыл бұрын

Fantastic! What I like about your casts is the choice of people to talk to and meaningful line of discussion. They elevate our understanding a little bit, looking forward to every episode!!

@roccoincardona9836 4 жыл бұрын

So inspiring! Thanks a lot for this and all the other interviews!

@pradnyachaughule7709 4 жыл бұрын

Thanks Lex. The conversation is quite informative. Andrew NG is the one who introduced me to the world of Machine learning through Coursera few years back. I think it takes a special kind of expertise to make complex things sound simple. Andrew NG truly has done a great job at explaining basics of ML to all of us. He truly is the father of Machine/Deep learning.

@aashishsinghnagvanshi4155 Жыл бұрын

amazing season...i am learning a lot in this podcast ..thank you so much

@joyeo2498 3 жыл бұрын

Hands down to Andrew. Great mind with such a down to earth personality. Just love composed and calm vibe that he gives out when he talks as well.

@manhalrahman5785 4 жыл бұрын

Listening to Andrew Ng is so nostalgic lol I remember how much I enjoyed my first step into AI with his ML course

@vijay14october1984 4 жыл бұрын

thanks for releasing this have been waiting for quiet sometime

@ramon1f 4 жыл бұрын

Great, enjoying my dinner at the moment. time to feed my brain some information also! Let's go.

@GovindKumarMaliLucky 4 жыл бұрын

Andrew Ng is my Guru.. This is first podcast I listed fully in a silent room

@krasimirzlatev4843 4 жыл бұрын

Nice listening/watching to both of you. Thank you.

@bluestacks661 4 жыл бұрын

He explains very eloquently actually! Thanks for the interview, Lex!

@submagr 4 жыл бұрын

Thanks, Lex for this amazing podcast. Thanks Prof. Ng for thoughtful advices. What I liked best - Try to study 2 Research Papers every week, make a habit of something. Think about who would be your peers before joining a team. Thanks.

@nb8298 11 ай бұрын

Thanks for having Andrew on. He is above all else very authentic in his journey.

@johnfunk7568 2 жыл бұрын

Lex, More love to you bud. Enrolled in Coursera and signed up for Andrew's course because of this!!! THANKS!

@sigangsabaglari3606 4 жыл бұрын

Thank you Andrew Ng, you are the best. I'm learning so much from you.

@hg4875 2 жыл бұрын

Andrew Ngs point about reframing the problem to solve it yourself was extremely insightful. I'm going to try this with my nephews when we make puzzles - I'll show him initially how some things can connect (not all) and have him "reframe it" to solve it himself! - super excited

@ashsilver8653 4 жыл бұрын

So exciting to see this talk. Two years ago, I started learning ML, the first series of courses about ML I watched were made by NG. He is my first ML/DL influence. He is such a nice educator.

@avinandanbanerjee9568 4 жыл бұрын

no words can describe how much i love andrew

@thequantartist 3 жыл бұрын

Loved this video, I found it really interesting to hear Andrew Ng draw the analogy of litteracy to data science or coding skills.

@zeitgeisttv5312 4 жыл бұрын

Andrew Ng and Lex Fridaman voices are so soothing

@caijason9486 4 жыл бұрын

Great job. I have been totally inspired by Andrew Ng two years ago.

@carlosvillarreal7989 20 күн бұрын

Andrew's videos on KZfaq are goated. 🐐

@san_dc 4 жыл бұрын

Great man. Really enjoyed every course taught by him. His dedication reaches thousands or even millions of people across the world.

@anandbalivada7461 4 жыл бұрын

This week has been awesome! First Scott Aaronson and now Andrew Ng :). Lex, it'd be really cool if you could get someone working on the theoretical aspects of Machine Learning, like Sanjeev Arora, Ankur Moitra or Costis Daskalakis... It'd be super interesting to see the conversation between experts on two different sides of the same coin; applied and theoretical.

@tunguyenlam 4 жыл бұрын

Thank Lex for interesting conversation ! Thank Andrew, I'm one of your million students !

@e-readers Жыл бұрын

I really enjoyed this interview done by you and Andrew.

@harshanawijesinghe9264 4 жыл бұрын

A podcast... waited for quite long time. Thanks Lex ✌️

@pleasedie1979 2 ай бұрын

Took his online course and it was and still is the best training I've ever had in AI development

@mustaqimkhan6885 4 жыл бұрын

Thank you Lex Fridman for this great podcast!

@hansmuster5291 4 жыл бұрын

so much love and respect for this guy!

@leizhong6369 3 жыл бұрын

💚🤍love this conversation, the warmth and gentleness from the brilliant scientists, thanks

@vegas1854 2 жыл бұрын

It's an amazing time to be alive. I'm fascinated by Auudia's new Vodacast. Perfect podcast compliment.

@marlhex6280 Жыл бұрын

Man this is one of the best guests that we can have in the field !!! 😂😂 that was awesome that you could get this generous man!!!! Such a wonderful human you to put him on the mic and him from providing such words

@baselalyafi4022 4 жыл бұрын

I have been waiting for this long ago. Thanks Andrew. Thanks Lex.

@AmitDotAcademy Жыл бұрын

I am watching it 3 years later and I must say this is a great interview. Great work Lex and Andrew.

@FloWoelki 4 жыл бұрын

Two beasts in a conversation. Awesome stuff!

@ryanwickman855 4 жыл бұрын

Amazing to see two great minds talk! Especially Andrew Ng who introduced me to the field of machine learning!

@MrAscetic23 4 жыл бұрын

Fantastic, just in time for my 2hr drive

@aaditya_ai 4 жыл бұрын

Finally ! Andrew Ng.

@dawitzenebe2284 4 жыл бұрын

A special interview of all. Thanks lex.

@miketannenbaum8909 4 жыл бұрын

Brilliant conversation. Thanks to you both.

@xisrax 4 жыл бұрын

such a great mentor, he makes that's everything is so easy.

@PrabhatKumar-fn4vy 4 жыл бұрын

Thanx for bringing Andrew

@nirajabcd 4 жыл бұрын

Good to see so many of the listeners took up ML/DL courses from Andrew Ng. I am one of them and actually been doing professional work for more than a year. Without Andrew Ng and Coursera, I would have never gotten into ML.

@henrycowsert3999 Жыл бұрын

You've come so far lex!

@Danny-ej3js 4 жыл бұрын

Great interview. Thanks Andrew & Lex!

@jboyce007 4 жыл бұрын

Hellz yeah! Big Ng on the podcast!

@mqasemniksefat4202 3 жыл бұрын

I love the guy! He influenced my knowledge and path, as well as many of you, for the better!

@VysakhRemesh 4 жыл бұрын

Thank you Andrew Ng and Lex Fridman

@cetrick_yeanay Жыл бұрын

Thank you for this! I'm a beginner and love this type of knowledge and insight!

@TheAIEpiphany 3 жыл бұрын

01:01:00 That's a huge piece of advice! And I couldn't agree more. People tend to get attracted to the logo - but the experience individuals have is so broad and ranges from poor to incredible even inside Google, Microsoft, Facebook and all of those famous tech companies.

@user-so7ix1pj7h Жыл бұрын

Andrew Ng is really productive in AI area. His courses of deep learning is my first AI course. It is really helpful. Helping people working great in one area makes people feel happy. do something useful for other people. Thanks Andrew and Lex.

@sampars7825 3 жыл бұрын

I've become one of Andrew's fans, especially after starting Deep Learning specialization and finishing the first course. It has changed my life.

@nirajabcd 4 жыл бұрын

Andrew Ng was the reason I started doing AI/ML. Big fan of him.

@kvnptl4400 4 жыл бұрын

I was waiting for this Podcast. Guruji!

@Mortz76 4 жыл бұрын

This is just fantastic. :-D Love both guys, they are great

@jackvial5591 4 жыл бұрын

Great interview! Andrew is a true legend. My only complaint is that I didn't hear him say "Concretely" once!

@abcdefghi2650 3 жыл бұрын

Thank you for Lex for this amazing podcast ! ! !

@engineer580 4 жыл бұрын

Two of the people that encouraged me to do artificial intelligence are you. Thank you.

@JousefM 4 жыл бұрын

I like all of your Podcasts Lex, but this one will probably be the first one that I watch from beginning to the end! AndrewNg 4 president! :D

@rayryeng 4 жыл бұрын

I'm used to watching his videos at 1.5x... so hearing his voice at normal speed tripped me out lol. Joking aside, what a great interview with a true pioneer and legend. Thanks so much Lex!

@MD-hx3wf 4 жыл бұрын

Yes, was waiting for this one!

@stanrock8015 4 жыл бұрын

Wow. Another amazing guest.

@ilfat_khairullin 4 жыл бұрын

Wow!!! Thank you so much!!!

@Nozomiko 4 жыл бұрын

Love the changes Lex. Thanks for taking suggestions man. ^_^ Keep doing you!

@bakhtiyor_sulaymonov Жыл бұрын

Thanks for the podcast

@nimmasoda 4 жыл бұрын

#1:15:00 Ripple Effect #1:24:00 Wealth Inequality #1:26:00 Mistake of Late Realization (Do not regret) What a golden interview it is... So much inspired by his words. We need Part-2 of Andrew ng, after his another ground breaking work. Such a great human-being in Tech space __/\__