I really enjoyed this conversation with Chris. We could've easily talked for many more hours. Compiling code down across levels of abstraction is one of the most fundamental and fascinating aspects of what computers do, and he is one of the top experts in the world in this process, its rigorous science and it's messy beautiful art. Here's the high-level outline: 0:00 - Introduction 1:30 - First program, BASIC, Pascal, C 4:20 - Compilers, LLVM, CLang 37:30 - Apple - LLVM, Objective-C, Swift 45:30 - Google - Swift, Swift for TensorFlow, compilers, Colab 57:32 - TPU & TensorFlow, hardware/software co-design 1:00:30 - MLIR (Multi-Level Intermediate Representation) framework 1:02:40 - Open sourcing of TensorFlow 1:05:10 - Tesla - transition from HW1 to HW2 1:07:24 - Elon Musk and time at Tesla 1:08:45 - Working hard 1:10:40 - Dragons
@aidenstill71795 жыл бұрын
Great video. Please answer me. What do I need to know to build a deep learning library? tell me the courses and books
@thehorse1sbrown5 жыл бұрын
This guy is brilliant! I wish the interview was longer.
@afriedli5 жыл бұрын
@@aidenstill7179 Type "lex fridman deep learning" in the KZfaq search field and it will pull up his series of MIT lectures on the topic, in which you will find much useful information and many pointers to further information. You might also like to visit ai.google/tools/ and www.tensorflow.org
@georget58745 жыл бұрын
There's a guy called Dr Michael Levin who works at Tufts, who did a talk on bioelectric computation outside the nervous system, he touched on a few things that might relate to AI. I'd love to hear an interview with him, his facebook talk was one of the most interesting I've seen on youtube... this one was also fascinating by the way. *kzfaq.info/get/bejne/iNB0ZMR90pq4mJs.html
@waystilos5 жыл бұрын
This was awesome. The questions and answers were all on point. Please have a part 2 one day.
@AlpGuneysel5 жыл бұрын
wow, i wouldn't expect Chris to be such humble, down-to-earth and loveable person. I could watch this all day. Thanks Lex.
@KimP06129 ай бұрын
Visual Basic??
@lazertroll7023 ай бұрын
He said for google choosing to keep ml proprietary and secret, that google makes the world better 😂😂
@ryanjohnson28443 ай бұрын
Out of all the things he said all you could think about was “wow he’s so humble” 💀
@aga1nstall0ddsАй бұрын
@@ryanjohnson2844don't underestimate humility
@user-nt2rz4ll9b4 күн бұрын
😅
@whiteF0x90915 жыл бұрын
Lex is becoming a professional in introductions 👏👏👏
@ravindrasharma852 жыл бұрын
Ì
@shengxu63313 жыл бұрын
I wish I had a professor like Chris Lattner in all my CS courses. If Chris finds some time in the future he really should open an online course in Compilers or Language design.
@domaincontroller2 жыл бұрын
01:29 first program basic, pascal, turbopascal...02:28 C/C++ 02:48 straight to the machine 03:02 C 04:45 what is even a compiler used for ? 06:57 C parser, front-end, clang 07:06 middle part, the optimizer 07:09 a late part, hardware specific 07:17 LLVM trying to standarsize these middle and last parts 15:57 C++ is a very complicated programming language, 1400 pages in the specs 16:53 gcc 17:20 clang, push forward on better user interface, compile time better, want to make new tools available 18:04 C++ and the front-end piece is complicated, syntax trees 18:46 AST, control flow graph
@AnitShrestha5 жыл бұрын
I can literally feel the love for code from Chris. Really good conversation on compiler and other hidden/hard subjects. Thank you Lex and Chris.
@BiancaAguglia5 жыл бұрын
Chris Lattner has a gift for taking complex concepts and **compiling** them down to something non-geeks like me can understand. 😊 Another great interview, Lex.
@nineth9445 жыл бұрын
Indeed. The ability to explain complex concepts clearly and in a beautiful way is often a sign of the depth and breadth of one's understanding and experience.
@Hexanitrobenzene3 жыл бұрын
@paz y amor I agree. Maybe also distilling.
@muneshchauhan5 жыл бұрын
A great talk on compilers by Chris. Thanks Lex for bringing this talk accessible to all. Would be interested to know if someone can define a learning path for LLVM compilers from a beginner level to advanced.
@KonflictYT3 жыл бұрын
I enjoy how thorough chris is when defining the concepts he brings up. He is clearly someone who cares to have a deep understanding of the things he knows.
@fortifyyourdata29715 жыл бұрын
This is the kind of content the internet needs more of. Thanks Lex!
@sai40075 жыл бұрын
Lex, thanks for all the hard work needed to deliver podcasts of top-notch quality. You have helped see a glimmer into the minds of these amazing researchers and engineers. Your questions are very enjoyable, not diluted showing the level of research you have undertaken before the interview. In the Goodfellow podcast, I learnt abstract view of how some new areas like differential privacy is evolving, or challenges are currently, which I wouldn't have with the rate of current research paper publications. Maybe you can continue this series (or create a new one) into exploring various areas machine learning ? For someone who lacks direct access to good mentors in ml, podcasts like yours are heaven sent.
@00jknight5 жыл бұрын
Lex, thank you so much for starting this podcast. These are real amazing people and their inner lives are not well documented in the collective human archive.
@kestergascoyne69245 жыл бұрын
Amazing Lex!!! Your podcast is INCREDIBLE!!! You are truly doing a service for the world!!!!
@OkiemPiotra5 жыл бұрын
Great convo. I wish Chris divulged more on how Tesla is approaching ML and what are the specific benefits of the vertically integrated hardware/software stack for self driving ;)
@smartwolf90453 жыл бұрын
I hope you'll never stop posting podcasts as it's a fantastic resource
@binihalex80974 жыл бұрын
Bow to the Master of swift. I just started a class on mobile app dev. The professor showed us this episode... a good way to start
@charlesbisbee30143 жыл бұрын
I can't think of a more engaging podcast to listen to. This was absolutely awesome!
@RamonSmits5 жыл бұрын
Turbo Pascal with inline assembly!
@DrunkenUFOPilot2 жыл бұрын
It was great except for the few odd quirks that would cause trouble in larger projects.
@nineth9445 жыл бұрын
I really like the demeanor of the interviewer - great job!
@yetanotherchannelyac14343 жыл бұрын
Good interaction. Chris was really polite 😅 and precise in his answers.
@artemisfowl90023 жыл бұрын
so this is the guy responsible for me landing a £85k job, honestly, learning the swift language was such a breeze having come over from C#, i was blown away with how easily understandable the syntax and compilation are , code is so bloody easy to write, no need to import separate libraries for string handling or input/output functionalities, the ternary conditional operator evaluates true/false expressions with quick returns on value, not sure if python has mutable collections but with swift even when you assign an array, a set or dictionary to a constant the collection is still mutable! one of its best features is ease in readability where a compound case can also be written over multiple lines, lets not even get into how you can define anything from a simple utility function with a single unnamed parameter to a complex function with expressive parameter names and different parameter functions. i do not see myself ever straying away from this language
@n00bstude5 жыл бұрын
Swift is a beautiful language. Great hearing Chris' design perspective
@AghaKhan95 жыл бұрын
You are my role model for a teacher and instructor sir. Thank you very much.
@AkshayAradhya Жыл бұрын
47:35 Progressive Disclosure of Complexity. My favorite new term. I love this concept and now there is a phrase for it that I can use.
@kenn8504 жыл бұрын
Thanks for the interview, learnt so much from it.
@karanbirchahal32685 жыл бұрын
Wow any hour never seemed to pass so fast. Chris Lattner is my idol !
@FamilyWinn5 жыл бұрын
Lex, I love your videos. Yet over an hour long!! I better get college credit for this much time spent.
@goldfish81964 жыл бұрын
What a great interview. Really incredible. Thank you so much for sharing it.
@xchromehearxt88385 жыл бұрын
I wish I could comprehend what these great minds are talking about... I have no knowledge of programming, I just watch this channel because I want to keep up wit AI and Lex is the best person to follow for that. Thanks for the very informative content.
@ethiesm14 жыл бұрын
Lattner & Keller= LEGENDS
@mohitgarg29253 жыл бұрын
Just amazing. Thank you so much for all these amazing interviews Lex! As a computer engineer and tech enthusiast, they really help me understand how these cutting-edge technologies were developed by these amazing people.
@frodobaggins39744 жыл бұрын
One of the few people who still speak fluent Assembler.
@pankajmistryin5 жыл бұрын
thank you for this podcast, gave me historical perspective of all things LLVM. Absolutely awesome!!!
@urvashimota074 жыл бұрын
I am thrilled to join an organization where Chris is working. Looking forward to work with Chris.. Great conversation!
@MrTubber445 жыл бұрын
Lex, absolutely excellent conversation. Watching a second time to take notes. Awesome! Thanks.
@cyndy38735 жыл бұрын
Cant get over how great this interview is!
@yash11522 жыл бұрын
16:14 syntax: how letters are arranged, symantics : how it behaves (C++ being complicated language) 21:15 neural network graph 24:15 trying to optimise across time 24:23 the RISC era ... 25:39 resources: running time, memory use, code size in embedded space 27:10 JAVA brought together good things like JIT compilation, garbage collection, portable code, memory safety, dynamic dispatch execution model
@SergioArroyoSailing5 жыл бұрын
dude you have such amazing guests , thanks for sharing ! :)
@jonesconrad15 жыл бұрын
GCC is still default on a lot of linux distros in part due to the kernel being developed with GCC, there are efforts to compile with clang but last time I checked the kernel has some very GCC specific bits in it.
@galdutro2 жыл бұрын
I think today, the biggest issue is actually glibc
@supersnowva67175 жыл бұрын
Great conversation as always Lex! Much appreciated!
@dmitrym37572 жыл бұрын
This is such a cozy office. What a view!
@TylerDiamond808 Жыл бұрын
I think most people that have had the chance to code something then improve on it to reach the same outcome but in a more efficient and simple way understand the love of an elegant solution to solve a complex problem
@fgabrieltomas2 жыл бұрын
one of the best players at Duke ever!
@RonSheely3 жыл бұрын
Thank you both.
@krishnaviyer69465 жыл бұрын
Lex, can you get a conversation done with Jeff Dean? I think that would be wonderful. His background with neural nets back in the '90s which he parked for the here and now automation at Google, followed by his work in the past few years to pick the ML gauntlet and run at breakneck speed, make it available at scale etc. would be wonderful to learn from.
@allurbase5 жыл бұрын
Hey Lex, it would be great if you uploaded this to Soundcloud too, youtube doesn't allow background playback on mobile. Keep awesome!
@allurbase5 жыл бұрын
@@skierpage yeah its a premium feature, but i found a workaround by changing into desktop mode in the browser
@Rafayak4 жыл бұрын
He would have been the perfect guy to ask about Temple OS
@hadiwall4 жыл бұрын
Man.. rip terry, he could’ve been lex most honored guest
@Rafayak4 жыл бұрын
@@hadiwall oh crap! Yeah! To this day I'm surprised by the breadth of Terry's work on Temple OS, regardless of how much he mentally regressed, the man was a once-in-life-time kinda genius
@JosephDelgadillo5 жыл бұрын
Who else was hoping for more spicy Tesla drama 🤔
@ekbastu4 жыл бұрын
What happened there?
@reoire8433 жыл бұрын
ekbastu, Exactly........
@VoltageLP3 жыл бұрын
Lex always looks and sounds baked af
@DustinGunnells2 жыл бұрын
Vastly Informative! Good Stuff!
@TheRealStructurer2 жыл бұрын
I have done some Objective C and Swift programming and it's. nice to hear the history behind it. Now doing some C++ for microcontrollers and boy do I miss some Swift features like memory handling!
@74477447744774472 жыл бұрын
Chris Lattner is going to be a great grandfather.
@JumpingCow2 жыл бұрын
Great interview! I learned so much.
@rudya.hernandez7238 Жыл бұрын
Awesome interview, thanks
@atillacodesstuff1223 Жыл бұрын
Computer design is so damn complicated and fascinating.. I'm a (intermediate-level) Python programmer sitting on top of god knows how many abstraction layers, and very grateful for it, but I love hearing about the depth from time to time :P
@chyldstudios5 жыл бұрын
Another great interview! Thanks Lex
@kamilziemian9953 жыл бұрын
Incredible talk.
@rikelmens5 жыл бұрын
Thanks Lex and Chris!
@sourPollo2 жыл бұрын
Great interview.
@deeplearningpartnership5 жыл бұрын
Thanks Lex.
@dendritedigital24304 жыл бұрын
Hi Chris and Lex, Got my ALU accelerated for a 64 bit unit from 164 ns down to 5 ns. Continuing to develop on FPGAs not easy on Macs. Thinking of unloading my antiques.
@dennis_johnson3 жыл бұрын
Haha I’m using the Dragon book this semester for compiler design!
@godblessamerica7935 жыл бұрын
Thanks Lex!
@thenoorer5 жыл бұрын
why the introduction gives a vibe of the twilight zone series
@reoire8433 жыл бұрын
He should start all of his videos with, “Submitted for your approval…“
@dciug5 жыл бұрын
Lex, I think the dataset is big enough for you to automatically generate the introductions.
@user-ng8rl3jb1i2 жыл бұрын
you both have appropriate voices for radio lol
@akilanselvacoumar47533 жыл бұрын
Amazing podcast !!!
@dnavas77195 жыл бұрын
Awesome interview. Thanks a lot. Any plans on interviewing Ben Goertzel?
@ivangetta5 жыл бұрын
also, android os platform code can no longer be compiled by gcc: clang allowed c++ programers to have fun and write templates with embedding level that gcc refuses to compile.
@mustafasabur5 жыл бұрын
Lex, Love u man! Thanks for doing this!!
@colinmaharaj5 жыл бұрын
Wish I could work with guys like this. I have no degree but I have a good understanding of C/C++/ASM/Java/JS...Parallel programming/Threading etc..
On this topic of compilers, I hope Lex also gets to talk with Yacc.
@Schcarraffone2 жыл бұрын
he will, if he is not attacked by a bison inbetween....
@albertwang59745 жыл бұрын
What's compiler? compiler is a translator to do the job translate human language or high level computer language to language of computer can understand and run.
@sidjoosin65495 жыл бұрын
great question from interviewer -- 'What makes prog. language complicated?'. As soon as the most errors in most languages made because of syntax, missunderstanding mechanics of language behavior or particular commands/libraries -- but not in pure logic -- what makes them complex? People. Thats why it's simplier to solve problem in Assembly, rather than C++. How we get there? Because solving logic problems is about of abstracting logic actions, not data itself, like sum(x,y), sqrt(x) etc.. -- we don't have one method for summing cars and another for summing donkeys, and result of sum is irrelevant to enviroment, if 2 + 4 = 9 after the rain because of moist -- this function should be purified.
@michel92777 Жыл бұрын
What a nice, lovely guy. Also a genius.
@Magical35892 жыл бұрын
Noob question.. been listening to the podcast in order and this one I'm finding particularly difficult since I'm new to the information/ what they are talking about. Anyone know of other references and info I might find to better understand the topic and then come back to this talk?
@alexandrearnold75463 жыл бұрын
//notes 28:33 How did JVM change the compilation pipeline?
@originalideas96175 жыл бұрын
lex + yacc = compiler
@SaifUlIslam-db1nu4 жыл бұрын
I made a note of the some points, not all, as a gist which you can see here so that it's easier to remember and look back on the details: gist.github.com/Rubix982/cbca0ddcc197bf0d32c9dfd9854c21c5 . Hope it helps.
@bbjjooddhh Жыл бұрын
"It's rigorous science and messy beautiful art."
@Creativecells2 жыл бұрын
Thanks
@ilovepickles74275 жыл бұрын
AnyChrisLattner
@bgoodwin910065 жыл бұрын
next step is to compile flow charts.
@grapy833 жыл бұрын
This channel is more like a nerd gold mine. An accurate one for that too.
@adelinaquijano1083 Жыл бұрын
lots of learn
@sagetmaster45 жыл бұрын
Don't know any of these acronyms LEEROOOOOOOYYYYYYY JENNKINNNNNNNS!
@user-bj8ev5rk8eАй бұрын
When you are interviewing Jeff dean?
@adelinaquijano1083 Жыл бұрын
I'm a hardworking trust is important
@yash11522 жыл бұрын
1:37 umh, i recognise him. ain't he same as the person behind the company promoting RISC-V. It was named smth like Start V if i recall correct. I saw his interview regarding same with Lex himself.
@justinbeam423310 ай бұрын
Its murr from impractical jokers
@richardlittlewood4367 Жыл бұрын
The tree is moving again, Please put another background in. it is distracting.
@DanielJayy Жыл бұрын
Mans really said is an AST like a neural network. As a CS PhD.
@dejabu242 жыл бұрын
I learned objective c like in 2 weeks , is not really that hard, Apple made that language to make it more accessible to web developers or people coming from Python, I don’t like Swift’s syntax but it was a smart move to do that
@user-dr5nt2is7f4 ай бұрын
18:52 58:04
@TABWA6 Жыл бұрын
Lexxie and I wife wendy Fridman would like to give thanks for congratulations on the birth of our new babies .🎉🎉🎉🎉😂😂😂😂❤❤❤❤😢😢😢😢😊😊😊😊
@jonesconrad13 жыл бұрын
Answer to Lex's question about the complication of C++ I would say it's templates, remove templates from the language and it would be drastically simpler.