Andrej Karpathy: Why Tesla Has a MASSIVE Data Advantage!! The Tesla Data Engine

Рет қаралды 19,449

Жыл бұрын

in a recent Tweet, Andrej Karpathy, former Tesla AI lead, describes how any company can dominate the AI/Machine Learning Space. It's not just about the data, but about the data engine or flywheel that can produce, label, clean and test data as fast as possible. Tesla has this in spades after years of engineering efforts, and other auto manufacturers are giving up!
Elon loved it on Twitter--get yours before it's gone! The "Now Pay $8" T: drknowitall.itemorder.com/sho...
Get The Elon Musk Mission (I've got two chapters in it) here:
Paperback: amzn.to/3TQXV9g
Kindle: amzn.to/3U7f7Hr!
**To become part of our Patreon team, help support the channel, and get awesome perks, check out our Patreon site here: / drknowitallknows . Thanks for your support!
**Want some awesome Dr. Know-it-all merch, including the AI STUDENT DRIVER Bumper Sticker? Check out our awesome Merch store: drknowitall.itemorder.com/sale
For a limited time, use the code "Knows2021" to get 20% off your entire order!
**Lift pucks for your Tesla: amzn.to/3vJF3iB
**Emergency tire fill and repair kit: amzn.to/3vMkL8d
**If you're interested in a CO2 Monitor, you can check it out here: amzn.to/3PsQRh2
**Check out Artimatic: www.artimatic.io
**For 30% off the amazing OneCarStereo instrument display for Tesla Model 3/Y, use this link: bit.ly/3vd7NRv
**Get 20% off an awesome Ekster wallet and/or wallet locator(!), check out my affiliate link here: shop.ekster.com/DrKnowitall
**Want to get in on WeBull's awesome Crypto and stock fun? Check out this link, and get started trading stock and Crypto!
a.webull.com/i/DrKnow-it-allK...
**If you are looking to purchase a new Tesla solar roof, solar tiles or PowerWall, just click this link to get up to $500 off! www.tesla.com/referral/john11286. Thank you!
**You can help support this channel with one click! We have an Amazon Affiliate link in several countries. If you click the link for your country, anything you buy from Amazon in the next several hours gives us a small commission, and costs you nothing. Thank you!
* USA: amzn.to/39n5mPH
* Germany: amzn.to/2XbdxJi
* United Kingdom: amzn.to/3hGlzTR
* France: amzn.to/2KRAwXh
* Spain: amzn.to/3hJYYFV
**What do we use to shoot our videos?
-Sony alpha a7 III: amzn.to/3czV2XJ
--and lens: amzn.to/3aujOqE
-Feelworld portable field monitor: amzn.to/38yf2ah
-Neewer compact desk tripod: amzn.to/3l8yrUk
-Glidegear teleprompter: amzn.to/3rJeFkP
-Neewer dimmable LED lights: amzn.to/3qAg3oF
-Rode Wireless Go II Lavalier microphones: amzn.to/3eC9jUZ
-Rode NTK Studio Microphone: amzn.to/3vjMomW
-Focusrite Scarlette 2i2 audio interface: amzn.to/3l8vqDu
-Studio soundproofing tiles: amzn.to/3rFUtQU
-Sony MDR-7506 Professional Headphones: amzn.to/2OoDdBd
-Apple M1 MacBook Pro: amzn.to/3wPYV1D
-Docking Station for MacBook: amzn.to/3yIhc1S
-Philips Brilliance 4K Docking Monitor: amzn.to/3xwSKAb
-Sabrent 8TB SSD drive: amzn.to/3rhSxQM
-DJI Mavic Mini Drone: amzn.to/2OnHCEw
-GoPro Hero 9 Black action camera: amzn.to/3vgVMrH
-Suction car mount for camera: amzn.to/3tcUfRK
-Extender Rod for car mount camera: amzn.to/3wHQXsw
**Here are a few products we've found really fun and/or useful:
* NeoCharge Dryer/EV charger splitter: amzn.to/39UcKWx
* A totally fun Tesla coil toy--awesome for the whole family: amzn.to/30rvzbI
* The Humane Interface, by Jef Raskin: amzn.to/3ajM7YT
* AI Superpowers, by Kai-Fu Lee: amzn.to/3dgRSs3
* A camping mattress for your Tesla model S/3/X/Y: amzn.to/3chSRrQ
**Music by Zenlee. Check out his amazing music on instagram -@zenlee_music
or KZfaq - / @zenlee_music
**New intro by Anthony Soto: sotoe907@gmail.com
Tesla Stock: TSLA
**JOWUA:
*For an awesome wireless charging phone holder mount, check out: bit.ly/3tRMSQR
use the Promotion Code: DRKNOW5
*Tesla USB Hub: bit.ly/2PXHPit
use the Promotion Code: DRKNOW5
*Powerful wireless iPhone/Android charger for your Tesla Model 3 or Model Y, check this link: bit.ly/3b5fHSW
use the Promotion Code: DRKNOW5
**EVANNEX
Check out the Evannex web site: evannex.com/
If you use my discount code, KnowsEVs, you get $10 off any order over $100!
**For business inquiries, please email me here: DrKnowItAllKnows@gmail.com
Twitter: / drknowitall16
Also on Twitter: @Tesla_UnPR: / tesla_un
Instagram: @drknowitallknows
**Want some outdoorsy videos? Check out Whole Nuts and Donuts: / @wholenutsanddonuts5741
Tesla Semi Delivery Event: • Tesla Semi Delivery Event

Пікірлер: 66

@tommornini2470 Жыл бұрын

I believe Andrej said: 1) a ton of… 2) clean 3) well labeled 4) diverse Tesla has #1-#3, but #4 is very important, and very difficult to achieve. It implies the “long tail” of weird stuff, as well as the common stuff, at every hour of the day, in every type of weather, during every season, in every locality, in every condition the camera can be in. Which is to say, a fleet of tens of millions of cars, driving billions of miles a day, for years. Which is why Tesla has a very large lead, yet still has not crossed the finish line - and why single stack is so critical - we need FSD Beta stack data from the entire fleet! And this will continue even after the system works well! If companies intend to compete, they MUST deliver millions of cars with substantial AI inference capability and a well thought out camera fleet ASAP. Before they do that, they shouldn’t even bother attempting FSD development. Given traditional automaker’s low margins, they’re going to have a hard time “giving away” that hardware on vehicles that don’t pay for it.

@pontonlabel242 Жыл бұрын

I am impressed how one tweet generates 15-30min videos on youtube nowadays

@Martinit0 Жыл бұрын

The data engine is the manufacturing line of AI applications. Without a data engine you can only do one-off prototypes at great expense.

@NJ-wb1cz Жыл бұрын

Tesla fundamentally doesn't have any radar data though. All they have are cameras, so their data will be largely pointless once they finally add radars to make the decision making of their cars more reliable

@tomschuessler7723 Жыл бұрын

Thank you for dedicating the effort to explain the thinking behind the new terminology and thoughts of the Karpathy's , and Musk's of this world. When they talk it is easy for me to get lost or at least confused and your explanations help me, at least, think I have more clarity. At least for a few minutes.

@BobBrownIII Жыл бұрын

Data is plural. “Those” data. “That” datum. Sorry. Pet peeve. Great video. Really clarified the importance of the data engines vs data.

@skinnymoonbob Жыл бұрын

It there a viable alternative to Tesla FSD? Sounds like how Microsoft ruled the PC industry in the 1990’s. If Tesla will license FSD to other car manufacturers, I can imagine that Elon mentioned earnings can become ’nutty’.

@grahambrown42 Жыл бұрын

Most likely outcome imho. Tesla Vision, will be the best and cheapest system by far.

@brunoheggli2888 Жыл бұрын

Sure BYD FSD and it will be much cheaper!

@Roguescienceguy Жыл бұрын

Xpeng has a pretty good autopilot. It's georestricted though.

@tommornini2470 Жыл бұрын

🎯

@denisharding5606 Жыл бұрын

@@brunoheggli2888 But not work as well.

@balaji-kartha Жыл бұрын

Any news if Andrej Karpathy is going back to Tesla?

@muratarican2985 Жыл бұрын

Thank you, doc, for all these short lectures which I believe are very inspiring for those who want to become AI software developers..

@ArizVern Жыл бұрын

OUTSTANDING

@davidbeppler3032 Жыл бұрын

😆

@markumbers5362 Жыл бұрын

I agree. I think other OEMs will adopt Teslas FSD system. It makes sense. They have been catalogue engineers for a long time now. They need to stop thinking they are something they are not.

@kabysummit5801 Жыл бұрын

Chi ching $$$ The beauty of software as service. Getting the products out to the masses, ramping up, and making serious amounts of money.

@benhofstad4593 Жыл бұрын

Lol true

@fjalics Жыл бұрын

Tesla needs to start capturing low resolution map data. I want it to figure out when road construction happens, so it can anticipate which lane to be in, how fast to go, where the turn is, when ramps are blocked. Like a human that goes the same way, the third time through you remember what to do. You don't need to see it.

@davidbeppler3032 Жыл бұрын

What happened to Mobileye? Back in July of 2016 they split with Tesla. At the time Mobileye said they were 10 years ahead of Tesla and would have level 5 in 2020. Here we are in 2023 (almost) and Tesla FSD is on any Tesla built after 2016. Over 2 million cars. Where is Mobileye? Are they still 10 years ahead? Does BMW that uses Mobileye have lv 5?

@oneproductivemusk1pm565 Жыл бұрын

This explanation/revelation simply puts Tesla in the far lead with no competition is sight because they have all that it takes to get FSD to work! This also means they can easily license the technology to all automobile companies and that means huge revenue! In fact this only goes to show how far into the future Elon thinks! Great Job my friend!!!

@dougmeyer3054 Жыл бұрын

Thanks.

@hockmengvincentchan4569 Жыл бұрын

Wow, thanks again!!!!!

@vasireddi Жыл бұрын

Lovely!!

@phatfel Жыл бұрын

any comments about the HD radar tesla is coming out with?

@jhmrem Жыл бұрын

I miss the old music!

@helmutmueller3326 Жыл бұрын

You are absolutely right. The problem is second that the models depend on camera positions. So only companies having a fleet out there have continuous access to viable data at all - then they must have the communication with the fleet up - then they must own the data - if the data is owned by a supplier and not the car manufacturer this may be a big non technical issue and you must be able to push back versions to the fleet online with all technical and legal aspects. And you must have a fleet out there that can execute AI models at all , though nobody gives you money for the hardware as long as your models are bad - so you have to preinvest and ruin your profits in the beginning. That is a long way to go if you start from now. But still - autonomous driving is far from trivial and crashes with bad models may ruin you fast. So big risk - and big opportunity.😢

@kcharles4630 Жыл бұрын

Great breakdown! I wonder how Mobileye and Xpeng are tackling this AI training requirement with their own development process?

@lylestavast7652 Жыл бұрын

So if Tesla isn't saving all their labelled and clean data endlessly, they have to re-do that in some way on new incoming (or are the neural nets holding what's important from them as the "storage" medium of useful knowledge ) - is the idea to update the auto-cleaning and auto-labelling to such high accuracy that running through the last batch produces no regressions/errors all the time ? How do they keep all the really unique situations if they're throwing away so much ? And at what phase of all this do things like RH drive country, different signs and road textures etc get factored in ?

@oneproductivemusk1pm565 Жыл бұрын

Dojo AI will achieve this in no time given the rate of data collection and training!

@yrrekad Жыл бұрын

Miss the old opening music

@MH-Tesla Жыл бұрын

Was this a re upload?

@nicholasmuni7995 Жыл бұрын

I wonder why the good top people at Tesla keep leaving?

@marriagepartnersministry5942 Жыл бұрын

There are many ways to solve the FSD problem. To say real world data is THE way, seems intuitively correct but intuition isnt always correct. There are many examples in life that teach us that alot of things are counter-intuitive and correct vs the intuitive answer. There are several data engines using simulated data very effectively. Also real world data of a driver doing something "wrong" is not only unusefull but has a compounding hindering effect within the neuronet. Many say that high quality simulated data can be just as useful and much faster than accumulating real world data and parcing out the real world mistakes that one doesnt want in the neuronet.

@bluetoad2668 Жыл бұрын

I see your point but I think that if pure simulation was enough Google would probably have already solved FSD by now. I'm not saying that Tesla's approach will solve FSD but it's looking like the approach getting the furthest down the path of a general solution right now. Tesla also makes heavy use of simulation in their training too of course. Turning AI away from text and images and toward 'real world' problem s which seek to mimic and, hopefully outperform, humans is a truly exciting and bold step - hats off to Tesla for investing in this in a way no other company has - I for one believe that they are getting way better value out of their investment than the other companies who are trying to solve vehicle autonomy.

@skipugh Жыл бұрын

You can’t simulate what you don’t know and we don’t know an awful lot about driving conditions throughout the world.

@andrasbiro3007 Жыл бұрын

If you learn to drive in a simulation, you'll learn to drive in a simulation. Unless the simulation is perfect in every way, your knowledge is useless in the real world. Even humans can't properly learn to drive in a simulation. Here's one example. After a plane crash, engineers wrote a software that was able to control a plane without moving any of the control surfaces, just by throttling the engines up and down. It worked perfectly in the simulator, so they deployed it on a real plane and when they turned it on it almost crashed the plane immediately. They traced the issue back to a trivial problem. In the simulators both engines were perfectly identical, but in the real world they are of course slightly different. That was enough to break the software. Another one comes to mind. The Three Mile Island nuclear accident. The root cause was that the simulator they used to train operators couldn't handle a specific edge case. The operators didn't know, so they learned the wrong emergency procedure. That exact edge case happened at TMI, and the operators applied what they learned, following the official procedures, which were also based on the incorrect simulator. The result was a complete core meltdown, the loss of a brand new multi-billion dollar power plant, killing all new nuclear power plant construction for the next few decades, and as a consequence significantly accelerating climate change.

@chrisheath2637 Жыл бұрын

How many engineers, electronic or mechanical - use all their knowledge to design something - they basically create a simulation . They make it, and something goes wrong in the " real world", something unexpected occurs, because in the real world there are so many factors, lots of them known, but it only takes one unknown, incorrectly identified, or slightly wrong factor to invalidate the design. I would imagine that every software engineer ever, has experienced this.

@Mellowyellow8888 Жыл бұрын

the future companies are going to be MAAS.. model as a service.. anyone that has propietary data and also can collect data the quickest will corner that AI market for their sector/nice that they are working on..

@MrDuncanBooth Жыл бұрын

John I remember when you first started doing lots of Tesla vids you said that you only had a few shares and didn’t really plan on buying any more. Still the case?

@harry-eto Жыл бұрын

If one understands that and compares it to marketing stunts like Mercedes' "level 3"...

@Kodibear111 Жыл бұрын

Dude that OUTRO really scared me, hurt my ears, too loud ouch.

@MuskArmyDotCom Жыл бұрын

👍

@perrinmossino974 Жыл бұрын

when is the last time that board on your wall has been in the water

@PhilippeLarcher Жыл бұрын

that's what chatGPT is for

@drjml351 Жыл бұрын

I wonder if this isn’t the reason for the large sell off in the stock price?

@hyp-o-crite- Жыл бұрын

google? nvdia?

@cryan9376 Жыл бұрын

Please don’t tell me that VW self driving project is the same name as NASA’s Artemis project which finally has flown but is so expensive that it is a total waste.

@noleftturns Жыл бұрын

This sounds like my dentist having lots of data and experience and doing a heart transplant - wrong data/experience. I keep saying that FSD is a navigation problem to be solved rather than a general-purpose AI problem that a robot faces. Elon is trying to do 2 things at once, and one has little to do with the other. FSD should update old maps other Teslas have generated and share those maps. 8 low-resolution cameras are not capable of generating highly accurate maps, so existing maps from another vendor must be used - so much for vertical integration. Instead, FSD has no idea what's 100 meters ahead and races along at 100 KPH - a disaster waiting to happen.

@bjs2022 Жыл бұрын

“Bad sound makes good video look bad.”

@marriagepartnersministry5942 Жыл бұрын

Especially for the easily distracted

@jacksmith8466 Жыл бұрын

Good for FSD. But the Tesla Bot has no such universe of data to work from.

@muradtalukdar4401 Жыл бұрын

That massive advantage is why he left the company?

@CrumResearch Жыл бұрын

Doesn't Tesla want to help other organizations succeed as well, with its good non-competitive mission statement and all?

@davidbeppler3032 Жыл бұрын

Yes. How can Tesla help them? Other than giving them boat loads of cash?

@CrumResearch Жыл бұрын

@@davidbeppler3032 Cool, maybe they can think of ways to help evolution, engineering-wise. NACS for example, and in the area of neural networking tech.

@RichardSalmore Жыл бұрын

OPENSOURCE all patents like TESLA!