How AI Powers Self-Driving Tesla with Elon Musk and Andrej Karpathy

No video

How AI Powers Self-Driving Tesla with Elon Musk and Andrej Karpathy

Рет қаралды 59,679

Preserve Knowledge

Күн бұрын

A segment on the technology powering self-driving Teslas from Tesla's Autonomy Day 2019

Пікірлер: 136

@austinryder9028 3 жыл бұрын

I had to double-check that I wasn’t on 2X playback speed

@renaissanceman622 3 жыл бұрын

Yep. I did too!

@AdrianMeredith 3 жыл бұрын

the video has been sped up, he isn't just talking fast but moving fast too. 0.75 is better

@brandonbarr2784 2 жыл бұрын

He has the chip in his brain

@jonathanqamanzi 2 жыл бұрын

I swear to God me too

@karenzhao4629 Жыл бұрын

I didn’t see your comment before, I did exactly the same thing

@vermack 3 жыл бұрын

The ability to source any type of examples from the fleet is amazing!

@dhruvpatel4948 3 жыл бұрын

That moment when Elon reminds Andrej about CS231 😅😅

@kaleygoode1681 3 жыл бұрын

Andrej sounds totally normal if you set playback speed to 0.75x... His brain is running a third faster than most people! NeuraLink is going to be interesting when communication is no longer the current slow speed speach...

@editg121 3 жыл бұрын

A third is understatement

@markhealth3386 3 жыл бұрын

OMG ... So true. thanks for the tip 😃

@zantetsu8674 Жыл бұрын

The video has been sped up, apparently by around 1.25x. Unfortunately needs 0.8x on the playback to make it correct but that's not available. 0.75x makes the playback a little bit too slow. So you either get too slow (0.75x playback) or too fast (1.0x playback). Not sure why the person who posted this video sped it up like that.

@MartinCapodici Жыл бұрын

I had to check my settings, he made me think I changed it to 1.5 !

@deveshbhatt4063 8 ай бұрын

@@zantetsu8674 seems like you haven't heard Andrej speak.

@andyandreou 3 жыл бұрын

That image of the fleet data on a map at 12:24 is absolutely stunning. I'm from Cyprus, and even though we don't have Tesla showrooms, superchargers or service centres I can see that Tesla is still collecting data from the cars which were imported here.

@Abhishekkumar-qj6hb Жыл бұрын

How come?

@aaronbounds1336 3 жыл бұрын

There are some pretty big high-level takeaways here: using pure vision with a slight hint of radar, for now, to get lidar like accuracy in terms of depth perception. This is major.

@PierreH1968 3 жыл бұрын

This is awesome!... I wish the Teslas have the aerial camera view by combining all 8 cams to show all around the car. Like BMW does on their cars

@fredepstein 3 жыл бұрын

There is no front bumper camera for doing that.

@PierreH1968 3 жыл бұрын

@@fredepstein that makes sense!... but i think you can project images from the front cameras with a transform to fit the road in front.

@fredepstein 3 жыл бұрын

@@PierreH1968 not possible because the camera can not see just in front the bumper.

@psbjr 3 жыл бұрын

very powerful hot dog/not hot dog technologies, thanks for sharing

@rabbitlissa Жыл бұрын

Jian Yang must be super proud

@peterprocopio2192 3 жыл бұрын

What a great video on AI and neural networks. Amazing future. Tesla is well positioned to remain in the lead with autonomous vehicles because they have so many cars in the field gathering data and teaching its neural network. No one else is in the game.

@TheKoekiemonster1234 3 жыл бұрын

I like how elon chipped in when the guy got nervous. Great team!

@tylerbradshaw7957 3 жыл бұрын

Is this on fast forward for anyone else?

@DesmondCheung 3 жыл бұрын

at 0.75 playback speed, it sounds about right.

@readyplayersid 3 жыл бұрын

No they just live life on 1.25x

@torstenziegler4826 3 жыл бұрын

Thank you!

@qwerty-tf4zn 3 жыл бұрын

Thanks for the delivery

@PierreH1968 3 жыл бұрын

Lidar is bad with object densities, works badly in the heavy rain and cannot make the difference between an opaque plastic bag and a rock...

@generationgap416 Жыл бұрын

That sounds like a startup worth launching

@XX-pq9mb 2 жыл бұрын

The future of communication speed of mankind is evolving into something that eventutally will sound like R2D2... Andrej is only the first phase of this

@Maverick5588 3 жыл бұрын

Why does it seem like his speaking is sped up? Is this video speed increased

@pearlfinder1 3 жыл бұрын

I put speed at .75 to hear it properly

@smhninja3746 3 жыл бұрын

Did I go slow or is this video sled up?

@justchary Жыл бұрын

What an amazing presentation! Thank you

@silberlinie 3 жыл бұрын

14:56 to 15:55, how long does the iterative run of the data engine take to complete the cycle? Seconds? Minutes? Days? And how often is an update sent to the fleet? Every day? Every week? 17:32, all examples coming from the fleet will be annotated, so are all the half million examples annotated by hand by people? And, how long does it take to download an new update to the car?

@jacksontriffon5064 3 жыл бұрын

Keen to know

@rickkay9548 3 жыл бұрын

Fleet examples are automatically annotated mainly by Dojo (their massive cluster) and anything with a low confidence score get human input, making the ai smarter. Asking the fleet and getting correct answers is a measure of the algorithms accuracy. Updates come to the fleet about once per month in the main updates, hard to say which of the smaller ones are streamed and when.

@silberlinie 3 жыл бұрын

@@rickkay9548 You will surely get a message if an update has happened. And surely also a message about when that was. Don't you have a history to retrieve? And also what name they all have. And what size. This must be somewhere in the screen menu to be called up?

@rickkay9548 3 жыл бұрын

@@silberlinie The updates only come in mass stages as official releases, not individually as tiny packages. You can auto-apply them when notified of readiness, or just delay or ignore them. Sometimes they have names like "V10" or "Holiday update" but usually are labeled with their release number or git hash, and can be tracked here teslascope.com/teslapedia/software

@silberlinie 3 жыл бұрын

@@rickkay9548 The updates come via WLAN? And also via cell phone network? Or can you define that yourself? Do you have to be in park mode for that? Or is it also possible while driving? Can you watch yourself when it srartet and finished, so you can see how long it takes? On the Teslascope page there is no information about the MBytes of each packet, what do you know about that?

@michelspeiser5789 2 жыл бұрын

Just wanted to turn down from 1.5x speed, but saw the video was playing at normal 1x speed...

@X_platform 3 жыл бұрын

Why use neural net to predict depth if you always already have the ground truth from Tesla’s sensor?

@X_platform 3 жыл бұрын

Oh the sensor only give sparse data points, neural net will predict every pixel and their distance

@patrickjdarrow 3 жыл бұрын

And 1 sensor is cheaper than 2 😬

@fredepstein 3 жыл бұрын

The sensors can not see far enough.

@DiZhaoairj23 3 жыл бұрын

This is how I imagine some ai dude speaking. 2x the normal speed

@aquarios_do_ivomar 3 жыл бұрын

Lol so true

@mattfairman8585 3 жыл бұрын

I had to slow my playback speed to 0.75 to understand him lol.

@liarzdice 3 жыл бұрын

@@mattfairman8585 LMAO I always wondered what the point of that feature was .. Now I know.

@zardi9083 8 ай бұрын

Set playback speed to 2x to fully understand what is happening in Andrej's brain

@X_platform 3 жыл бұрын

What did you use to query the fleet? How can you guarantee the search engine return all the correct result?

@malikhamza9286 3 жыл бұрын

They already said machine Learning Mechanism to do this.

@X_platform 3 жыл бұрын

@@malikhamza9286 Sounds like a chicken and egg problem. If ML is perfect, it will return all the correct results; but if ML is perfect, they would not need to query and label these images.

@dogmatichobbyist4575 3 жыл бұрын

@@X_platform doesnt have to be perfect when such influx of data is coming in

@pc_screen5478 3 жыл бұрын

They could be using a larger, more accurate but slower network to do this automatically. Consider that FSD has to run in real time on relatively modest hardware compared to what tesla has at their disposal for actually training the network. They could also be simply looking for moments where the network is uncertain about what it's looking at, and that should generally be good enough to get desirable results

@BryanFletcher 3 жыл бұрын

Still... Such a powerful talk!

@Qattea 3 жыл бұрын

The fact that his last name is Karpathy

@Qattea 3 жыл бұрын

@@timurishuov5141 I mean since he’s working on AI for cars following roads (paths)

@dtibor5903 3 жыл бұрын

Human drivers have accelerometers and microphones built-in that should be used too for self driving cars

@nalinbranden 3 жыл бұрын

Awesome presentation. Question: when he says '"fleet" that means all the autopilot enables Tesla cars currently owned by public, or a dedicated fleet (purely for testing) of Teslas driven all around the world by a group of Tesla employees or contractors?

@MichelConrado1 3 жыл бұрын

This is genial!

@Diarkia124 2 жыл бұрын

It's weird to think I've watched this guy before he got into neutral networks. Glad to see badmephisto is doing well

@anujnm6597 Жыл бұрын

Same here....I learned advance cross and look ahead from his videos.

@clawdeckcd3018 Жыл бұрын

I learned a lot about AI thanks to Andrej videos, he is a talented teacher, no doubt. But never heard about that Mephisto, so I checked, and yes, sure that's his voice, especially here: kzfaq.info/get/bejne/jc6Anc-fvMjYg2w.html I could'nt believe it.

@Abhishekkumar-qj6hb Жыл бұрын

So basically you guys are utilising the fleet for getting varied data and also ensuring if the model works fine and if it fails then again quickly train the model on those groups of datasets to make the model more robust!!! Interesting However how far are we from the moment where we kind of act well as humans do with just very few datasets ??? Cuz what we are doing is statistical inference on the basis of large datasets ! So it's basically good datasets and good compute as mentioned earlier

@posthocprior 2 жыл бұрын

Is this true, that Tesla is primarily concerned with image detection? Driving requires so many skills: the understanding of basic physics, understanding when objects are static and don't move and when they're dynamic... How does Tesla incorporate all these other concerns into their models?

@edwardolvera5280 Жыл бұрын

They cant Thats why the Teslas keep crashing.

@Ran_Dhir_Singh Жыл бұрын

I think he explained they are using drivers as training data as how the drive cars to maneuver the car based on the steering ,wheel etc. Might need more progress on that tho .19:30

@jonathanqamanzi 2 жыл бұрын

I had to double check playback speed and actually put it at 0.75x

@vermack 3 жыл бұрын

I don't understand one thing with Tesla cars is what happens when they are not connected to the network for long periods of time? Also, I'm sure these cars are going to be shipped with the Starlink receivers in the near future in some sort of miniature forms.

@lmcclymont Жыл бұрын

The car doesn’t use network for self driving, the relevant code is stored on the car’s computer (twice). The only difference is updates and route planning.

@parent5x 2 жыл бұрын

Another beautiful brilliant mind.

@sidkapoor9085 3 жыл бұрын

How are half a million images annotated? Is it done manually?

@nightlessbaron 3 жыл бұрын

Normally yes, but there are also methods to make it semi-automated, you can check active learning.

@lmcclymont Жыл бұрын

This is now mostly done automatically

@RyanSmithPhoto 3 жыл бұрын

Now if they could just make it so my car doesn't hit the brakes like mad when another car is turning across my lane of traffic. It seems like the AI should be able to tell at the speed the car is moving it would be long out of my way and doesn't slam on the brakes. I wish they had an option in the car to report when the AI does something wrong.

@leedsbutler3567 2 жыл бұрын

I'm absolutely blown away. This is true AI.

@gregorythompson8627 2 жыл бұрын

Wouldn't it still be a good idea to include lidar devices in some of the cars with FSD so you have can have a ridiculously large dataset for unsupervised training, image -> point cloud?

@turtleking9999 2 жыл бұрын

That's what I'm inferring they're doing, because they explicitly said it's possible to do exactly that. However they did double back and said they could train on distance without it anyway.

@ntluan2k 3 жыл бұрын

Understand why Tesla is going so fast

@theLowestPointInMyLife Жыл бұрын

Walt and Gale vibes

@suissdagout5153 Жыл бұрын

Missiles making

@SyedAli-du9iq 2 жыл бұрын

Shut up Elon musk and let the smart guy talk

@marcopaluszny 3 жыл бұрын

Lidar hit job?

@colinmaharaj 3 жыл бұрын

Can I enroll in these courses that teaches neural networks

@generationgap416 Жыл бұрын

Cousrea, youtube, udacity, udemy

@markhealth3386 3 жыл бұрын

Kar-pathy .... Like psychopathy for cars... how ironic that's his last name

@sidkapoor9085 3 жыл бұрын

Uh lol

@sylvaingirard 3 жыл бұрын

Imagine being an annotater at Tesla. What a mind numbing job that must be…

@ainnovation6967 2 жыл бұрын

Fast talker is also fast Mathematics problems solver.

@lkd982 Жыл бұрын

I heard Musk say it. 11:55 "You can't. There's no way". Where is my prizemoney??

@PierreH1968 3 жыл бұрын

Tesla has it right, an AI taught to replace humans should see like humans. Not only interact with the road but also with the environment. and the evil is in the details... The long tail.

@jamespatrick5348 2 жыл бұрын

There may not be sufficient number of edge case images to perfect the neural net. This limitation is crucial and may not be solvable.

@generationgap416 Жыл бұрын

Like human vision?

@muhammedsauod9901 Жыл бұрын

wow👏

@gauravrai5784 2 жыл бұрын

Me with 4 GB RAM machine: Interesting 😯😯😮

@Splish_Splash Жыл бұрын

it doesn't rely much on RAM, it's more about GPU

@Yurost1 3 жыл бұрын

Hey OEMs, pay us and we will license our suite of hardware and software. We will be sure your cars are just one update behind ours always.

@techsource2235 3 жыл бұрын

Another reason I believe that human body, brain, neuro system was actually PLANNED, THOUGHT THROUGH, DESIGNED by the SUPREME being, God! If it takes so much planning and efforts from people to design a limited version of AI software, its logic etc. I will never believe there is no God. There is God and He came to live among us in the person of Jesus from Nazareth.

@JerryMetal 2 жыл бұрын

Wouldn't your car need a freakin' super computer onboard to run this neural net??

@lmcclymont Жыл бұрын

The fact it works on their own chip is one of the most underrated thing Tesla has done tbh. The training is done back at Tesla and tHe nets are downloaded to the car so it can drive. Other cars have massive computers in the boot.

@generationgap416 Жыл бұрын

No, training of neuronet needs a gpu,s and tpu's running models already trained can on cellphone or raspberry pies

@dogefromthefuture Жыл бұрын

and this whole thing ended up being a dead end?

@yondaimehokage2281 3 жыл бұрын

If I had a tesla, I wouldn't care about them taking images from my car to improve fsd. Go Tesla!

@pocok5000 10 ай бұрын

the good old days when Musk wasn't a total nutjob

@ProGangstaShit 3 жыл бұрын

0.75x speed sounds more normal!

@mahdiamrollahi8456 2 жыл бұрын

🥵🥵🥵 How fast you can talk ?!

@janmolski 2 жыл бұрын

Andrej always speeks 1.5x

@essentials9302 2 жыл бұрын

Elon musk is like /|:

@semtex6412 3 жыл бұрын

does he really talk like that? he sounds like a stephen hawking's computer

@Jayismynickname 3 жыл бұрын

Play this video in 0.75 your welcome

@edwardolvera5280 2 жыл бұрын

Mercedes-benz is already level 3 this weirdo has no noticed it yet

@lmcclymont Жыл бұрын

It is L3 on certain roads under 30mph 😂. Tesla is almost L3 anywhere in Northern America.

@edwardolvera5280 Жыл бұрын

@@lmcclymont mercedes-benz did it in a quarter of time Tesla did its. This weirdo does not know much about cars.

@edwardolvera5280 Жыл бұрын

@@lmcclymont Mercedes-benz already took control of the EVs industry. And the faul lies in this weirdo who never could finish 100% the Self-driving autopilot. Thats why the company Tesla can not really take off.

@lmcclymont Жыл бұрын

@@edwardolvera5280 I gar unter you that FSD beta can work hands free at every single place the Merc can and then at millions of other places as well. You have zero understanding of what is happening here.

@lmcclymont Жыл бұрын

@@edwardolvera5280 umm L3 on a handful of roads is not full self driving 🤦‍♀️. Maybe read something other than the New York post or other FUD and you will understand the difference.