CUDA Explained - Why Deep Learning uses GPUs

Рет қаралды 226,277

Күн бұрын

💡Enroll to gain access to the full course:
deeplizard.com/course/ptcpailzrd
Artificial intelligence with PyTorch and CUDA. Let's discuss how CUDA fits in with PyTorch, and more importantly, why we use GPUs in neural network programming.
Strange Loop: • "PyTorch: Fast Differe...
🕒🦎 VIDEO SECTIONS 🦎🕒
00:00 Welcome to DEEPLIZARD - Go to deeplizard.com for learning resources
00:30 Help deeplizard add video timestamps - See example in the description
13:03 Collective Intelligence and the DEEPLIZARD HIVEMIND
💥🦎 DEEPLIZARD COMMUNITY RESOURCES 🦎💥
👋 Hey, we're Chris and Mandy, the creators of deeplizard!
👉 Check out the website for more learning material:
🔗 deeplizard.com
💻 ENROLL TO GET DOWNLOAD ACCESS TO CODE FILES
🔗 deeplizard.com/resources
🧠 Support collective intelligence, join the deeplizard hivemind:
🔗 deeplizard.com/hivemind
🧠 Use code DEEPLIZARD at checkout to receive 15% off your first Neurohacker order
👉 Use your receipt from Neurohacker to get a discount on deeplizard courses
🔗 neurohacker.com/shop?rfsn=648...
👀 CHECK OUT OUR VLOG:
🔗 / deeplizardvlog
❤️🦎 Special thanks to the following polymaths of the deeplizard hivemind:
Tammy
Mano Prime
Ling Li
🚀 Boost collective intelligence by sharing this video on social media!
👀 Follow deeplizard:
Our vlog: / deeplizardvlog
Facebook: / deeplizard
Instagram: / deeplizard
Twitter: / deeplizard
Patreon: / deeplizard
KZfaq: / deeplizard
🎓 Deep Learning with deeplizard:
Deep Learning Dictionary - deeplizard.com/course/ddcpailzrd
Deep Learning Fundamentals - deeplizard.com/course/dlcpailzrd
Learn TensorFlow - deeplizard.com/course/tfcpailzrd
Learn PyTorch - deeplizard.com/course/ptcpailzrd
Natural Language Processing - deeplizard.com/course/txtcpai...
Reinforcement Learning - deeplizard.com/course/rlcpailzrd
Generative Adversarial Networks - deeplizard.com/course/gacpailzrd
🎓 Other Courses:
DL Fundamentals Classic - deeplizard.com/learn/video/gZ...
Deep Learning Deployment - deeplizard.com/learn/video/SI...
Data Science - deeplizard.com/learn/video/d1...
Trading - deeplizard.com/learn/video/Zp...
🛒 Check out products deeplizard recommends on Amazon:
🔗 amazon.com/shop/deeplizard
🎵 deeplizard uses music by Kevin MacLeod
🔗 / @incompetech_kmac
❤️ Please use the knowledge gained from deeplizard content for good, not evil.

Пікірлер: 130

@deeplizard 5 жыл бұрын

Check out the corresponding blog and other resources for this video at: deeplizard.com/learn/video/6stDhEA0wFQ

@kudoamv 5 жыл бұрын

So I can't use Computer Vision Programs which require GPU because I am an AMD card user?

@mae1000 3 жыл бұрын

@@kudoamv Actually, you can, I think. AMD invested in that field too, google "gpuopen".

@debajyotisg 5 жыл бұрын

Great job speeding Jensen Huang up. xD

@sudeepkadyan5480 4 жыл бұрын

Can i use 1050ti 4gb for data science

@faroukmokhtar6900 4 жыл бұрын

Ofcourse

@atisbasak 3 жыл бұрын

But it will be quite slow.

@Xiler6969 5 жыл бұрын

Congratulations, You've impressed me. Very professional series. Right to the good stuff, clear and sharp voice, broad yet specific explanations.

@estebansevilla2229 Жыл бұрын

I ended up here because my daughter is learning "AI" at high school and now I need to understand how this all works to make her a PC.

@deeplizard Жыл бұрын

😅😅

@sikuq 3 жыл бұрын

Beautifully done, Chris. Wow. Thanks. I learned a lot.

@larryteslaspacexboringlawr739 5 жыл бұрын

<a href="#" class="seekto" data-time="313">5:13</a> ballmer ambush, panic clicking to skip (thank you for awesome video)

@deeplizard 5 жыл бұрын

lol. You are welcome!

@majeedhussain3276 5 жыл бұрын

This channel seriously deserves million subs.Have been watching many series from this channel.Great work !!!!! keep going I'm sure this channel gonna flow with lots of subscribers someday .

@deeplizard 5 жыл бұрын

Thank you, Majeed! We're glad to hear you've been enjoying multiple series here, and we're happy to have you as an engaged member of the community! Always appreciate seeing your comments :)

@gabriellugmayr2871 4 жыл бұрын

wow, I saw these first 4 videos of the Pytorch series and am impressed how much time & effort you put into these tutorials. Thanks a lot. Also, you have developed enormously (although the older tutorials were already very good)

@engkamyabi Жыл бұрын

Amazing video and loved the short clips! Thank you!

@ajwadakil6020 3 жыл бұрын

This channel should have more subscribers, seriously

@shivangitomar5557 2 жыл бұрын

The BEST VIDEO on this topic!

@Aweheid 3 жыл бұрын

Rich informative video !! No better explanation is more than yours!!

@IgorAherne 5 жыл бұрын

Good overview, also having 8 cores won't necessarily speed up computation by exactly x8, perhaps by x7 in practice I just wish you would mention that processors use SSE2, AVX2 and similar things that allow each core do 8 summations/multiplications/shifts/etc at a time, rather than one by one. This allows a CPU registers to process arrays in chunks of 8. Many C/C++ programmers don't know about those, and build programs that are by default doomed to underperform. So I feel everyone is always unfair towards the CPU. Everybody is pointing at the cores, but each core can (and should) use intrinsics, doing parallel things. Especially with various RNNs where we only win if we move the entire algorithm to the GPU to avoid data transfer bottlenecks, and when the RNN is decently wide in each layer for the GPU. Also, CPU is really flexible when it comes to 'if/else' or while loops, reacting faster and wiry when the branch occurs.

@deeplizard 5 жыл бұрын

Hey Igor - Thanks for adding these details. Great stuff. Much appreciated! 🙏

@Not0rious7 4 жыл бұрын

Nice video, I like all the graphics you used. Where do you find them?

@bazzinga204 3 жыл бұрын

Beautifully explained.

@AdrianDucao 4 жыл бұрын

my girl friend and i been doing a lot of deep learning lately

@osumanaaa9982 4 жыл бұрын

you sure it's not just shallow computations ? :p

@q3d385 3 жыл бұрын

@@osumanaaa9982 🤣

@Aditya_Kumar_12_pass 3 жыл бұрын

I hope you are not hoping for any output.

@anamitrasingha6362 3 жыл бұрын

@@Aditya_Kumar_12_pass KZfaq should have a Haha react xD

@vibesnovibes6320 3 жыл бұрын

How many layers for protection? Are you clear on how back propogation is supposed to work? 😂😂😂

@taj-ulislam6902 2 ай бұрын

Very professional video. Good information.

@mayur9876 5 жыл бұрын

Thanks for putting in all the efforts.

@deeplizard 5 жыл бұрын

You are welcome!

@jamesferry8484 5 жыл бұрын

Thank you for sharing. Very helpful.

@deeplizard 5 жыл бұрын

Hey James - You are welcome!

@durafshanjawad5250 4 жыл бұрын

Very Helpful Series

@MarcelloNesca 3 жыл бұрын

Thank you very much, currently learning deep learning and this was perfect to explain why I need a good GPU

@chinonsoalumona6734 Жыл бұрын

Hi Marcello how’s your deep learning experience going?

@Henry..s 3 жыл бұрын

What I learned from this video is that nvidia gpu got their speed from the CEO

@jackt9535 Жыл бұрын

I'd like to know whether you could use dedicated graphic card for deep learning while you don't have a CPU with no iGPU. This will help me much with my screen cable management issue (I'm new to this) ! Thanks!

@True38 5 жыл бұрын

Did they remove all those stats/functions on a newer version of Cudo? Because I just recently downloaded it, and the only thing I can see on the screen is CPU, XMRig, h/s to the left and Payout Coin to the right. That's it! I'm using CPU but want to use GPU, but can't see any option. Please help if you can.

@Ammothief41 5 жыл бұрын

Any idea on how the rtx graphics cards and their tensor core stuff compares to the standard gtx gpus? Is that something that tensorflow or pytorch take advantage of?

@deeplizard 5 жыл бұрын

Haven't seen the comparisons. And. Yes. www.geforce.com/hardware/technology/cuda/supported-gpus

@ajaykrishnan4277 5 жыл бұрын

you just nailed it

@SW-ud1wt 2 ай бұрын

I have HP envy ci7 laptop having GeForce rtx 2050 card, will it be used for machine learning tasks?

@mexzarkashiev2435 4 жыл бұрын

So which graphics card should I buy for deep learning?

@faizahmed8034 4 жыл бұрын

Aren't GPU's used for image processing (i.e conversion of binary code to analog Graphic pixels)? If so how can we use them for mathematical computations ?

@henson2k 4 жыл бұрын

When multiple apps are using CUDA how it's managed by GPU? Can GPU execute different kernels at the same time?

@sqliu9489 3 жыл бұрын

brilliant explanation

@nozaxi0327 5 жыл бұрын

Thank you. This series so helpful for me

@deeplizard 5 жыл бұрын

Glad to hear that, jesse! You're welcome!

@robertatvitalitystar2444 5 жыл бұрын

ty! Peeling the plastic of a brand new GPU is a good day, lol.

@e4r281 5 жыл бұрын

Maybe if we start telling people the brain is an app they will start using it.

@clbl8706 3 жыл бұрын

That's some cringeworthy joke my grandma would share on FB.

@e4r281 3 жыл бұрын

@@clbl8706 actually, it's not a joke.

@nikhilmathur3351 3 жыл бұрын

@@e4r281 Unlike you

@hailongvan8285 3 жыл бұрын

ok commie

@kudoamv 5 жыл бұрын

PLEASE HELP, Is it something like - "you have to download pytorch with cuda if you wanna use gpu or else you will only be able to use cpu" ? I am an AMD user.

@JasperHatilima 5 жыл бұрын

CUDA is NVIDIA platform and so only supports NVIDIA cards like the GTX GPUs. For AMD, the framework for parallel programming is OpenCL...which unfortunately does not have a development community as big as the CUDA community.

@ankitaharwal5886 5 жыл бұрын

I can feel your pain 😔 😔

@ezevictor4448 4 жыл бұрын

Is a gtx 960m or 1050m worth using?

@Priya_dancelover Жыл бұрын

excellent

@krishna_o15 3 жыл бұрын

I am agreeing since Soumith has said it.

@qusayhamad7243 3 жыл бұрын

thank you

@rifatmasud 5 жыл бұрын

Anyone have that video link regarding "python is slow"?

@deeplizard 5 жыл бұрын

Added it to the description. Here you go: kzfaq.info/get/bejne/eqiGf8aY1pipl2Q.html

@arkamitra4345 5 жыл бұрын

GIL is evil 😓

@jordan5253 5 жыл бұрын

Jesus @<a href="#" class="seekto" data-time="161">2:41</a> I spit out my water lol

@adithi729 3 жыл бұрын

Sir is there any way to do cuda programing online? i mean any online compiler is present now? my system is not supporting cuda..pls help

@dalirkosimov4623 3 жыл бұрын

You can do it on jupyter

@sajolsajol8393 Жыл бұрын

wow!

@anujsaboo7081 4 жыл бұрын

You have a mistake in the quiz section: Q. Different PyTorch components are written in different programming languages. PyTorch is written in all of the following programming languages except? Ans. Java (on blog correct answer is coming as Python)

@deeplizard 4 жыл бұрын

Hey Anuj - Thank you so much for pointing this out! I've fixed it. You may need to clear your cache to see the change. Chris

@vibesnovibes6320 3 жыл бұрын

Great video

@user-pf2hj8er8x Ай бұрын

😄very nice video

@magelauditore333 3 жыл бұрын

<a href="#" class="seekto" data-time="325">5:25</a> i was like wtf. Can anyone have the link of whole video. 😂😂. Man i got excited and started shouting at home

@deeplizard 3 жыл бұрын

It's a popular one. Google and you will find 😂

@MMphego 4 жыл бұрын

Subscribed.............

@zeppybrawlstars3906 4 жыл бұрын

So when I play games with advance Ai make sure my gpu is ready

@deeplizard 4 жыл бұрын

Exactly. 🤖

@lancelotxavier9084 5 жыл бұрын

nVidia is holding back processing power in order to make selling their products sustainable.

@deeplizard 5 жыл бұрын

This is important. A company's incentive to make a profit can be a double-edged-sword. Consider the same problem in healthcare or biotech.

@henson2k 4 жыл бұрын

@@deeplizard conflict of interests indeed, every software developer knows that LOL

@henson2k 4 жыл бұрын

At research stage I can see how Python is acceptable choice. However for production systems Python too large in size and not fast enough!

@kanui3618 4 жыл бұрын

Can I combine Nvidia GTX 1070 or higher with amd ryzen 5

@deeplizard 4 жыл бұрын

no amd at the moment.

@A-Predator 3 жыл бұрын

i just learned the name of deep learning 😵

@louerleseigneur4532 4 жыл бұрын

merci merci

@TheTariqibnziyad 4 жыл бұрын

Finally these nerds got the guts to call something a funny name, Embarrassingly parallel xD

@deeplizard 4 жыл бұрын

🤓

@zackrider3708 3 жыл бұрын

@@deeplizard can the new XE server gpu from intel handle ai or Deep Learning workloads like nvidia gpu ?

@richarda1630 3 жыл бұрын

exciting and if you read WBW blog thrilling times

@SuperMIKevin Жыл бұрын

Lmao, I can't believe they actually named it embarrassingly parallel.

@isbestlizard 4 жыл бұрын

OH MY GOD WOW are you a lizard too? i love ai and stuff as well :D

@deeplizard 4 жыл бұрын

🤣

@beomheelee1249 3 жыл бұрын

you're so geinus!! Thanks

@hedonismbot1508 Жыл бұрын

Never in my lifetime would I have ever imagined "Embarrassingly [something]" would be an actual technical term.

@deeplizard Жыл бұрын

😅😅

@pscheuerling 4 жыл бұрын

I came Here to learn how to utilitise deep learning cores for Training my own ai... I still don't know why i should buy cores i cant use.

@A-Predator 3 жыл бұрын

😵

@lakeguy65616 Жыл бұрын

the forward pass can rely on matrix math which can be run through CUDA(software layer) and done on an NVIDIA GPU. The more GPU cores, the faster the process. A gpu with 100 cores will perform this step 10x faster than a GPU with 10 cores (in general...).

@yourgflikesit 4 жыл бұрын

Steve Balmer off his face again lol

@Infinityxx3 5 жыл бұрын

u need some music in vid... attracks views.... cool vid

@deeplizard 5 жыл бұрын

What kind of music do you like?

@Infinityxx3 5 жыл бұрын

@@deeplizard PEWDIEPIE bitch lasanga ? jk... any relaxing music when u talk... when u changing camera shot etc... ;)

@deeplizard 5 жыл бұрын

haha. That sent us on a tangent. Hadn't seen that before.🤣

@robertsmith512 5 жыл бұрын

SUBBED ! EVERYBODY SUB THIS CHAN ! THIS ONE KNOWS HE'S STUFF ! GO LOOK AT THE PLAYLIST LIB !

@deeplizard 5 жыл бұрын

Thanks Robert! Note that there are two of us here. 🦎🦎

@avdhutjadhav5657 2 жыл бұрын

Does that mean GPU with more CUDA is better for Deep learning ?

@lakeguy65616 Жыл бұрын

yes (and more gpu ram...)

@alkeryn1700 4 жыл бұрын

Guys, don't use cuda, use HIP so it runs everywhere or use opencl or sycl but don't have your software stuck to proprietary and platform specific hardware and software

@DinoFancellu 3 жыл бұрын

Its a pity that AMD don't seem to support CUDA. Their new big navi cars look really nice apart from that

@liangwei4869 4 жыл бұрын

<a href="#" class="seekto" data-time="357">5:57</a> 東工大でるのは草www

@cubul32 3 жыл бұрын

Former CEO - and we can see why.

@deeplizard 3 жыл бұрын

Although, he became a billionaire from his tenure at Microsoft 😄

@MeowsyDancer 3 жыл бұрын

I will now send this to anyone who asked why I bought a 3090! rip wallet tho

@deeplizard 3 жыл бұрын

🤣💰

@Joco5012 2 жыл бұрын

Wow was it this ok to do so much coke back in the day? <a href="#" class="seekto" data-time="312">5:12</a> damn dude take it down a notch

@alebecker12 3 ай бұрын

I have a doubt, does Nvidia has a monopoly in such hardware? If not, does CUDA only work on Nvidia hardware?

@deeplizard 3 ай бұрын

Yes. Nvidia built CUDA. It only works with their hardware.

@MilesBellas 9 ай бұрын

Jensen is better at 2x

@iLevelTechnology 15 күн бұрын

He doesn’t explain tensor very well but overall good job

@ErrorRaffyline0 3 жыл бұрын

I really dislike CUDA becouse it’s not open-source and AMD is not able to use it, it makes development for both AMD and NVIDIA much harder.

@Drtsaga 3 жыл бұрын

"Deep learning" should not be on the title in my opinion.

@jacobcorr337 2 жыл бұрын

CUDA not explained at all

@lakeguy65616 Жыл бұрын

CUDA is a software layer that interfaces with Nvidia GPUS to allow porting some problems (think forward pass) to the GPU which can be done in parallel. (your pc has an Nvidia GPU, with software like Pytorch, you tell PC cuda is available and to send certain processes to GPU for processing in parallel.) vastly over simplified.