GPUs: Explained

Рет қаралды 312,343

Күн бұрын

Check out IBM Cloud for GPUs → ibm.biz/BdPSfV
In the latest in our series of lightboarding explainer videos, Alex Hudak is going tackle the subject of GPUs.
What is a GPU? What's the difference between a GPU and CPU? What are the most relevant use cases for GPUs, and how do GPUs figure into your cloud strategy?
Get started for free on IBM Cloud → ibm.biz/sign-up-today
#GPU #HPC #AI

Пікірлер: 234

@dheerajyadav3034 Жыл бұрын

Out of the many videos for GPU/CPU, this video saved my time as well as loved the simplified story. Thanks Alex & IBM

@Newbport849 4 жыл бұрын

Finally a more layman's terms video on the subject, thanks!

@adityarakshe8558 2 жыл бұрын

I was a layman then I took and arrow to the knee to become a Standingman who can use complex terminology

@josemedeiros007 18 күн бұрын

Great explanation , I was also a IBMer working in IBM Global Services in 1996 -1998. When I first learned Windows NT 3.51 server in 1996, Microsoft stated that it uses Symmetrical Processing "SMP" in utilizing more then one CPU on a server.

@wireghost897 5 жыл бұрын

IBM dev rels are the best when it comes to explaining stuff...

@eudritchbenjamin8919 3 жыл бұрын

Facts

@voovin 3 жыл бұрын

Fax mon

@fangirlg2625 7 ай бұрын

Agreed 🤝

@TonyCalice 2 жыл бұрын

This educational video is one of the reasons I love the Internet. Thank you Alex for doing this and you answered the question: 1) what is a GPU, and 2) why parallel processing is important? Would love to see this presentation further explain: 1) what does my solution delivery team need to do in order to leverage parallel GPU processing, 2) how do I integrate a GPU processing within my current architecture and 3) what challenges do traditional solutions have with leveraging GPU capabilities?

@arounaalaho6357 4 жыл бұрын

"Gaming is no longer the focus of GPUs anymore"! Thanks guys

@pratyush7987 2 жыл бұрын

Lmao I paused the video just to check on this statement.

@JB-qq1xz 2 жыл бұрын

No mention of ⛏

@thechurch275 2 жыл бұрын

Hey Alex! Looks like you are doing very well since your days in Troy. Of course, I'm not surprised. Keep up the amazing work!

@KingsleyOkeze 2 жыл бұрын

Having an exam in 2 hours time and I'm here to know a killer explanation of a GPU. Thanks for this.

@awichichedi3382 4 жыл бұрын

I've been looking for a good video And finally I found the best one Thanks a lot 💓

@KiranPhaneendran 2 жыл бұрын

The best and easy to understand explanation so far. Thanks!

@IBMTechnology 2 жыл бұрын

We're glad you found it useful, Kiran! 🙂

@gemini_537 Ай бұрын

Gemini 1.5 Pro: This video is about GPUs, explained by Alex Hudak, an offering manager at IBM. The video starts with a basic question: what is a GPU? GPUs are graphic processing units, in contrast to CPUs (central processing units). CPUs are made up of just a few cores and perform computations in a serial form, one at a time. GPUs, on the other hand, are made up of hundreds of cores and can perform computations in parallel, making them ideal for intense computations. GPUs are especially useful for graphic intensive applications such as VDI (virtual desktop infrastructure) and movie animation/rendering. Another big application of GPUs is in artificial intelligence (AI), including machine learning and deep learning. There are GPUs specifically designed for inferencing for machine learning purposes and for training neural networks. GPUs are not always necessary for high performance computing (HPC) but they are an important part of it. HPC applications can be very compute intensive and GPUs can be added to servers to spread out the workload. The video then discusses why GPUs are important for cloud computing. GPUs are expensive and constantly being updated with new technology, so it’s impractical for companies to keep up with the latest tech on their own. Cloud providers, however, can continually update their technology and provide GPUs to companies when they need them. There are two main types of cloud server infrastructure: bare metal and virtual servers. Bare metal infrastructure allows companies to access the entire server and customize the configuration, whereas virtual servers are more flexible and can be a better option for companies that only need GPUs in short bursts. In conclusion, GPUs are powerful tools for graphic intensive applications, AI, and HPC. Cloud computing allows companies to leverage GPUs without the burden of maintaining their own expensive infrastructure.

@Cyber_Vigilante_Jonathan 6 ай бұрын

I love IBM, I'm holding the IBM Certified Cyber Security Analyst Professional Certificate and the experience was awesome throughout the 8 coursed

@swapnilc17 5 жыл бұрын

Thanks a lot mam for this video. It has been explained nicely.

@user-qh3dr7rg3o 6 ай бұрын

Wow, I had a very vague (and wrong, lol) idea of what a GPU was. It actually makes sense for me now.

@JoeLafferty-to7jg Жыл бұрын

Wow - I can't begin to tell you how enlightening this short video was. It has, in 8mins, shed great light onto two MSc modules I'm working through right now: Blockchain (PoW mining) and Cloud Systems. I came for the blockchain mining but stayed for the relevance to cloud and virtualizaiton. 5 *s.

@kavanspace1654 8 ай бұрын

Great presentation and clear explanation to get basics of the GPUs etc... make sense in a simple manner.. i m loving the IBM Technology videos ...

@Old299dfk 3 жыл бұрын

Can we all just take a second to appreciate how easy this woman makes writing reversed look? She doesn't even bat an eye!

@47Mortuus 3 жыл бұрын

Don't you think that it's much more likely that they simply mirrored the video along the vertical axis? I think so, because it's much more likely that she's right-handed instead of left-handed. BRAINZ

@hrgwea 3 жыл бұрын

All these IBM explanation videos are made that way. It's a simple horizontal flip.

@night23412 3 жыл бұрын

......

@empyreus9047 3 жыл бұрын

My thoughts exactly

@eyyo3571 3 жыл бұрын

@@47Mortuus wooooosh

@venkatadesai7157 5 ай бұрын

Amazing explanation. Thank you so much for bringing in the clarity on CPU vs GPU.

@addusernamehere 4 жыл бұрын

Good speech presentation, good visual presentation with the colored markers & screen layout. I am impressed!

@kevinchand8359 4 жыл бұрын

And I as well!

@happypantsfilmmaker1797 4 жыл бұрын

The most impressive thing about this video is how you had to draw everything backwards. How did you do that without it looking like crap

@IBMTechnology 4 жыл бұрын

Well actually we don't write backward. Here is a blog post we wrote that explains how we do it, with a photo. ibm.co/2LTPMjo

@mrknarf4438 4 жыл бұрын

@@IBMTechnology that link doesn't work :( (at least from mobile)

@elimalinsky7069 4 жыл бұрын

She writes it the regular way and the video itself is mirrored.

@anhbayar11 4 жыл бұрын

Lol leads me to channel called "post" but nothing is posted.

@1dan1609 4 жыл бұрын

I think they basically invert the video after shooting.

@achioterojo8819 2 жыл бұрын

I study it and nowhere I found this good videos, IBM is awesome

@akwiseguy Жыл бұрын

That's cool how you write backwards so neat

@shockwave3283 4 жыл бұрын

Good video , but I wanted to know that laptop with small cpu and beast GPU good?

@surendersingal2192 3 ай бұрын

Thank you ma'am for clearing up this run away computer technology components n its effects on user.

@agentNirmites 5 жыл бұрын

Explained well, thank you.

@mikekousyaku Жыл бұрын

Thank you for your good explain. May be, I can understtand the defference between CPU & GPU. But　I have more question. from your direction ,Writing the keywords was very difficult?

@JuliusSDeLaCruz 4 жыл бұрын

Thank you. That was great explanation. Do you have a video with data that shows the speed differences of CPUs and GPUs or a CPU w/out a GPU? Thanks

@IBMTechnology 4 жыл бұрын

Hi Julius! At this time that kind of content does not exist, but it is something we are working on for future videos.

@Lights_Darks Ай бұрын

Thanks very much for simplifying. This helps a lot.

@elhamzeinodini4828 3 жыл бұрын

so comprehensive, thanks

@VictorSavelle 2 жыл бұрын

Great info, and also such a cool presentation setup.

@Van_Verder 2 жыл бұрын

Tremendously Helpful Thx!

@champion_life 3 жыл бұрын

Well..this explains what i needed, thanks

@dominicsmith7793 4 жыл бұрын

Excellent presentation...many thanks! HAL would approve :-)

@akaJekyll 2 жыл бұрын

Exellent lecture! Thank’s a lot ma’am

@learntoilluminate 3 жыл бұрын

Good Explanation. Nice Job

@the_notorious_bas 3 жыл бұрын

This is a great introduction

@bobbyutube1 4 жыл бұрын

You Rock! Alex

@nsambataufeeq1748 2 жыл бұрын

Great explanation 👏🏿

@mrknarf4438 4 жыл бұрын

Simple, but effective. The drawings help a lot. Thank you!

@IBMTechnology 4 жыл бұрын

You are most welcome.

@switchnowtechnology 2 жыл бұрын

very informative info,, hats off

@ivy3420 3 жыл бұрын

subed! great content! love!

@joshngarcia 5 жыл бұрын

Great explanation

@001vgupta 2 жыл бұрын

Excellent.

@ImmanuelHenne 4 жыл бұрын

well explained. Like it a lot.

@IBMTechnology 4 жыл бұрын

Glad it was clear, Immanuel. Thanks for visiting.

@pankajsinghv 4 жыл бұрын

Brilliant video post

@Djoeeeeee 7 ай бұрын

what is vram and what is does to gpu and which one matter the most gpu or vram?

@manish3572 25 күн бұрын

excellent job by the speaker!

@drawitout 2 жыл бұрын

Amazing video.

@sou_desu8587 3 жыл бұрын

Can you explain gpu names like rtx gtx etc idk

@sallysally58 Ай бұрын

Excellent

@rockbottom1014 2 жыл бұрын

Are both necessary for a gaming pc? If so what brand and capacity do you recommend?

@tanaymalikk 2 жыл бұрын

yeah both are quite necessary id say just type your budget and a pc build related to that should show up

@sebon11 4 жыл бұрын

Sooo cool video! Thx

@rajd33p42 11 ай бұрын

Ok but my question is how in the God's good world she's writing in reverse so smoothly and explaining alongside

@IBMTechnology 11 ай бұрын

See ibm.biz/write-backwards for details

@LawatheMEid 7 ай бұрын

..so how to choose the optimum gpu for an existing cpu?

@abnereliberganzahernandez6337 Жыл бұрын

I need a book where i can aboard tecnical details? anyone any book?

@bagaspermana88 Жыл бұрын

Great thank you

@serch7352 4 жыл бұрын

Speechless

@midlifecrisis920 3 жыл бұрын

Informative video

@YTradiodemon Жыл бұрын

i recently looked at a brand new cpu, they are a fasinating piece of kit!

@o_o6869 2 жыл бұрын

GPU are more than gaming, inally people now days realised .thanks for making it easy to understand IBM and Alex.

@IBMTechnology 2 жыл бұрын

You're welcome, thanks for watching! 🙏

@cbdaly01 2 жыл бұрын

good video thanks

@hussainramzi8109 4 жыл бұрын

Thanks

@alimenhem8402 4 жыл бұрын

when a cpu does a computation it does it in a parallel form right???each cpu takes a part of a computation

@kartikpodugu 4 жыл бұрын

CPU also does in parallel, but not to the extent of GPU. Also, like mentioned in the video GPU has too many cores that work in lockstep unlike CPU cores which do different work on each CPU. The video is over simplification for layman.

@bikedawg 4 ай бұрын

This is the coolest white board i've ever seen!

@mjames2117 4 жыл бұрын

Writing backwards in real time whilst multi tasking and multi processing is seriously impressive

@rytisss92 2 жыл бұрын

She is a human GPU :3

@porrasbrand 2 жыл бұрын

it's just an horizontal reflected video.

@Lights_Darks Ай бұрын

@@porrasbrand good call.

@newsportal7870 Ай бұрын

@@Lights_Darksthere are 2 glass

@creative.domain344 22 күн бұрын

I almost thought she wasn't human.

@marccracchiolo4935 8 ай бұрын

But if GPUs are so massive more powerful why not switch everything to them & go completely parallel processing for all applications

@indrajeet5000 5 жыл бұрын

If a GPU is so great at everything then why is it not used in place of a CPU. Is it because the OS is stuck with some architecture that only works with a CPU or cpu brands (Intel / amd) or is there some other reason.

@IBMTechnology 5 жыл бұрын

Hi @indrajeet500 thanks for reaching out. GPUs have the capability of processing particular applications far faster than CPUs, but GPUs lack the some of the core functionality of CPUs which are needed for modern operating systems. GPUs are most suited for intensive compute applications such as low-latency graphics and deep learning, whereas CPUs are built for everyday computing. For now, GPUs and CPUs are a robust team!--Alex

@brothergrimaldus3836 4 жыл бұрын

In my learning from what I understand and how I explain it to people in a cliff notes version. Is that the CPU is quicker at writing out the equation, the GPU is quicker at coming up with the answer. I know it is a little thin but it seems to fit the description.

@neamam9228 4 жыл бұрын

@@IBMTechnology can you tell us more about the core functions that cpus can do it but gpus can't ?

@KangJangkrik 4 жыл бұрын

Technically, when you make an operating system, everything must executed in order. You can't do that in GPU because it's parallel processor. Therefore, you need serial processor (in this case CPU)

@shun2240 3 жыл бұрын

@@neamam9228 complex arithmetic calculations, GPU are best for simple calculations that are computationally intensive such as graph traversal, encryption and decryption

@jaysonparkhurst7422 3 жыл бұрын

Did she just write backwards that whole time??

@BibleSamurai 2 жыл бұрын

good job

@konstantinlozev2272 Жыл бұрын

Amh, described this way, GPUs include also iGPUs (rightly). So, Intel are the biggest producer of GPUs.

@robocopvn 4 жыл бұрын

I admire the way you can write things behind the glass like that. I tried and it's so HARD!!

@legoman1304 4 жыл бұрын

she never actually wrote backwards they just flipped the video around in post production

@IBMTechnology 4 жыл бұрын

Well actually we don't write backward. Here is a blog post we wrote that explains how we do it, with a photo. ibm.co/2LTPMjo

@whothefoxcares 6 ай бұрын

Does IBM offer training for reverse writing?

@roronoa_d_law1075 Жыл бұрын

Why gpus don't replace cpus ? Why do we need both ? What does the cpu that the gpu can't ?

@matthewspurgin4220 Жыл бұрын

i love the way she says virtual desktop infrastructure

@OmarMohamed-ge2zg 3 жыл бұрын

thank u

@tenniszhang 6 ай бұрын

Good intro video, but why did IBM not invest in the GPU industry?

@CT-rr1no 2 жыл бұрын

What is offering manager?

@IBMTechnology 2 жыл бұрын

Hi Tom! An Offering Manager is responsible for the full lifecycle of an offering (for a product or service) and owns the strategy and execution for bringing that offer to market. You can read this article about a day in the life of an offering manager at IBM 👉 ibm.co/3CfytBe 🙂

@SaahilPriyaPrasannajeet 4 жыл бұрын

Good Presentation

@IBMTechnology 4 жыл бұрын

Thank you!

@bapple7844 3 жыл бұрын

Is writing in reverse part of IBM training because...

@MurderWeaponLimited 3 ай бұрын

Hi Alex!

@bogdand1475 4 жыл бұрын

Good!

@fenderjohn9813 4 жыл бұрын

draw , write backwards. . . wow i subscribed, and liked already

@joeyng1282 3 жыл бұрын

LOL I noticed that too.

@BenOgorek 4 ай бұрын

3:44 “[AI] is something that a CPU cannot do on its own.” That’s not off the wall but not really true. I ran mistral 7b with cpu using hugging face. If I get it from source, I do need NVIDIA gpus based on the way the code is set up. You can do a lot of great AI on CPU though.

@moinakram7319 4 күн бұрын

thanks for knowledge information keep sharing good for humanity love and respect from pakistan

@mosesmunene4668 2 жыл бұрын

In summary, GPUs are focused on matrix computations in order to create images. CPUs execute more general and more complex instructions. A CPU is like a musician that can read and write music. A GPU is like a musician that knows specific chords.

@tylersummers6209 4 жыл бұрын

When will AI be able to think in 3D

@stylishskater92 Жыл бұрын

If a CPU has multiple physical cores, meaning multiple ALUs, cant it also do multiple calculations at the same time? Or does she mean that it will a single "task" for the same "program" so to speak into multiple parallel calculations? But the CPU also does that i suppose. So is the difference just that the GPU does a lot of it because it has more cores? Why would a GPU then not always be better? I think im not fully understanding the difference of a multicore CPU calculating things in parallel, and a GPU calculating things in parallel. It cant be only the number of cores.

@doomtomb3 Жыл бұрын

It's over simplified. The CPU cores are like master chef. The GPU cores are like line chefs.

@lisaagenia435 3 жыл бұрын

good content

@sajithks97 2 жыл бұрын

Maria Sharapova explaining computers

@Akash.Chopra 4 жыл бұрын

This is more B2B ad for cloud compute gpu than education on gpu's.

@gersonasifiwehabinshuti9590 23 күн бұрын

People are trippin! Certainly not a bad video, but far from best. Everything can be summed up in less than 2 lines why 7 min!: GPU's have more cores than CPU and are thus able to handle compute intensive tasks. You can choose to have your own gpu infrastructure, or pay cloud-based resources. To call this a stellar explanation of GPU's is simply not acceptable! I have said my piece

@TheTimmerKimmer 8 ай бұрын

Great video on clarification! ...Also are we NOT going to address the fact that the presenter has been writing in REVERSE for the purpose of this lesson?

@IBMTechnology 8 ай бұрын

It's flipped in post-production. See ibm.biz/write-backwards for details.

@andresacostaegea7372 3 жыл бұрын

I liked the video.

@sarumitai 3 жыл бұрын

Great video, more impressive how well she writes backwards.

@telimarkskierman 3 жыл бұрын

lol

@aneeshyr 3 жыл бұрын

The video is horizontally flipped. She is writing normally

@IBITZEE 3 жыл бұрын

Good video... although... It needs just a 'minor' correction--- CPU's can have only 1 core... the cores run in Parallel (not serie) the core in the GPU usually run in slower speed than the CPU cores... (there are a number of technical reasons for this limitation...) the big difference is that the specialization the GPU was initially developed for a specific task (as the name states) and as the goal was mainly graphics calculation (although it can be used for others... now AI, ML, ...) it has a small and specific set very math-oriented... It shines in any task where there are the possibility of using a distributed load (a bunch of simple tasks, remember these are simplistic cores) that can tun in parallel and spread the load for the GPU... ;-)

@gauravnegi4312 2 жыл бұрын

your first paragraph is exactly what i was thinking, thanks for additional info too.

@elliott8175 2 жыл бұрын

I agree that mistakes were made, but it's not right to say _"CPUs can have only 1 core... the cores run in parallel"._ As she said, a CPU can have one or many cores, but usually much less than the GPU. Also, the parallel vs series argument is quite strange. The OS manages multithreading which can mean that a program can run in parallel on a CPU. The same is true for a GPU (This is where I disagree with the lady in the video). But I agree with her in saying that GPUs are specifically designed and suited to tasks that run in parallel, while CPUs can do both well.

@hiennguyenanh8512 Жыл бұрын

Good comment! it makes me clear the point that if GPU is fast why we need CPU, the main difference is that GPU's core is simplistic cores, doing specific tasks and running at a slower speed than the CPU.

@martintai3004 2 жыл бұрын

Even a basic computer need GPU.

@ruka8106 Ай бұрын

yeah technology are becoming so advanced that a gpu from 2017 is considered obsolete already but a car from 2017 is still considered new lol.

@vulpritprooze 4 жыл бұрын

Got to load off this question off my mind: Why don't we just have a cpu that has the capability of gpu and cpu at the same time? Like a god processor or something

@hanskurppa 3 жыл бұрын

For a short moment the world had a "god processor" that had parallelism built-in; it didn't need tens or hundreds of physical cores because a single instruction could do things in parallel (that is, if the code was written to correctly support it and not just a lazy port from traditional cpu architecture). It was called Itanium and it was as glorious as you would imagine. But due to reasons it got discontinued, so it never had a change to mature and become the GPU killer. edit: Just to be pedantic, my "single instruction does parallel stuff" is not totally correct but in layman's terms it should be good enough. If you wan't to actually know how it works, read up on "IA-64" and "very long instruction word."