Sign up for Masterworks www.masterworks.art/anastasi and purchase shares in great masterpieces from Pablo Picasso, Banksy, Andy Warhol, and more.

Gaming demand didn't cool so much as gamers are sick of the huge price increases.

Anastasi, your videos are amazing. I've only been watching for maybe 5 months, but have been going back and watching all your stuff. Sometimes I watch the same ones several times since there is always so much information presented. Please keep them coming.

deep dive! first video I watched which actually explained well why everyone is so exited about Nvidia and GPU rush.

Anastasi, the H100 is a monolithic design, not a chiplet design. Chiplet designs refer to designs that split the different components of a [traditionally singular] die across multiple dies on the same package, for example AMD's Epyc or MI300 processors having 'chiplets' of cores and a 'chiplet' for the memory controller. In datacenter products, HBM is often packaged with the die but this is not what a chiplet design implies. Also, there have been converters that can transform CUDA code to roughly corresponding OpenCL or HIP code for a while, but CUDA will never be able to run natively on AMD hardware as CUDA compiles to PTX, a proprietary virtual instruction set.

Thank you for making things so easy to understand

CUDA is way more than a parallel computation framework, it's a complete series of libraries for solving problems on the GPU with C/C++ including linear algebra, deep learning, sparse matrix, solver, FFT, nvJPEG, profilers, etc.

I wonder if AMDs software stack is being underrated. I avoided their graphics cards for years because of the ROCm horror stories I had heard; and I think that was a smart choice at the time. But a month ago I bought a Radeon 6700 XT for my girlfriend's computer, and even without official ROCm support (after changing one line in a text file) it's been incredibly easy to use for stable diffusion and Leela Chess Zero. I'm just a hobbyist and don't have any commercial application for ANNs at the moment, so their are probably use case issues that I am completely unaware of. But I was absolutely amazed at how easy it was to get ROCm up and running on an AMD consumer GPU (it took like an hour, and it was only that long because of slow driver downloads). I ultimately found it less of a hassle than using CUDA on my Nvidia RTX 2060 Super because (at least in Ubuntu 22.04) the drivers that make it work for CUDA break it for Steam and vice versa. After setting up the 6700 XT with ROCm I was so sure I'd have problems getting Steam to run games, but everything went smoothly. I was simply mind blown. I hope AMD brings official ROCm support to their 7000 series cards ASAP. As a hobbyist I don't care that Nvidia cards might train a faceswap model slightly faster, I just care that everything runs smoothly.

SHE is always the goto source for credible AI & New Tech developments!

One of the most beautiful genuine geniuses that explains it easy for us to understand! Thank you so much always for your information and updates! You make something’s that can be boring very easy to want to watch!

Can you explain the differences between x86, arm, risc-V and the GPU architecture that I don't know what is called :D Thx for the great videos. It's an andidote to the pessimism that the consumer side industry has

I cannot wait until Optical CPUs will be available over the counter working near the speed of light ❤ Quantum Computing is available for the enthusiastic people out there, I remember the days of £500 CD writer reader & the 40MB Hard Drive thinking thats fantastic, now there so cheap, more & more solid state drives i purchased 200GB SSD for £6 in the UK 🇬🇧 Have a fantastic weekend ❤

The first computer I had as a teenager was a based on the MOS 6502. It's insane to realize how far these chip architectures and technologies have come since the mid 1980s.

Thank you for another excellent video which in a nutshell allows me to stay updated about the GPU/ CPU « universe », the upcoming technical hurdles and challenges, as well as where the future may be going.

- Fascinating! - Thx for keeping us updated. - Oh and, great presentation. Keep up the great effort/content...

Your videos are the best! And you look and sound great.

Another terrific video Anastasi! Well done.👍

Anastasia's videos are so great. I love listening to them.

thanks for the video Anastasi !

These hardware companies don't actually need a parity with CUDA. They only need to implement custom backends for TensorFlow and PyTorch libraries. This is much easier than replacing CUDA. I even did similar stuff myself, on top of Direct3D 11 compute shaders.

Some amazing stuff coming down the line. I'm looking forward to Graphcore's Good computer next year.

Thanks again for another great informative vlog. Until next time thank you and keep up the great work

You are extremely educational. Thank you.🎉

i came back from work awsome thanks for info!

enjoyable and informative as always thank you

excellent video. very well researched. lets hope Cerebras (that actually just closed a deal with AMD for a supercomputer to help with ML) and AMD are able to pull ahead and actually compete. the fact nvidia has such a big piece of the pie with proprietary software is a real problem imo... or else no AI for everyone cause its a company focused only on profits and extremely greedy at that. i pray Rocm has a chance to shine but amd needs to actually focus on it massively. AI is in its infancy so theres a chance for others to join the fight.

Thanks for the information.

Very informative, and exciting.

Hi Anastasiia your English is fantastic you are explaining reasons for the shortfall and high prices so clearly and concisely keep up the great work gb

Hey, I saw my name as a supporter! Thanks, Anastasi! 😍

🎯 Key Takeaways for quick navigation: 00:00 📈 The demand for GPUs, particularly for AI applications, is surging, causing supply struggles. 03:02 🚀 Nvidia dominates the GPU market due to its high-performance hardware and proprietary software, like CUDA. 05:03 💹 The new Nvidia H100 GPU offers significantly better performance for large language model training compared to CPUs. 09:51 💼 Alternatives to Nvidia GPUs for AI applications include Tesla's Dojo, Google's TPUs, Cerebras' Wafer Scale Engine, and Intel/AMD GPUs. 16:34 💡 The future of AI hardware is promising with intense competition, and diversifying investments is recommended, including alternative investments like Fine Art through Masterworks. Made with HARPA AI

Turned on notifications! Can't miss these vids. Thank you for teaching us and keeping us updated! 🤖🌹

Insightful and clear. Thanks.

Thank you!

Great video Anastasi.

Love your videos, but justed wanted to say: I love your watch, the Santos is one of my all time favourites

Me encantaria un video sobre el impacto que puede tener el descubrimiento de LK99 en el universo de los microchips

Thank you.

Alright will watch this after work

you have a great ability to explain . would be a great teacher

Thanks!

Cartier watch?? looks pretty. Will be interesting to see the role GPU chips and quantum chips may play soon...

Awesome growth ahead and happening now.

Best Market advisors are those who knows the most about the company and the technology.

plz bring videos on quantum computing

Very good ! 🌞😉👍

Thank you for this video and all of previously you did. As i know, if we could make a digital chip implement Non Volatile elements such as Memristor or MTJ device, it will be actually useful 👌

Can you make a video on the new room temperature superconductor paper?

One maybe off topic question, how will the on going and coming AI boom add to data storage? Old forecasts as far as I understand was based on more streamed video, but as I understand, AI will add a lot of data stored as well. Any idea of where we are heading? My rough guess is that we will have a lot more data stored but that the amount to be manufactured can’t grow as fast.

Another insightful Pro-Video - Thanks ! 'seems a dedicated AI to help streamline and optimize the software layers of MUX/DeMUX (pls excuse the hardware terminology) for all these parallel processors will be another 'Cutting Edge' tech

This from Model 3 manual, May also apple to model Y ( I would think): To experience the same amount of deceleration whenever you release the accelerator pedal, regardless of the state of the Battery, you can choose to have the regular braking system automatically engage whenever regenerative braking is limited. Touch Controls > Pedals & Steering > Apply Brakes When Regenerative Braking is Limited.

Great work Anastasi video always very interesting I believe that NVIDIA will be increasingly the protagonist in the realization of supercomputers given the billion-dollar investments I foresee exciting solutions in a short time !!!”

Excellent presentation across the board. I would love to see Cerebras compared to GH200. That would be more apples-to-apples. And the NVLink vs Cerebras in build memory - should give a good comparison.

Nice info. Any alt GPU for the end users? What are the options for end users for playing with AI text and image generation?

Wasn't it Clive Sinclair and associates back in the 1990s who came up with the idea of using a single wafer ( at that time likely a 200 mm wafer) as a single large RAM device, similar in general idea to the Cerebras full wafer TPU?

I’m curious as to which companies are using Niobium in their supercomputing chips?

Crazy how much the other chip makes slept.

VM limited on single chip versus the Dubai Wafer?

I enjoyed your great, intelligent presentation. For me, it filled in some of the details about AI that I was missing. For what it's worth, my feeling is that AMD are on a good path. Their chiplet design is ultimately very scalable. It depends upon them getting the software right.

the real question is who are the alternatives if tsmc goes down, because cerebras receives chips from tsmc

As a gamer I'm hoping there would be some GPU dribble to us. For example failed chips getting new life as gamer GPUs.

Room temp superconductor patent was released Ana. Maybe we could have mini super computers oneday. Could you explain how superconductors would help computing?

:) strix point apu is the only way for me.

I need updates on running Cuda on rocm

You should do a video about multimodal models and see if/when we'll have proper and accurate 3D STEP files imagined from AI inputs. STEP is the only real engineering format for 3D IMO. It means you can machine the parts and build assemblies to 100% proper engineering specifications. When we get there, we'll see a step change in everything.

What about the Photonic Processors & The Quantum on silicon (& Intel's neural network)?

How do you explain TSMC earnings report and guidance of 10% reduction in sales and Ai only accounting for 5% of those sales?

_What?_ Covering my hobbies, now, too? Gee, thanks! More seriously, you made a good case for Cerebras. Taken together, these trends may spell deep trouble for Intel in particular.

16:25 Overall, proprietary code can be relevant to AI development, including LLM and autonomous AI. However, it is crucial to strike a balance between proprietary and open-source components in the AI ecosystem to promote innovation, collaboration, and transparency while protecting intellectual property rights.

There is no parallel between the two: gold retains its value, CPUs and GPUs become e-waste after 10 years or so

Love the quality of your videos

Why is the celebrus chip square and not round? Seems to he loosing some of the silicon area.

Backround in what ?

What do think about Tiny Corp and their future Tiny Box ?

The larger chip area must create much more heat hence thermal waste, just my thoughts.

What about photonic chips as the new development trend for GPU or TPU instead of electronic ones?

The new throughput to chiplets tech of hopper looks exciting:) With open source. It will probably be like consoles. Where the company that becomes more consumer friendly dominates.

Towelie of South Park has a TPU

Спасибо за информацию, очень интересно.

Ive been a big proponent of Open Source since desktops first came into the market.

Nicely explain , I was born 1965 now i am 57 years old ten years old than bill gate. when i was at University i am as lecture asst System Information , and Electronic Data Processing

First Comment And First Like.......Love your videos.. I'll watch your Videos and become more intelligent..

Has Apple some in-house super-computer for ai training? The M series arm processors show good performance for that.

Bravo

The watts to do the same ISOwork are the key factor. Cost of the rack much less so. Heat and software difficulty a distant third and fourth place. H100 GPU on TSMC N4 and better tensor cores, chiplet memory, CoWoS is impressive but... When a RISC-V solution on DUV with AMD's parallel franework comes out, itll be far cheaper i exoect.

we are talking about wafer scale computing but the truth is there is barely anything preventing chips at the size of square meters

Talk about AI designing itself, how much of that happens, chipwise?

Hey, supremely tech lady maybe in the future they use some sort of messenger RNA coupled with special types of fluid dynamics to impart AI with some sort of human thought! Maybe it takes a decade or 2 or...!

The flip side of this is that AMD is making serious market shares in the private sector which may have massive implications later in this trend.

I feel like Cerebras can benefit if these bottleneck by selling the GPU's that NVIDIA can't supply yet.

Could you pls explain how much extra energy ( e.g. MG=Megawatt's) is aprox. in future needed to fuel AI ? Elon Musk made a warning about a lack of power plants in US (equal to europe)

AMD Instinct MI300??

GPUs are currency now!

Tensores y transformadores. Los chips se sofistican especializándose en lo que funciona. La función hace al órgano o viceversa.

FYI Grace Hopper: en.wikipedia.org/wiki/Grace_Hopper Grace was a consultant to DEC (I'm a former employee)

very exciting! The real world kinda sucks but the computer world is so promising! cheaper, better, faster... exciting opportunities in tech, beautifully, and organically presented! I don't think she can be replaced with a bot!

I feel that Cerebras direction sounds promising and really hope and wish that AMD catches up with nVidia and ROCm succeeds because nVidia is a monopoly as of now and it hurts of all us

Well right now with NVDA people are assuming massive sales in the future even if the market isn't there for it and the market can't supply what NVDA needs. Good luck with that.

Which sounded fine to me

Will AMD stocks fly too, what do you think? Since NV can not deliver to the demand, the next best will catch up. I just dont see both of them as very stable and predictable. Even more at NV where news been spread way to slow and therefore too late to counter react in case.