How AI 'Understands' Images (CLIP)

How AI 'Understands' Images (CLIP) - Computerphile

Рет қаралды 181,737

2 ай бұрын

With the explosion of AI image generators, AI images are everywhere, but how do they 'know' how to turn text strings into plausible images? Dr Mike Pound expands on his explanation of Diffusion models.
/ computerphile
/ computer_phile
This video was filmed and edited by Sean Riley.
Computer Science at the University of Nottingham: bit.ly/nottscomputer
Computerphile is a sister project to Brady Haran's Numberphile. More at www.bradyharanblog.com
Thank you to Jane Street for their support of this channel. Learn more: www.janestreet.com

Пікірлер: 257

@michaelpound9891

As people have correctly noted: When I talk about the way we train at

@uneasy_steps

I'm a simple guy. I see a Mike Pound video, I click

@lucianoag999

So, if we want to break AI, we just have to pollute the internet with a couple billion pictures of red cats with the caption “blue dog”.

@orange-vlcybpd2

The legend has it that the series will only end when the last sheet of continuous printing paper has been written on.

@adfaklsdjf

thank you for "if you want to unlock your face with a phone".. i needed that in my life

@beardmonster8051

The biggest problem with unlocking a face with your phone is that you'll laugh too hard to hear the video for a minute or so.

@edoardogribaldo1058

Dr. Pound's videos are on another level! He explains things with such passion and such clarity rarely found on the web! Cheers

@eholloway

"There's a lot of stuff on the internet, not all of it good, I should add" - Dr Mike Pound, 2024

@chloupichloupa

That cat got progressively more turtle-like with each drawing.

@pyajudeme9245

This guy is one of the best teachers I have ever seen.

@thogameskanaal

I feel the term 'GPT' has lost it's coolness factor since OpenAI lit the world on fire...

@aprilmeowmeow

Thanks for taking us to Pound town. Great explanation!

@MichalKottman

9:45

@bluekeybo

The man, the myth, the legend, Dr. Pound. The best lecturer on Computerphile.

@skf957

These guys are so watchable, and somehow they make an inherently inaccessible subject interesting and easy to follow.

@rigbyb

6:09

@TheRealWarrior0

A very important bit that was skipped over is how you get an LLM to talk about an image (multimodal LLM)!

@Shabazza84

Excellent. Could listen to him all day and even understand stuff.

@musikdoktor

Love seeing AI problems explained on fanfold paper. Classy!

@wouldntyaliktono

I love these encoder models. And I have seen these methods implemented in practice, usually as part of a recommender system handling unstructured freetext queries. Embeddings are so cool.