Why Computer Vision Is a Hard Problem for AI

Рет қаралды 115,024

Күн бұрын

Computer scientist Alexei Efros suffers from poor eyesight, but this has hardly been a professional setback. It's helped him understand how computers can learn to see. At the Berkeley Artificial Intelligence Research Lab (BAIR), Efros combines massive online data sets with machine learning algorithms to understand, model and re-create the visual world. His work is used in iPhones, Adobe Photoshop, self-driving car technology, and robotics. In 2016, the Association for Computing Machinery awarded him its Prize in Computing for his work creating realistic synthetic images, calling him an “image alchemist.” In this video, Efros talks about the challenges and changing paradigms of computer vision for AI.
00:00 Why vision is a hard problem
1:18 History of computer vision
2:01 Alexei's scientific superpower
3:14 The role of large-scale data
3:37 Computer vision in the Berkeley Artificial Intelligence Lab
4:15 The drawbacks of supervised learning
4:57 Self-supervised learning
5:33 Test-time training
7:08 The future of computer vision
Read the companion article at Quanta Magazine: www.quantamagazine.org/the-co...
- VISIT our Website: www.quantamagazine.org
- LIKE us on Facebook: / quantanews
- FOLLOW us Twitter: / quantamagazine
Quanta Magazine is an editorially independent publication supported by the Simons Foundation: www.simonsfoundation.org/

Пікірлер: 79

@weinhardtadam1159 6 ай бұрын

I love that with 120.000 citations, he is regarding the grad students and the next generation of scientists as his biggest achievement.

@Alex-rh5jo 6 ай бұрын

It's great that there are professors out there that value their students as their greatest achievement!

@ev.c6 6 ай бұрын

I have no idea where you are from, but I have studied in two continents, 3 different universities, and this was my experience in all of o them. Academia is just an amazing world.

@blueAndblack-ec6jk 6 ай бұрын

@@ev.c6then u r lucky that you got this kind of experience bcz mine wasn't.😅

@whannabi 6 ай бұрын

@@ev.c6until some people try to get popular by changing the data and embellishing things. Bad apples yes, but they look the most appetizing until you bite into one.

@leif1075 6 ай бұрын

Hiw do they work so hard for so long and not get bored and tired and frustrated?

@leif1075 6 ай бұрын

@@blueAndblack-ec6jkis working 8 hours a day enough as a grad student so it doesn't have to fucking wear you out or take over your life?

@joaoguerreiro9403 6 ай бұрын

As a computer scientist working in Computer Vision tasks (and other AI applications) for medical imaging processing, this video made me smile :)

@smirnovslava 6 ай бұрын

In a good way?

@azyrael96 6 ай бұрын

Made me smile in the same way. One of the first things my professor told me at the beginning of the phd was that his goal is to make me a better scientist than him. Really nice moment to see this guy so passionate about it as well.

@nutmeg0144 6 ай бұрын

As some random guy sick of seeing these subtle humble brag comments, your comment made me cringe

@joaoguerreiro9403 6 ай бұрын

Next time I’ll be more modest @nutmeg0144 :)

@rijulranjan8514 2 ай бұрын

All they said was that they work in the field and enjoyed seeing the video? The only thing cringe was your response@@nutmeg0144

@brianfunt2619 3 ай бұрын

I love how at <a href="#" class="seekto" data-time="488">8:08</a> one of the students' phone falls out of their pocket and everyone turns and looks at it

@JZFeser 6 ай бұрын

Wonderful video! I love everything this channel has made!

@werwardas1 6 ай бұрын

Thank you for the insights and this very well produced video!

@xXMaDGaMeR 6 ай бұрын

my favorite topic in CS

@greatviktor4017 6 ай бұрын

Love this channel

@MichaelFergusonVideos 6 ай бұрын

Wonderful! Looking forward to the future!

@liangcherry 23 күн бұрын

thank you for explanation!

@BenMitro 6 ай бұрын

All very interesting. I wonder if we are limiting computer vision by only considering human vision. Each other organism has vision selected to make the organism successful, and its not like ours. I wonder if there is something we can learn from this diversity of purpose for visual systems in all organisms. Alexei Efros has touched on this diversity of purpose with his own experience of vision.

@dexterrity 6 ай бұрын

yeah well computer vision in ranges of the electromagnetic spectrum outside of visible light exist. That is more relevant to hardware: how the sensor is detecting light and what range of frequencies etc. Once it becomes image data of whatever kind, the convolutional neural networks do their thing and don't really care about how "humans" see things.

@BenMitro 6 ай бұрын

@@dexterrity There also sonar for bats and other creatures, but I was thinking more about the cognitive processes, although yes, the hardware is certainly required.

@BenMitro 6 ай бұрын

@@TzaraDuchamp Efros made a point of his personal experience with low vision which helped him move forward. I was just proposing that perhaps we could move forward by considering a broader specturm of experience by tapping into animal vision. Its not about how computers currently perform computer vision algorithms, its about learning how we could uncover insights that allows us to enhance or redesign computer vision.

@Siroitin 6 ай бұрын

First problem is that humans are creating AI. We are going to be AI's limit

@BenMitro 6 ай бұрын

@@TzaraDuchamp You misunderstood me - I was wondering if we could get more insight from a broader view. I didn't cast any aspersions on Efros - in fact I admire the man. Maybe reading too much between the lines?

@terryliu3635 Ай бұрын

Love the short video!❤

@QuantaScienceChannel 6 ай бұрын

Read more about Alexei Efros's research in a written interview by Susan D'Agostino on the Quanta website: www.quantamagazine.org/the-computing-pioneer-helping-ai-see-20231024/ Quanta is conducting a series of surveys to better serve our audience. Take our video audience survey and you will be entered to win free Quanta merchandise: quantamag.typeform.com/video

@primenumberbuster404 6 ай бұрын

I am waiting for a video on the progress of Quantum Optics. 😃 I am hoping to pursue research in this field and it has some of the greatest ideas of all of experimental physics.

@brain_respect_and_freedom 6 ай бұрын

Thank you👍

@alirezaahmadi5018 6 ай бұрын

so amazing.😍😍🤩🤩.good luck.

@presence5834 22 күн бұрын

I had an idea when I was working on my thesis that if we have transformer for vision and a new embedding system that treat the visual data like human we can have a model that will understand the images of the universe that is beyond the computer ability of human brains such as the cosmic microwave background. But it’s an idea only😢

@Fine_Mouche 5 ай бұрын

what about use analogue computing in the futur for AI ?

@lilhaxxor 5 ай бұрын

This is a very good interview. I am glad to see that it's validating my intuition, about the fact that models should continuously learn instead to being frozen, and then retrained from scratch. One of the biggest difficulties to improve the current techniques is reducing models size. I don't know how much data a real brain can store, but given the miniaturization of current chips, I suspect we are wasting resouces. Anecdote: I have bad eyesight as well. 😂

@harishhanchinal2838 6 ай бұрын

Nice informative video.

@a4ldev933 4 ай бұрын

Man.. I wish you were my CS professor. 👍

@andrewsun4385 6 ай бұрын

Cool!!!❤❤

@tim40gabby25 5 ай бұрын

Interesting to see the distribution of ethnicities along that outside shot bench.. humans are drawn to those with whom they assume they might have common ground. Just an observation. Might be wrong.

@autonomous_collective 6 ай бұрын

@kylebowles9820 6 ай бұрын

Computer vision is so fun!

@1.4142 6 ай бұрын

AI generated timestamps <a href="#" class="seekto" data-time="0">0:00</a>: 👁 Computer vision is a complex process that is difficult for computers to replicate, but advancements are being made. <a href="#" class="seekto" data-time="176">2:56</a>: 🌳 Visual data and its importance in machine learning and computer vision. <a href="#" class="seekto" data-time="358">5:58</a>: 🔑 Computers struggle to generalize in their machine learning algorithms, but test time training can help improve their performance.

@mihailmilev9909 5 ай бұрын

wow

@mihailmilev9909 5 ай бұрын

Wow

@mihailmilev9909 5 ай бұрын

Were the emojis from the AI too?

@1.4142 5 ай бұрын

yup @@mihailmilev9909

@OBGynKenobi 6 ай бұрын

What about computer audition?

@_soundwave_ 3 ай бұрын

<a href="#" class="seekto" data-time="328">5:28</a> he is so deep inside, he calls us 'agents'

@severusgomez4979 5 ай бұрын

Thumbnail lookin’ like a front foot catch 3 flip

@AyushSharma80001 Ай бұрын

I also have Myopia

@strangevideos3048 3 ай бұрын

the problem is that even if you watch a real video from nature on the screen, it is not real for your eyes, a two-dimensional image plus unrealistic colors of the screen, i.e. resolution..

@ElParacletoPodcast 4 ай бұрын

Computers cannot see, and will never see, they only process information, but will never see.

@bharatjoshi9889 5 ай бұрын

So AI is just data with some selective results from that data ..is it ?

@k-c 25 күн бұрын

Waiting for the day when computer vision beat skills of georainbolt

@kengounited 6 ай бұрын

Computer vision is hard because it's right at the mercy of the so-called curse of dimensionality.

@abursuk 6 ай бұрын

thx for supporting Ukraine

@strangevideos3048 3 ай бұрын

Two minute paper 😊

@enesmahmutkulak 6 ай бұрын

cool and first comment

@PythonAndy 6 ай бұрын

I was early.

@JuliusUnique 6 ай бұрын

We literally have cameras for a few centuries now, making AI learn to "see" is just that, a camera attached to AI processing it, we already feed AI with pics and make it learn visually

@jsmunroe 6 ай бұрын

There are multiple levels of vision. Everything from pattern matching is to recognizing symbols to identifying and interacting with objects. We see mostly with our brains, for instance.

@JuliusUnique 6 ай бұрын

@@jsmunroe I thought it's just having a lot of digital neurons and then letting them figure out the concept of patterns themselves

@Earth-To-Zan 6 ай бұрын

@@JuliusUniquewell usually you train a model on the dataset of images or videos then once it is trained you can test its capabilities by feeding an input image/video that wasnt in the training data now this is just a very simplified explanation and its more complex than that

@ValidatingUsername 6 ай бұрын

Just convert a 2d plane to 3d calculations 😂

@YacineBenjedidia-wm6pw 6 ай бұрын

that's how our brain works converting 3D into 2D then analysing the image

@djp1234 6 ай бұрын

<a href="#" class="seekto" data-time="215">3:35</a> Slava Ukraini

@dronefootage2778 6 ай бұрын

you didn't explain how AI learns to see, like at all, i'm gonna have to give a thumbs down

@-p2349 5 ай бұрын

Panoptic segmentation is to complicated for an eight minute video

@sillystuff6247 6 ай бұрын

stop the insipid background music

@jasperhilliard6289 6 ай бұрын

i don't think it is insipid at all

@fionagrutza9291 6 ай бұрын

Still not "AI" and this exploitation of the term is exhausting. He even admits its about data comprehension ie algorithmic formulations (tiered) and not unprovoked generation which is and was the metric for the term. We have lost the boundaries of what things are so as to cater to branding for $$$

@ItIsJan 6 ай бұрын

yes hype and money!!!

@khalilsabri7978 6 ай бұрын

its exactly AI, what are you talking about? maybe very old Computer vision was, recent research into the domain is all AI. If anything, Computer vision was the field impacted most by AIl, especially in early days of deep learning.

@fionagrutza9291 6 ай бұрын

@@khalilsabri7978 You could then assign any and every computational process as "AI" based on the metrics you and they are suggesting wildly. What was once labeled "bots" with keyword association generative replies are now "AI" bcz every thing has been rebranded to serve a new narrative for profit. AI used to have a requisite to meet in order to be classified as AI, we had science fiction esk tests as thresholds, and if you can claim any of these things just abundantly appearing all of a sudden today meet those standards, then you are a mindless consumer. Image generation from keywords is not AI its is algorithmic compiling. ChatGPT is just search aggregation with a fancy front end. None of these things generate information independent of the user defined rules or software defined boundaries, thus why it is so easy to censor information immediately. As for research, literally nothing has changed.. data is compiled, an algorithmic is authored to seek a model, where is the AI?

@Saturnine37 6 ай бұрын

Unprovoked generation is and was the metric for the term in which field? Computer science, or science fiction and general aspiration? Thinking of early intelligence in single-celled life, a part of it must have been in reacting to light when moving around in the water. Seeing energy, food, and the environment. Is that not intelligence enough for something not alive yet to be able to autonomously sense and react to the world. Artificial intelligence for me should connect all modes of sensing and making inferences into a single place. Then, computer vision is exactly AI in the same sense as computer generation "unprovoked" or not.