See invisible motion, hear silent sounds. Cool? Creepy? We can't decide

See invisible motion, hear silent sounds. Cool? Creepy? We can't decide | Michael Rubinstein

Рет қаралды 318,281

9 жыл бұрын

Meet the “motion microscope,” a video-processing tool that plays up tiny changes in motion and color impossible to see with the naked eye. Video researcher Michael Rubinstein plays us clip after jaw-dropping clip showing how this tech can track an individual’s pulse and heartbeat simply from a piece of footage. Watch him recreate a conversation by amplifying the movements from sound waves bouncing off a bag of chips. The wow-inspiring and sinister applications of this tech you have to see to believe.
TEDTalks is a daily video podcast of the best talks and performances from the TED Conference, where the world's leading thinkers and doers give the talk of their lives in 18 minutes (or less). Look for talks on Technology, Entertainment and Design -- plus science, business, global issues, the arts and much more.
Find closed captions and translated subtitles in many languages at www.ted.com/translate
Follow TED news on Twitter: / tednews
Like TED on Facebook: / ted
Subscribe to our channel: / tedtalksdirector

Пікірлер: 256

@lisaboulton2887 9 жыл бұрын

It would be interesting to see if magnifying the image of people in comas might lead to finding signs that indicate the patient is actually still "in there" somewhere.

@warpspeed8305 4 жыл бұрын

fMRI or BCI. With BCI it's even possible to communicate with patient. There was some video on this subject.

@DEO777 9 жыл бұрын

If this technology was available in the 80s and 90s, we could have detected that Milli Vanilli was lip syncing and saved the people from buying their albums.

@MrVinceq 9 жыл бұрын

Lol, it scarred you deeply ?

@DEO777 9 жыл бұрын

David Munoz Milli Vanilli did more than just lip sync, they never sung the songs ever.

@codebeat4192 6 жыл бұрын

Haha, good one! bullseye! haha.

@EnriqueHJ 3 жыл бұрын

Jahahaha

@MuadDib1402 9 жыл бұрын

This kind of thing is the reason we watch TED talks. Amazing.

@Kaizerg 9 жыл бұрын

Note to self: Don't talk about important things in a room with empty chips bags laying around...

@warpspeed8305 4 жыл бұрын

If subvocal recognition works with video -- note - don't talk to yourself :-) even if you don't open mouth.

@brentfisher902 4 жыл бұрын

If you tell about an important gory political event, it might never be able to happen. Loose lips sink ships.

@E-99x 4 жыл бұрын

This will be ground breaking for solving crimes that were committed where surveliance recorded situations regarding murder, rapes, and abduction where the camera had no sound.

@xponen 2 жыл бұрын

it cannot be used with camera that don't have HD and high-speed/high-frame-rate function, so it cannot be used for old surveillance footage.

@MedEighty 9 жыл бұрын

I saw the talk about this a year or two ago and I was very impressed. Now I'm impressed all over again.

@tarassu 9 жыл бұрын

That same sound extraction technique was used in science fiction movie "Eagle Eye". I was pretty sure that extracting sound from vibrating water in glass was somehow even possible. Now I see the result.

@elloboblanco9111 9 жыл бұрын

WOW! I'm blown away with this... the speech recognition from objects is awesome! Technology really is becoming incredible.

@fidelio1991 9 жыл бұрын

Science gets more and more stunning. I dream of incredible possibillities in 100 years and on...

@MedEighty 9 жыл бұрын

This isn't science. It's engineering. As in, the application of science. There's no new science here. It's an application of known science in inventing new and impressive technology.

@matbroomfield 9 жыл бұрын

I think that George Orwell's vision of the future will not be a fraction as bad as the real future.

@5to22a 9 жыл бұрын

Mat Broomfield Unless we get rid of the state, then things will be awesome.

@fidelio1991 9 жыл бұрын

MedEighty Doesn't really matter... i mean every aspect of progress happening in these days. It's a real pleasure for me to be part of an age, where humans once may be able to fight cancer or other dieseases and fly to other planets and settle down... that's what I'm talking about. Nobody would have thought this to be possible 60 years ago.

@fidelio1991 9 жыл бұрын

becool365 -.- It's clear to me, that most of the things have been thought about way earlier, but the speed with which inventions are made, is admireable... Dreams are no longer just dreamed but made or will be made possible to become reality (sorry for mistakes - I'm not a native speaker)

@mamundavidebneahameddornse7407 9 жыл бұрын

This is brilliant use of creativity! Hats off to the team that made this possible! (y)

@sandrisaug 3 жыл бұрын

To recover a sound from video you need to take that video with hi-speed cameras with frame rate at least 12000 hz.

@yurikolovsky 9 жыл бұрын

Amazing!!!!!! Best TED talk in a while!

@codebeat4192 6 жыл бұрын

In one word: Speechless. Amazing. Mind Blowing.

@Deusmecumest 9 жыл бұрын

Wow, Wow, Bravo. What an amazing breakthrough. What a amazing limitless application of science.

@Bluemoondm1 9 жыл бұрын

Pretty incredible. Will make people even more paranoid though (maybe rightly so?)

@MedEighty 9 жыл бұрын

Shhh! Close the blinds. Someone might be listening. :D

@shadowx089 9 жыл бұрын

MedEighty The vibration from the blinds would be the speaker.

@Bluemoondm1 9 жыл бұрын

Given the right light, the window itself would probably be an amazing speaker

@MedEighty 9 жыл бұрын

shadowx089 You're right. Bluemoondm1, if you want to say something, just text it or send it by brain waves.

@FranktheDachshund 2 жыл бұрын

Recovering sound from video is just amazing.

@luis96xd 5 жыл бұрын

Wow, this technology is so amazing! Thanks for this video!

@HangOn2seconds 9 жыл бұрын

This is amazing!!! I wonder if the video has to be hd quality?

@Chronomatrix 9 жыл бұрын

Mind blown, this is incredible.

@olliloco 9 жыл бұрын

Thanks for sharing.. And darn good work.. :-)

@nubeslocas 9 жыл бұрын

Best idea I've seen in years!!! Awesome!

@FELICIENRo 9 жыл бұрын

BRAVO and thank you.

@RSP13 9 жыл бұрын

Talks like that make me love TED

@amortalbeing 3 жыл бұрын

Magnificent work. loved it

@BEPrimAnim 9 жыл бұрын

This gives me an idea of a microphone made of some material super sensitive to motion, so it can record the sound in nearly perfect quality. This is like something from a sci-fi movie!

@rickysukhi 9 жыл бұрын

so fascinating !

@IdioticPlatypus 9 жыл бұрын

i bet if we pointed this at stars and star systems, we can enhance how much they wobble so we can see which ones have planets without having to watch them for months.

@JackassJimbo 9 жыл бұрын

This is amazing, cant wait to see what this will develop into! I really wish I could live several hundred years sometimes just to experience what the future will be like :/ Hurry up science, I dont have forever you know!

@v-22 8 жыл бұрын

Just so you know, if you live for the next 50 years, you will have forever.

@nikkibridgewater4223 2 жыл бұрын

Well you dont have to long none of us do hope your right with jesus christ everyone needs to repent if they didnt already

@eeyoresbutt3747 2 жыл бұрын

@@v-22 Explain your statement please.

@v-22 2 жыл бұрын

@@eeyoresbutt3747 In 50 years, things will have progressed to the point where we should have achieved immortality. Life expectancy is going to increase exponentially, until it reaches infinitum, death will be optional. Printed organs, nano bots, crspr, being uploaded to some virtual reality, this is just the beginning.

@MarkKislich 9 жыл бұрын

Very HIGHLY interesting.. Shared left right and center.

@Mink0twink 9 жыл бұрын

I want this tech in realtime goggles, oh the possibilities.....! lol

@warpspeed8305 4 жыл бұрын

lie detector built inside google glass or something similar.

@heyolast4464 9 жыл бұрын

Amazing!!! just WOW!

@kulovsky1 9 жыл бұрын

This is so awesome!!!!!!

@joshjeggs 9 жыл бұрын

most of the sound clips were unintelligible if you didn't know the original clip. but this is still stunning Would love to go back to those scilent black and white videos and recover some remarkable insights.

@acekel7040 9 жыл бұрын

Awesome video just one question how would this technology work in environments such as outdoors. For example does wind obscure an objects reaction or light may be modified by angles of sunlight?

@ShaiBarack 9 жыл бұрын

Fantastic!

@Anakele20 9 жыл бұрын

I'm in awe. This is so incredible. I'm just stunned at the brilliance...between this and sending signals via lasers...this is an exciting time to be alive.

@AaronHendu 3 ай бұрын

I have been messing with increasing color saturation in my photography to extreme levels, revealing a the full spectrum of intense coulor hidden behind the neutral exposure of our vision. Even a bland nearly gray scale scene is full of color variation and intensity. It is quite unteresting to wonder how other eye systems are able to interpret the same scenes.

@jhe9521 Жыл бұрын

would've been cool to see HOW crisp packet movement was translated to sound ~ all else was explained wonderfully, but on that we had to take a leap of faith...

@DmitryShevkoplyas 2 жыл бұрын

Brilliant!

@Kris_A 9 жыл бұрын

This is all very awesome, it really is; in trustworthy hands. But in the future... when those armed robotic drones are hunting you down for a parking violation or stealing a can of beans to feed your starving family, and you hold your arms up and go *shhhhhhh!!!!* And in a quiet whispering voice you tell everyone to "stay as still... and as *quiet* as you can"... ...The machines will see your slightest movement. The machines will tell that you aren't *reeeeaally dead* as you fake it on the ground. They will magnify your every sound, and can see you piss your trousers at a mile away.. The machines will see all, and you will not escape. Or something like that. If that doesn't frighten your pants off, I don't know what will. :) Sidenote: I keep making these quips about this kind of thing, and non of them are actually funny because of the cold and unfortunate reality opening up before our very eyes. There are some great robot killer terminator film concepts in there though :P

@ShoaibKhan 9 жыл бұрын

Reminds me of the movie "Eagle Eye" where an super smart AI 'listens' to a secret meeting by just observing the sound waves produced in a glass of water placed on a table.

@katiekawaii 9 жыл бұрын

Incredible. Absolutely incredible.

@buddy77587 9 жыл бұрын

Fabulous!

@AlexDings 9 жыл бұрын

I haven't seen anything this brilliant AND this creepy in a long time. One should be very careful in saying that something will change our world, but I think that's quite possible to happen here.

@sallysassa 9 жыл бұрын

That's brilliant. I see many applications. Just wondering if Steve has a tooth issue lower left jaw at 1:31.

@steffahn 9 жыл бұрын

I would like seeing actors playing dead bodies breathing, moving slightly or showing pulse.

@wyrwshwsrey463y 9 жыл бұрын

thats absolutely brilliant- science is so awesome

@RavenJay 9 жыл бұрын

Amazing

@TheLazyKey 9 жыл бұрын

I'm gana have to try this out...

@vaibhavshoran 7 жыл бұрын

amazing!

@AtamMardes 9 жыл бұрын

Interesting. Laser devices already exist that convert vibrations from a window into audible sound. The video sound detection and laser sound detection can be utilized depending on conditions. The laser detection system can be used to detect sound from the window where windows are covered by a curtain where video cannot see the potato chips bag. The video sound detection system can also be used to detect sound out of curtain vibrations.

@Ponk_80 4 күн бұрын

I wish that this would have become popular, sadly I can’t find any news about it.

@saxyboyraw 9 жыл бұрын

this is huge. it basically gives everyone a sixth sense worth of information on everything ever video recorded.

@3dsman 9 жыл бұрын

Very cool!!

@ybefutile 9 жыл бұрын

Amazing.

@mastereymaster8180 4 жыл бұрын

Amazing technology wow

@JohnBastardSnow 9 жыл бұрын

This is extremely impressive. I've heard of people using infrared cameras as a remote lie detector to assist capturing facial micro-expressions (Paul Ekman aka Lie To Me style). And that was YEARS ago. In the future, an average Joe will be able to gaze into your soul. They will see your involuntary muscle micro-reflexes. They will know your pulse, your breathing rate, perspiration. With the addition of molecule sensors, they will be able to perceive your biological processes; imagine small amounts of molecules smelling as distinct as an onion breath or as hydrogen sulfide. I think that interesting social patterns can arise, when your body will give more honest signals than your words or appearance; and when you can perceive so much more.

@sidneyhart6221 9 жыл бұрын

Thanks science dudes. This is truly awsome tool.

@bruney6 9 жыл бұрын

Wow!! So cool, do you think the NFL could use this to watch players before the ball snaps to uncover what is the likely play they will play based on their micro actions?! :)

@YosuaSimanjuntak 9 жыл бұрын

This is waaaaay tooooo coooool!!!

@potemkin505 9 жыл бұрын

Best Ted Talk I've seen

@250108 9 жыл бұрын

This is totally amazing.

@avedic 9 жыл бұрын

Sometimes I'm so happy to be alive now. We don't realize just how lucky we all are to be born at a time where we get to come of age....the same time the human race is exponentially coming of age. We get to live during the elbow of that curve....the _most_ exciting time. Also the most potentially frightening and stressful time. Lots of challenges ahead. But, human's innate desire to learn, connect, create, and dream is what gives me my sense of long-term optimism & hope.

@nikhilkumarm7445 9 жыл бұрын

Awesome ...

@madmark458 9 жыл бұрын

Super amazing you might be able to get back your relatives speeches as well. amazing

@rorychin8670 4 жыл бұрын

Amazing technology! Out of curiosity, has anyone used this on supposed paranormal entities captured on video?

@jamesdonaghy6758 4 жыл бұрын

Bet the 3 letter agencies LOVE this ; )

@woobiesftw 9 жыл бұрын

I imagine this is how fictional cyborgs like Seven of Nine and RoboCop monitors another character's heart rate and stuff. If they turn this technology on every piece of silent historical footage, we might learn some very interesting and shocking things.

@alekseyalexej9665 3 жыл бұрын

Where can I get software to enhance the visibility of motion in the frame? (required to solve technical problems)

@Telleryn 9 жыл бұрын

Wish they'd provide some relevant links in the description

@Mike165987 9 жыл бұрын

what kind of video quality is needed in order to extract the information needed for this software? Do they all have to be high FPS films?

@kingofmaiars 9 жыл бұрын

Oh boy. "Samaritan" will definitely want a piece of this technology. I see this advancement implemented to the story of POI.

@pseudonym4893 9 жыл бұрын

I think it has already been used in POI by The Machine in earlier episodes. I also saw it in the movie Eagle Eye and thought it was total bullshit, but boy was I wrong.

@venusmarina 9 жыл бұрын

Super!

@rogue_spirit 7 жыл бұрын

The second part about sound is the same principle in the movie Eagle Eye when the computer records the Defence secretary discussion from the vibrations in his cup of coffee :)

@ICOD73 9 жыл бұрын

8:59 that girl looked too amazed

@MaxLohMusic 8 жыл бұрын

12:40 mind = blown

@sam-zy2dn 4 жыл бұрын

I wonder how the filter setting are selected to reduce the noises. Also what are the nature noises that he speaks about . Is it like noises due to movement of camera or what?

@religiondestroyer 9 жыл бұрын

wow!

@TheHellz0r 9 жыл бұрын

This is amazing......but I see it becoming very sinister, very quickly loooooooooll

@Dishmab 9 жыл бұрын

This is really fucking amazing

@ihategoogle2382 9 жыл бұрын

This reminds me of an episode of Fringe. Gosh I miss that show!!

@christophhenninger6440 9 жыл бұрын

My first thought about the audio-thing was: Hey, we could use it to see what those referees are talking to the players.

@Mastikator 9 жыл бұрын

This is beyond science fiction!

@misbahashraf961 3 жыл бұрын

Plz describe how image processing can b used in silent sound technology ?

@fudanchu8436 9 жыл бұрын

Wow, covert operations will *love* this tech - if they don't have it already.

@kessu83 3 жыл бұрын

since the 70s they can even read your PC screen with just an antenna on another room.

@itsjustmedanny 9 жыл бұрын

The possible applications will lead to incredible discoveries! Paranormal activity anyone?

@IreneEnriquez 9 жыл бұрын

Cal Lightman would love this technology. :D

@knolly57 9 жыл бұрын

Listen in on the people in the Space Station just by pointing a telescopic camera and hear them talking - without the need for radio.I suppose to make it 2 way, the Space Station crew would need a camera of their own - so Hasselblads are out.

@HangOn2seconds 9 жыл бұрын

Where is the link TED?

@sentmode 7 жыл бұрын

Use this camera and video tape those moving relics in Egypt.

@Cars701 2 жыл бұрын

Skynet will love this. Thanks

@RunescapeGod 9 жыл бұрын

All I know is that with this technology those "ghost hunter" shows will be permanently put to rest or will become very big.

@iviewthetube 9 жыл бұрын

Wouldn't you need 3000 video frames per second or more to get any reasonable sound resolution from this technique?

@Zencarbine 9 жыл бұрын

Most amazing

@truedeadandlife 9 жыл бұрын

Omg. The world has changed, biggest innovation since THis!

@breaneainn 9 жыл бұрын

You could process scenes in movies and recover the directors cues and instructions.

@MonsterSlayer14 9 жыл бұрын

That's amazing. They should get a Buddhist monk meditating and see if they can literally still themselves from motion.

@battmarn 9 жыл бұрын

The exaggerated motion is kinda trippy

@acdcrules0896 9 жыл бұрын

We need to put it in contact lenses and be able to have multiple views. iPhone app gives you options. Satellites, microscopes, heat seaking, night vision, telescopes, our normal eyes, a mechancial fly following you so that you could see in third person through your eyes, and this one. This is crazy.