Using Haptic Gloves to Control an Amazing Telepresence Robot!

Рет қаралды 163,096

4 жыл бұрын

We go literally hands-on with the HaptX haptic glove to test its integration with an incredibly dexterous telepresence robot by Shadow Robot Company. Using these VR hand controllers, we're able to not only manipulate intricate objects like a rubix cube, but feel the objects we're grasping in a natural and intuitive way! We chat with the makers of this tech to learn how far telepresence robotics have come and what's next.
Shot by Gunther Kirsch and edited by Norman Chan
Additional footage courtesy of Shadow Robot Company and Syntouch
Subscribe for more videos! / tested
Follow us on Twitter: / testedcom
Get updates on Facebook: / testedcom
Tested is:
Adam Savage / donttrythis
Norman Chan / nchan
Simone Giertz / simonegiertz
Joey Fameli www.joeyfameli.com
Gunther Kirsch guntherkirsch.com
Ryan Kiser / ryan.kiser
Kishore Hari / sciencequiche
Sean Charlesworth / cworthdynamics
Jeremy Williams / jerware
Kayte Sabicer / kaytesabicer
Bill Doran / chinbeard
Ariel Waldman / arielwaldman
Darrell Maloney / thebrokennerd83
Jen Schachter / schac_attack
Kristen Lomasney / krystynlo
Intro bumper by Abe Dieckman
Set design by Danica Johnson / saysdanica
Set build by Asa Hillis www.asahillis.com
Thanks for watching!

Пікірлер: 341

@TheMugHoarder 4 жыл бұрын

This is literally the Aperture Science Hands Tech Demo lol

@zeke7515 4 жыл бұрын

With a LOT MORE EXPENSIVE hardware :D. Aperture Hand Labs was a great Knuckles intro. I've used one of these HaptX gloves and they're freakin incredible. Waiting for the day we don't need to be strapped to a table with them.

@captainjames4649 2 жыл бұрын

@@zeke7515 obviously.

@WWIflyingace62 4 жыл бұрын

WHEN DO WE PUT THESE IN A MECH SUIT

@WayaWolf 4 жыл бұрын

Fallout power armor WOOT WOOT!!!

@ernestthelumberjack 4 жыл бұрын

as soon as we can reliably power one I'd imagine

@Deanorama 4 жыл бұрын

This is exactly what I came here to say, I'm just not fast enough.

@vantongerent 4 жыл бұрын

Combine these projects! kzfaq.info/get/bejne/sLKHqKugm5mnaJ8.html

@zzdesolatezz 4 жыл бұрын

@@ernestthelumberjack wrote can power it using a combination of Kanye west's and Trumps ego and narcissism.

@Mitzi_DelverVRC 4 жыл бұрын

I love how close-ups like at 1:44 look stop-motion animated. I know they're not, of course, but it *looks* like it.

@fruitypebbles3047 4 жыл бұрын

Yeah, probably latency/polling matched with super fast motors makes it look stop motion

@zorby9403 4 жыл бұрын

Always impressed with Norm's interviewing abilities. He clearly does his homework beforehand and it shows, teasing out the most useful information and doing his best to make the interviewee shine.

@MrCoffee777 4 жыл бұрын

Seriously Norm, thanks for all the hard work!

@index7787 4 жыл бұрын

His segues are on point as well

@Amitrak 4 жыл бұрын

(HaptX guy from the video here) -- Can confirm: Norm comes prepared, asks thoughtful questions, and shows genuine interest in the tech on and off camera. It was a pleasure working with him!

@Amitrak 4 жыл бұрын

Also can confirm: he nailed the flip cup @4:20 on his first attempt.

@confusedstockimage9807 4 жыл бұрын

Daniel Kennard If you go back a couple of years all of the comments on those earlier videos say that Norm is a terrible interviewer. Funny how times change.

@Mireaze 4 жыл бұрын

Finally, I can flip people off from the other side of the planet.

@Korgann 4 жыл бұрын

(╯°□°)╯︵/(.□ . \)

@TerryTurner 4 жыл бұрын

That would be so awesome. 😂

@jwlandfair 4 жыл бұрын

🖕

@radaroreilly9502 4 жыл бұрын

(Gives finger in Australian) “Sigh, it’s upside down...”

@JackieBright 4 жыл бұрын

tot

@Aaron_Jensen 4 жыл бұрын

Imagine the best surgeons in the world being able to operate from across the globe.

@FMFvideos 4 жыл бұрын

Imagine being able to change diapers from across the room.

@grimsoul0 4 жыл бұрын

@@FMFvideos LOL, Hell yea. I like how you think. 😀

@dshcfh 4 жыл бұрын

Yeah, only for $100,000

@zzdesolatezz 4 жыл бұрын

Imagine using this to masterbate!

@user-fm6op9ur5l 4 жыл бұрын

The internet speed needs working, since a very small delay may be very deadly while providing a surgery

@davidyoung518 4 жыл бұрын

The holy grail has to be able to juggle with them!

@jackren295 4 жыл бұрын

I would say using a pair of chopsticks is equally hard, if not harder.

@1st1anarkissed 4 жыл бұрын

Need to get a pro juggler to try!

@willd6215 4 жыл бұрын

@@1st1anarkissed or just a juggler

@1st1anarkissed 4 жыл бұрын

@@willd6215 well it wouldn't be hard to get a guy who does cool stuff and see how far up the skill grade he can get. i'm sure there's at least 3 decent pro jugglers busking somewhere in that city any given day.

@spectralpiano3881 4 жыл бұрын

It's definitely not the hardest, but I think typing on a keyboard would be interesting to see. In terms of hard to do, I think playing guitar or piano will be quite painful

@Betruet 4 жыл бұрын

How come Norm is such a great interviewer? Flowing questions perfectly pointed follow ups from actually listening. Great video :)

@arturmical 4 жыл бұрын

I wish I could see an artist drawing with a pencil with those arms attached to them and seeing if they can tele-draw this way.

@41tinman41 4 жыл бұрын

Hello, and welcome to Drawfee!

@Duraltia 4 жыл бұрын

I'm intrigued in your train of thought on using THESE gloves and robots arms - highly unpractical - for your given task when instead you could use a - purpose-built - pen and tablet solution hooked to a PC to draw on and then teleprompt the information there to another PC? The WORST solution that might actually work would be to JUST teleprompt the pen in your bare hands instead of THOSE gloves holding a regular pen.

@drewby4701 4 жыл бұрын

@@Duraltia Because it would be cool

@grimsoul0 4 жыл бұрын

You could do one drawing while the robotic hand draws a duplicate. Double your production.

@sirduggins 4 жыл бұрын

@@grimsoul0 Who needs printers? We could have an entire factory of robot arms replicating famous artists drawings as they're being done. Now that is true efficiency.

@AlbertVicol 4 жыл бұрын

Norm, beautiful presentation and interview! Good questions and letting the smart people talk.I Love the video and where it's all going!

@adamwigley9738 4 жыл бұрын

That's AMAZING, I love how advanced technology is getting!

@LegoHero10000 4 жыл бұрын

Dude, Doc Oc will become REALITY

@robbieking4070 4 жыл бұрын

As soon as we connect it to the brain, yes

@fgregerfeaxcwfeffece 4 жыл бұрын

For Doc Oc Tech you are on the wrong video, search for brain interface. Currently the biggest concern are permanent solutions. It works just fine. It's just that your body doesn't like the implants long term.

@zzdesolatezz 4 жыл бұрын

And then so will be the first real life, live action hentai pornstar.

@jwlandfair 4 жыл бұрын

That very slight jitteriness makes them look like they're stop motion animation. And...I kind of love it.

@stonemuzza8311 4 жыл бұрын

These have come so far damn! I’m excited

@TheAprone 4 жыл бұрын

The hands look so much like stop-motion it's crazy! :D I love it

@owensvoboda 4 жыл бұрын

This is literally the Aperature Hand Labs robot

@yaelm631 4 жыл бұрын

I'm late, I made the same comment You get the like for the original

@mikk.t.7824 10 күн бұрын

I thought it was some aperture science portal video until i clicked it

@peterkelley6344 4 жыл бұрын

Incredible advancement. I would imagine these hands would eventually handle non-dry environments. planting plants, aquatic research, etc..

@aic53 4 жыл бұрын

Love the stop motion like movement of the robot fingers.

@dickswingston8854 4 жыл бұрын

It''s like Harryhausen himself animated them! Beautiful imperfections :)

@FMFvideos 4 жыл бұрын

Now I can change diapers!

@fuglong 4 жыл бұрын

Adam absolutely HAS to try to juggle with this!

@MarcusWu 4 жыл бұрын

This is fascinating! One question I wish was asked at the end: What are the particular improvements they feel are necessary to get the full human capabilities they were speaking of?

@Kenoi_ 4 жыл бұрын

Can’t wait for the mech release

@xXYannuschXx 4 жыл бұрын

Aperture Hand Labs 2 is looking great!

@Korgann 4 жыл бұрын

Looks like the Future is drawing closer and closer :D Even if those hands are still pretty clumsy, this is definitely going somewhere. Haptic feedback in a glove is something I'd seen only in movies for ages, and these last years are making it real, that's quite extraordinary. Thanks Norm and Tested for that review !

@jamesoloughlin 4 жыл бұрын

Been wanting to try these HaptiX gloves for like years.

@OkGringoVlog 4 жыл бұрын

That sounds like a good thing for manipulating radioactive material or stuff that cannot be contaminated

@tutorialhuyquang7807 4 жыл бұрын

Wonderful! I love it!

@noahshelton9885 4 жыл бұрын

“Hello. It’s me again , friendly frank. Who you murdered”.

@meaningfulsongspoetry6269 4 жыл бұрын

Love the stop motion

@WayaWolf 4 жыл бұрын

Wow, this is really really cool!!!!

@NewWhirledSlacker42 4 жыл бұрын

Sick T-shirt Norm!

@LIFEOFSTUFFEDANIMALS 4 жыл бұрын

Wow. Just wow.

@DaMadpenciler 4 жыл бұрын

So amazing to see these things in old school anime and see it from the early stages

@r603burakkusuta2 4 жыл бұрын

These gloves are exactly what I need for my mech prototype.

@starplatinum8236 3 жыл бұрын

Sheeeesh, things like this are gonna be crucial for technological advancement

@paulivalo5979 4 жыл бұрын

Univeral Robots probably really liked when Norm called their UR10-cobots "almost like industrial robots" 😂

@deadextra 4 жыл бұрын

About the difficulties of the thumb joint mirroring the capabilities of the human thumb...how about the folded mechanical linkages that have been coming out?

@daughterofmercurymetalwork403 4 жыл бұрын

I wonder if they could hook up a sensor like there are in prosthetic arms that read the electrical signals in your arm to move a prosthetic hand and record the inputs? Might help improve prosthetic hands to be quicker and more dexterous

@loganeasley4343 4 жыл бұрын

Bruh this looks dope

@BLAISEDAHL96 4 жыл бұрын

Fascinating video! I loved hearing what went on to put all of it together. So many great sound bites, makes me super excited for whats possible in the next several years

@ryanmalin 4 жыл бұрын

Imagine the practical uses. Remote Surgury. This is amazing

@xXSinForLifeXx 4 жыл бұрын

Or hear me out PORN

@SorenSackreiter 4 жыл бұрын

Would it be possible to add more arms like these in a backpack and hook them up to the brain?

@000Krim 4 жыл бұрын

Soren Sackreiter Perhaps

@JD2jr. 4 жыл бұрын

Calm down there, Dr. Octavius.

@nathanael2814 4 жыл бұрын

Theoretically, yes

@r603burakkusuta2 4 жыл бұрын

Direct connection to the brain would kill you, use a neural sensor network head mount/cap and shave your head instead.

@JD2jr. 4 жыл бұрын

@@r603burakkusuta2 [citation needed]

@CASAROME 4 жыл бұрын

Amazing

@1st1anarkissed 4 жыл бұрын

This is going to be amazing in gaming, art, so many applications! I know it will also want to be used in some very crucial applications such as surgery or handling radioactive materials or biohazardous materials. I just hope those folks work "hard wired" but I suppose if the connection went down there would be a backup surgeon who keep you from dying while the techs fixed it? LOL Pretty fabulous future, I must say.

@Flyingwigs 4 жыл бұрын

use this for deep ocean repair/exploration along with VR steroscopic vision!!!

@dukenukem6137 4 жыл бұрын

Super cool! 😃

@realvampireblue 4 жыл бұрын

Awesome!!!!

@yuhanzhang2882 4 жыл бұрын

Telepresence robotics wow!

@autumn948 7 күн бұрын

with haptic gloves like these, you could just simulate a controller object in VR, and make it feel and look to the player like they're using whatever controller they want. you could even create entirely new controllers, or simulate an entire arcade cabinet complete with goofy controls.

@arthurschwieger82 4 жыл бұрын

Put a 3D camera about where a head should be compared to the arms and hands and then wear some VR goggles. Then you could be in a different room or even a different city, state, country, planet! Well, maybe not too far away as the latency would become an issue. This could mean doing work on the ISS without an EVA or even from a ground station. Cook tech. P.S. Seems I should wait until the end of the video to comment as you guys touched on this. :-)

@mrmateusz5188 4 жыл бұрын

My idea was to make a robot with the camera and hands, had troubles bout the legs so i decided on wheels but still

@dadsfriendlyrobotcompany 4 жыл бұрын

Haptic gloves and omnidirectional treadmills, we are getting closer to the Oasis!

@bobcrutch8905 4 жыл бұрын

I thought about these gloves/robot hands 20 years ago, ok I didn't know how they might work but I imagined them, my idea is let us say for example a washing machine factory, there could be one guy with the gloves on building a washing machine and 50 sets of arms copying his motions on an assembly line, the beauty of this system is it gives hand built quality to products but production line speed...cheers now

@gmt1 4 жыл бұрын

If you concealed your own hands (behind a sheet or something, or from the view of a VR headset set in a different location), how would that effect the process?

@neoblackcyptron Жыл бұрын

Excellent platform for data collection and feed to the ML model so the arms can start working without human assisting them in the future.

@ubacow7109 4 жыл бұрын

It's amazing how tactile they are, if someone could write an AI algorithm that's tuned and trained with natural human movement you could make some really cool precision robots. If they can increase the polling as well it would be even more amazing.

@gahkak 4 жыл бұрын

Imagine: the world's most technologically advanced reacharound

@The_Wosh 4 жыл бұрын

Nice to see they use a speedcube instead of a Rubik's brand

@-haris-9802 4 жыл бұрын

Can these be combined with valve’s index controllers? To do some offshore virtual robotic surgeries ?

@crywolfe210 4 жыл бұрын

Been hearing a lot of good things about your hands back at the main office. VP of sales, Ted baker, said “Bill, you gotta fly down there and you gotta see these hands” and I said “Ted, you’re lying and you’re fired”. But then I thought, if Ted was willing to get fired over these hands, maybe I better check ‘em out for myself. So here I am. Those. Are. Impressive. Gotta shake that hand.

@Zybit1423 4 жыл бұрын

With the close ups of the arms around 1:36 it looks like they’re from one of those 1970-80 movies with stop motion because there was almost not CG or at least not competent CG.

@TheKhairulredzuan 4 жыл бұрын

Use this technology for future Vr games

@KillerTacos54 4 жыл бұрын

This is mental

@benlee5039 4 жыл бұрын

This has so much potential. Military personnel can control robots of warfare without ai.

@1theheightofparadise 4 жыл бұрын

I can already see the future, Chambers that have a 360 degree treadmill as well as these haptic controllers and vr hesdsets, use this tech with the robotic tech in the video and you can have a remote controlled warrior that we can send overseas

@1theheightofparadise 4 жыл бұрын

Or instead of a vr headset you could have a display that wraps around the outer edges of the chamber and have a few cameras on your robot warrior so you can see what the robot sees

@Luchoedge 4 жыл бұрын

The way the robot fingers move is really cool. Like, Super fluid but at the same time twitchy.

@techbro_4309 8 күн бұрын

Jaeger Mech Technology might be closer than expected!

@AttilaTheHun333333 4 жыл бұрын

impressive

@WindFireAllThatKindOfThing 4 жыл бұрын

Oh someone is going to get MeToo'd controlling these by remote for certain

@quodkrkn3680 4 жыл бұрын

Future: Ok google take my shirt

@Aleph-Noll 4 жыл бұрын

thats neat, wonder what the tech will be like in 20 years

@knallkul 4 жыл бұрын

Good morning Hal

@OscRos03 4 жыл бұрын

Hopefully full body and more accurate

@Joddythebong 4 жыл бұрын

Now For the rest of ready player one to be made

@ruwellsalatan7774 2 жыл бұрын

every invention becomes a weapon at some point, imagine this being implemented on a 10-meter tall mobile suit, being piloted inside or controlled remotely using a custom VR set up, then say "oh, this robot is for dancing"

@paradigmcustomscales7832 4 жыл бұрын

It looks like they are using a pneumatic or hydraulic fluid system to achive the small points of tactile feedback. Would it be more responsive to use an ER fluid within a confined layer of nitrile with a electromagnetic matix of pathways embedded in it. This should allow for much faster response time in the system and have greater potential to scale up the system. Potentially allowing a set of giant ands to be controlled to move large heavy objects. Possibly is response to large scale catastrophes like a building collapse.

@lordcrayzar 4 жыл бұрын

The way the fingers twitch looks like stop motion.

@jamesbarisitz4794 4 жыл бұрын

How do you keep slam dunking videos back to back Norm? 👍

@anasqai 2 жыл бұрын

Maybe if a A Memory Movement(a Macro) can be repeatitive for maybe a factory of "always same needs at the point" to use robots will be faster? Just an idea.

@LordGrotesk 4 жыл бұрын

But does this mean you'd be able to tickle yourself? On a related note, are the hands scalable?

@Zybit1423 4 жыл бұрын

Omg, Giant robot hands.

@petsan97 4 жыл бұрын

Whelp, one step closer to playing Rock 'em sock 'em with Jaeger's

@janoskis4727 4 жыл бұрын

well hand tracking comes early next year for Oculus Quest. without any gear.

@nindjayy 4 жыл бұрын

2019: Cybernetic Touch sensitive machines. 2039: SAO

@user-fm6op9ur5l 4 жыл бұрын

Imagine how much firefighters’ lives could be saved if this was invented earlier.

@paul4105 4 жыл бұрын

Imaging slapping someone on the other side of the world and actually feeling it in your hand 😮

@MassLox 4 жыл бұрын

I just realised why they have that foot switch... you ever seen in VRchat type games when someone moves in an unexpected way that the controllers aren't quite sure what to make of? and so the character models hands flail around wildly for a second?... god damn, imagine those robot arms swinging around suddenly and knocking out the pilot.

@MrManta2012 3 жыл бұрын

Adam we miss you.

@con.x 4 жыл бұрын

So funny enough... this would be a perfect use of technology to do Telepresence Massage in the age of COVID19.

@Nekotaku_TV 4 жыл бұрын

Maybe in 50 years this will be in people's homes and work almost perfectly. ToT

@curdledstraw227 4 жыл бұрын

reminds me of that portal 2 vr game

@kemphoss-4791 4 жыл бұрын

Kinda sad they don't let you smash through tables yet

@index7787 4 жыл бұрын

Kemphoss - It can though

@vacant4 4 жыл бұрын

@@index7787 The first thought I had when I saw the hand shake was him just obliterating his hand within the lethal grips of the robot arm. Though the likelihood is they have actuator constraints and even more likely is that the fingers are weak.

@swavyts1355 4 жыл бұрын

Reminds me of the robot in avatar

@jack0cat 4 жыл бұрын

In combination with the VR on a deep sea research vessel with a ROV you could explore the titanic and other sunken ships.

@narrator3682 2 жыл бұрын

All I'm thinking, with this technology after a bit we could make giant robots just like in Titanfall that we could control just by moving.

@KimsLantern 4 жыл бұрын

I just crapped my pants. Holy shat. This is also terrifying.

@ViniSocramSaint 4 жыл бұрын

WAIT! Hold up a tad! Fingerprints are important to amplify vibes, helping us differentiate surfaces? Wasn't expecting this kind of knowledge from a video about bots

@ViniSocramSaint 4 жыл бұрын

Wonder what would be the "perfect fingertip" for "seeing with hands"

@rdmcfoxinator2131 4 жыл бұрын

This video reminds me of the Big Bang theory episode where someone gets a robotic arm stuck on their little man

@weswright7888 3 жыл бұрын

Soon they’ll have a whole robot controlled by these things, head movement, hands, legs, hips etc. You can just strap all up your gear and get on a circular treadmill or whatever they have, and power up the robot and you’ll be able to live through the robot out and about in the world, go out to eat, go on roller coasters, travel to the moon, all while sitting in your living room safe and sound

@asterlofts1565 4 жыл бұрын

If we could apply this to any virtual reality game ... such as Boneworks or Half-Life: Alyx ... or Pavlov VR, Onward VR, Blade & Sorcery, Compound VR, H3VR or the current Walking Dead game for VR ... it would be great ...

@isaboll1 3 жыл бұрын

now imagine the same tech being used to control the arm on spot

@SerCaliber 4 жыл бұрын

*Reel Steel Shadowboxing intensifies*

@thebatter2127 4 жыл бұрын

Now we wait for the Nintendo power glove 2.0

@mmseng2 4 жыл бұрын

I legitimately enjoyed the video and I'm not holding it against him, but it kinda looked like Rich.exe stopped responding when Norm started addressing questions to Jeremy (13:42).

@tomnewsom9124 4 жыл бұрын

That's standard behaviour for this model :)