"computation time takes 10 minutes..." Oh okay "...per frame" Oh
@JealouseStatement3 жыл бұрын
**chuckles at blender rendering a 2hours and 40 min video**
@blackshard6413 жыл бұрын
I've been making CGI since the late 90's, and ten minutes per frame isn't that far off the kind of rates I dealt with all the time. Mind you, that was for scenes with fewer than two thousand polys, 3-4 maps at the most, super simple IK skeletal deformation, and some linear motion blur. Zero physics simulation. So... ten minutes per frame for flawless simulation of hands? I'll take it!
@squishy46453 жыл бұрын
It's just a google slide show at that point
@cgGreenstar3 жыл бұрын
im rendering 30 minutes per frame in lightweight scene
@radar07203 жыл бұрын
It sounds bad, but if you create a piece of hardware (FPGA/ASIC) that's dedicated to these calculations, you can bring that time down to manageable levels.
@bex23 жыл бұрын
The hand massage footage may be the most realistic looking cgi I’ve ever seen
@georgerussell29473 жыл бұрын
certainly, the best ratio between realistic and hard
@pvic69593 жыл бұрын
my brain was saying "real hand" but my brain was also saying "but wait this isnt real" so it came to "cant compute" lol
@StiekemeHenk3 жыл бұрын
That part blew my fucking mind! I didn't expect it to reconstruct skin stretching and wrinkles!
@martiddy3 жыл бұрын
The UE5 CGI reenderings are pretty realistics too.
@michelkliewer39963 жыл бұрын
You may have, but you wouldnt have noticed it because it was so good :D
@SuperWiiBros083 жыл бұрын
This is freaking amazing, it shouldn't take too long for this algorithm to be optimized to run in real time smoothly
@tommybazar3 жыл бұрын
Optimizing is haaaaard :) But with enough smart people throwing their sweet, university funded PhD time at this, we might get to see it sooner rather than later.
@fayezsalka3 жыл бұрын
You also need 124 cameras capturing the hands from every imaginable angle every frame to make it work (that was the setup used for the results you see)
@Twiddle_things3 жыл бұрын
Why are you everywhere?!
@EvilEtho3 жыл бұрын
I can also see them dropping the detail down alot for real time use. As the hands won't be as visible from a distance, so they can lower the polycount down to save time
@someoneunusual71863 жыл бұрын
Imagine how many stuff you could use with these VR hands The "We are in the future, old man!" quote really fits in
@Vareckes3 жыл бұрын
Me at 3am watching this random video and not understanding anything: I like your funny words magic man
@snooppp88733 жыл бұрын
I don't understand it but i can feel it
@moussetache3 жыл бұрын
Wait. That meme was 5 months ago??
@jay-yg2nh3 жыл бұрын
@@moussetache haha i was thinking the same thing
@dnh3433 жыл бұрын
Hahaha same but it's 2am for me :)
@Bisqwit3 жыл бұрын
I would be interested in knowing how the camera/lighting quality affects the algorithm outcome.
@Masonova13 жыл бұрын
I would love to see how this method performs under increasing levels of "silhouette-ness" with the captured footage. It has 2 cameras, so perhaps it doesn't necessarily *need* all that much color detail to reconstruct depth information?
@ArnaudMEURET3 жыл бұрын
OMG Bisqwit! Stumbling upon this comment made me realize YT must have unsubscribed me from your channel! 🤬
@MindfulVR3 жыл бұрын
Probably not much req unless in a dark room or very dim lighting. Suppose the dual cameras setup may req a higher res capture though. e.g. at least 4096px x 2160px @ 30 FPS per camera. All data streams goes into post-pocessing after capture. Anything of lower Res can’t yield such result.
@dial26163 жыл бұрын
I own an Oculus Quest, and while it's certainly not a top-of-the-line VR headset, it does have basic hand tracking that works similarly to the one in the video (stereo vision + ml). In my experience, a relatively well-lit room is pretty integral to the experience. While I don't need my lights at full-blast to use the feature, it certainly helps the tracking accuracy.
@dial26163 жыл бұрын
@Zwenk Wiel IR isn't necessarily a solution here though, I doubt you could get a 72+hz IR camera working at a high enough resolution to facilitate it.
@humter3 жыл бұрын
dang, i was really hoping i could finally have a virtual hand-washing simulator :(
@Abossow773 жыл бұрын
two more papaers down the line ;)
@commenturthegreat29153 жыл бұрын
A man can dream though, a man can dream...
@asdasd-pf1vc3 жыл бұрын
Leapmotion work with handwashing
@Klaster_13 жыл бұрын
Maybe one day I'll finally make a competitive hand drier video game I had in my mind for years.
@Fanaz103 жыл бұрын
finally you can wash your hands in VR after watching dirty videos
@teriyakipuppy3 жыл бұрын
3:28 imagine that happening during VR surgery
@ErtugrulK3 жыл бұрын
Oops doc accidentally cut your brain oops 😡😡😡
@muffins99173 жыл бұрын
This really makes me appreciate the ultimate realism of the physical world.
@Hawky29472 жыл бұрын
Personally, I'm not fan of hardcore survivalism with instadeath enabled.
@Zeekar3 жыл бұрын
I was staring in disbelief until the computation times were mentioned, but this is still a marvel to behold. I can't wait for the next advancement or two. 🙏
@watcherofvideoswasteroftim57883 жыл бұрын
Agreed, that was the only thing that let me keep my sanity
@kraftykactus10283 жыл бұрын
if this had been real time I don't even know what my reaction would be!
@DanielMK3 жыл бұрын
@@watcherofvideoswasteroftim5788 insanity scheduled for two papers down the line
@sigma_043 жыл бұрын
I sense some serious work for quantum computers here.
@coldlight96473 жыл бұрын
But that means its real, and with ever-evolving hardware and optimization of software, we can get this in real time some day. i wouldnt be suprised if it was thing in the next 15-20 years.
@razvan14353 жыл бұрын
They made heaven for Italians to talk to each other
@dislike__button3 жыл бұрын
Not a single italian gesture in the demo, I'm disappointed.
@davide6013 жыл бұрын
I'm Italian, this video moved me to tears.
@waltersmidnightshack40633 жыл бұрын
@@davide601 @Davide Dutto Could you upload a video please? I don't quite understand what you're saying
@kylebowles98203 жыл бұрын
🤣
@trabaregocer3 жыл бұрын
Computers can now fully support Italian language.
@johnmck053 жыл бұрын
I really got to “Hand” it to them, this is incredible
@kelpdock89133 жыл бұрын
,t 100
@dactorwatson43133 жыл бұрын
Karoly, your optimism and passion is so refreshing in the current state of everything. Thanks so much for this channel and all the effort you put into it.
@TwoMinutePapers3 жыл бұрын
I tried to hold on to my papers but my fingers went 3:27.
@engineerbot3 жыл бұрын
Fingers gone
@Sekir803 жыл бұрын
Well played, Sir! :D
@ephraimcullen3 жыл бұрын
Maybe you can hold on to them... but once your fingers melt together you can never let them go! Mhehehehe...
@Zakoyo3 жыл бұрын
that's what you get for holding tooo hard! :D
@blu0x7d123 жыл бұрын
u made me see it againn!!
@Maxjoker983 жыл бұрын
Can't wait till the frame times are in the ms, so I can finally give somebody the finger and properly slap people in VR.
@BattousaiHBr3 жыл бұрын
god imagine this in VRchat, people would kill for this sort of accuracy.
@ThePlacehole3 жыл бұрын
you'd need force feedback gloves. Can't wait for Immersion to patent troll them...
@komposten3 жыл бұрын
Already doable. 😉 Take a look at Leap Motion/Ultra Leap. Their hand tracking has been ridiculously good for years, with 120 fps update rate, and can be used in e.g. VRChat if I'm not mistaken. 🙂 (Though, they can't handle hand occlusion and hand interactions too well yet. And we're not getting awesome 100k polygon meshes!)
@chaosfire3213 жыл бұрын
Current hand tracking can let you give someone the finger just fine, even with controllers. But this research, once computation times are shortened, can increase the fidelity of movements, especially with both hands interacting with each other.
@jearlblah51693 жыл бұрын
@@chaosfire321 i too want to give people the finger in high fidelity
@Pluvillion3 жыл бұрын
As someone who loves posing hands on blender, this was such a pleasure to watch! We now have accurate hand tracking (albeit very very early and time-consuming) - faces next. I won't be surprised if we'll experience Ready Player One in the near future.
@rpbmpn3 жыл бұрын
This is so good. This is the first time I've found videos from a guy who's at the absolute cutting edge of his field, sharing everything as it happens. I feel like I've learned more about the state of the art in the last five minutes than I ever knew before.
@eamonia2 жыл бұрын
When I stumbled across his page, it was huge! I am so happy to have this resource and so grateful for all his hard work. I as well have and continue to learn so many new exciting concepts and applications because of it and I always get so excited any time he releases a new video. Thanks again, Doc. We loves ya!
@PostponeProductions3 жыл бұрын
I didn't realize the "uncanny valley" applied to hands. I'm blown away by how real this looks.
@blahblahblahblah28373 жыл бұрын
Interestingly, when we were first shown cadavers in anatomy, they had placed towels over the hands, feet and face. The first time they took the towels off was shocking. They are the features that are arguably the most human
@dan339dan3 жыл бұрын
@@blahblahblahblah2837 That is quite interesting.
@JarOfGibbons3 жыл бұрын
Have we found it? Have we found... Canny Valley?
@danielawesome363 жыл бұрын
@@JarOfGibbons Impossible, the legends are not true! They are merely legends made to trick children into thinking that the world is a happy place!
@logandunlap91563 жыл бұрын
@@JarOfGibbons it’s canny mountain actually, because when we get there, we’ll have ascended
@antiloompa83383 жыл бұрын
Imagine playing a game with this and seeing your hands dismorph like that. The potential for body horror is endless.
@josiahpolite91813 жыл бұрын
So true, I tend to feel everything I watch so certain videos like fungus growth timelapses or ants eating an animal etc I can't watch because it's really uncomfortable. I had to put my phone down while watching this just to be cautious and guess what lol, the hand did dismorph
@lvbboi93 жыл бұрын
You are a genius
@Look_Upon_The_Heart3 жыл бұрын
@@josiahpolite9181 I feel exactly the same way. Good to know I'm not a weirdo
@averagegenzguy27513 жыл бұрын
oh gods oh no I just
@ke1d3r3 жыл бұрын
When Sign language is subtitled in Vr games, then the future has finally arrived.
@Nyconbr3 жыл бұрын
The hand massage part was so realistic it convinced me to massage my hands
@mrpedrobraga3 жыл бұрын
Now I can hold on to my papers in VR!
@ogvibe113 жыл бұрын
Hold on to your vr papers😭😂😂
@alex150953 жыл бұрын
man this VR headset sucks, it's running at 10 minutes per frame!
@RizzY_RUS3 жыл бұрын
Vr papers please😳
@reyariass3 жыл бұрын
@@alex15095 oh no! I missed what happened in the previous frame! Now we have to restart
@kilIstation3 жыл бұрын
What
@tacticaltaco74813 жыл бұрын
This would be amazing for sign language in VR
@mateuszabramek70153 жыл бұрын
Let's do it!
@Alfredo.r3 жыл бұрын
Yoooooooooooooooooo 😳
@knyt03 жыл бұрын
the quest hand tracking is already decent enough for that
@Max248713 жыл бұрын
Maybe this will be the start of good automated translation/transcription of sign language
@mangomakebeats3 жыл бұрын
@@Max24871 yea sign language subtitles
@Ninjashifter3 жыл бұрын
Unbelievably impressive result. Very excited to see where this work takes us in the next couple of years as more researchers turn to VR while it continues to rise in popularity.
@redpandaz51463 жыл бұрын
I think for the purposes of VR, a lot of the things in this simulation could probably be simplified and it would still be a great advancement
@dennisrichards25403 жыл бұрын
3:22 Right - A level Italian Left - Fluent Italian
@logandunlap91563 жыл бұрын
you have no chance at learning italian if your hands aren’t made of pudding
@ryo-kai85873 жыл бұрын
@@logandunlap9156 That might be even funnier out of context
@silentai38263 жыл бұрын
Explain?
@HassanSelim03 жыл бұрын
@@silentai3826 There is a stereotype that Italians talk with their hands a lot, meaning they rely heavily on hand gestures when talking.
@smorzYT3 жыл бұрын
I like how they had to say "Fingers in incorrect positions" at 3:27 as if I didn't notice what is gonna scar me for life
@123mickymouse1233 жыл бұрын
Better safe than sorry.
@diakounknown12253 жыл бұрын
@@123mickymouse123 Better sorry than safe in this case
@Fanaz103 жыл бұрын
elephant man hands moment
@renasouza82613 жыл бұрын
i have never seen any tracking footage as realistic and accurate as this, including facial expression tracking. And all this with just a camera, no tracking points or lights or special sensors, really amazing
@theofficialczex17083 жыл бұрын
That's mindblowing. Really impressive work! Congratulations to Breannan Smith, Chenglei Wu, He Wen, Patrick Peluse, Yaser Sheikh, Jessica Hodgins, and Takaaki Shiratori for the incredible paper.
@KarenTookTheKids3 жыл бұрын
Isn't it way cooler to be alive while all the cool stuff is being created than living when we'd take it for granted
@EmilParkour3 жыл бұрын
Definetly. I keep saying this to my friends all the time xD "What a time to be alive!"
@cameron73743 жыл бұрын
But what if the cool stuff was a sewage system?
@humanbeingwithinternet40313 жыл бұрын
A Karen that doesn't complain?!?! This is rare.
@theleafshandsomedevil15523 жыл бұрын
@@cameron7374 good point
@lol-ot4pn3 жыл бұрын
Id like to exist AFTER everything is made and made amazing though. Not at a time when it is still being processed.
@sammikinsderp3 жыл бұрын
I was an early adopter of the leap motion as well as VR, seeing these improvements just BLOWS MY PAPERS AWAY. It may not be even close to real time, but it is incredibly impressive and we're well on the right track.
@emoluv548653 жыл бұрын
Baby Gamora: Is it done? Thanos : No Baby Gamora: What did it -- wait what ? Thanos : It's still Rendering. Edit: Shouldn't you guys be Holding on to your papers? ⬇️ People who didn't held their papers.
@PashaGamingYT3 жыл бұрын
Best comment on KZfaq.
@jezd22233 жыл бұрын
underrated comment
@bunksoup81373 жыл бұрын
First time I’ve watched a 2 minute papers and literally gasped out loud. This is unbelievable.
@rgstever3 жыл бұрын
Look up SFM porn dude. This is not new.
@heinrichwonders88613 жыл бұрын
This paper contains a lot of hand-waving.
@turkosicsaba3 жыл бұрын
But it's getting two 👍 from me. That is, I pressed the 👍button twice.
@jackbarbey3 жыл бұрын
Ok, but we don’t need so much hand-wringing about it!
@Agnostic0803 жыл бұрын
@@turkosicsaba so you didn't like the video? When you click it twice you first like the video and then unlike it.
@turkosicsaba3 жыл бұрын
@@Agnostic080 Whoosh ;)
@Demmrir3 жыл бұрын
Really? It seems to me like the algorithm just needs a hand.
@7777Insanity3 жыл бұрын
Before I could type in "better hand tracking for vr UE4", this shows up at the top of my feed. Perfect timing!
@mostafaali91343 жыл бұрын
Hey! , Do you know any hand tracking that i can use with UE4 or unity ? I tried Media pipe and it's not so good
@Hello-qg4yk3 жыл бұрын
@@mostafaali9134 but why use this hand tracking? It can take upwards of 10 minutes per frame, or am I mistaken?
@Archman1553 жыл бұрын
@@Hello-qg4yk we have real time hand tracking on headsets like the quest 2, it just isn't as advanced
@jesseessej3 жыл бұрын
Absolutely amazing! I can't wait until you can accurately render virtual me sitting at a terminal coding for 8 hours a day and unwinding by playing Zelda II on an NES emulator in my emulated OS on my emulated computer in my virtual reality
@jameskerridge50343 жыл бұрын
As a game designer I can't wait till VR games use this so I can mess around with it and see how it works
@andie_pants3 жыл бұрын
I missed that second hold on, and my papers went flying everywhere.
@IndyStry3 жыл бұрын
As a VFX artist seeing the hand massage footage blows my mind. That looks so freaking believable even without any hand textures and just plain purple color. Can't these papers be turned into softwares, even if they are paid?
@Niosus3 жыл бұрын
Yes they can. If you can implement the math yourself, in principle you should be able to go from paper to implementation without issues. Some papers also release the source code on Github or some other place. In that case it's typically just a case of downloading it. Just a word of caution: that doesn't mean you can simply use this in professional applications without worries. Check the licenses, and it's probably prudent to reach out to the researchers as well. This research software also typically isn't in a state that's really usable for more than a simple demo. Going from a proof-of-concept like this to a plugin for a 3D program you can sell is not trivial. It's the "other 90%" of the work. Not in difficulty, but in effort.
@Daniel_WR_Hart3 жыл бұрын
@@Niosus "If you can implement the math yourself" Well damn...
@Feintgames3 жыл бұрын
One of the nice things abou the Valve "knuckle" controllers is that they allow you to let go of them and still have them close at hand. Then when you need to pick up something, you actually are gripping a physical object. So VR without a controller isn't as interactive, even if the hand simulation is better. And when it comes to finger simulation, those knuckles does something that I consider good enough. You can have semi-reliable 5 finger simulation. Once the controllers move to their next generation, they will be even better.
@_fudgepop013 жыл бұрын
I’m absolutely blown away by not only the hand simulation, but also the perceptilabs ad. For once it’s something I think I’ll check out as a developer that’s used to learning things in a hands-on, experimental way and seeing the results. Thanks for not only sharing high quality papers, but also high quality ads :D
@olivierbegassat8513 жыл бұрын
Amazing! And no gloves involved ... that's incredible. I'm curious to see the improvements 2 or 3 papers down the line : )
@keco1853 жыл бұрын
This could be useful for animators that are already used to spending hours to render each frame
@edenkeeping22983 жыл бұрын
with this, animators wouldnt have to animate anything at all
@gokikuburi86533 жыл бұрын
Animation gets cheaper?
@TheAkashicTraveller3 жыл бұрын
"Doctors could be trained to perform surgery in a virtual environment" More like doctors could train a learning algrithm to perform surgery.
@reactjsmedia64063 жыл бұрын
So basically, in the future, every job can be taken over by a robot.
@manamsetty26642 жыл бұрын
@@reactjsmedia6406 it's really hard to define a problem a computer can not solve
@manamsetty26642 жыл бұрын
In theory
@shauryatomer10582 жыл бұрын
If quantum computers are sometime in future used to train neural networks and seeing how QC can solve NP problems. I think these learning algorithms are gonna get way more sophisticated
@PacificBird3 жыл бұрын
I've been watching the channel for a whole, and it has to be the coolest channel on this site. Especially with how much research and writing I've been doing for college, it can get really difficult to separate my love of learning from the stress of student academia, and it can also be really hard to find the time to keep learning for the sake of it, but Two Minute Papers never ceases to keep the fire burning. Thank you :)
@Sekir803 жыл бұрын
Wow, I believe I witnessed the beginning of a revolution! Thank you Károly for presenting it, it looks great!
@rustable41653 жыл бұрын
Its not a revolution :l
@rynzoku86623 жыл бұрын
@@rustable4165 technological revolution since if we give it a few more years, we might get vr interactivity so it’s kind of a revolution?
@nekokna3 жыл бұрын
That 'hold into your papers' icon is wonderful!! 😃 🎉
@RegahP3 жыл бұрын
The hand massage part is literally ASMR for CG AI researchers and everyone who's ever worked with bone systems in blender and such, it's so damn satisfying, i can almost touch it lol
@LarpingGecko38512 жыл бұрын
I'm over a year late watching this video and I don't work in any of the fields related to your work, but I wanted to thank you for your videos and content. As a child of the 80s, watching movies like UHF and Flight of the Navigator, I am constantly amazed by the march of progress. "What a time to be alive", indeed! Keep it up, good sir!
@RazsterTW3 жыл бұрын
Jaw dropping! Oh my the future VR/AR is going to be amazing.
@EmilParkour3 жыл бұрын
At one point it will inevitalbly be indistinguishable from reality. That or civilization ends.
@zakuro85323 жыл бұрын
Imagine stroking the ham and you do it in VR too. Such realism!
@swapnageorge40183 жыл бұрын
@@zakuro8532 Peak of human evolution.
@-untcuchable.mp42683 жыл бұрын
@@EmilParkour probably in a few decades or so.
@Phiwipuss3 жыл бұрын
So much progress was made in just 2 months?! I feel like I am living in a science fiction movie!
@danieljensen26263 жыл бұрын
Nah, they are approaching the problem in different ways, both this and the paper they mention at the beginning probably have been in the works for a couple years.
@fredspipa3 жыл бұрын
I absolutely love how you present these technologies and techniques, especially the way you understand that overstatements and click bait only take away from the fascinating subjects you cover. Thank you!
@TwoMinutePapers3 жыл бұрын
You are very kind, thank so much! 🙏
@fedupadhesive48853 жыл бұрын
“You’ve won, but at what cost” is the perfect quote for this
@emanuelescarsella31243 жыл бұрын
We need hardware acceleration for this kind of software ASAP 😍 that's going to be the future of vr (as soon as we can have it in real time 😅)
@fivesprite31513 жыл бұрын
THIS CHANGES EVERYTHING
@OctagonalSquare3 жыл бұрын
this may not be close to being able to actually be processed in real time, but instead of a stepping stone, this is more like finally being able to see the other side of the river. The fact that it can be done at all is incredible and I can't wait to see it get used in something
@nomatter_me3 жыл бұрын
That hand massage reconstruction is so satisfying to watch, it's weird, didn't expect that feeling!
@thisismyalias3 жыл бұрын
I was sure that those chess patterns were some kind of body painting. Just incredible!
@WilsonJavierVelozParra3 жыл бұрын
Wow, that's amazing! What a time to be alive!!
@OneADayGaming3 жыл бұрын
This is hands down one of the best videos for this specific topic. You've got to hand it to this guy for showing is this stuff. This stuff will certainly be handy for future tech.
@AVERYhornyMrDinosaur3 жыл бұрын
haptic VR gloves with bladders and resistance in them are the future of VR hands right now. they will make you able to actually feel what your grabbing in the videogame world.
@christianhorvath7913 жыл бұрын
That is amazing! What a time to be alive!
@juliandarley3 жыл бұрын
amazing! thank you for this excellent video. at last some hope for really high-quality hand/finger recognition/interaction. hoping that this can be both linked with optical body mocap (which is normally hopeless with the fingers) and help body mocap do better with physics interaction (eg pick up up a wine glass or write with a pen). narrative filmmaking needs lots of really precise interaction and it is very tedious trying to do this with wonky and jumpy mocap. another thought: since this algorithm deals with two hands very accurately, what about dealing with two bodies? then we can could have accurate optical (markerless) mocap of the tango or people shaking hands or greeting with deux bisous (when covid rules allow this again...).
@FireyDeath43 жыл бұрын
The thing about interacting with objects in VR is that if you're not wearing a suit that handles collisions, there's no force holding you back from crushing an object in your hand, smashing a wall or doing literally anything that involves using more space than they give you which results in phasing and breaking stuff. But the thing, about the suits, is, that, they could get hacked to suffocate you to death.
@houghwhite4113 жыл бұрын
Haptics won't crush your body, it only gives feedback. With good tuning the feedback will be convincing
@onevoltten68453 жыл бұрын
To avoid the complex computations, you can just simulate and save all the simulated hand motions. This allows every hand motion to be saves and avoid the computer hit at the cost of a fairly large filesize for the hand data.
@manzell3 жыл бұрын
0:56 Can you simulate holding on to your papers??
@frankyboy13853 жыл бұрын
Underrated XD
@tauon_3 жыл бұрын
We need to simulate floppy paper with an ink texture.
@lucilferadonis54813 жыл бұрын
Everyone: impressed Me: now do fireball jutsu
@seraphin98253 жыл бұрын
I can see this being the next breakthrough in motion capturing in movies and games, I cant wait to see what the Entertainment Industry is going to do with it once it is a bit less resource-intensive to use!
@LifeLikeSage3 жыл бұрын
This guy is so pure, he talks about VR technology being used for wholesome things like: training doctors, training pilots, reconstructing sign language. But I know the primates on this mud ball so much better, they're going to want it for their naughty VR games for rear running muscles and mammary glands.
@Invalid5713 жыл бұрын
If the next paper(s) manages to pull of Naruto hand signs for jutsus I'll be able to die happy. :)
@konignickerchen72653 жыл бұрын
Perfect VR hands, at the cost of your real hands.
@Cless_Aurion3 жыл бұрын
As a 3D artist, the UV mapping of the hands almost gave me an aneurism! All the squares are supposed to not be barely deformed! hahahaha
@sentientglitch3 жыл бұрын
My dad is a writer publisher and translator. About 10 years ago he wrote a short story about getting trapped in virtual reality end it was recently translated into English.
@Loiterghr3 жыл бұрын
Perfect virtual hands, but at a cost: you lose your real hands
@DurianFruit3 жыл бұрын
Cant wait to hold on to my papers in VR
@CesarTheKingVA3 жыл бұрын
The hand has always been a staple of CGI animation technology demos. If I recall, Ed Catmull and the team that would later go on to create Pixar debuted the concept of 3D, polygon-based rendering with a short animation of his hand, which had been covered with tracking dots and used as reference to show how complex polygon-based animation could be.
@NutyRiver3 жыл бұрын
This would be fantastic for social vr. There’s a huge deaf community in VRChat, and this would make signing in-game so much clearer
@Solizeus3 жыл бұрын
I have the feeling we might not even need to model anything in a few years
@thelemoneater3 жыл бұрын
Me: sad 3d modeller noises
@idkidk92043 жыл бұрын
Well programmers be like, nice ... but wait, we are going to be next oh fuk fuk fuk...
@Zakoyo3 жыл бұрын
photogrammetry ?
@numbdigger95523 жыл бұрын
@ADMINISTRATOR I believe that we could teach a neural network to calculate all this from an image in a millisecond. It has been proven time and time again that self learning algorithms end up doing a far more efficient job than complex man-made ones.
@thelemoneater3 жыл бұрын
@@Zakoyo photogrammetry is great and all, but kinda useless when your sculpting something that doesn't exist irl. It won't be replacing 3d modeling any time soon... By itself.
@joannot67063 жыл бұрын
2:06 I swear I held on to my papers but it blew me two meters in the air anyways.
@AlarSenpu3 жыл бұрын
I cant wait for further development of virtual hands! Ive always been excited about papers on stuff like this.
@zalancsoke68963 жыл бұрын
Szeretem látni hogy egy Magyar ilyen nagy sikert ért el...
@Tortuex_3 жыл бұрын
3:25 i laughed so hard ahhahahahahahahaha
@MasterVertex3 жыл бұрын
I want this for motioncapture
@EmilParkour3 жыл бұрын
That's the goal
@ZentaBon3 жыл бұрын
I love that you're whispering in my ear about these beautiful VR hands.
@blakksheep7362 жыл бұрын
Umm...
@webeewaboo3 жыл бұрын
3:24 The guy in Far Cry when you have to heal, but he hasn't broken his fingers yet.
@iiliq-yt3 жыл бұрын
Roblox VR Games: "I'm four parallel universes ahead of you!"
@iiliq-yt3 жыл бұрын
@@wtfimcrying no
@katomiccomics2023 жыл бұрын
Me: *truly interactive nsfw games*
@EmilParkour3 жыл бұрын
Oh yes, there is already amazing work being done there. Have you tried VirtAMate and MeshedVR stuff? Oh my world. It still needs a bit of processing power but a decent gaming PC will do wonders as long as you skip cloth / clothes simulations.
@oxey_3 жыл бұрын
@@EmilParkour what the fuck
@imkharn3 жыл бұрын
This channel 2 years from now "You make think that needing 10 video cards to get real time vagina simulation is too expensive, but this is a 0 to 1, it took something previously impossible and made it indistinguishable from reality....You can see the uncensored version of this paper on my pornhub account linked in the description below "
@Iuwna3 жыл бұрын
@@EmilParkour nice :)
@katomiccomics2023 жыл бұрын
@@EmilParkour i don’t have a VR headset but cool.
@sitnamkrad3 жыл бұрын
For people interested in working with this kind of technology for example to teach or read sign language. I have done some similar work using the Leap motion controller. One big tip/mindset I can give everyone : the human body has limits, use those to abstract your detection. For example a simple rock-paper-scissors detection. Paper : All you need is the distance between the tip of the 4 fingers and the palm of the hand. For the purpose of "paper", the position of the thumb and space between fingers is irrelevant. You don't need to check every angle on every joint because there's no physical way they can be bent if this distance is at its max. Rock : Same as "paper", but the distance needs to be small instead. Scissors : While your first instinct might be to first check the distance between the tips and the palm, and in addition to that, check the distance between the tops of middle and index finger. You only need to check the distance between tips and palm for the ring and little finger alongisde the *sideways* distance between the middle and index finger. There can not be any notable sideways distance between these two fingers unless both of them are outstretched. (there can be a difference lengthwise, so be sure to keep that in mind). You can use these and similar rules to greatly simplify the detection of gestures people are making. Now of course there are hands that don't play by these rules, and thus will be able to fake some gestures by doing something an average hand is incapable of, like bending fingers backwards. Others may be unable to make the gestures at all. Depending on the application this may need to be accounted for. But this of course wil also be an issue with machine learning unless they feed the A.I. with enough samples of these irregularities as well. I would be very interested in seeing how this system handles such cases as it stands right now. To see how much it can already do and how horribly it would break.
@ArtBySabin3 жыл бұрын
My goodness, this is the most impressive thing I've seen in 2021 so far! Kudos to the researchers!
@varunvedavyas3 жыл бұрын
You can hold on to your papers, virtually, two more papers down the line.
@Shadow-xb2ce3 жыл бұрын
Is this a re-upload?
@Shadow-xb2ce3 жыл бұрын
Nope.
@SuddenlyMythical3 жыл бұрын
Vr shooters, racing and space games in vr with this system would just be the most fun
@kaigorsuch35862 жыл бұрын
dude I love your work in summarizing AI papers. it makes one of my favourite subjects so much more accessable for me!
@johnnyfrankenstein01233 жыл бұрын
2:06 what??? it looks so insanely realistic, imagine what crazy things could be done with convincing textures too, holy moly
@thedudethatneveruploads26173 жыл бұрын
This is crazy. Back in the 80s, games became rapidly more advanced and detailed, and I think we're living in another one of those periods with VR.
@pc15483 жыл бұрын
I was blown away, all of your videos leave me amazed!!! Its great to see so much new AMAZING stuff getting made so fast!
@Terror-Gene3 жыл бұрын
I never comment on these... but... This is just Beautiful! Can't wait for this to advance to realtime! What a time to be alive!
@benosonline3 жыл бұрын
The hand massage is insane
@dillonridder87373 жыл бұрын
I am excited for the effects this could have on deaf communication via VR!
@KhemWaste3 жыл бұрын
That text input method of, "Scroll to select your letter" triggered a fight or flight reaction.
@windyboiii7713 жыл бұрын
watching the hand massage footage was so satisfying it made me realise how tired I am and need a rest. Thank you hand massage footage.