Hand Gesture Detection with Unity XR Hand Tracking

Рет қаралды 13,663

Күн бұрын

Hand tracking lacks input but we can fix this problem by using Hand Pose detection to detect a particular gesture and turn it into a custom behaviour. Let's learn howto make that with the Unity XR Toolkit.
❤️ Support on Patreon : / valemvr
🔔 Subscribe for more Unity Tutorials : www.youtube.com/@ValemTutoria...
🌍 Discord : / discord
🐦Twitter : valemvr?lang=en
👍 Main Channel : / @valemvr
🔥 Tiktok : / valemxr
Hand Pose Detection On Meta SDK : • Hand Pose Detection wi...
Hand Pose Detection Made From Scratch : • Hand Tracking Gesture ...
····················································································
❗❗❗ WISHLIST MY FIRST VR GAME ON STEAM ❗❗❗
store.steampowered.com/app/26...
····················································································
📝Best VR Assets ( These links are Affiliate links which means it costs the same to you and I get a small commission. Thanks for your support!)
VR Interaction Framework
assetstore.unity.com/packages...
Hexabody (Physics VR Player)
assetstore.unity.com/packages...
Mirror and Reflection for VR
assetstore.unity.com/packages...
Auto Hand (automatic hand grab pose)
assetstore.unity.com/packages...
Hurricane VR (vr physics interaction)
assetstore.unity.com/packages...
3d Hand Model for VR
assetstore.unity.com/packages...
····················································································
Full Series on How to make a VR game • How to Make a VR Game ...
····················································································
If you enjoyed this video, here are some other really good channel you should appreciate :
⌨️ Game Dev
Brackeys : / @brackeys
Dani : / @danidev
Code Monkey : / @codemonkeyunity
👨‍🎓 Vr Dev
Justin P Barnett : / @justinpbarnett
Vr with Andrew : / @vrwithandrew
····················································································
#vr #vrdev #madewithunity

Пікірлер: 28

@Nick2054 5 ай бұрын

Thanks for the tutorial, I couldn't find the hand gestures sample scene because I didn't have experimental packages enabled. Its amazing how Unity has made absolutely complex logic like pose detection so accessible.

@billkeane1375 6 ай бұрын

Perfect tutorial. Complete concept from start to finish, efficient and fast. Very, VERY useful. Thank you.

@teawa_ 6 ай бұрын

Great tutorial as always Valem!

@peterschreuderr 6 ай бұрын

Yess!! Just what I needed since i dont work with the Oculus package anymore

@dopinkus 6 ай бұрын

Would love a tutorial on how to make good quality UI in VR / on Quest! I think you go through it another - but I believe it’s outdated

@ivanaguilar2856 6 ай бұрын

Great tutorial on inputs via hand gestures. Will you create a tutorial on how to use Meta's new inside-out body tracking (IOBT), for instance, to detect if the user is leaning forward (rotated their torso) instead of walking forward? This will be useful to not have the character move forward and just lean forward (i.e., leaning forward to grab something on a desk and not have the character's body move forward and collide with it).

@De-Panther 6 ай бұрын

Thanks! Great tutorial! It works on WebXR as well🤩

@ironandsilk 6 ай бұрын

How does that work on WebXR?

@De-Panther 6 ай бұрын

@@ironandsilk there's WebXR Export package. The same tutorial here can be applied to that package.

@semihyildiz2977 2 ай бұрын

Hi Valem I have a probelm it always tells me NullReferenceException: Object refernce not set to an instance of an object - when I try to use the displaying with the text. Do you have any tips for me?

@desmondantony7058 2 ай бұрын

same issue bro any solutions?

@davidosorio1585 Ай бұрын

Comment the lines that are showing an error, so you have to double click on the error to open the script. There you have to add double slash "//" in the beginning of the lines 195, 207, and for the line 156 replace with "m_BackgroundDefaultColor = Color.black;" without ""

@roguestargun 6 ай бұрын

Damn just when I thought I was done adding features to Rogue Stargun (cough, coming February 1st to Applab). Thanks for the tutorial Valem!

@Hemecan. 6 ай бұрын

Did you upload to Applab

@Besttechnology 6 ай бұрын

Hi valem can u made a video of how to navigate using hand

@ivanaguilar2856 6 ай бұрын

If you take the output of the "Static Hand Gesture" script (Gesture Performed) and have it send a signal (i.e. a boolean of true) to a locomotion script, you can then trigger the virtual camera (i.e. VR rig) to move until another gesture is performed (sends a boolean of false). You can then have the player move based on a constant speed based on a direction, for instance the virtual camera's forward direction. I haven't seen a tutorial show how this is done, but if you take what I said with what this tutorial shows and with a continuos locomotion (i.e. joystick locomotion) tutorial, you should be able to create a simple locomotion system based on gestures. I hope this helps.

@Besttechnology 6 ай бұрын

@@ivanaguilar2856 thank you so much it's completely logic I will try it.

@ivanaguilar2856 6 ай бұрын

@@Besttechnology you're welcome. I hope it works out well.

@ivanaguilar2856 6 ай бұрын

Here are some other forms of locomotion that could also be used through hand tracking. It might be useful if you really want to use your hands to control navigation, but know that it isn't very precise or fast - kzfaq.info/get/bejne/jNCZqKx01bjPgp8.htmlfeature=shared kzfaq.info/get/bejne/aa2Zrbt1zKiRm40.htmlfeature=shared I think using your body's leaning to control locomotion might be a better solution as your hands are free to do other actions, like interact with virtual objects, instead of being used to control locomotion (like in real life) - kzfaq.info/get/bejne/oOCflKVyyZzLgI0.htmlfeature=shared Leaning to fly: kzfaq.info/get/bejne/f7iKfNylt5q7m6s.htmlfeature=shared I hope this helps.

@starbuck3980 Ай бұрын

XR hands works with AR?

@mathivaananvedaraj9374 6 ай бұрын

Hi, wonderful video. Could make a video on teleporting using hand tracking please? Thanks alot.

@VirtualWorldDE 6 ай бұрын

Finally I can make my VR Rock Paper Scissors game without having to do the handtracking myself

@WarrenEBB 6 ай бұрын

can you (or anyone here?) note what replaced TrackedPoseDriver component - for sticking a mesh onto your hand anchor? (say I wanted to put a custom mesh prop onto my wrist). + and can this mesh stay: in same spot when you put controllers down and switch to gestures? ( InteractionSdk suggests HandJoint component, but this doesn't keep mesh in same spot when you cross over between controller and raw hand input.) (... i'm debating joining everyone in XR Toolkit usage world, after watching this video, but still not clear how to best stick props onto my custom VR hands. Want to support switching between controller and controller free usage at will. Guessing i need to have 2 setups and switch what is active when I detect change. curious what more experienced folks would suggest. mostly curious if there is an established "this has officially replaced Tracked Pose Driver. everyone should use it."

@Thesomeonevr 6 ай бұрын

can you do a tutorial on how to add fishing to unity vr project

@XaviDevSama 5 ай бұрын

XR HANDS work fine on Unity Editor but in the build it doesn't detect my hands its this normal, or I have to make some changes in the configuration?

@daryladhityahenry 6 ай бұрын

Hi Valem! I have a question... Why do you choose unity over unreal engine? I am really curious... I like unity of course, I never even touch the unreal engine. But, wherever I see, unreal engine seems to have massive advantage if we're going to do realistic VR graphics.. Is there any specific thought on that? I really think a lot wether I should learn unreal or not at this point... Thanks.

@teawa_ 6 ай бұрын

I had no idea you could change the value of a text through an event