XR Hands: Installation and Setup - How to create a Hand Tracking App using Unity's XRI

Рет қаралды 12,640

Күн бұрын

In this video we are going to show you how to use Unity's new XR Hands Package! This package allows us to get hand data and poses of supported devices such as the Meta Quest and later on even Apple's Vision Pro. Due to Apple's focus on hand tracking, now is the time to learn about this amazing package in Unity and start building your own hand tracking applications!
Resources:
🔗 XR Hands Documentation: docs.unity3d.com/Packages/com...
🔗 Unity XR Hands API: docs.unity3d.com/Packages/com...
🔗 Our Hand Tracking Prototype: thexrguy.itch.io/wing-fling-p...
Other Videos:
📹 How to become an Apple XR Developer with Unity for visionOS: • Apple Vision Pro - How...
📹 XR Interaction Toolkit Beginner Series: • Part 1: Setup Meta Que...
Join the Discord!
👾 / discord
Support the Channel:
🫂 Patreon: / blackwhalestudio
🐦 Twitter: / thexrguy
Need professional XR & Multiplayer development for your project?
👨‍💻 Get in touch with us: bento.me/blackwhale
Chapters:
0:00 Intro
0:49 Setup new Android Unity Project
1:21 Install XR Plugin Management, OpenXR & Project Validation
2:56 Install XR Interaction Toolkit & XR Hands Package
3:57 Hands Demo Scene & New XRI components
6:50 Enable Hand Tracking for our App and Testing
7:35 Setup our first own Hand Tracking App
9:00 Define Input Actions for XR Hands
10:29 Testing our App
10:49 Let's make an even simpler Setup!
12:12 Let's Test!
12:28 Outro

Пікірлер: 37

@LoveFacts01 Жыл бұрын

Best tutorial out there. Most of them only cover the hand demo scene, but you took it a step further. Well done!

@idpjay2525 11 ай бұрын

the best XR tutorial til today. Seriously. I neeed to see the other videos you are talking about.. so intriguing

@Justeen15 10 ай бұрын

Best tutorial +1. I like the simplification part the most. Always great to know what the absolute essentials and then develop from there.

@mlavinb 8 ай бұрын

Great update! thanks for sharing

@haroldvicknair1989 2 ай бұрын

I have followed this video to the letter as well as several others. I have never once had the hands even show up when I play the scene. It's very frustrating that I cannot get this to work. I am using a quest 2 and Unity 2022.3.18. Any troubleshooting tips?

@HansMilling 6 ай бұрын

Started of the Oculus framework in Unity but they recently changed everything so none of the tutorials on KZfaq work any more. This is far better, also because it is cross platform, so it is possible to port to other headsets as well. However I have a hard time keeping up as you skip very fast over some steps. I cannot get the hands to show, plane or anything else, like I am positioned somewhere else in the world than the start point.

@Fares_Dev883 6 ай бұрын

hi, still cannot grab items, you skipped that phase of assigning things on input

@1979zeesh 7 ай бұрын

i was exploring spatial for collaborative setup. if i create a scene with XR hands and import that into spatial..will i be able to interact same way?

@user-bl8ej4kj7o 8 ай бұрын

How to use it on pico 4?

@timurradman3999 5 ай бұрын

For some reason, the hands get disable on start

@ParryOP 11 ай бұрын

HI, it shows that my hand tracking system doesnt work and i need to chnage some sort of a backend, can you help me with it please?

@blackwhalestudio 9 ай бұрын

Hi, can you let me know the exact error message please?

@ErenBR562 5 ай бұрын

Do the hands only appear when I install the apk on oculus? Because here it doesn't show up when I play through the editor.

@blackwhalestudio 5 ай бұрын

No, it should work in the editor. Make sure to enable the hand travking subsystem for windows as well

@bernardusmuller1109 7 ай бұрын

Any idea how to change it from pinching to grabbing with your full hand?

@blackwhalestudio 7 ай бұрын

You should be able to change interactions in your input action map!

@LeoninMinecraft Ай бұрын

@@blackwhalestudio Can you explain this further? im trying to change it from a pinch a full grab, but I cant find any tutorials online for this.

@helmi1729 9 ай бұрын

Is this only working for the meta vr headsets? I’m currently working with the vive focus 3, and everything works apart from grabbing objects, any advices?

@blackwhalestudio 9 ай бұрын

This should work with any device that supports OpenXR and has cameras for hand tracking! Unfortunately I am not too familiar with Vive Focus, though I've had my fair share of problems with its predecessors before. Sorry for not being able to help!

@helmi1729 9 ай бұрын

@@blackwhalestudio thanks for your answer anyway!

@helmi1729 9 ай бұрын

@@blackwhalestudio it does support open xr and only when i try to grab something, the handtracking stops for a short time and then comes back. Maybe this is a unity problem and not a device prroblem, thats what i maybe thought...?

@1979zeesh 9 ай бұрын

at 7:44, when i search for origin xr hands, i get xr origin (xr rig) and not xr origin hands as u get. my xr hands is version 1.3.0

@blackwhalestudio 9 ай бұрын

Have you imported the samples in from the package manager?

@1979zeesh 9 ай бұрын

@@blackwhalestudio yes

@charithf3095 8 ай бұрын

not visible hand my project pls help

@blackwhalestudio 8 ай бұрын

make sure to import the hand visualizer from the samples in the unity package manager under the xr hands package!

@Besttechnology 11 ай бұрын

complete the serie please

@blackwhalestudio 10 ай бұрын

I will resume the series very soon, please excuse the delay! We both have full-time jobs and sadly didn't have enough time for KZfaq in the past weeks :(

@Besttechnology 10 ай бұрын

@@blackwhalestudio all support ♥️

@barboradarmova1368 4 ай бұрын

Does anyone else have a problem with objects just falling out of hands constantly when using hand tracking compared to controllers? It's so frustrating and there is literally no information out there... It's happening in every project no matter which version of XR toolkit I use...

@anxelaperezcosta9227 5 ай бұрын

Does anyone know why I don't have "Samples"?

@blackwhalestudio 5 ай бұрын

Make sure you import them separately from the package manager

@phandinhlongnhat 9 ай бұрын

Hello man, I must say that I have a lot of respect for what you have achieved! If I understood correctly, you were able to create something in Unity without using any controllers or headsets. Is that correct? Also, could you explain why an Android device was necessary for this project? Did you use it as a third device for some aspect of the creation process?

@blackwhalestudio 9 ай бұрын

I used my meta quest 2. you definitely need a headset for this tutorial that supports OpenXR and has handtracking capabilities!

@cristatcristat8693 4 ай бұрын

Hello, I'm using the Pico 4 and followed your tutorial. When I load the app on the headset, the hands are detected but are unrendered(bright pink) and I can't use the pinch and the ray doesn't work. Although I can press the buttons by moving the hand. Do you know what could be causing the problem? Edit: I recently found out that the XR default input action doesn't contain the indexPressed and pinchStrength to work for Pico 4. Therefore, at the moment you can only use this by importing the Pico SDK instead of Pico OpenXR SDK which is outdated. Hope they add it soon. You can follow the rest of the tutorial as it will work. Only the bindings need to be changed and you can't use OpenXR.

@blackwhalestudio 4 ай бұрын

Thanks a lot for your feedback!!