Setting up XR/VR on Godot 4 | First Impressions, Passthrough, Hand tracking

Рет қаралды 10,632

10 ай бұрын

In this video I shared my first impressions on the XR setup on Godot 4.
Tempted to make a tutorial out of it, but the guide on the documentation covers the setup process pretty well. Also, I guess speed-running it is more fun.
I was trying to search for the "Oculus Integration" plugin (because that's needed on Unity), and was genuinely surprised by the fact that passthrough and hand-tracking features came with Godot out of the box.
Overall, very easy to setup, and I would definitely recommend it to anyone who is interested in developing VR games.

Пікірлер: 43

@pietraderdetective8953 9 ай бұрын

this hassle-free approach provided by Godot is one of primary factors that makes it very compelling to use both for experienced and beginner programmers. It cuts a lot of time going from idea to implementation! i'm not going to use XR/VR anytime soon, but I'm leaving a comment to help with the algorithm. Cheers!

@boonmakesgames 9 ай бұрын

Thanks!

@BastiaanOlij 9 ай бұрын

Nice video! Pretty clear following through the steps. Android setup remains a pain, too many moving parts that we don't have control over but luckily once setup correctly, its reliable. For those who may spot the issue with the index, middle and ring fingers, that is fixed in the next 4.2 build :)

@boonmakesgames 9 ай бұрын

Good to know. I saw your tweet on the hand-tracking fix. Thanks for working on the XR features on Godot!

@someanimatordude2925 7 ай бұрын

You've been working on this for pert near 7 years? Thank you so much for your efforts.

@BastiaanOlij 7 ай бұрын

@@someanimatordude2925 Facebook gave me a reminder couple days ago, I think I even publicly shared it, that I posted a video 7 years ago on the dot showing the first integration of OpenVR with Godot. So yeah, 7 years :)

@PuRe_AdDicT 7 ай бұрын

You’re at the cutting edge my friend, great work! Please continue!!

@diguifi0fficial 5 ай бұрын

This is INSANE, thank you so much for this video. I'm looking forward to create some silly augments when it releases!

@nickromanek9444 8 ай бұрын

Amazing, would love to see more XR/MR development using Godot, especially with the Quest. Keep the content coming! THanks

@alvinblanco907 3 ай бұрын

Excellent video and very helpful, thank you for sharing it, I hope you can continue providing more content about it. 👍👏

@cdashrowe 2 ай бұрын

Excellent video, thank you for this. Subscribed.

@ChaojianZhang 19 күн бұрын

Beautiful!

@antoosh6899 9 ай бұрын

awesome video thanks!

@jeffg4686 2 ай бұрын

It definitely has enough functionality at this point to build a lot of cool XR experiences. They kicked ass on this. I left Godot for Bevy, but came back because of the XR in Godot (not really in bevy yet - some starter efforts going on).

@bossbibs 5 ай бұрын

W video thank u

@asdfasdf1555 9 ай бұрын

Thanks for the tutorial! Do you know if it's possible to pick up objects easily using tracked hands? How would you go about implementing something like this?

@boonmakesgames 9 ай бұрын

I recommend you take a look at "Godot XR Handtracking toolkit" github.com/RevolNoom/godot_xr_handtracking. Take note that its "Pickable" doesn't work with controllers.

@asdfasdf1555 9 ай бұрын

@@boonmakesgames thanks!

@jakubo1853 9 ай бұрын

unity to godot speedrun any%

@lukario7173 8 ай бұрын

Do you know how you add interactions the hands (from hand tracking) with objects (like collisions) .

@boonmakesgames 8 ай бұрын

Hi, you can take a look at this project github.com/patrykkalinowski/godot-xr-kit

@dani_martinechen 5 ай бұрын

But how do you do it without VR?

@dagonrevenge2309 9 ай бұрын

Did you use Oculus Link here, or Virtual Desktop? I'm experiencing some issues with twisted hand models and fingers being tracked only when actually holding the controllers (this is with Godot XR tools assets). I'm using SteamVR, Quest 3 and Godot 4.1.2. You made it look so easy on the video and then when I got to it it felt like hitting a brick wall, lmao. Nonetheless, amazing video.

@boonmakesgames 9 ай бұрын

I'm using Quest 2 with link, without SteamVR (my active OpenXR Runtime is Oculus). I didn't have Godot XR tools in my project when I was setting up the hand tracking. The hand models I used are from here: github.com/RevolNoom/godot_xr_handtracking/tree/main/assets/valve_hand_models

@mrjubbleTV 8 ай бұрын

Did you have any luck getting hand tracking working?

@dagonrevenge2309 8 ай бұрын

@@mrjubbleTV As far as I tried, I did not. If I understand it correctly, one can only access the hand tracking when having dev access in the Quest... But it feels like I'm missing a piece here.

@dagonrevenge2309 8 ай бұрын

Perhaps there is a workaround I'm not aware of, but I did a bunch of research and the consensus was that hand tracking is NOT accessible in PCVR otherwise. Threads about using it in VRchat and such. Also, hand tracking is not available in the Oculus PC app so I have no clue how on earth it would be usable in apps connecting to the Quest via the app... this whole thing really boggles me. 😭

@mrjubbleTV 8 ай бұрын

@@dagonrevenge2309 From what I can tell, to pass hand tracking and passthrough data to PC, a users account must be a developer account. This kinda blows because PCVR users will not have hand tracking in game unitl that information is passed in the normal runtime. I think we just have to wait for Meta to pass it for all users

@hannesjunk1035 6 ай бұрын

Is there any way of downloading this Project? I can't move my fingers when I copy your steps.

@boonmakesgames 6 ай бұрын

Meta doesn't allow hand tracking data to stream via the AirLink or QuestLink, without a developer account. You'll need to have the developer option turned on for it. Alternatively you can build the game as a standalone quest app and see if the handtracking work on your Quest.

@albertoperez5189 5 ай бұрын

Great video! Just one question, I´m trying to do the hand tracking, but I can´t get right the finger tracking, it only shows the hand model as a static object where my hands are. I think it has to do with that MeshInstance3d called "vr_glove_left_slim" you have as a child to the skeleton or the superior Node3D called Armature, how did you get that part?

@boonmakesgames 5 ай бұрын

Did you have the developers option turned on? In the oculus PC app.

@albertoperez5189 5 ай бұрын

@@boonmakesgames yeah, and it gives an error on every bone, "couldn´t obtain bone for Ring_Tip_R" and so an so, so I guess is getting no skeleton, but it should go inside the hand model either it is a glb or gltf, right?

@boonmakesgames 5 ай бұрын

@@albertoperez5189 The bone names has to be the exact same name as the list here: docs.godotengine.org/en/stable/tutorials/xr/openxr_hand_tracking.html. You can try to edit them in blender.