How to make a Mixed Reality app for the Quest 3

How to make a Mixed Reality app for the Quest 3 - Part 1: Passthrough

Рет қаралды 32,599

Күн бұрын

This is the first part of a short tutorial series, in which you will learn how to create Mixed Reality experiences on the Meta Quest 3. We will be building our app in the Unity game engine, using Unity's native 'XR Interactive Toolkit'.
In this first video, I will show you how to set up a Unity project for Quest 3 Mixed Reality development. I will then show you how to activate 'Pass-through'. Lastly, we will drop a virtual character into our Mixed reality Scene.
→ Next Video • How to make a Mixed Reality app for the Quest 3 - Part 2: Plane Detection: • How to make a Mixed Re...
▬ Support My Work ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
❤️ Support me on Patreon: / ludicworlds
☕ Buy me a coffee: ko-fi.com/ludicworlds
The 'Unity Asset Store' links provided below are affiliate links. If you click on them and make a purchase, I may receive a small commission at no extra cost to you. This support helps me continue creating content for this channel.
🏷️ Spring Sale: assetstore.unity.com/?aid=110...
⚡ Flash Deals: assetstore.unity.com/?flashde...
🏷️ 50% Off: assetstore.unity.com/?on_sale...
Thank you for your support!
▬ Timestamps ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
0:00 - Intro
2:10 - Create Unity Project
2:41 - Build Settings
3:15 - Player Settings
3:57 - Meta OpenXR
5:05 - XR Packages
5:58 - XR Interaction Toolkit
6:26 - XR Plug-in Management
7:41 - Optimizing Rendering
10:52 - XR Rig
13:03 - AR Components
13:59 - URP Settings
14:48 - Get Zombie Asset
15:36 - Set Up Zombie
17:15 - Build & Run App
▬ Useful Links ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► How to Turn on Developer Mode on Meta Quest 3 (Swiftness):
• How to Turn on Develop...
► Free Zombie Character (Pxltiger - Unity Asset Store):
assetstore.unity.com/packages...
► Unity OpenXR: Meta - Package Name:
com.unity.xr.meta-openxr
► Unity OpenXR: Meta - Documention:
docs.unity3d.com/Packages/com...
► XRI Docs: docs.unity3d.com/Packages/com...
▬ Credits ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► Music by Scott Buckley - released under CC-BY 4.0 - www.scottbuckley.com.au
#Unity #Quest3 #mixedreality #VR

Пікірлер: 87

@BullyStudio 3 күн бұрын

I tried 3 or 4 other tutorials to achieve this yesterday and none of them worked for me. Errors and problems at every step. THIS however, is the one. Just got to the end of this video and it's working great. This guy knows his stuff, and goes into great detail and takes care to make sure the project is set up just right. Looking forward to working through the next vids.

@crimil610016 7 ай бұрын

Love the way your tutorial instructs, explaining the reason behind each step, super clear and clean. Thank you.

@LaikaBossGames 8 ай бұрын

Thank you ! Starting to learn VR and your channel is exactly what i looking for.

@davidturnbull9893 7 ай бұрын

Exactly what I was looking for. Subscribed. Thank you.

@HansMilling 6 ай бұрын

Best tutorial of them all. Slow pace so anyone can follow and you don't miss a single step from start to finish. Most other videos I have watched left me in the dark. Either by starting with the environment already set up, skipping crucial steps or going way too fast to see what is going on. Can't wait for more tutorials from you, especially hand tracking and use of hands instead of controllers would be awesome to get a tutorial on.

@GenoFelice 7 ай бұрын

This is by far the best tutorial I have watched. I have watched many and they all suffer from the same issue. Either parts are skipped or glossed over. This makes the tutorial hard to follow. It might just be my lack of some basic knowledge that the author is expecting that I have but, in any case, I find many of the tutorials hard to follow. In the case of your tutorials every step is detailed with nothing skipped or glossed over. GREAT TUTORIALS!

@skahler 7 ай бұрын

Thank for for this super clean video. Smart people in the world are thankful for this right now.

@williamjustus2654 8 ай бұрын

Exactly what I have been looking for with do as I do steps. Please keep working with the mixed reality/Quest 3/Unity tutorials. Thanks so much.

@LudicWorlds 8 ай бұрын

Glad it helped!

@JoseLuisGutierrezHerrera 8 ай бұрын

Really loved this video. I was looking for the specific combination of using the XR Interaction Toolkit and the Passthrough feature for the Quest and this video delivered! Looking forward for part 2!

@LudicWorlds 7 ай бұрын

I'm glad you found it useful. :)

@camelmotion2685 Ай бұрын

Best clear explanation from the scratch

@xmesaj2 8 ай бұрын

you're great teacher and wish your channel gets more attention in this new gen headsets era, love your videos, made my first game with older guides and quick tinkering with Unity within 5 evenings and I plan some day to get back to VR development when I have more time and new ideas :)

@LudicWorlds 8 ай бұрын

Thank you for the kind words. Best of luck with your projects!

@NuiiCashy 8 ай бұрын

Here before this video blows up :O You have my sub! :DDD

@MrDayTwo 7 ай бұрын

Super helpful, thanks a lot!

@timkummel8139 7 ай бұрын

OMG, so good pleas a lot more

@imanniom 5 ай бұрын

Thanks a lot. Nice toturial structure and well explained. Keep up the good works and wish you all the best 👏

@metasmash 7 ай бұрын

You are a real PVP!!!! Subbing right now and shared!

@forginbits5457 3 ай бұрын

Absolutely amazing tutorial, clear and straight to the point. Saved me a lot of time. Thanks a bunch !

@LudicWorlds 3 ай бұрын

Thank you very much for your kind words and donation. :) More MR content planned for next week.

@user-gc1nr8gc4v 5 ай бұрын

thank you very much for this tutorial it worked very well with me.

@r3kr 6 ай бұрын

my god, this tutorial is a piece of art work. Thank You!

@stevenzuccaro2639 5 ай бұрын

Can I save the project and just use as template so I dont have to do the setting changes each time?

@antoniovictor2000 5 ай бұрын

thank you sensei, please continue the videos

@renishantony6133 2 ай бұрын

Best Tutorial

@gagagu01 2 ай бұрын

Thx

@michaelhelle3020 8 ай бұрын

Top Tutorial, works like charme! How long did you take to find out all these settings?

@motoday3580 8 ай бұрын

Great video, show how to use the enemy's movement in a scanned room, how to make windows into the virtual world, how to make the destruction of walls and the virtual world behind the wall, how to place a lever on the wall of the scanned room. I want to learn more about how to interact with the scanned grid of the room.

@LudicWorlds 8 ай бұрын

Thanks! I intend to cover various forms of interaction with the scanned environment. The next video will cover 'Plane Detection' of the room and furniture.

@Kingdomax 7 ай бұрын

Good job, your VDO is well detail explained. I'm looking forward for next part. BTW, why did we setup the project with URP instead of default built-in render?

@LudicWorlds 7 ай бұрын

Thanks! Working on Part 2 right now. I used URP in the tutorial as, although you could use built-in, URP is more performant on the Quest.

@davestr2046 5 ай бұрын

It is people like this who should be doing tutorials on Udemy and the like. Tutors who actually know what they are talking about.

@LudicWorlds 5 ай бұрын

I've actually been considering doing just that. ;) Thanks for the kind words and motivation!

@tianshuli1927 8 ай бұрын

Hello, I've been quite intrigued by the implementation of MR in the Quest 3, particularly in the "First Encounters" project. In this project, the game environment is displayed after scanning a space. I have a specific question: How is it possible to create an effect where one wall is virtual, and when touched or shot with a gun in the game, it reveals a virtual wall? I'm very curious about the technical aspects of how this effect is achieved in the "First Encounters" project. I would appreciate any insights or explanations you can provide on this matter. Thank you very much.

@fabiuspeak 7 ай бұрын

Great tutorial.... it is very helpful! Any tip on how to continue it for example to include either hand tracking or controller inputs to include some basic interactions? There are not input presets for the controllers in the XR Rig....

@LudicWorlds 7 ай бұрын

Thank you, I'm glad you found it useful! I've just covered basic Touch Controller setup in Part 2 of this series: kzfaq.info/get/bejne/fZ2RoLKSysi6c3k.html I plan to build on this as the series progresses. However, I've also created this short course covering basic interactions: kzfaq.info/sun/PLWcLPdrF6kOmwlF8mOx8bY6HfYnV3NPqq

@ElectronicWallPlays 7 ай бұрын

I did hit a snag at 5:30 I also had to install the xr interaction toolkit to get all the options you show at 11:00, it only showed the mobile AR xr rig

@skahler 7 ай бұрын

The amount of pre-configuration that's needed here is precisely the bottleneck for new developers, as it was with Python development back in the day. Definitely can't wait till new MR projects are a button click away.

@LudicWorlds 7 ай бұрын

Agreed, it's far from a streamlined process right now.

@dionaea973 5 ай бұрын

You could use meta building blocks

@lauraluna7479 5 ай бұрын

What I find incredible is how easy it was with the oculus rift and even with hololens 2!

@ManhDungNguyen-cs3ih 7 ай бұрын

this video is amazing. It works perfect for me. However, when i try to grab and throw the interactable objects, it keeps falling endlessly. How to make the VR game recognizing the floor? Thank you so much

@HearthstoneMontage 7 ай бұрын

Why 3D(URP) when there is MR option?

@haraldgundersen7303 8 ай бұрын

Very nice ... Please keep em coming but forget about Oculus Integration (obsolute). Could you show how to destroy a real wall? Just kidding😊 there's so many requests and wishes...

@Yair_Zvilichovsky 3 ай бұрын

I was not shown the Run Device by ease ... first select the SDK in edit->Preference -> external tools . make sure to have a usb (3) data cable . install oculus meta quest link software . connect cable -> enable authorization from the Quest 3 device for the PC. then selecting your device will be available in the build settings run device Hopes this helps

@sadshed4585 3 ай бұрын

im stuck here I will try this

@sadshed4585 3 ай бұрын

yeah I couldn't get it to work any advice? how did you get connect cable ->enable authurization inside of external tools

@davidosorio1585 7 ай бұрын

How can you upload it to your Quest 3 library? So you can play it without cable?

@alvin3171997 7 ай бұрын

loves the tutorial. Do you see how well will Unreal engine compete in MR space going into 2024?

@LudicWorlds 7 ай бұрын

I've only started looking into Meta Quest development in Unreal, so don't feel qualified to comment on that right now.

@EltonC06 5 ай бұрын

do i need to have an oculus quest 3 to create a game for it?

@b.s.7693 8 ай бұрын

Day 3: it hasn't blow up. But yes, it's a very cool and interesting video.

@user-uo2ph3ul3d 2 ай бұрын

Thank you for the video! It might be a stupid question, but do I understand correctly that developing for mobile AR and AR using Quest is fundamentally different? Like the features from ARCore would be available on Quest at all right?

@LudicWorlds 2 ай бұрын

By using the 'Unity OpenXR: Meta' package we are also leveraging the 'AR Foundation' API. The API will remain the same, regardless of platform, however, the features available to you on the Quest may be limited compared to mobile. Check out 'Features' here: docs.unity3d.com/Packages/com.unity.xr.meta-openxr@2.0/manual/index.html

@ricardojaviergarnicapena6749 5 ай бұрын

Amazing video, thanks. I suppose I can use another object instead zombie, for example a terrain model or 3d map. Is it true? Thank you

@LudicWorlds 5 ай бұрын

Yes, absolutely. Feel free to substitute the Zombie for any other 3D asset that you want.

@ricardojaviergarnicapena6749 5 ай бұрын

@@LudicWorlds thank you

@attentiondeficitdisorder 8 ай бұрын

Anyone else having horrible video lag from the passthrough camera feed when running this from Unity? It's like 4 fps.

@hoainhan9118 7 ай бұрын

I am experiencing FPS issues when implementing Passthrough in Unity VR. My FPS drops to below 5, even hitting 0, but it works fine without Passthrough. I've tried just adding a cube and even creating a completely new project, but I still face similar issues. I have also attempted exporting the APK file and distributing it on App Lab, but the problem persists. Please Help me!

@samanthaah263 6 ай бұрын

I currently don’t have a Quest 3 only a 2 I’m waiting for my 3 to be delivered.. my question is in the beginning when selecting android and editing the run device can I select something else to start or should I wait for my 3 to come in the mail and connect the device and select that?

@LudicWorlds 6 ай бұрын

Yes, you can use your Quest 2 to follow along with the tutorial. The passthrough will be monochrome and low-res, but it should all work just fine.

@deianpopic9664 8 ай бұрын

Very good tutorial! Are you also planning to add the XR hands to the XR Rig to switch flexibly between controller and hand tracking? Thank you and keep up the good work!

@LudicWorlds 8 ай бұрын

Thanks! Yes, switching between hands and controllers would be a good topic for a future video. 👍

@seanthecommandblockenginee1238 7 ай бұрын

I am having issues with my meta quest 3 I tried to load my unity game on my standalone vr headset, and it seems to take a while to load it.

@r3kr 5 ай бұрын

took me bout 5 minutes to build and run.

@bharatkumaracademy720 2 ай бұрын

How to place object at particular position just like we do through mobile AR

@LudicWorlds 2 ай бұрын

Take a look at Part 5: Raycasts & Anchors: kzfaq.info/get/bejne/j76ogrKgmsXeZpc.html In that tutorial, we detect where a controller ray hits a collider, and then place an object at that specific position.

@jtinz74 6 ай бұрын

The controllers aren't tracking and the app crashes when compiled in debug mode. Looks like VR support in Unity is still a mess.

@r3kr 5 ай бұрын

Hey I built it and ran but just see blank blury unity scene..?

@r3kr 5 ай бұрын

Figured it out...I did not enable developers settings.

@user-td6lt9ng4b 6 ай бұрын

I cannot see on Rin device quest 3 , and its connected by USB any suggestions ?

@LudicWorlds 6 ай бұрын

Have you turned on 'Developer Mode' ? if so, have you accepted the "Always allow USB Debugging?" dialog (that appears in the headset when you first connect it)?

@somediedrank 4 ай бұрын

I developed MX reality used "OCULUS" option. (not XR) what' the difference?

@LudicWorlds 4 ай бұрын

Using Meta's Official SDK means that you have the most up-to-date integration with Meta's platform specific features. Going the 'OpenXR Meta + XR Interaction toolkit' route means that some of these features may not be as well supported. The advantage is, however, the potential for easier adaptation to other platforms (since the XRI Toolkit provides a common interface to OpenXR compliant headsets).

@shenbagapriyak5368 4 ай бұрын

Image target is possible using meta quest 3?

@LudicWorlds 4 ай бұрын

Unfortunately, it does not look like Image Tracking is supported on Meta Quest (take a look at the 'Platform Support ' table) docs.unity3d.com/Packages/com.unity.xr.arfoundation@6.0/manual/index.html

@shenbagapriyak5368 4 ай бұрын

@@LudicWorldsThank you so much

@mm.A747 2 ай бұрын

Does this work with oculus2?

@LudicWorlds 2 ай бұрын

Yes, Passthrough certainly works on the Oculus 2. However, it will be monochrome and low resolution.

@elliek419 24 күн бұрын

Why do I not have a settings folder under my assets?

@LudicWorlds 22 күн бұрын

The 'Settings' folder in 'Assets' typically contains various project-specific settings files. In this project, these files define Graphics Settings (i.e., configuring the Render Pipeline). However, it could also contain Audio Settings, Build Settings, etc.

@elliek419 22 күн бұрын

@@LudicWorlds Hi, thank you for your reply. Your video tutorials are so helpful! I still am a little confused because I do not have this settings folder within my assets like you show in your video, and because of that I am unable to apply the URP balanced renderer asset to the scriptable render pipeline setting like you show at 10:17. Let me know if you know why this could be happening and thank you again!