Mixed Reality Cessna 152 Cockpit Tour - Quest 3 / Virtual Desktop / MSFS 2020

Рет қаралды 5,958

5 ай бұрын

A quick tour of my new mixed reality flight simulator set up that uses a custom build Cessna 152 cockpit dashboard and a Quest 3 (using Virtual Desktop) to passthrough the headset cameras to see the real cockpit dashboard inside virtual reality.
This gives me the ability to enjoy all of the benefits of VR, being able to look completely around my environment, but also to be able to see partially into the real world and see my actual cockpit readouts and controls.
This is just the beginning of this sort of technology but I can definitely see a future where this is the way to sim with full tactile feedback!
My PC Specs are:
AMD 5900X
Nvidia 3080Ti
32GB 3600 Ram
Quest 3 via Virtual Desktop
I'm averaging about 55fps which is smooth enough for VR with no asynchronous space warp turned on.
Software used:
Mobiflight: www.mobiflight.com/en/index.html
Air Manager: www.siminnovations.com/
JPL Cessna 152: flightsim.to/file/2246/jplogi...
Virtual Desktop: www.meta.com/en-gb/experience...

Пікірлер: 86

@kristianjorg418 2 ай бұрын

I have just stumbled upon the mixed reality idea and looking up different solutions. This method of modifying the actual 3D model is absolutely genious. Did'nt even think that was possible. Great idea!

@virtuallyreal 2 ай бұрын

Just stumbled across your video, glad to see my masking method working for other titles😄 the result you got looks very good, great job.

@baf_mcnab3065 5 ай бұрын

I think you have done a fantastic job, kudos to you, and now you can really enjoy flying past Villa Park et al, well done mate.

@FlyingTheston 5 ай бұрын

Already done a villa park fly by 😎😉

@richardgoldstein5600 14 күн бұрын

Best yet. Thanks.

@expataviator7107 5 ай бұрын

What incredible work dude!

@FlyingTheston 5 ай бұрын

Thanks so much!

@fly320YT 5 ай бұрын

Wow very amazing setup!

@FlyingTheston 5 ай бұрын

Thanks very much!

@japp3playzz 4 ай бұрын

Lol awesome cockpit, mate! Tons of worjk there!

@sixpackpilot 5 ай бұрын

What we all dream of...only downside is that I am stuck with one aircraft type for use with Mixed Reality (pass-through). Of course you can make multiple cockpits, but not many of us have the time, space and money...and patience/understanding from partners. Still, this is about the ultimate FS experience, only to be improved with full-motion for the cockpit and force feedback on controls.

@FlyingTheston 5 ай бұрын

I only ever fly the Cessna 152 so it's perfect for me. But if you're someone who likes to fly multiple planes then obviously this set up isn't ideal 😊

@davidmuir6849 4 ай бұрын

This is fantastic I had made a 152 sim out of a real 152 cockpit with 3 tv screens ,I wish I had kept the airframe Regards. Dave

@FlyingTheston 4 ай бұрын

@@davidmuir6849that sounds amazing, I bet having it built into a real cessna cockpit was as close to real as it gets! I was going to go for the 3 monitor set up, but space and cost (and performance) kinda pushed me towards vr

@davidmuir6849 4 ай бұрын

@@FlyingTheston Can you please tell me where you got the drawings for the panel ? Thanks Dave

@davidmuir6849 4 ай бұрын

@@FlyingTheston Believe me your idea with the mixed reality vr is far better than using 3 outside monitors 😀

@myphysicalworld3958 5 ай бұрын

Total awesomeness!

@FlyingTheston 5 ай бұрын

thanks very much!

@ChokDK-bryllupsmusik-duo 4 ай бұрын

OMG you're back!!!!! Let me please say thank you thank you so much for all your fantastic videos that have helped me making content for MSFS 2020 and/or learn more about the sim. Ohh and uhm.. "we" need to know how to insert an active marshaller to a helipad :D

@FlyingTheston 4 ай бұрын

glad you're making content with help from my videos! I've not touched the SDK in quite some time to make anything new, they kept making so many changes to it that it became hard to keep up to date with!

@jonmabec 4 ай бұрын

This is the best example of an affordable mixed reality cockpit I have seen so far! I am currently building my own, King Air one!

@FlyingTheston 4 ай бұрын

Thanks for the compliments! I hope your King Air one goes well, I'd love to see a video of it when its fully built!

@jonmabec 4 ай бұрын

@@FlyingTheston You bet! I would love to see more of yours as well! How is the readability of the instruments from air manager? Is the Quest 3 passthrough sharp enough? I am planning to use an external camera ( Stereolabs Zed Mini) attached to a Bigscreen Beyond.

@FlyingTheston 4 ай бұрын

@@jonmabecThe readability of the instruments is "fine" as much as in I can read them for the most part, but small details on them is just lost. Like I'd never read the kollsman window. But for the most part, its all fine, I can see what I need to see and I have the altimeter dial set up so when I press it, it just sets the altimeter to whatever atc says.

@rbarlow 4 ай бұрын

Brilliant. I mentioned this in my early Mixed Reality video but didn’t know how to modify the model. Could you do a step by step video on the process of creating and modifying an aircraft to include the color keyed panel replacement?

@FlyingTheston 4 ай бұрын

Your video was the one that inspired me to try the mixed reality cockpit in the first place! This was the video I used to add the custom model, it's quite an involved process and I'm not sure I could make a video that was any clearer kzfaq.info/get/bejne/j698m8V1tMCtiHk.html&ab_channel=Wooselman

@rbarlow 4 ай бұрын

@@FlyingTheston Thaanks....I'll check it out. I really found your early scenery creation tutorials helpful. This approach is the best DIY implementation of MR I've seen. Realitry Mixer is just too difficult to get setup and aligned. I also prefer VDXR too and no steamVR overhead. What is really needed is a plugin that could interject the color keyed object into the cockpit and to resize and align it. Perhaps a .obj modeled in Tinkercad so that anyone could create it without much skill. This is definately the future,

@julianlockwood3040 3 ай бұрын

Brilliant !

@tehsideshow 5 ай бұрын

Man, you've got some lovely hands here, do you moisturise? I've tried all sorts of brands of lotion, I even went fragrance free for a whole year.

@FlyingTheston 5 ай бұрын

Look lad, you want to stay away from those fragrance moisturisers, they're just going to dry out your skin and cause irritation. If you're genuinely serious about good skin care then have you considered toilet duck? It's just a question to you, don't get defensive or anything

@sascenturion 4 ай бұрын

😂

@andrewmorgan1819 5 ай бұрын

I loved that you made this video at Wellsbourne Mountford, then I saw the channel name and thought, where else would he fly from 🙂 Your Airfield has never looked better. Nice job on the cockpit and Airfield 😎🤘

@FlyingTheston 5 ай бұрын

thanks very much! hope you're enjoying the airfield too :)

@garysaunders1714 4 ай бұрын

@@FlyingTheston⁠hi great video, definitely the way to go. I’ve just recently bought a quest 3 for the purpose of mixed reality. I believe VR Desktop is what you used is this software only good if you are running your headset wireless? I have my quest 3 tethered via the oculus cable. Do you also need to purchase Mixed Reality software? I want to do exactly how you’ve set up but not shure if it makes a difference mine being tethered. Sorry I hope I make sense. Gary

@FlyingTheston 4 ай бұрын

@@garysaunders1714 I'm not sure how you'd go about getting it to work with a Quest 3 tethered, because even things like Reality Mixer would need VirtualDesktop as they don't have access to the quest cameras via steam vr.

@garysaunders1714 4 ай бұрын

@@FlyingTheston thanks for your reply, running your vr headset wireless do you find you get good fps still? I read somewhere you need fast internet and wifi 6 router. Thanks

@FlyingTheston 4 ай бұрын

@@garysaunders1714 you don't need fast internet, but you do need at least a 5Ghz router (most routers are these days) and you do really need your computer connected to the router via an ethernet cable (1Gb connection too)

@fwdskillzone1767 Ай бұрын

What an amazing enhancement for the X-plane for its drawback not utilizing the pass-through feature of the Quest 3. Could you create another video detailing the step-by-step process for implementing the pass-through modification? Especially focusing on how to seamlessly integrate the pink block into the aircraft model. Maybe Laminar Research should consider bringing you on board to make this a reality in X-plane officially!

@FlyingTheston Ай бұрын

This is for Microsoft Flight Simulator, not X-Plane. I'm sure you could do something similar on X-Plane but I'm not sure if the steps would be the same.

@Windsurfer7607 2 ай бұрын

Really great. May I ask you to make a short video how to generate and include that pink block? Many thanks in advance

@FlyingTheston 2 ай бұрын

This was the video I followed kzfaq.info/get/bejne/j698m8V1tMCtiHk.html&ab_channel=Wooselman and I'm not sure if I could do a video any clearer... The process is quite clunky and hard to follow, but it is what it is, just needs patience and perseverance. I'm happy to provide the cockpit gtlf for my JPL C152 if anyone would like it though :)

@baraskparas9559 3 ай бұрын

Fantastic presentation and realism. Smartest ever solution.Wider fov for you?

@gagagu01 2 ай бұрын

Fantastic idea, sadly the pop out panels won't work anymore when MSFS is in VR mode otherwise it would be a great solution for my A320 panel. Thx for this video

@rcbruce841 3 ай бұрын

how did you make the block and add it to reality mixer

@ExperimentalSimAvionics 4 ай бұрын

If generating the pass through mask could be generated automatically this would work really nicely with any of the Experimental Sim Avionics panel sets using Air Manager. You could fly many different aircraft in MR using that combination.

@FlyingTheston 4 ай бұрын

Yeah, my version is super basic, just a big block of pink across the whole cockpit dash... It would be great if custom plane models came with a "passthrough" cockpit so you could just choose that livery or something and get it all without having to mess about.

@techsilv5170 4 ай бұрын

This was what I was looking for, will the quest 2 work the same way?

@FlyingTheston 4 ай бұрын

yes....ish..... the quest 2 is only black and white and noticabley lower res, you may not be able to read any screens overly well in it, and the passthrough is also only monoscopic so things may not look 3d... the quest 3 is stereoscopic passthrough so it looks far more lifelike.... it's not perfect but its certainly "good enough" i think

@sirgriffinman 3 ай бұрын

@FlyingTheston where do you actually put the models you make for this cockpit passthrough? Would this work for a sim racing title like iRacing?

@FlyingTheston 3 ай бұрын

The model is the actual JPL Cessna 152 model and I've just used blender to inject a big pink block into that model, so when the game loads it loads the normal plane model but that model now includes my big pink block. I'm not sure if you could do the same with iRacing. You can always look into Reality Mixer on steam, that is an overlay application that runs over the top of any steamvr game, letting you add a passthrough block anywhere you want. It adds a bit of overhead though so it may make things a little laggier.

@Norwayflightsimmer-ky7ge 5 ай бұрын

Very nice, I will try to modify an model myself and get an pink box to get my stremdeck visible in vr, do you have a link to an good video on how to modify the airplane model in msfs?

@FlyingTheston 5 ай бұрын

If you're just using steam vr then I definitely recommend looking at reality mixer on steam. If you're using vdxr like me then you'll need to do the custom model thing. I'll dig out the KZfaq video I watched and link to it

@FlyingTheston 5 ай бұрын

Ok here are some of the links you may find useful: This is the Reality Mixer for steam: kzfaq.info/get/bejne/h5aSpdaH3M-WYIU.html&ab_channel=RussBarlow And this is the video I followed for injecting a blender model into another plane model: kzfaq.info/get/bejne/j698m8V1tMCtiHk.html&ab_channel=Wooselman

@Norwayflightsimmer-ky7ge 5 ай бұрын

@@FlyingTheston Tried with steamvr, but can`t get this to work. kzfaq.info/get/bejne/ocp3fMSFr9SVZ4k.html

@thecow76 Ай бұрын

would be nice if developers provide a passthrough option in future by default

@FlyingTheston Ай бұрын

yeah that would be great if planes just came with a livery that had a magenta cockpit panel :)

@lucafymail7147 Ай бұрын

How or where did you get that radio stack, it looks awesome?

@FlyingTheston 29 күн бұрын

It's custom built with a 3d printed face panel, then a couple of dials/buttons for operation with the monitor behind it that runs the right side components. If you want to build your own then I'd definitely recommend watching Captain Bob's channel, he has a video on how to build a really good radio kzfaq.info/get/bejne/j62igcaLrpvHe2Q.html&ab_channel=CaptainBob

@lucafymail7147 28 күн бұрын

Thanks 👍

@melvilib 2 ай бұрын

What did you do to get sufficent levels of light for the passthrough? Mine is very grainy and I need to work out how to light it, TIA

@thestonefox 2 ай бұрын

The trick is lots of natural light if you can help it. artificial light seems to make the passthrough noticeably grainier. As my cockpit is right under a skylight it means the natural light covers it pretty well

@melvilib 2 ай бұрын

@@thestonefox Thanks for that. No natural light in my case, but I could create it with daylight matched LED light panels.

@oleksandrbykov5480 11 күн бұрын

Would that also allow seeing IPad on kneeboard, for ForeFlight, and would that be readable, in your opinion? Thank you!

@FlyingTheston 11 күн бұрын

If you already own a quest 3 then I'd recommend just putting it on and putting it in passthrough mode and looking at your ipad on your knee and see if you think it's good enough quality to read. In good lighting conditions, the quest 3 passthrough is pretty good, but an ipad at a range of what maybe 50cm may become a bit grainy? But it all depends on the size of the text you're reading. I tried a quick test with just my phone on my lap and it was "readable" but not amazing.

@lovelyapple7167 3 ай бұрын

what is your mix reality system and how did you connect it to sim?

@FlyingTheston 29 күн бұрын

I'm using the passthrough mode on Virtual Desktop to only apply passthrough to a magenta colour, which I then mask out in the plane model. You could also look into SimXR for an easier alternative to this.

@yokoh691 3 ай бұрын

How did you fix the reality mixer stutter with msfs Works great with my DCS and other flight sims but I get a stutter with msfs only with reality mixer 3080ti

@FlyingTheston 3 ай бұрын

I'm not using reality mixer, I'm just using the built in colour passthrough function built into Virtual Desktop as I found reality mixer to give me a laggy overhead too.

@yokoh691 3 ай бұрын

@@FlyingTheston big thanks! Gonna do that, didn’t realize Vd had its own now aha

@publicname515 Ай бұрын

This looks sweet, does anyone make these custom built cockpits anywhere?

@FlyingTheston 29 күн бұрын

I'm not sure if there's anywhere that builds custom cockpits at a reasonable cost (I'm sure there are ones that cost thousands), but half the joy is in the process of making it yourself :)

@lesneilson67 5 ай бұрын

Is the Quest 3 passthrough stereoscopic?

@FlyingTheston 5 ай бұрын

Yes the Quest 3 is colour stereoscopic passthrough

@lesneilson67 5 ай бұрын

@@FlyingTheston Thanks, I'm asking because I have a Pico 4 which has passthrough, but with only one camera, and I'm wondering if stereo is necessary to make mixed reality work. Do you know if that's the case?

@FlyingTheston 5 ай бұрын

@@lesneilson67I'm not sure if Virtual Desktop for Pico has the passthrough mode, you could look into Reality Mixer on steam which does kind of the same thing and I'm pretty sure that works with Pico 4... although the Pico 4 passthrough isn't as good as quest 3, which is a shame because the optics and comfort on the Pico 4 are really great.