I find this incredibly interesting and awesome.

If you ever showcase this again, it would be awesome if you could clip away all the flickery and large spats. Only keeping refined areas. Like perfection in a black void!

its really cool that there is audio. I assume captured audio from the location. But even if its created from stock footage or something it still adds a lot!

If you train it for longer it’ll look a lot better!

It’s Melbourne! Gaussian Splat let me recognise Eureka tower!

Thank you for the explanations. What kind of LIDAR machine would get the results shown in the bridge scene at the beginning?

Does Garcia work with the point cloud files that the Luma AI iphone app generates? I tried uploading my point cloud luma files up to garcia, but it doesnt seem to like that format?

When I saw Instant NeRF and gsplats rendering at FPS greater than 100 I got excited. Because like you, I had seen photogrammetry in VR and know how cool it can be. The Valve HQ in Steam VR is wild! Have you see Google's "Block-NeRF"? They scanned a very large area of a city in the bay area and can stream it in so they can fly around maybe a ten block area. Wait until we can train and render these in real-time so that they'll be able to set up some cameras around a sporting event or concert stage and stream everyone volumetric video as gsplats. This type of streaming will eventually replace other 2D types.

its hard to get good splats without running 400 photos

Any way to run this in browser? Or directly from headset hard drive?

Thank you

this is so interesting because i was interested in bringing 3d scans into one of my fave games as mods but other modders told me "its too many tris its impossible" but then here you are running it in vr which is suually even more demanding. I am wishing i can bring stuff like this in game.

Great stuff, I think we will mix technologies to get the best of all worlds for the forseeable future

what a time to be alive

*promo sm*

How to export this into quest 2 ? What engine to use ? And what sdk to use? Can you please explain? I am interested to try this. This is awesome..😊

what VR software do you use to place splat in?

Interesting video. Would be great if when capturing video from your point of view you move and look around a bit slower.

Great!

Excatly what i was looking for, incredible for capturing spatial memories

Very cool indeed

Maybe it can be used as skyboxes?

This looks absolutely amazing!😮

The biggest problem of nerfs and gaussian splats i see their lack of editability like it's like capturing hologram it looks great but for world construction pacticulary for games it seems really hard to use..

There is no point cloud in 3D Gaussian splatting it is built from splats. It is still ok from a distance and actually quite good but you come close and it all breaks. That is why you see them around. You can still import it to 3D modeling software but only if you do not plan to come close to them in 3D environment.

WELL DONE

i could see google doing this with street view

I wonder if apple’s Vision Pro spatial video uses something like this. They say the iPhone 15 pro camera can record the spatial video but the cameras aren’t human eye distance apart so it seems like they’d have to be doing some 3D math with the cameras. I wonder if they’ll end up adding a “capture your whole environment in 3D” feature

What lidar scanner do you recommend? Cool shit.

I was unaware that the splats change their properties depending on the direction we view them from, that explains a lot of how specular highlights can change, and how reflections can work. Google did this in their Lightfield demo by 3D reconstruction and from what I could tell texture swapping. Kind of disappointing as it kind of removes some of the magic, but made sense at the time. That technique also suffered badly from being limited to the 1m sphere of their camera array. If I could take a video of my apartment and, as you said, port it into VR Chat, I would do that in a heartbeat to get my international friends to visit... on location, as it were. I very much look forward to this technology maturing, so we will have neat GUI applications to generate and export these environments. Also, I have completely forgotten to look at this myself, while I've watched videos and tutorials for a while now. Thanks for sharing!

I‘m not too knowledgeable about gaussian splatting, but I think it would be nice to somehow convert these splats to roughness, translucency, bump, displacement, normal and opacity maps etc…then map them onto the photogrammetry polygon model

beautiful thought

15:12 Never thought about it. Gaussian Splattering could "bring back" a loved one who passed away. Only for a short moment where you are only watching a still frame of the person but the possibilites are immesurable.

If you don't want to listen to me ramble and just want to look at the comparisons here are the timestamps: 02:22 - Back to back comparison 08:07 - Side to side comparison 13:15 - Quick splat vs lengthy photogrammetry

RIP THE HEART OUT

I remember when I had cancer several years ago, whenever a needle was about to go in, I always automatically muttered “Oh boy”.😂

Promo sm

I forgot about what Gentlehand told Sonja to do and got confused 🫤 at the Vortex Propagator but watching it back, it all makes sense now and I look silly lol.

Hi buddy. I've seen so many projects you've done on World of Warcraft in VR. Will you make more? I'm a WoW and VR enthusiast and would love to see other areas.

02:01:00 Is this on Normal? Watch my stream because they come in, in droves. It was damn near impossible...still haven't beat the last part. Probably have died a good 15 times.

Is there a mass effect home

Oh boy

Can you make Icecrown or Icecrown Citadel? Pls :(

Jade sea was a map / zone from Guild Wars 1. From the Factions expansion.

What - no authentic Star Trek Next Generation bridge movie set photoscan? Ah I see no 3D headsets were available in the middle of the eighties... well In this case of course I´ll take that absolute awesome Hobbit house from LucidKiwi :) And the last one in the video is also the most beautyful one and it has the iconic Portal cube on one of the shelves and a functional clock on the wall.

It's 2022 i would like my exasperated exclaimations to be gender neutral please you bigots.

To be totally honest just building your home environment is good enough for me. I've been doing a little bit of research and looking up VR and it's totally mind blowing. I'm hoping to get one after the holidays but I'm so excited I'm tempted to actually get one now.

Next time use Frank Parker from Seven Days, the world's first chrono-naught. Then when he lands to call in the worldwide emergency and he's about to say the word code word conundrum, have him use "Oh boy".

Nella versione italiana era: oh,mamma!