That Unity joke made me fall out of my seat laughing. Super relevant right now.

YES! Thank you for going live and explaining some of the questions! you guys ROCK!

I've been waiting for something like this to happen. What a time to be alive!

Respect. I think you guys are following into the footstep of the Corridor Crew. I like the flavor that you bring with the video scripts/montage. Subscribed.

Really great video, I’m definitely subscribed to continue having fun with you guys! 😂

Cool! Very nice video again! It was interesting to see how Kenjis UE plugin runs in practice. Great job!

Looking forward to your next video on G-Splats! So fun to see you experimenting with it.

This just keeps getting better and better!!

Thx guys ! Looking forward seeing where all of these new techs lead us

I love the enthusiasm of you guys. You keep inspiring me to learn and try new things.

Pretty awesome video, thanks for sharing!

How are you able to get the GS visible in the CineCameraActor for the rendered cinematics. When I look through my camera the GS is not visible even when the GS is directly in front of the camera?

You guys are the best, literally! Big hug from Chile!! I will try GSplats this weekend for the terrain of my architecture thesis project, to see if next week I can bring all together to UE5. Hope everything works :)

For GSs I can open in the python view they don't show up one I import with the plugin and drag into scene with a light. Is there any niagra prerequisites which need installed? It shows when I edit the BP but not in a blank scene, even scaled large and small. Any sanity checks I can perform? Geo shows up fine in the scene, just not these BPs it creates in a blank scene.

hey, i played around with that tool aswell in UE5 but i didnt get to the point to make the different parts of my gaussian splatting scene look seamless. you know what i am talking about? its dependet on where your viewport camera is. it seems as if certain parts of the gaussian splatting scene jump from one resolution to another. were you able to solve this? i looked it up in the documentation but i think i did something wrong. just for now i prefer the "sibr gaussian viewer" from the original github documentation.(just for viewing)

Hey, which software are you guys using for video playback?

Amazing content! Keep it up!

thanks for bringing interest to these new/old techniques!! :)

excellent video! What is the name of the program to preview the frame sequence, when you drag the mouse, move forward or backward in time?

Very exciting! Have you done any side-by-side tests on if shooting 1080 vs 4K vs 50MP stills vs HRDI vs RAW give and significant quality advantages in the final g-splat?

Hi there. Nice vid but I struggle with a small detail. Maybe you can give me a hint? How do you link the gauss to a cinema camera actor instead of the viewport to render out?

Need some details video how you did it, cabt understand how that splater came or was processed , really confused that how the plugin dose it, dose it take image sequence directly and dose it or we need other software to make the gaussian spaltter ???

Splat only showing in live mode, not in viewport. Is there a fix for this?

Yessss.!!!!Awesome!!!Thank you for testing this app. Now I buy Thanks! More Gaussian!!!!

Dude!!! This is SO COOL!!!! I can't believe how far back the detail goes

Nice!!!

Hi! Thanks for the sharing you guys are amazing!! but I run into a problem that the Splat Ply I download from Polycam can't load in UE5 with Luma plugin on....the file crash immediately if I drag the file in... anyone knows the solution? Thanks!

This is very nice.

amazing stuff!!

Hei! I have just downloaded Unreal and tryed to connect with Luma but it seems Unreal is 5.3 and plugin is for 5.2? Any help?

I wanna use this to keep the same camera angle i intended but stabilize shaky shots. I'm a freak of stabilization and this seems like the ultimate solution. maybe some basic masking the 2 methods might fix the sky? or the colors will differ too much? nice work keep it up.

Totally blown away!!

Thanks for hearing me out!

Hello guys, first I want to say amazing work as always! Do you know if there are other methods of cleaning your splat aside from cropping with the plugin? Is it possible to do it with another 3d software like blender?

What is the software used for gaussian splatter

Heads up, there is a new plugin out there now that has supports importing edited PLY files, so you don't have to deal with floaters, objects, distortions and areas that you don't want. I can't post link because of KZfaq's horrible filtering, but there is literally only two plugins on Marketplace right now, so :P

I'm curious, how heavy is a scene like this in terms of memory usage ?

I'm curious if one can do in-game rendering with this. Like do (2 or more)-stereopair for inner rendering -> do GS estimation -> display rendering with GS. Some optimizations come to mind. As I can get GS can allow some extrapolation on multiple frames for static scene when view camera moves. So one can do inner rendering less frequently.

Hi guys and thanks for all the great content. I was wondering to use this technique to test infrastructure assessment with drones (imagine capturing a full bridge by flying around and under it). Do you think this could work? And do you think that using a reference object for sizing it would be possible to take precise measures of parts of the structure? Trying to understand if this technology could be useful to replace complex photogrammetry missions to some degree.

This is getting crazy!!!

It always failed when I train my model, and shows cuda out of memory, anyone can help ? My GPU is NVIDIA RTXA6000 48G, and I input 999 pictures , they are 10G in total.

Anything to use gaussian splatting in blender? I've seen a tweet from a guy who creates tutorial to make 3d gaussian splatting, so I just want to know if it exist / its possible to make. Any Response is appreciated.

Looking forward to making my house and neighborhood a map in a future video game with like a minute of video from my phone. This is insanely cool.

Hello team, just a random question , can we create 3D models using guassian splatting ?

Hi just a short question can we achieve this with low vram gpu like rtx 3050 laptop edition with 4 gb vram the unreal engine works fine but it's the gaussian splatting I'm concerned about? Thankyou in advance

Guys, please, try this in VR! UE+3GS+VR it will be mind-blowing, I sure 🙌🏻

Nice! Could you use a negative volume or something to crop the unused parts?

Thanks a lot for sharing this ! I was very impatient to find a way to get it in UE (I was searching for it, found your video) I hope we will get it Twinmotion as well in a not too far future... And of course to be able to edit the splats !!! That would be great !

Okay so, hear me out. As an artist, a traditionally trained painter and one who's pretty familiar with 2D digital illustration on a tablet, this has me imagining a new level of digital painting tool. Instead of working on a tablet, you'd wear a VR headset and paint splats directly into three dimensional space with a motion controller. Imagine a 3D rendered scene in Unreal, that's hand painted into space and looks like an impressionist painting. I want that. I want to be able to do that.

How is performance? Is this something we might see in a game ... or something that I might use to create a VR game that runs on Quest 3? Does this need as much VRAM as GSplats usually need?

I think that the issue with the sky generating weird gaussians could be remedied if the software knew what certain parts of the images are supposed be like. For example you could mark parts of the image and tag them as "sky" or "far away background" and it would then know to generate those splats far away instead of how it is now. Someone would just have to code in that functionality first. :D

for certain applications, you could make crazy games like this

Supercooool!!! Would it be possible to grab an hdri with rendertargets and then use this hdri to light additional 3D objects in the scene with it?

pretty cool vid, thanks. i m new to this channel but it sounds you guys come from film. i'm a gamedev, so i see it from that pov. i find Gaussian Splatting interesting, though i really think mesh reconstruction with nanite could give better results, and speed. specially on the text of the signs (depending on what you want to do). (also reflections, light and collisions). though i'm actually interested to know if actually the performance diff between both. if GS are 100% on niagara it might outperform nanite (given it might be simpler). though on a game, i wouldn't want to use up all my gpu with GS, the game itself would be demanding. It would be nice if you guys could share the gpu consumption of playing in the scene. i wonder if you could do stuff in VR like virtual stuff (like a "walk around somewhere" or "see this stuff"). i think the cool stuff on GS was the part where it captured the "floaters" i think that makes for cool clouds. but i think volumetric clouds are actually better, though maybe less realistic. another point might be how it works with collisions lights and reflections. i think GS visualization might be much less flexible in that regard. i really hope Epic adds GS directly to the engine, it might just be a cool thing to mix with other pieces. Maybe for certain things, like an intro animation (like FFVII e.g.), or mountains on the distance or buildings.

Could you compare the unreal paid plugin and the luma free one ? Is one better than the other one ? Fps ? Yours videos are great btw

Welcome to new UE Plugin: "UEGaussianSplatting: 3D Gaussian Splatting Rendering Feature For UE"

This is dope! Just learning about this new tech as I would like to find ways to innovate with my drone work in the 3D world 😊. Btw if you want to use some footage from Puerto Rico for these videos I’ll gladly provide one just to see you do some magic with it 🙂 Keep up the good stuff! 🍻

Yall innovating at record speeds

do you think it would be possible to import a 360 video from a camera mounted on top of a Mavic3?

in theory you could make a scale model town and use that as your training right?

Ur tutorials are the best they are so immersive and on point just like your awesome work

So cool guys!

Gaussian splatting can be the future of 3d rendering

I wonder how well it could render a scene if you got more scans closer to parts of objects and more angles too! This has a lot of potential

I tried doing photogrammetry with Google street view domes and it didn't work but I wonder if you could do it with this?

Imagine Microsoft integrating this into Flight Simulator. It's already scary realistic looking at times. With this, it would become indistinguishable from real life. This as a tool in creating movies, shows and I can even see plenty ways to make this useful in 3D games, if it really takes down the processing power to achieve this level of realism, it's going to be a big thing in all media going forward. One issue I see though, the lighting and shadows from the time of day you record in are baked into it. To make this useful in games, you'll need to figure ways to convert this to a neutral lighting, so you can apply lighting to it.

You guys rock!! I don't have a very powerful machine so before when I tried importing NeRFs inside Unreal with another plugin it would crash. Do you think those Gaussian Splatting can load on a less powerful machine? Would you make a test file available to try?

The price of the plugin is worth it honestly

So now what we need is for DJI to add a feature to their drones to be able to define a target for calculating a flight path for taking splat maps

I really want to see more!

Could you provide the link to download the photos to imput, like the piramid ? I love your channel!!

I want to know if the size of the trained large-scale scene model is very large? A simple model I trained myself can reach several hundred MB

How to create such point clouds?

7:21: that Chrono Trigger "End of Time" vibe

Dayum you bros have some uncanny valley qualities! : D Only 1m4s in tho really liike it so far! One Love! Always forward, never ever backward!! ☀☀☀ 💚💛❤ 🙏🏿🙏🙏🏼

Guys in the drone videos. I wonder if the drone goes 360 how it is going to be ?

Great video thanks! The UE5 plugin costs 99$, has anyone found a cheaper version?

Hi. Were these locations shown as niagara particles? Wish you showed how the added lighting would’ve affected these scenes 😢

Using this technology on security cameras. The videos captured by them. Exploring the environment to have a better look and understanding of the scene

amazing

It seems this technology could also serve as the perfect LOD bias setting, instead of switching out for a lower poly model you can just switch to the Gaussian representation. I imagine it will be very useful for open world games, like assassins creed or cyberpunk 2077. It seems that with the combination of these technologies with things like DLSS and Gaussian rendering we can get games to both look better and run better than native, but easier said than done lol.

Wen export to c4d

Wow, just Wow.

Can you do a 360 video inside a city and use this as HDRI/sky dome for a game?

So technically you could create a photorealistic 3d scene traditionally, then, pan the camera around virtually every single angle and take a video of that… then create a 3d Gaussian world based on that world.

very soon we won't be able to tell 3D from real life, wow!

damn, thought you guys were gonna throw a third person character in there real quick over a plane so he can walk, and just make the plane transparent or something. That would've been real simple but cool. either way this is awesome

can you edit the niagara system?

I'm having pain because I have to wait for the next video

Also polycam has now added a feature for this.. but experimental and only 200 photos

As it stands, while GSplats are visually more appealing than NERFs, the latter appears to have a slight advantage in terms of adaptability for virtual production. Would you agree?

It's amazing 🤩, can i use this in unity 🙄 ?

PLEASE do this real time!!! The end of problems with stream 3d content! 🤯🤯

Ah yes, UEFN my home, can't wait to see what you guys do with this

Can you view 3dgs in vr?

We need some Aeria 51 footage to analyse the place better :P

Here we go)

You guys have to try gaussian splatting with a 360 Camera

Just imagine the Gaussian Splats Robots and self-driving cars would produce. They'd be able to "videogame" your life and generate maps for everywhere you go.

What about an indoor Nerf vs GSplat. ? I’m going buy this app next Friday and try with the Polycam Splats. And hopefully get around to the regular splat set up. Hopefully these can replace costly reshoot builds where we have to recreate a portion of a Set. And the background is just out of focus anyway Can you test Polycam Splat Vs Original Splats? Awesome channel BTW!