Step-by-Step Unreal Engine 5 Tutorial: 3D Gaussian Splatting for Beginners

Рет қаралды 54,614

7 ай бұрын

In this UE5 tutorial you will learn about 3D Gaussian Splatting in Unreal Engine 5. We are going to render Gaussian Splats in UE5. 3D Gaussian Splatting (gsplats) is a huge leap forward in 3D rendering. We will use UE5.3 this tutorial.
UE5 Beginner Course ► pinkpockettv.gumroad.com/l/UE...
Patreon ► / pinkpockettv
Instagram ► / pinkpockettv
About XVERSE 3D-GS UE Plugin ► neuralradiancefields.io/free-...
Free UE5 Gaussian Splatting Plugin ► github.com/xverse-engine/XV3D...
Polycam Gaussian Splats ► poly.cam/tools/gaussian-splat...
City GSplat ► poly.cam/capture/acc9a12f-b9a...
Car GSplat ► poly.cam/capture/423070ad-c13...
#animation
#ue5
#gamedev
‪@UnrealEngine‬

Пікірлер: 87

@dzezonja3558 7 ай бұрын

I'm more and more convinced we're living in a simulation created by someone, and we've just started a process of creating a new one.

@pinkpocketTV 6 ай бұрын

Yeah it’s scary where this technology is heading.

@DrLazerbeam 6 ай бұрын

What a stupid thing to think and then say. The tools, no matter how good they get, only make what we already believe to be reality. They can never make things more real than reality. To suggest you’re living in a simulation because somebody made Rome in a day, based on the Rome you know already exists is completely insane. There is no hint of a simulation just like when a chef makes my food my immediate thought is not “a rat under their hat made that”

@RHStevens1986 6 ай бұрын

there's a Futurama episode about this

@PHILXFROMBHK 6 ай бұрын

I was thinking exactly the same thing X'D

@Mopark25 4 ай бұрын

Simulations all the way down

@fotozhora 6 ай бұрын

Happy to see my creation right from the beginning ;)

@pinkpocketTV 6 ай бұрын

Heyy, thanks for watching. Appreciate the support!

@DillonThomasDigital 4 ай бұрын

This is a great video! Thank you! I got this working just a few minutes ago using Xverse plugin in 5.3. It seems to be fine but when I bring it into the vr template and activate VR, it only shows correctly in the left eye, whereas the right eye doesn't correctly show the splats - they look like billboard cards. Is it possible to view these splats in VR?

@WillFalcon 6 ай бұрын

Sure, waiting.

@simonebasi1 4 ай бұрын

Thank you very much! So helpful! Do you know how to make the "point transition" effect of luma ai app?

@entumonitor 6 ай бұрын

Is it possible to convert a 3D scene to Gaussian splatting? that each point of the cloud is specifically determined and that this kind of blurring in the cloud is not seen when viewing from angles far from the camera's point of view in conventional constructions.

@kickassmovies5952 5 ай бұрын

what could be its usage apart from creating various camera movements ?

@midzasaur 5 ай бұрын

My scenes don't look as high-quality as yours when moving my camera around. is this a setting I haven't changed or did I mess up on the import process?

@Hobnockers 2 ай бұрын

Cool. Can you change the texture maps, materials as well from the splat? I guess not possible?

@-NIGHTPIXEL123 7 ай бұрын

Wow Nice Grafics

@pinkpocketTV 7 ай бұрын

Yup!

@rajendrameena150 7 ай бұрын

what about other propoerties of material like specularity, metalness, transmission etc because it just capture current view at the time of recording.

@cristobalpesce1122 7 ай бұрын

great video, a question, can applications be packaged using this plugin? I would like to add this to my games

@pinkpocketTV 6 ай бұрын

Yup! It can be packaged into a game!

@aweidenhammer Ай бұрын

Do you have any idea if any of the gaussian splat plugins will compile and run on android? Mainly for native Quest experiences.

@akrommt6796 7 ай бұрын

more more video like this, plzzz!

@pinkpocketTV 7 ай бұрын

Yup! Thanks for watching!

@dimaananyev5336 7 ай бұрын

Many thanks to the author for the clear explanation and high-quality demonstration. It inspires me to conduct my own experiments. I have some questions and would be grateful if the author of the video could answer them: Firstly, I would like to understand more about performance, specifically how many resources are consumed in processing the files. Is it possible to cut out an area with a single toy car, or an area with a single Christmas tree, from these files and then clone this object multiple times within an Unreal level? I would like to learn more about the capabilities of working with lighting; it would be great if the next video could include a demonstration. Thanks again for the video!

@pinkpocketTV 7 ай бұрын

Thank you for watching. And yes the next video is going to cover all the things you mentioned. And again appreciate the support!

@samliveshere88 7 ай бұрын

are they compatible with niagara fluids and VDBs?

@ajking913 7 ай бұрын

Could one tell concert goers to download an app, then have them all film the show with their phones, but live-stream their footage through the app, to compile a song performance as a Gaussian splat construct? Could be a cool way to record concerts for virtual viewers.

@pinkpocketTV 7 ай бұрын

Gsplats doesn’t support animation for now, they are static. But this is a cool idea 🔥Thanks for watching! Appreciate the support!

@ajking913 7 ай бұрын

@@pinkpocketTV they don’t right now, but when they do, and an AI can assemble them, the world of concert coverage will change.

@dibbidydoo4318 6 ай бұрын

@@pinkpocketTV what do you mean? there's papers that have 4D gaussians like 'Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesis'

@MWLaboratories 15 күн бұрын

Would it be possible for a player running a compiled UE5 game to upload a video and it is used in-game to generate an environment? Or are the splatting tools for dev environment only?

@hotsauce7124 6 ай бұрын

How do you photograph this photogramitry and convert it into a UE5 asset?

@25mars 6 ай бұрын

which gpu are you using ?

@rccsrgaming6987 2 ай бұрын

Loved this content! But one thing to be aware! If you are having flickering issues, you will need to set your sort precision in your sprite renderer to high!!!

@JORGE-cb5oi Ай бұрын

como haces el efecto de los puntos? gracias

@tamiopaulalezon9573 3 ай бұрын

is it okay to use this on a Mac?

@Kafka-mo5vg 7 күн бұрын

hi, can you render 360° panoramic frames including a gaussian splat? How does this work?

@hytalegermany1095 6 ай бұрын

So gaussian splats are light interactive now? I see the colors change, but do gaussian splats actually draw shadows?

@dimaananyev5336 6 ай бұрын

My first tests showed that no, shadows from GS objects are not cast.

@kidtoday 7 ай бұрын

Anyone else notice how the translation transformations do not seem to work correctly with this plugin? When you try to move the GS actor, it will double transform and move diagonally on multiple axis. As cool as this is, if we can't properly transform the actors... it becomes almost unusable for many workflows.

@dimaananyev5336 6 ай бұрын

Hello, I encountered a similar problem. I assume that at the moment gaussian splatting is not an object such as a mesh, it is a system of particles in a certain volume. Transforming this volume and moving it does cause problems. In particular, I tried to isolate a certain part of the gaussian splatting object that interested me by enclosing it in a local volume, then I grouped the volume and the object, but I could not move them to the part of the scene I needed; the gaussian splatting moves diagonally almost uncontrollably. The second problem, which is also relevant, is the visual deterioration of the gaussian splatting image compared to the native viewer. The lighting works quite poorly; shadows from light sources are not cast. Has anyone managed to deal with these problems?

@lucho3612 6 ай бұрын

is this plugin better in any way than the lumaai plugin?

@pinkpocketTV 6 ай бұрын

It’s pretty similar and free as well.

@jayanthk6492 7 ай бұрын

I am getting "Unknown extension ply" when i click and drag the ply into the Content Drawer. Can you help me ?

@pinkpocketTV 7 ай бұрын

Don’t drag it, there is that button to import Gaussian Splats on the top.

@onedayapp3534 6 ай бұрын

where could i download gaussian splats??

@Lubos91 7 ай бұрын

Where did you take the first clip? It is from my country :D

@pinkpocketTV 7 ай бұрын

All links are in the description!

@FPChris 6 ай бұрын

You can’t go in close on it?

@isays 6 ай бұрын

it doesn't look like it would be especially useful for videogames - there is no interactivity with it. Even doing adding collisions seems like it'd be a pain. I suppose as a replacement for a skybox (specifically distant landscape) since it can be affected by lighting. Or maybe if you need parallax in your distant background for some reason.

@TheDiervek 5 ай бұрын

Hold on! Yes it can run in a standard browser and that is truly amazing but your browser uses your GPU. It might not tax the GPU like some apps but it has to be using it even if it's simply to display an image.

@pinkpocketTV 5 ай бұрын

Yup!

@randfur 3 ай бұрын

WebGL and WebGPU.

@rodrigohostup 6 ай бұрын

Download ply file is closed?

@SpockKaDeddy 7 ай бұрын

na bro, thought youll show using it with your own videos, what to do with pre made ones

@anjaligauchan3594 7 ай бұрын

❤

@karubrandao 6 ай бұрын

WE WANT THE TEXTURED MESH!

@hrivis 10 күн бұрын

Of course its on gpu, browser is only a viewer

@Fancy.languages1 4 ай бұрын

why my ue5.3 doesn't have crop volume?

@Aleksey_V_ 6 ай бұрын

It doesn`t work correctly in 5.2. Splat shows fine for one second and after that I see only gray checkered planes. Is it plugin error or I need to check some settings?

@ianzits 5 ай бұрын

instead of installing into unreal's installation folder, place the plugin into the projects folders as a folder called plugin, it worked for me

@Lyumins Ай бұрын

@@ianzits Unfortunately this didn't work for me. Do you have a solution? I have the same problem. At first, the textures appear for a second and then disappear. Folder solving not working.

@ianzits Ай бұрын

@@Lyumins have you tried removing it first from unreal default folder? The other option is to get the Luma aí plugin which is free and pretty much does the same, downsize is you have to create the GS I side their website.

@ianzits 5 ай бұрын

When i drag the BP to the scene i get one second of the colors displayed then what i end up with are a bunch of planes with no textures, like with the default unreal untextured object, couldn't find how to fix it, i tried to download the 1.0 version, but does the same thing. any suggestions?

@ianzits 5 ай бұрын

instead of instaling the folder into unreal installation folder, i installed inside the projects content folder and it worked

@pinkpocketTV 4 ай бұрын

Yeah!

@Lyumins Ай бұрын

@@pinkpocketTV Unfortunately this didn't work for me. Do you have a solution? I have the same problem. At first, the textures appear for a second and then disappear.

@maxhopnik2229 6 ай бұрын

Hello , when Im importing .ply file UE crash (NVIDIA GeForce RTX 2060 SUPER , i5 - 13600KF , 32 GB RAM) , can you help please ?

@mastas7 4 ай бұрын

dont rename your .ply while or after downloading... u need to keep it how it was named when uploading

@maxhopnik2229 4 ай бұрын

@@mastas7 , thanks , I ve got figured how to import )

@red4666 6 ай бұрын

you can't cast any shadows onto it though. like, if i create a cube in unreal and have the sun hit it, no shadows land on these splats.

@emilpohjalainen2293 4 ай бұрын

Oh ok. Wonder if there is a way to somehow extract a 3D mesh out of the splat, even just a low res one you could use as a fairly accurate shadow catcher. If not then at least shadows on simple surfaces could be easily created by just using simple shapes as shadow catchers.

@__--JY-Moe--__ 6 ай бұрын

👍

@pinkpocketTV 6 ай бұрын

Hey, thanks for watching! Appreciate the support.

@OlegJakushkin 7 ай бұрын

Can we have them animated?

@pinkpocketTV 7 ай бұрын

At the moment they can only be static. However I read a crazy paper which experiments with animated gsplats, so they are still working on it!

@rodrigohostup 6 ай бұрын

Very good explain!

@pinkpocketTV 6 ай бұрын

Heyy, thanks for watching! Appreciate the support.

@sepigraph 7 ай бұрын

There's nothing particularly new about point cloud data used in 3D, just with Gaussian Splatting it's being processed and rendered differently. Yes, details and material properies at the time of capture you are stuck with, but firms like Infinite Realities are already exploring animated gaussian splats of humans. I imagine the files are incredibly massive though considering the detail they can capture. But for video games and background elements in production movies this is definitely a game changer because of the fidelity. And if you output a splat with spherical harmonics it can be re-lit by the 3D scene/space it is in to some degree.

@yambarajesh 7 ай бұрын

@motiondesignermx2847 3 ай бұрын

i cant donwload for free there.

@ADUuniverse 7 ай бұрын

So youu in are not even teaching how to do Gaussian splatting the command prompt way

@MountEverestMetaverse 6 ай бұрын

would you say that way is better in terms of quality?

@yambarajesh 7 ай бұрын

Please contact me sir one doubt sir

@ArpitGolani 7 ай бұрын

Hello pinkpocket as we know using substrate materials is a game changer and far more realstic but i always had that issue whenever i want to render something like glass for example then i wont get the realstic caustics of a glass in path tracer any tips for that please...