After 3 days trying I get!! I just want to say thank you for your tutorial!! I have some troubles and after solving that the results is really amazing!!

been seeing this everywhere, but nobody wanted to show how to do it! Thank you so much for this. I'm on my way to make some really awesome art. Keep it up!!

Hi, one of the authors here, this is awesome, thanks so much for doing this! Is it ok if we link this on the Github page?

This video is great! Thank you for being so generous with your knowledge about this cutting edge technology! ...and the command prompt tips were GOLD! :)

IT worked first try, this is incredible. I have a 3d cloud model of my living room forever. Great tutorial, super detailed.

man i remember we learned the theory in the 90s... movement detection due to motion blur and calculate / recreate vectors and depths in a blackn white photo... but the computerpower was so limited we were not really able to proceed......... working on paper, lol, later volumetric clouds came in and now we have this.....this is truely awesome..... something i had dreamed of for decades, recreated my own 3d scenes for months, now its only a video and photos you put in an ai. i am totally flashed.

Hey this is very cool! Thank you a lot. I finally managed to generate my first Gaussian Splatting model with your instructions. Lot of steps in here but it finally works! Nice that you have made windows version to github from the original. Thank you! This is so intresting!

Thank you very much for making this video! You're a great teacher, I had no problems following this and I'm very happy with how my first splat turned out.

you nailed it! thank you. had been led astray on other tuts and this one was very straight forward. I should drive all the confused viewers from other tuts this way.

I cannot thank you enough for this. I went from knowing basically nothing to a completed scene in 3 hours. It would have been much faster but I had the wrong CUDA version. You absolutely nailed this tutorial!

the coolest advancement in neural rendering! amazing stuff man

Really COOOOL video! Thanks for the guide and I successfully made my own 3D model!

Amazing job guys! As a surveyor i know photogrammetry and this is another level ♥

Very Helpful Guide. Thank you so much for making this video and saving a lot of time for others trying to understand and install the program :D

Been looking forward to this, thank you!

This is going to change the world.

Very detailed instructional video, love from new beginner. :)

Thank you, Jonathan! It works and it causes a storm of emotions in me. Just crazy!)

Wow amazing, this is great work! I am looking forward of applying this technology on google map's street view.

we used to use this 13 years ago for 2D--3D streo conversion with polar axis. :) Now its realtime hardware based. It used to be software based on depth maps layed out manually. :) now the hardware auto creates depth maps that changes it.

Nice tutorial. I would like to give a suggestion. When showing webpage's or application it would be great if one could zoom in, so the text is bigger, so people with problematic sight could see what is on screen :) Thanks

Much thanks. Will be trying this out tomorrow.

I've a 3090 TI, I feel blessed that I'll be able to mess with this tech. Tx a lot for hte tutorial.

soo good man running perfectly. Thanks for the video

Bravo. I will give this a go with images captured with my Leica BLK3D and compare the result with the coloured textured mesh created from the same images in RealityCapture.

Thank you very much for the video, it helped me a lot. Thank you for your generous sharing！

Thank you very much for making this more accessible!

Great video amazing tutorial skills. I would like to know if I can use 360 photos or does it have different setting

I managed to get pretty cool results on a RTX2070S with just 5000 iterations. The training step was pretty fast too, under 10 minutes! Incredible technology. I can only imagine how much more incredible it's going to get in a couple of years. Thanks for the video, everything was explained very clearly.

Thank you for the tutorial. Very helpful.

Awesome video! Any suggestions where you can get high quality drone footage like this (following a similar orbit path)? I'm performing research around various NeRF / gsplat models

dankeschön. thank you for doind this, it was a very good explanation

very cool tutorial, appreciate you made this. I am also curious whether this can be used to the video/image sequences that contains human actions, like dancing or performance, instead of static pose or static objects.

Great tutorial. Thanks!

Imagine capturing images for google street view using this technique 😃 I won't leave home ever again

I was getting errors with "diff-gaussian-rasterization" and "simple-knn" when running the command "conda env create --file environment.yml". I just wanted to let others with the same problem know what I did to solve it. I had to add "C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Tools\MSVC\14.29.30133\bin\Hostx64\x64" to PATH in order for the build command to find cl.exe. And since the "conda env create" command was aborted before it was finished I had to start a new CMD window after adding to PATH and rerun the commands, ending with "conda activate gaussian_splatting" and from there I typed "conda env update --file environment.yml" to start the build process again. Hope it helps someone. 😊

Ur the best! thanks for this tutorial mate❤❤❤

wow you are so kind this video is so easy to understand tank you

It feels like just yesterday when I tried out Nvidia nerfs and was disappointed by it's limited use but now here we are with visuals rendering out in real time smoothly :o

Very useful tutorial. Thanks mate

Correct me if I'm wrong, but it should be possible to convert any 3D blender scene into Gaussians because we already know the position of the virtual camera from the rendered 3D scene. So it should be possible to create photorealistic, interactive scenes pretty fast from 3D scenes created in blender from a few rendered images using cycles. This could be a revolution in gaming as well.

Awesome Tutorial!

Man I don't even know where to start... I've been struggling with the submodules diff-gaussian-rasterization and simple-knn and have been combing through the GitHub comments about the same issue for hours... nothing seems to work. Do I just need to uninstall all components and start fresh? Seems to be a lot of confusion about which CUDA version to use and how to install torch.

Wow!! this is really amazing. I'm new to Radiance Field methods and this is mind blowing. It's the future of all audiovisual industry. Also your tutorial is so incredibly detailed and well explained. Unfortunately I reached a point from which I couldn't continue because I work on Mac. Do you know if there's any resource where we could learn how to use gaussian splatting on an M1max macbook? Thank you very much in advance

Very cool, thanks for this. Curious, will this take 4k video data from like a DSLR? Also, is there a way to export these into a web viewable format?

Hi , first huge thanks for the video ! First time getting into it and it's working great. I have a question : i have a good recent pc ( 14900k etc...) but i still have my 3080 10gb and i struggle a bit. Is it possible to change the checkpoint to 5000 its for example ? To do some tests ? How and where can i change that ? At the begenning of the learning it goes to like 20its and then im truck between 5 and 6 so it's prety long. Again thanks and keep up the good work

Thanks for sharing!

Hi! Great project! How about adding support for EXR?))) It would be a fantastic opportunity to create HDR projects, such as those for cinema, for example. I just filming a low-budget historical movie, and I really appreciate your software!

Amazing. Thanks a lot.

Hi, Great tutorial, thanks a lot!!! Is there any explanation how to implement CUDA12? Didn't find it in repo

I don't have the machine for this, but I immediately want to see what one of these splatted scenes look like in a VR headset. 😁

Thank you! I managed to make a very basic one with 4000 iters on a 2060RTX not a lot of VRAM but it's something!

Tks for the tutorial, is it possible to export it at the end to a 3d format? (fbx, obj..)?

Can we use this as an alternative to Nerf (or in combination with) to convert video/images into "nicer" 3d models, addressing downsides of nerfs (garbled geometry, muddy "textures")? Certain angles certainly look better compared to nerfs output (even stunning so), but I don't quite understand if these "gaussian points" can enable geometry estimation or provide better point colorss? "Dumb" way that comes to my mind is to produce video/lots of pictures straight from 3d gausiann viewer (hoping to get the perfectly consistent stabilisation/angles/image quality compared to original video) and feed them into Nerfstudio, but I am sure this is not an optimal approach 😅

Well done!!

Awsome Video! We are getting this message while training the model: Tensorboard not available: not logging progress [30/09 12:35:06] Reading camera 990/990 [30/09 12:35:15] Loading Training Cameras [30/09 12:35:15] [ INFO ] Encountered quite large input images (>1.6K pixels width), rescaling to 1.6K. If this is not desired, please explicitly specify '--resolution/-r' as 1 [30/09 12:35:15] . other then that it seems like it is busy because it not allowing me to add a new cmd. Do you know how to resolve this?

Thanks for the video and managed to get it working. As someone who is new to this radiance field rendering.. may I ask is there a way to use this data and convert it into a 3d object? Like 3d scanning? What uses/application can I use this data for besides viewing it with a viewer? Thanks

Thank you very much!

You're a great teacher, really easy to follow, thank you very much. Is it possible to export a mesh or point cloud? I'm very new to this, but I saw that on instant NGP there is a "mesh it" button. Is it the same here?

Fantastic stuff! Would this work using a colourised 3D point cloud obtained from a LiDAR scanner as well? If so, what point cloud file formats are produced in your workflow?

Jonathan, thanks for doing this. As the data is effectively pointcloud based, can a wireframe mesh be made from the source data along the lines of poisson or similar methodology? Also, what lighting data do we get from the result-- can this environment be used to calculate a 3D radiance (if not raytrace) model? Very exciting stuff-- apologies if you've gone into detail on this elsewhere.

Excellent. I guess for the coding world on GitHub models and PY, windows is a must to try out these models. Unless there is a Mac workaround - any advice?

when running convert.py, colmap appears utilize my GPU initially for feature extraction but then completely relies on the CPU for retriangulation / global bundle adjustment, which takes a long time. is there any way to tell it to use the GPU for this to speed things up?

Hey, Could you maybe make a video on the colab file that is provided in the main code, there is no test file to evaluate the model or see the output in any way

Olá, eu tive problemas com o environment.yml, mas eu usei o conda env update -f aparentemente está dando certo.... obrigado!

Awesome video! Have you seen the paper for Dynamic 3d gaussian splatting? Code is suppost to come out soon. It looks very exciting.

Hi, after starting training iI always get this line: Loading Training Cameras [30/09 14:41:23] [ INFO ] Encountered quite large input images (>1.6K pixels width), rescaling to 1.6K. If this is not desired, please explicitly specify '--resolution/-r' as 1 [30/09 14:41:23] Loading Test Cameras [30/09 14:43:54] Number of points at initialisation : 172044 [30/09 14:43:54] This part (INFO) Encountered quite large input images... Should I resize them or just leave as it is? Thanks.

@thenerfguru hi, I have an idea that would utilise differentiable gaussian splatting, and I have a couple of questions you might be able to answer - would save me tons of time trying to figure it out myself. 1) Is orthographic camera available, in addition to perspective camera? 2) Currently the splats disappear when they are close to the camera (which makes sense for your use case). Would it be possible to disable this? If both are true, it would be possible to "slice" through a set of splats, which might have interesting use cases. Vertex representation provided by pytorch3d is unfortunately unsuitable for my purposes...

Is there a way to export a LAS/LAZ file or some other format for the pointcloud that this generates? At a glance it looked like the export option was for exporting a video; I assume that's a video recording of the user moving around in the environment?

When I try to compile it I get errors saying that the code has issues. I have gcc and vs code. It is failing to build the wheel for diff-Gaussian-rasterization.

The conda env install would keep failing for me until I finally installed python 3.7. I already had 3.10 and 3.11 installed, but apparently it wasnt compatible.

@thenerfguru I having some problem with the setup stage idk what wrong am I doing. I am getting some errors when I enter conda env create --file environment.yml I am not able to install the pip dependencies. I did go to github repo and asked for help but trying all solution given by the people I was not able to get the error fixed. Can you please help me out?

Great tutorial, thank you! I'd like to know if the resulting model and point cloud can be accurately geolocated/georeferenced for use in GIS 3D analysis scenarios?

Hi! Thanks! If I have 2 iphones filming static videos from different angles is it possible to combine the fuutages to create 1 scene with better quality? What about movement? Is it possible to animate gaussian splatting scene?

Thanks for all your work (also on your older vids!)! I am running into a problem creating the conda env. It found conflicts, lists them and then fails to create the env. I then tried doing it manually but ran into the same problems. Any suggestions on how to start fresh? Tried un/reinstalling anaconda but that didn't fix it.. Thx again!

ii See in post the big error for all is: error installing diff_gaussian_rasterization for X or Y reasson, i install all dependencies and still got this error in my machine.

you need to set up the enviornment inside the anaconda prompt. cmd didn't work for me

I am having the error on the command prompt of "conda is not recognized as an internal or external command". I'm stuck at 16:30. I installed anaconda and restarted my computer but it didn't work

During the process of using gaussian-splatting-Windows, when the image files originally in the 'input' folder are processed by python convert.py -s and output to the 'images' directory, they reduce in number from dozens to just a few, and these images now display a wide-angle effect. What could be the issue, and how should one go about troubleshooting this?

good, I had an error when I used the python train.py -s line Traceback (most recent call last): File "C:\Users\IvoJr\gaussian-splatting\train.py", line 13, in import torch ModuleNotFoundError: No module named 'torch' and I don't know how to solve it, can you help me?

What 360 Camera did you use for this Splat and which one do you recommend> I have the Insta360 RS One Inch and the Ricoh Theta X.

Hi from Fance; What about D3s stéreos ( 2 points of view at the same time mixed in one anaglyphe scène or displayed on 2 screens or on a single screen shared in two halves ? BTW: Thanks for the tutorial.

What is the base coordinate system/axis used ? Right or left handed? Ie. Z up, Y forward?

\gaussian_renderer\__init__.py", line 14, in from diff_gaussian_rasterization import GaussianRasterizationSettings, GaussianRasterizer ModuleNotFoundError: No module named 'diff_gaussian_rasterization' It showing me this error! tried to solve it but it isn't working... PLS help!

Hi i have a question. I am new to all of this but can i export like fbx or obj format to use in 3d software

I'm at the "SETUP" step and can't build. How can I proceed please? Restarted and all. I would really like to be down with it!

This is amazing. I wish I could use it, but I don't have enough VRAM for this, I have a 3070 ti unfortunately. I hope it will work for GPUs that have 8 GB VRAM in the future.

Just curious, if I have kinda greater Graphic card like 4070ti, but its 12 VRAM which is less then 3090 24 VRAM , will it work? Thx!

This method is great! I have little question. Can this method be reconstructed only use RGBD input not globa pointcloud?

is it possible to move around with the arrows and the mouse ? Trackball is so bad..

Dear author, hello. Regarding your Gaussian pasting, I would like to ask, actually, I want to use it to export 3D models. Yes, I see that the generated effect is very realistic, and I want to export the characters or objects in the scene separately to 3D formats such as OBJ for my own use. Can I do this?

can you export it to a 3d scenery such as .obj with this method? would look damn cool. also got to render a small scene with just a 3050 in 1 hour and 30! theres hope

Hey, tried to follow but had a lot of trouble with Colmap stuff. Don't really understand how to get it working. :(

I'm on a 2080 Ti - Whenever I try to keyframe in the viewer I can't move the camera anymore. Is there something wrong with the software, my graphics, or am I doing something wrong? How's it supposed to work?

Amazing tutorial. I've been looking forward to this. Unfortunately, the 24 GB VRAM requirement will keep me out of the game for a couple of years, or until the memory requirements are reduced. Anyway, thanks a lot!

hi Jonathan, I have one issue starting the ffmpeg. it show me : C:\Users\(User): No such file or directory I think it was cause my username has a space

Awesome video. I tried installing nerf studio on Linux, but could not get it to run. Are you aware of any "ready to go" docker container for nerf studio?

So, i have a high density laser scanned pointcloud, and i have 360 pano images every few meters, it should be possible to use that directly right? my pointcloud is super high density and the points have color already, but for training it will still need the panos i suppose? damn i want to get this to work

hey Jonathan! First off, thanks again for posting this. This is incredible. Much appreciated. So I'm at the install for the gaussian_splatting environment in anaconda (also, when i launch a regular cmd I dont see the (base). I have to launch an anaconda prompt. I'm assuming thats fine as it's just the assigned terminal for the Anaconda environment?) So when I ran the second prompt, it did it's thing and then it gave me a "failed". I did a restart like you suggested, however I forgot to copy and paste the error in a terminal. Now when trying to run the second command again I get an error that the prefix already exists so it's clearly trying to write over the gaussian_splatting environment thats been built already. But how do I know if it's missing part of the installation? Should I just continue with the third step? Thanks so much man.

Hi Jonathan!! that's awesome. thanks for your video. I followed carefully the whole process, but when i'm going to create the conda env, with the line: conda env create --file environment.yml i can't go on, cause i have an error message. I have the result of the process in cmd in a text file (if you need) , but in brief, i get something like this: Processing e: erf\gaussian-splatting\submodules\diff-gaussian-rasterization Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Processing e: erf\gaussian-splatting\submodules\simple-knn Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Building wheels for collected packages: diff-gaussian-rasterization, simple-knn Building wheel for diff-gaussian-rasterization (setup.py): started Building wheel for diff-gaussian-rasterization (setup.py): finished with status 'error' Running setup.py clean for diff-gaussian-rasterization Building wheel for simple-knn (setup.py): started Building wheel for simple-knn (setup.py): finished with status 'error' Running setup.py clean for simple-knn Failed to build diff-gaussian-rasterization simple-knn Installing collected packages: simple-knn, diff-gaussian-rasterization Running setup.py install for simple-knn: started Running setup.py install for simple-knn: finished with status 'error' I don't know wwhere the problem could coming, and don't know if you can help me a little with this. Anyway, thanks for your time and for the awesome video.