How to Make 3D Models from NeRFs using Nerfstudio

Рет қаралды 67,208

Жыл бұрын

In this video, we walk you through the steps to train a NeRF using Nerfstudio and export both a point cloud and textured mesh from the neural network.
For more information on using Nerfstudio, check out their documentation website: docs.nerf.studio/
Tips:
-If you do not see the Export options in Nerfstudio, you need to upgrade your version. You can simply upgrade Nerfstudio using "pip install --upgrade nerfstudio"
-For smaller objects reduce the number of points or faces
-If you don't need normals with point clouds, uncheck the option. The resulting file will be about half the size.

Пікірлер: 72

@alistairbuchan Жыл бұрын

Just stumbled upon your channel while investigating NeRF and integrating it into my VFX workflow. Super useful stuff. Good level and length of videos! Subscribed and will be keeping an eye out for future vids. Thanks!

@msampson3d Жыл бұрын

I'm definitely interested in a getting started quick guide for getting started with Nerfs. Been meaning to get into it but it's hard to know where to start so I'd find it super helpful

@EveryPoint Жыл бұрын

Would a 15 minute "Getting Started With Nerfstudio" video be helpful?

@msampson3d Жыл бұрын

@@EveryPoint absolutely! I think it would help lots of people. This is really cool tech I think a lot of people would appreciate a straightforward introduction to!

@x_jaydn Жыл бұрын

@@EveryPoint I keep running into errors when trying to follow the official nerf studio guide, so a tutorial might help a lot 💯

@shania5214 Жыл бұрын

@@EveryPoint Definitely!

@kangk9194 Жыл бұрын

非常感谢，教程演示给了我很大的启发，虽然没有从事相关的工作但我希望能自己尝试成功这一技术

@JAYg33t4r Жыл бұрын

No way I am down this nerf rabbit hole and you are not only doing the remote chance thing I'm researching and now you're modelling my hometown icon. If you are in the area awesome. We have similar interests!

@EveryPoint Жыл бұрын

We are in the Pacific NW, stretched between Salem, OR and Redmond, WA. We drive by this icon periodically!

@JAYg33t4r Жыл бұрын

@@EveryPoint thank you for all of your responses. What an exciting time to be alive with technology!

@VorpalForceField Ай бұрын

Thank You for sharing ...Cheers :)

@rcafilmproductions1640 Жыл бұрын

Dude! Fellow Pacific Northwesterner here, please do a beginner tutorial!!!! I am making a very VFX-heavy pitch and have been relying on the Matrix city released in UE5 and being able to creat a mesh from a nerf of part of a city would be amazing!

@cumburxx Жыл бұрын

I'll try this. Very useful.

@EveryPoint Жыл бұрын

We're glad you found it useful!

@carlosedubarreto Жыл бұрын

For sure its very useful. everytime I see a new video from you I know is somethign worth a watch, and this one was no exception.

@EveryPoint Жыл бұрын

Glad it was helpful! Also, thank you for the kind words regarding the usefulness of our content.

@GalloBeat Жыл бұрын

Hello! I just discovered your channel and I'm finding it very useful as im also working on a similar project at work, where i have to reconstruct a sort of 3d model from videos pointing to a coast from the sea from a medium distance. The videos would not go over the entire scene 360 but they will cover just a portion of these angles, mostly front-facing. I ran over these Neural Fields some days ago and I tried them of linux, and I was just astonished by the performances and speed of the results. Do you think instant-nerf of nerfstudio (which also includes a spatial distortion technique for unbounded scenes -> similar to the original NeRF's NDC technique for front-facing unbounded scenes) would be a good solution for my task (even if not taking 360degrees videos I could maybe extract a sort of 2.5D model of the scene) ? Thanks in advance!

@CastilloJA89 Жыл бұрын

Hi @EveryPoint, I have been following the development of nerve since last year, and over the winter break, I missed all of this. Could you make a video from 0 with the installation of Nerf Studio, please? I'm working on my PhD and this information will be really helpful, In trying to use Nerf to recreate a 3d models of insects.

@jeffreywolff4961 Жыл бұрын

Great tutorial - I will definitely be experimenting with Nerfstudio!

@EveryPoint Жыл бұрын

Have fun! Please share your results with us.

@its-bc Жыл бұрын

Fantastic demo. Very useful. Have you played around with some of those default parameters yet? Any improved results, if so what did it?

@EveryPoint Жыл бұрын

Not yet! That would make for a great follow up video.

@3RDEYELOVE Жыл бұрын

👌🏾cool vid could you do a ' how to train your Nerf video ' Next💯💪🏾

@user-rz6zh9ge6y 10 ай бұрын

Can we utilize these 3D models for training to use as dataset and further using in MD DL? if yes then how? and if not which tools is used commercially for real time dataset of 3D to use in our training purpose? thanks in advance

@Luizof Жыл бұрын

How is that different from standard point and cloud softwares like WebODM for example?

@grahamwebster8913 9 ай бұрын

If you are using the locally hosted viewer is there a way to set up the command line prompt to give you a link to the locally hosted NeRF viewer link? Or will this just send you a default link to the general web viewer?

@sprekkatsiu779 Жыл бұрын

Need a getting started video around 15 minutes or less. Segmented and marked on your video so we can follow it easily. This will blow up

@EveryPoint Жыл бұрын

We're on it!

@javierpaternina Жыл бұрын

Can you create a textured mesh from instant NGP?

@user-nr2vy5ng9s 11 ай бұрын

Hi, Is it possible to export in STL format and than upload it to 3d printer?

@JAYg33t4r Жыл бұрын

Do you know of a way to get the 3d mesh info transcribed through an API into a modelling program such as Blenders Geometry Nodes to have it generate assets with adjustable parameters?

@EveryPoint Жыл бұрын

Your best option to is reach out to Luma AI regarding their API and integrations.

@aaronszczepanek2583 Жыл бұрын

im looking for example using drones taking images of crops

@svsarma1 Жыл бұрын

Noob question, what program are you using to open the finished mesh? Thx

@heyjianjing Жыл бұрын

At 11:47, there are two obj files. How is the mesh.obj generated? Is this part of poisson mesh file or is this an independent mesh generated using other method? if so, which method? Thanks again for the tutorial!

@EveryPoint Жыл бұрын

What you are seeing here is two meshes, both generated using poisson surface reconstruction. One mesh is the initial result, the second mesh has been optimized at a target number of triangles.

@radovanvasko7888 4 ай бұрын

Does anyone know wether its possible to calculate the accuracy of such 3d modeling process? I use photogrammetry for surveying and thats exact math so im able to calculate the accuracy of such process, but this is basically a trained ai to do it for me, so id love to know the math behind it so it could be used for exact replication with calculatable accuracy

@helenagarcia5103 Жыл бұрын

Hello! Do you know if nerf can work with 360 (equirectangular) images? I have many 360 images of a house in diferent position, would like to test to generate a model

@EveryPoint Жыл бұрын

You can make NeRFs using cubemapped images from equirectangular output. However, results are mixed. Nerfstudio also supports the fisheye lens outputs from the 360 cameras.

@user-zl9gl9cy3l 2 ай бұрын

hi bro. How much data is needed for the model to perform well like bicycle ? and i have a 2 minute video from which i need to choose what fps per second. please give me your advice

@pradeepmanoharan4859 Ай бұрын

hi jonathan recently i got way too old xbox Kinect to scan my entire house but its only capture half of the room . i would like to know is there any other way to scan my entire interior of my house like i tried vslam but its doesnt work . please guide me if you got any idea. My old house gone demolishing within a month ,so i have a plan to capture my entire house in 3d . kind of preserve my nostalgia and happy moments in this way . so let is there any way to capture my house

@ZongHoops 2 ай бұрын

Have you encountered the issue that transforms.json is not created using customer data? Would you like to share your customer data?

@JAYg33t4r Жыл бұрын

What happens when you feed it a bunch of data from varying sources of a similar object?

@EveryPoint Жыл бұрын

What you are describing is NeRF in the Wild. Check out the project page: nerf-w.github.io/

@mohitgupta5000 Жыл бұрын

yes please make a video on nerfstudio installation. I found the process simple to follow but tinycudann does not compile properly.

@beytullahyayla7401 Жыл бұрын

Same issue for me, could you find any solution :(

@mohitgupta5000 Жыл бұрын

@@beytullahyayla7401 For me, tinycudann compiled properly but on running 'pip install nerfstudio', pytorch with cuda gets removed and pytorch without cuda support gets installe.This caused the issue with preinstalled tinycudann. Easy way to go around it is by again running commands to install pytorch with cuda. (Tinycudann requires pytorch with cuda to run) Once you do that, it should be resolved. Also use nerfstudio 0.1.18 instead of default which is 0.1.16 [pip install nerfstudio==0.1.18]. Let me know if it helps

@beytullahyayla7401 Жыл бұрын

@@mohitgupta5000 Thanks for the answer, to be more clear i'm getting this error NameError: name 'tcnn' is not defined because i can't install tinycudann properly. I'm getting this error when i try :× Encountered error while trying to install package. ╰─> tinycudann note: This is an issue with the package mentioned above, not pip. hint: See above for output from the failure.

@dimitriosskarlatos3688 Жыл бұрын

Please makea video about how to use nerdstudio to train a nerf

@ottokitchenbrand1409 3 ай бұрын

thanks for helpful tutorials. getting this message the whole time Could not find ffmpeg. Please install ffmpeg

@brown2840 Жыл бұрын

well that's complicated with all that code. Why can't the software just run those behind the hood with an easy UI?

@beytullahyayla7401 Жыл бұрын

I cant install nerstudio. I'm getting tinycudann error :(

@cowsforliyyfe Жыл бұрын

How would you say nerfstudio compares to something like luma? im interested in making nerfs, but the pros and cons of each way to make nerfs are not very clear

@EveryPoint Жыл бұрын

Nerfstudio is primarily meant for researches, scientists, and software engineers. It is also useable for creators, however, it has a steeper learning curve. Luma AI is more targeted at creators who want to make VFX and visualizations with limited ability to modify parameters. Both are great options.

@MrTilePRO Жыл бұрын

Great. Do you have video from A to Z for noobies? Iwhant to learn this 2d to 3d but how to start?

@MrTilePRO Жыл бұрын

How to start in to new PC? What must install end how? A to Z?

@jag24x Жыл бұрын

What video card is worth getting? More vram is better?

@EveryPoint Жыл бұрын

More vram allows you to input a greater number of total megapixels into a project. However, a more powerful card speeds up rendering time. Nvidia suggests RTX 20xx or higher. We found that a 3080 or better is ideal. The older cards take a long time to render.

@YaSynAmRaUi 2 ай бұрын

I don't know how to use nerfsutdio.

@rhinoxrstudios8067 Жыл бұрын

Make the video please! Beginner here. Thanks

@nobody-u-know 9 ай бұрын

That's very interesting, but this mesh is not usable for any kind of production, unfortunately.

@lln6123 Жыл бұрын

My Assumption is that 3D-Asset-Markets will get flooded with highpoly-meshes, which are totally useless for videogames, unless you want to retopo everything. Am I wrong with that?