3D Python Tutorial: Building 3D Models from 2D Images (Photo or AI) with 5 Libraries

Рет қаралды 8,112

Күн бұрын

This tutorial shows how to create a 3D model (point cloud) from a single image with 5 Python Libraries. The input is a 2D image (from AI or your camera), and we generate a 3D Model. I cover everything from setting up your environment to generating your 3D Point Cloud Model (going through Monocular Depth Estimation).
I go through several linear phases that follow the different chapters.
🍿 NEXT STEPS:
Code a 3D Point Cloud Segmentation Solution with Python: • 3D Point Cloud Segment...
Finish the 3D Tutorial Series: learngeodata.eu/3d-tutorials/
Dive in Expert articles: / florentpoux
Become a 3D Data Science Expert: learngeodata.eu
🙋 FOLLOW ME
Linkedin: / florent-poux-point-cloud
Github: github.com/florentPoux
Research: scholar.google.com/citations?...
WHO AM I?
If we haven’t yet before - Hey 👋 I’m Florent, a professor-turned-entrepreneur, and I’ve somehow become one of the most-followed 3D expert. Through my videos here on this channel and my writing, I share evidence-based strategies and tools to help you be better coders and 3D innovators.
📄 CHAPTERS
[00:00:00]: Tutorial Introduction
[00:01:12]: Setting up the environment and installing the base libraries
[00:03:51]: Installing necessary libraries (PyTorch, Pillow, Transformers)
[00:05:03]: Taking an Image
[00:06:44]: Generate an Image with AI (StableDiffusion)
[00:08:37]: Image pre-processing and model setup
[00:10:53]: Loading and resizing the image for the model
[00:13:18]: Depth Estimation predictions from the model
[00:15:06]: Point Cloud Generation
[00:17:54]: Defining the camera extrinsic
[00:19:21]: 3D Point Cloud Analysis and Post-Processing
[00:23:40]: 3D Modelling: 3D Point Cloud to Mesh
[00:26:40]: 3D Mesh Analysis (Quality Control)
[00:28:13]: 3D Mesh from Generative AI Image
[00:30:30]: 3D Mesh Retouching
[00:33:10]: 2D Image to 3D Reconstruction: Conclusion

Пікірлер: 19

@birucao3132 3 ай бұрын

Thank you so much for the tutorial! It's super clear and helpful!

@FlorentPoux 3 ай бұрын

You're very welcome!

@user-fy2hz2og3b 3 ай бұрын

So clever!

@FlorentPoux 3 ай бұрын

So many creative ways it can be used!

@ZahraNabizadehShahre-Babak 22 күн бұрын

Thanks for your useful video. Does the .obj generated file have the texture?

@FlorentPoux 16 күн бұрын

Thanks! Yes it does have a texture indeed

@juanfranciscovarvello6836 3 ай бұрын

Hi Florent! I'm launching a startup that offers 3D menus for restaurants, cafes, and more. Currently, I'm researching how to create 3D models from images of dishes taken from various angles. Could you recommend any tools for this process? It's essential to maintain accurate colors and ensure high-quality models so that clients can navigate and examine details with zoom capabilities, etc. Thank you for your help, and I appreciate the valuable content you provide!

@FlorentPoux 3 ай бұрын

Sounds great! So, I think you could turn yourself towards turntables and automate the scanning process with a lightbox to control lighting. then, you can use 3D Gaussian Splatting for the visual quality of the rendering you would get from it.

@adityaranjan5078 2 ай бұрын

Sir , how we convert 3d images to floor plan

@HarryStylesFanSansy 2 ай бұрын

lmao got the same internship assignment???

@adityaranjan5078 2 ай бұрын

@@HarryStylesFanSansy Have you any idea about this?

@FlorentPoux Ай бұрын

A Very good idea indeed! And this is a vast topic, I will heavily dive on it next month, but basically, decompose the process in (1) classification, and (2) vectorization (regression)