It's Time To Put Open Source Photogrammetry In Your Toolbox

  Рет қаралды 175,442

Daniel Jutz

Daniel Jutz

Күн бұрын

superfastmatt's video • It’s Time To Put A 3D ...
Add camera to database guide github.com/alicevision/meshro...
Software
Meshroom alicevision.org/#meshroom
Meshlab www.meshlab.net/
Freecad www.freecad.org/
This video was created using
Shotcut
OBS Studio
Gimp
Inkscape
00:00 Intro
00:20 Surface Prep
01:12 Pictures
01:47 Meshroom
02:51 Meshlab
03:45 Scaling
04:31 Orient
05:22 Trim
06:06 Repair
06:29 Simplify
07:19 Freecad

Пікірлер: 133
@thecasualgerman8031
@thecasualgerman8031 Жыл бұрын
I recommend using your smartphone for taking photos. Like the S22 for example. But before you start, turn on any metadata options you can find. It will write every sensorvalue including tilt, position, roll etc etc into the image metadata and photogrammetry tools can use those very efficiently!
@justinlabarge8178
@justinlabarge8178 Жыл бұрын
@@UCKY5 it's likely on by default, and unable to be disabled
@pratikkore7947
@pratikkore7947 Жыл бұрын
@@justinlabarge8178 how do I check that my files have them?
@annekedebruyn7797
@annekedebruyn7797 Жыл бұрын
@@UCKY5 The majority of smart phones don't allow you to turn it off besides GPS which is a good thing in this case.
@rafiffadhil5872
@rafiffadhil5872 Жыл бұрын
How to record orientation of each photo? Idont get it. if it's drone, it separated to different file
@annekedebruyn7797
@annekedebruyn7797 Жыл бұрын
@@rafiffadhil5872 It doesn't NEED the orientation as meta data. It just speeds up the calculation if it does. You can throw different cameras in the software (like mixing drone shots with regular shots) and the software will do just fine.
@tristanscott4118
@tristanscott4118 Жыл бұрын
I used a similar workflow years ago to create some custom spring seat adapters for my Volvo. You have shown me a lot of little tips and tricks that would’ve made the process go A LOT more smoothly. Nice work!
@squareoctopus
@squareoctopus Жыл бұрын
Wow, this process has not improved at all in like 10 years. The results are way better now, tho. Thanks for the video, very clear instructions and tips!
@horrorhotel1999
@horrorhotel1999 Жыл бұрын
This is a contradictory statement
@Muftobration
@Muftobration Жыл бұрын
@@horrorhotel1999 I think he means the laborious steps involved are the same as ever (no advances in automation), but the 3D reconstruction you get at the end is better. I don’t know whether that’s true, but it’s not contradictory.
@phildavis1723
@phildavis1723 Жыл бұрын
You've made me very, VERY happy!! A nice concise way to do what I figured was possible but had no idea how!
@LuxGamer16
@LuxGamer16 Жыл бұрын
Bro came back after 9years and just posted a super useful video. Very appreciated, thank you😁
@heatshield
@heatshield Жыл бұрын
hahah That’s pretty wild. I did that on one of my other channels. Just had some mobile game footage from years ago and posted a flight training video. (with a real airplane, not a video game) Just wanted to backup the files somewhere else besides the phone because it was overheating and the battery was expanding in thickness. Didn’t want to have to wait until I could order a new battery to get to the video files, in case the battery completely failed or even burst open. Ended up uploading public by accident and didn’t realize it till I got home hours later. Some of my old game buddys saw it along with a “face reveal” lol
@scottwallace1689
@scottwallace1689 4 ай бұрын
Good video thanks. I had tried Meshroom before but struggled with it. This is a really concise and clear path through it. Good work!
@FilterYT
@FilterYT Жыл бұрын
This was so great, took about 10 seconds to know I was going to subscribe! Thanks
@marcfruchtman9473
@marcfruchtman9473 Жыл бұрын
Thank you for a great walk-thru of the process.
@chrstphrr
@chrstphrr Жыл бұрын
Thank you for starting me down the path. I already have a 3d scanner, to use in a hobby / part reconstruction / replication of "antique" or out of production auto parts. For the last while I've had the scanner, I've been seeking an open-source focus on the toolchain and workflow. Thus, for me, I get to sidestep Meshroom for the moment, but everything in the MeshLab and FreeCAD portions still applies.
@chrismofer
@chrismofer Жыл бұрын
Meshroom is free and open source
@pgknippel
@pgknippel Жыл бұрын
I imagine he’s talking about time, not money
@jvljn8903
@jvljn8903 Жыл бұрын
Thanks for your time and trouble making this, much appreciated!
@Lawdog388
@Lawdog388 Жыл бұрын
Wow thanks. Scaling in MeshLab is so much easier
@apaskiewicz
@apaskiewicz Жыл бұрын
This is really well explained. Thank you! ❤‍🔥❤‍🔥
@goigle
@goigle Жыл бұрын
great video, thanks for sharing your workflow in such detail
@Fury9er
@Fury9er Жыл бұрын
Cornflour mixed with IPA in a sprayer is another alternative to scanning spray.
@alun7006
@alun7006 Жыл бұрын
This is EXACTLY what I need. Thank you!
@deluxeddelirium
@deluxeddelirium Жыл бұрын
fascinating and concise, very well put together video
@TheJcman72
@TheJcman72 Жыл бұрын
Great video with a lot of tips. Thanks!
@tinkerman1790
@tinkerman1790 Жыл бұрын
Very useful tutorial video made! Thx a lot 👍🏻
@divyajnana
@divyajnana Жыл бұрын
Great video, slick system, very informative, Thank You!!!
@dlclz
@dlclz Жыл бұрын
Great Video, concise and really informative. Danke :)
@geenes4120
@geenes4120 Жыл бұрын
11/10 explaination !
@JamieBainbridge
@JamieBainbridge Жыл бұрын
So, there is at least one person who knows how to use Meshlab. Impressive!
@BHBalast
@BHBalast Жыл бұрын
Thanks, very comprehensive
@mikesportsman1811
@mikesportsman1811 Жыл бұрын
Thank you, This helped me very much.
@Build_the_Future
@Build_the_Future Жыл бұрын
I'm waiting for NeRF to get better. I think that will replace Photogrammetry and hopefully LIDAR also
@dwylhq874
@dwylhq874 Жыл бұрын
Awesome! Instant sub. ❤️
@faultboy
@faultboy Жыл бұрын
Sehr gutes Video!
@mahakrandomusername2672
@mahakrandomusername2672 Жыл бұрын
wow the scanning resoult is so good even without a 3d scanner crazy
@TheShanehiltonward
@TheShanehiltonward 3 ай бұрын
Absolutely excellent video. I run the same software on Linux. Thank you for the video.
@alejandrominder2097
@alejandrominder2097 Жыл бұрын
Thanks for sharing! 🙂
@menchelke
@menchelke Жыл бұрын
Ahh, I was trying to do this photogrammetry using screenshots. Haha. Thank you for the video.
@Teh-Penguin
@Teh-Penguin Жыл бұрын
Fascinating!
@Ritefita
@Ritefita Жыл бұрын
I widh I could subscribe the second time just for mentioning our bro Matt =)
@Liberty4Ever
@Liberty4Ever Жыл бұрын
I've been looking for an open source 3D scanning tool to add to my FreeCAD and 3D printing tool chain. I need to make some parts that mate to someone else's fairly complex parts and I don't have their models. I'm a bit put off by the CUDA and nVidia requirements, but photogrammetry is definitely getting better.
@amzp_dat
@amzp_dat Жыл бұрын
Thats great, im planning on scanning all items in a computer museum to make a virtual tour
@DanielJutz
@DanielJutz Жыл бұрын
That sounds quite ambitious. Best of luck!
@amp08021
@amp08021 Жыл бұрын
Sadly the Cuda requirement is a dealbreaker :( Also, from an open source standpoint a solution for AMD cards would be lovely
@shubinternet
@shubinternet Жыл бұрын
Solutions for macOS would also be very welcome. Thanks!
@randyc750
@randyc750 Жыл бұрын
Blender can take a video and turn it into individual images in a folder, FYI.
@kiplinght
@kiplinght Жыл бұрын
Using FOSS: Yay! And an Nvidia card.......... Oh.... Us FOSS users own ATI graphics cards since Nvidia refused to participate in FOSS for so long. Pity, was very interested in this video.
@pmcquay1
@pmcquay1 Жыл бұрын
is it possible to use this process to scan the inside of something? I want to scan the inside of my truck, so that I can get some dimensions for fabricating a headliner. There are curves there that would be difficult to model in a traditional way.
@DanielJutz
@DanielJutz Жыл бұрын
Yes, it should work. Make sure to get photos from different positions in you truck.
@VAS.T
@VAS.T Жыл бұрын
now this is a interesting topic... you could basically steal the blueprint of anything worth getting machined for example premium bike-frames or other stuff you can 3d-print or CNC it
@TheBarretNL
@TheBarretNL Жыл бұрын
Wouldn't it be easier when you start aligning meshes, to use a mirror-build from the middle, for certain shapes?
@kiiyll
@kiiyll Жыл бұрын
I hope something like this eventually comes to AMD GPUs. Haven't had an NVIDIA card since the 1050ti.
@zmeygavrilych
@zmeygavrilych Жыл бұрын
It will come to Intel GPUs.
@chikokishi7030
@chikokishi7030 Жыл бұрын
time to join the winning side
@JGnLAU8OAWF6
@JGnLAU8OAWF6 3 ай бұрын
1050ti is capable enough to run Meshroom
@GregoryCarnegie
@GregoryCarnegie Жыл бұрын
For reflective surfaces you could creating a NERF rather than using photogrammetry.
@kettch42
@kettch42 Жыл бұрын
How would you change this workflow to make a 3D model of something big like a house or garden?
@DanielJutz
@DanielJutz Жыл бұрын
Not much. You'll still want to get pictures evenly around the object. Professionals use a drone for that. If that's not an option, take pictures close and further away from the house. Then, depending on your roof you might not get good reconstruction there. For scaling you could use the length of a wall for example.
@phildavis1723
@phildavis1723 Жыл бұрын
I was watching the video you referred to at the beginning when I saw yours. I clicked your video at the moment the same scene was showing in his, so I thought I was still on his! Very weird.
@KanzakiZD
@KanzakiZD Жыл бұрын
can we use photogrammetry with turntables instead of us rounding the object?
@DanielJutz
@DanielJutz Жыл бұрын
Yes that is possible. For it to work I had to set "Minimal 2D Motion" in the "FeatureMatching" Node. I used a value of 5 but you might have to experiment.
@axcelleria
@axcelleria Жыл бұрын
We can't use Radeon Graphic?
@gadoyw
@gadoyw Жыл бұрын
A very fascinating thing. Tried myself 30 hrs ago. My thing is still rendering. I guess 70 photos with 108mp is overkill. Has Ryzen 5 1600x, 16gb of DDR4 RAM and Gtx 1060 6 gb to process it.
@DanielJutz
@DanielJutz Жыл бұрын
The number of pictures is good but 108mp is a lot ;) Are you stuck at the depth map node? That one took the longest for me. In the depth map node you can set a downscale factor. Try 8/16, the default is 2. On my system 100 images at 18mp took 80 minutes (ryzen 3800xt, 32gb ddr4, 1080TI).
@gadoyw
@gadoyw Жыл бұрын
@@DanielJutz It was just the first step. It took approx. 65 minutes to process one photo. So at 35 hrs it was around 30 photos out of 68. So i went to make another set of photos xD
@robertsimmons9563
@robertsimmons9563 Жыл бұрын
108mp?!? What are you shooting with?
@yosyp5905
@yosyp5905 Жыл бұрын
maybe try using a better camera. Picture resolution isn't a good value to judge camera quality, usually they aren't good sensors if they need to market them with 108mp
@Tom-ku8bu
@Tom-ku8bu Жыл бұрын
Algorithmen often work better with less megapixels. Tesla's FSD example work I believe with a 3 or 5 Megapixel cameras. But sure it's not the same for fast real time 3d Images or high quality 3d files
@lohikarhu734
@lohikarhu734 Жыл бұрын
Any way to do this without a monster graphics accelerator?
@janeblogs324
@janeblogs324 Жыл бұрын
Yes, the exact same way with a cheaper GPU
@user-uo2ph3ul3d
@user-uo2ph3ul3d 2 ай бұрын
Thanks for amazing tutorial! Question: I have a drone and want ro reconstruct a church, using this approach? Would it be possible?
@DanielJutz
@DanielJutz 2 ай бұрын
From a technical standpoint it should work. Results will depend on your drone's camera. Always make sure you have permission to fly! ;)
@legendboyAni
@legendboyAni Жыл бұрын
Try nerf it even work on reflective surface as well
@rsstnnr76
@rsstnnr76 5 ай бұрын
How do you take pictures of the bottom of the subject? There's a lot of detail underneath.
@DanielJutz
@DanielJutz 5 ай бұрын
I know two ways around that issue. Option A: Mount your object on a pole at a height that allows you to take pictures from above and below. Option B: Perform two scans, one with the object flipped upside down, and merge them digitally. Meshlab has the Alignment tool for that purpose.
@Racing2Learn
@Racing2Learn Жыл бұрын
Excellent video! What RC truck is that?
@DanielJutz
@DanielJutz Жыл бұрын
Thanks! An old nitro rc car converted to electric with a drill motor.
@wekkimeif7720
@wekkimeif7720 Жыл бұрын
The main idea of 3D scanning is that you don't need to do yourself 3D modelling. As long as it requires doing Topology manually after scanning it's not working as intended. You could 3D model this RC-Car by hand faster than you 3D scan it and then model manually
@DerkvanL
@DerkvanL Жыл бұрын
Nice video. Will this work if I record a full 360 video in 4K and export that as single images?
@DanielJutz
@DanielJutz Жыл бұрын
Maybe, Meshroom might not like it if you are in the frame. This discussion might be able to help you github.com/alicevision/meshroom/issues/526 .
@DerkvanL
@DerkvanL Жыл бұрын
@@DanielJutz thx.
@Maisonier
@Maisonier Жыл бұрын
I'm still waiting for a good OCR AI that can read old math books and transcribe all the formulas without any issues
@oliverer3
@oliverer3 Жыл бұрын
Like handwritten or printed? I feel like tesseract should be able to do it if it's printed. If memory serves there is a language pack for math symbols.
@Maisonier
@Maisonier Жыл бұрын
@@oliverer3 Yes, I have tried Tesseract as well as numerous open-source tools and private software like PDF elements. I have some old scanned books that are no longer available in my country, but they are low-quality images in the form of old PDFs. Unfortunately, I haven't come across a single AI tool that can accurately recognize the text and transcribe it directly into a format like Markdown or LaTeX, especially when it comes to mathematical formulas and other symbols.
@oliverer3
@oliverer3 Жыл бұрын
@@Maisonier You could probably use a combination of tesseract and OpenCV to do it then but it would take a decent amount of manual effort to tune it. Plug and play tools are probably not there yet.
@kingmasterlord
@kingmasterlord Жыл бұрын
take a shot every time he says 'mesh'
@sebastianosewolf2367
@sebastianosewolf2367 11 ай бұрын
Before I use something like meshlab I use blender which is way better for cleaning and also retopo
@weirdnewworld1736
@weirdnewworld1736 Жыл бұрын
What about taking a video and then splitting it up into a series of still images? Seems like one could get thousands of pics that way?
@JGnLAU8OAWF6
@JGnLAU8OAWF6 3 ай бұрын
Photos have higher resolution
@Magnymbus
@Magnymbus Жыл бұрын
Blender can replace meshlab, and will give you undo support, just gotta use a different workflow.
@notmadeofpeople4935
@notmadeofpeople4935 Жыл бұрын
Any options for AMD cards?
@fxarts9755
@fxarts9755 Жыл бұрын
why not just scan with an iphone with the lidar. does all the computing on the phone in the app and puts in scale and even color pretty accurately.
@thisisus.504
@thisisus.504 Жыл бұрын
I got an error message for even thinking about doing this.
@Todestelzer
@Todestelzer Жыл бұрын
I recommend 3DF Zephyr (there is a free version to try it out) or better buy a good 3D Scanner such as Einscan SP or Einstar from Shining for slightly bigger parts.
@Probber
@Probber Жыл бұрын
I also prefer 3df zephyr, is much much faster imo. Free version used.
@theneonbop
@theneonbop Жыл бұрын
the free version has a limit on the number of images you can use
@Todestelzer
@Todestelzer Жыл бұрын
@@theneonbop yeah but it’s around 70 pictures. Try it out. It’s enough for most projects. I bought the version for 300 pictures in the end because it works.
@logicalfundy
@logicalfundy Жыл бұрын
Is nVidia strictly required?
@DanielJutz
@DanielJutz Жыл бұрын
Draft Meshing is available which does not need a Nvidia GPU. While it computes faster, the results will always be worse. You can access that Pipeline from File > New Pipeline > Photogrammetry Draft. You will probably want to increase Describer Density and Quality to high or ultra in the Feature Extraction Node.
@fontende
@fontende Жыл бұрын
These days of Ai you can't even test any LLM without Nvidia, forget about cheap notebooks with Intel graphics or AMD trash (their chips are cheap but very bad in support and unreliable, Amd was found in planned obsolescence in graphics chips, so designed defects in Macbooks which massively dying after certain years, I have one of whose).
@_specialneeds
@_specialneeds Жыл бұрын
What is a much more powerful device. Calipers.
@jothain
@jothain Жыл бұрын
Seems way too much of a hassle compared to taking couple pictures from different axis and scaling picture to sketchplane and using that and simple measuring of target.
@forbiddenera
@forbiddenera Жыл бұрын
"An nvidia gpu" *pulls out a decidedly red card* 😂😂😂
@janeblogs324
@janeblogs324 Жыл бұрын
4:13 you mean use a decimal as a decimal? Why do Europeans use commas for decimal points?
@chrstphrr
@chrstphrr Жыл бұрын
Why do they use a comma in that case? Because they were already using the period as a thousands separator, of course! :) This sort of thing is quite like the idea of having traffic drive on the left or right hand side of the road as a convention. To be pedantic, it's called a radix point in general, in case you're not using a period, or a comma ... or not using a decimal number system. This issue is a problem of bad localization in MeshLab, and it ought to be raised as a bug with that project so this sort of advice to use a foreign choice of radix point symbol isn't needed anymore.
@MrRobot-lm2lo
@MrRobot-lm2lo Жыл бұрын
AMD 6900xt?
Жыл бұрын
Photogrametry sux!
@3d_dean975
@3d_dean975 Жыл бұрын
0:20 isn't that an AMD Gpu?
@DanielJutz
@DanielJutz Жыл бұрын
It's a Nvidia 1080 Ti.
@fontende
@fontende Жыл бұрын
I don't know even any LLM project using anything other than Nvidia, so forget about Amd and never buy their trash - after they deliberately engineering the death of graphics chips in all Macbooks Pro from 2011, which I have, moreover I have two similar models Macbooks, one Nvidia, other Amd and last one died as predicted on forums, a mass time bomb. It's really hard to resurrect macbook after, you're left only with Intel graphics and half power slower notebook. Their chips dying because of overheating, ridiculous.
@did3d523
@did3d523 Жыл бұрын
scan with iphone 11 is better
@mrle0719
@mrle0719 Жыл бұрын
Ok I dont want to sound like a dick but how is requiring cuda open source ^^
@Gromic2k
@Gromic2k Жыл бұрын
Danke, aber es wirkt jetzt nicht besser als noch vor ~4 Jahren
@michaelhicks8603
@michaelhicks8603 Жыл бұрын
I need LiDAR. I need to scan medium to large spaced and retain a high level of detail at mm or sub mm precision. And I need to be able to scan past 20 meters. The issue I have is that everything on the market that can do this starts at $50,000 usd. And goes well north of that. The fact that they can get away with charging this much money in 2023 is a joke. I’m can’t believe that someone hasn’t made something in the $1000-4000 range. And for the love of got please don’t say iPhones or iPads. I’m talking about real scanners.
@menkiboj
@menkiboj Жыл бұрын
i used to do this for fun a long time ago using "123d catch" and later "3DF Zephyr" 😅
@anzdes219
@anzdes219 Жыл бұрын
i love the vid but the result is poor
@DanielJutz
@DanielJutz Жыл бұрын
Better results are possible. Either by taking more pictures or by tweaking pipeline settings. You can find more information here: meshroom-manual.readthedocs.io/en/latest/faq/reconstruction-parameters/reconstruction-parameters.html . For those improvements you will have to accept longer processing times.
@anzdes219
@anzdes219 Жыл бұрын
@@DanielJutz but is it better than a manual topo ?
@PaulG.x
@PaulG.x Жыл бұрын
You don't do your computer any favours including all that paving in the images
@DanielJutz
@DanielJutz Жыл бұрын
I'd say it depends. While it does increase processing time, in my experience it also increases the likelihood of all camera positions being reconstructed successfully.
@Max24871
@Max24871 Жыл бұрын
> Open Source Photogrammetry > Uses an nvidia only tool on windows. Yeah, right...
@JGnLAU8OAWF6
@JGnLAU8OAWF6 3 ай бұрын
And on proprietary CPU, shame on him should be all open source to count!
@Vaasref
@Vaasref Жыл бұрын
Maybe open source but still proprietary thanks to CUDA so unavailable for anyone not wanting to support the contender for the worst tech company.
@AzeemMia
@AzeemMia 8 күн бұрын
You are really good at working with the software, but you not that good at explaining stuff.my brain is hurting
@SLPCaires
@SLPCaires Жыл бұрын
but meshlab sucks soooo bad, sooooooo bad....
@ronliebermann
@ronliebermann Жыл бұрын
This is a research tool, not a production tool. So the guy spends a whole day making just one part. Big deal.
It’s Time To Put A 3D Scanner In Your Toolbox
14:24
SuperfastMatt
Рет қаралды 504 М.
Was I unfair to FreeCAD?
17:31
Maker's Muse
Рет қаралды 112 М.
Summer shower by Secret Vlog
00:17
Secret Vlog
Рет қаралды 12 МЛН
Playing hide and seek with my dog 🐶
00:25
Zach King
Рет қаралды 34 МЛН
Mom's Unique Approach to Teaching Kids Hygiene #shorts
00:16
Fabiosa Stories
Рет қаралды 34 МЛН
Photoscanning 100% Free: Complete Meshroom Tutorial | Photogrammetry Course
1:04:37
Meshroom: 3D models from photos using free photogrammetry software
21:45
ExplainingComputers
Рет қаралды 604 М.
3D printed 3D scanner BiHor3D 360 Kinect Xbox
54:31
printyourfix
Рет қаралды 35 М.
Photogrammetrie | vom Foto zum 3D Modell - MESHROOM
19:22
Medieninformatik
Рет қаралды 18 М.
The Ultimate Guide to 3D Scanning | FULL WORKFLOW
16:06
pwnisher
Рет қаралды 353 М.
3D modelling with the DJI Mini 3 pro (using photogrammetry)
38:43
Jérôme Tabeaud
Рет қаралды 146 М.
I built an EDM machine
9:23
𝕄𝕠𝕣𝕝𝕠𝕔𝕜
Рет қаралды 1,1 МЛН
The Key to Cleaner 3D Scans: Cross-Polarization
15:22
William Faucher
Рет қаралды 75 М.
Hexagons Are NotSoGreatAgons
14:36
Con Hathy
Рет қаралды 370 М.
Todos os modelos de smartphone
0:20
Spider Slack
Рет қаралды 63 МЛН
Kumanda İle Bilgisayarı Yönetmek #shorts
0:29
Osman Kabadayı
Рет қаралды 2,2 МЛН