Delicate Arch NeRF'd in 4K
1:16
10 ай бұрын
TEMPLVM
1:44
Жыл бұрын
Point clouds 1.mp4
1:31
Жыл бұрын
Пікірлер
@peterbell6557
@peterbell6557 6 күн бұрын
Thank you very much for the detailed explanation of the three systems, I am teaching myself to use Agisfoft Metashape for developing 3d models of cave interiors. Your video has really helped, I have just rendered your zip file of Church rock with excellent results the output quality is confirming my techniques and results for image capture underground. Excellent video.
@PC-Phobic-Jean-Rene
@PC-Phobic-Jean-Rene 9 күн бұрын
Splendid recreations!
@o-gr8ty
@o-gr8ty 13 күн бұрын
Any updates on status of the project?
@MatthewBrennan
@MatthewBrennan 10 күн бұрын
I'm currently investigating ways to get this running in WebXR - will hopefully be able to post something soon :)
@Sir_Racha
@Sir_Racha 14 күн бұрын
Great comparison. Thanks!
@SpikeySlayer
@SpikeySlayer 25 күн бұрын
The subject is actually a star destroyer but shhht, it's a rock
@Tasarran
@Tasarran 27 күн бұрын
Looks like it would have been pretty much perfect if you had been able to get some drone shots from above...
@MatthewBrennan
@MatthewBrennan 27 күн бұрын
That would have been nice, but the Cinque Terre is a national park and drones aren't allowed.
@Tasarran
@Tasarran 27 күн бұрын
@@MatthewBrennan Oh, yeah, I understand, I'm just saying it looks like for other places where one can get shots at elevation, better results will happen
@lukem5798
@lukem5798 Ай бұрын
This is awesome! Did you scan a miniature for this or what was the process?
@MatthewBrennan
@MatthewBrennan 27 күн бұрын
This is the actual town, I just turned the texture off and added a virtual light.
@KingLiakos
@KingLiakos Ай бұрын
why you skipped the align method?
@MatthewBrennan
@MatthewBrennan 16 күн бұрын
the photo alignment is at 32:15 and 36:50
@macScsgo
@macScsgo Ай бұрын
The fan kicking on when the Gaussian Splat started rendering got to me 🤣🤣
@IndieLambda
@IndieLambda Ай бұрын
In the future, the 2 others might become an option too, but my favorite aspect of photogrametry is that being a "standard" 3D model, it can be edited in something like Blender, fixed, simplified, reworked, given PBR textures, and then used as an optimized asset in a game engine, like Unity, and for exemple, uploaded to VRChat. So after having done all the drone videos, you could just, be there as a friend, with a properly scaled world, then have your friend walk towards it, showcasing just how big it actually is.
@BartvanderHorst
@BartvanderHorst Ай бұрын
Everything they build looked beautiful... they probably couldn't build ugly, like we do.
@JWPanimation
@JWPanimation Ай бұрын
I'm curious if you have used your Insta 360 1 for the photogrammetry? I know that Meshroom supports 360 images. There may be instances where you are unable to use the drone for aerial shots, but could mount your 360 camera on a long selfi-stick to get over the subject.
@MatthewBrennan
@MatthewBrennan Ай бұрын
I have used the insta360 with the wide angle 4K lens for photogrammetry, but the 360 lens does not work very well.
@JWPanimation
@JWPanimation Ай бұрын
Thanks for posting this. Adding Houdini to your tool set will give you the ability to leverage volumes and point clouds to their fullest potential.
@AaronBegley
@AaronBegley Ай бұрын
Enjoyable and educational! Thanks Matthew!
@broslyons8045
@broslyons8045 Ай бұрын
That was good man - thanks
@pangaeuspress
@pangaeuspress Ай бұрын
Wonderfully well done! Keep it up: you'll answer a lot of unasked questions!
@ihspan6892
@ihspan6892 Ай бұрын
Immediately recognized Porto Venere! Absolutely unique place.
@salehbaker9221
@salehbaker9221 Ай бұрын
I'm not into software war camps, but why using zbrush for cleaning up if you can use blender for free? Is there a huge benefit sticking to zbrush?
@MatthewBrennan
@MatthewBrennan Ай бұрын
I have used blender, I'm just more familiar with and more proficient with ZBrush. I also hate blender's interface :) It's one of the worst softwares I've ever used. However, it IS free. I last used it 3-4 years ago, maybe it has gotten better.
@nitisharora41
@nitisharora41 Ай бұрын
Very nice!
@aVTuser
@aVTuser 2 ай бұрын
how did you get the camera positions?
@MatthewBrennan
@MatthewBrennan 2 ай бұрын
photogrammetric alignment using Agisoft Metashape.
@aVTuser
@aVTuser 2 ай бұрын
@@MatthewBrennan thank you!
@goodman5568
@goodman5568 2 ай бұрын
I couldn’t find in the description and credits at the end of the video whose music was used here. Could you tell?
@MatthewBrennan
@MatthewBrennan 2 ай бұрын
Sorry: "Elgar - Serenade for Strings", added to the video description too!
@goodman5568
@goodman5568 2 ай бұрын
@@MatthewBrennan thank you very much
@AlexViktor1997
@AlexViktor1997 2 ай бұрын
why not taking only keyframes from the pictures?
@MatthewBrennan
@MatthewBrennan 2 ай бұрын
That’s cheating.
@zsigmondforianszabo4698
@zsigmondforianszabo4698 2 ай бұрын
11:26 bro uploaded the video in 4k but recorded the screen with an amazon doorbell camera 💀
@MatthewBrennan
@MatthewBrennan 2 ай бұрын
😂 yep. Lesson learned. The renderings were 4K but my screen recording was 1080 🥲
@bluedeep8041
@bluedeep8041 2 ай бұрын
If only these beautiful buildings existed today, it would have been amazing. It’s an unbelievable engineering. The talents and skills of the builders were astounding.
@todd5334-p7w
@todd5334-p7w 2 ай бұрын
Of course we have to remember, that slaves were worked very hard,even to death for these beautiful palaces.
@grigtod
@grigtod 2 ай бұрын
Amazing use case!
@falldog9
@falldog9 3 ай бұрын
Wow this is incredible work. Thank you.
@MatthewBrennan
@MatthewBrennan 3 ай бұрын
Glad you liked it!
@JohnHutchinsonJPH
@JohnHutchinsonJPH 3 ай бұрын
What type of 360 camera did you use?
@MatthewBrennan
@MatthewBrennan 3 ай бұрын
Insta360 One R - I've had it for about 4 years and have mixed feelings about it - sometimes it's great, other times it will freeze and shut down for no reason - and to my eye the footage is decent. For the price it's a good little 360 camera.
@infectioussneeze9099
@infectioussneeze9099 3 ай бұрын
what are your computer spec?
@MatthewBrennan
@MatthewBrennan 3 ай бұрын
The 3DGS was trained on a cloud workstation instance with an A100 GPU. The video rendering and photogrammetry was done on a desktop with a Ryzen 9 3900X, 4070ti, and 32GB RAM.
@chumleyk
@chumleyk 3 ай бұрын
Ok. Why did the psychedelic sky of the gaussian splat give me a panic attack? I'm going to call it a Splat Attack.
@FredGarcia-yt6te
@FredGarcia-yt6te 3 ай бұрын
What music?
@MatthewBrennan
@MatthewBrennan 2 ай бұрын
"Elgar - Serenade for Strings"
@tamiopaulalezon9573
@tamiopaulalezon9573 3 ай бұрын
What is your drone?
@MatthewBrennan
@MatthewBrennan 3 ай бұрын
Mavic 2
@HeadPack
@HeadPack 3 ай бұрын
Very informative video. You are showing a textured model from photogrammetry in the end. How does one create that?
@MatthewBrennan
@MatthewBrennan 3 ай бұрын
You need a photogrammetry software. In this case, I used Agisoft Metashape, but there are free/open-source options, such as COLMAP and VisualSFM
@HeadPack
@HeadPack 3 ай бұрын
@@MatthewBrennan Thank you very much for that information. Much appreciated.
@ryukisai99
@ryukisai99 3 ай бұрын
Thanks for the good video and for providing the nice dataset. What is the focal length of your drone's camera (full frame equivalent)?
@MatthewBrennan
@MatthewBrennan 3 ай бұрын
35mm equivalent is ~28mm. It's a 1" CMOS 20mpx sensor (for still images). However this dataset uses 4k video.
@ryukisai99
@ryukisai99 3 ай бұрын
@@MatthewBrennan thanks for your answer. I'm trying to run your dataset using micmac photogrammetry. I'll let you know if I get good results!
@handlemonium
@handlemonium 3 ай бұрын
Cool.....but where's the moon?
@MatthewBrennan
@MatthewBrennan 3 ай бұрын
During totality the moon moves in front of the sun (it's the black "hole" with sunlight shining around it) - when it's not occluding the sun, it's not visible (because the light is coming from behind it)... Unfortunately, the exposure settings on the 360 camera don't make it possible to really see the moon occluding the sun because there is enough light to still overexpose that area - but the shift from full/partial sunlight to eclipse is still pretty dramatic.
@sommergreen3803
@sommergreen3803 3 ай бұрын
THANK YOU SOOO MUCH FOR THIS
@michaelytterberg8941
@michaelytterberg8941 3 ай бұрын
Wow!!!
@jimj2683
@jimj2683 3 ай бұрын
Someone should turn Google Street View into 3d. It would be so nice to drive around and explore the world in a driving game.
@lifeunframed9154
@lifeunframed9154 3 ай бұрын
Is the photogrammetry done from VR footage?
@MatthewBrennan
@MatthewBrennan 3 ай бұрын
No - the photogrammetry is a DJI mavic 2 and a Sony A7Rii. Although, as I was watching the 360 footage, I think I will try to digitize one of the grave markers using the spherical video (the one that I walk around completely).
@trollenz
@trollenz 3 ай бұрын
Good old nodal stitch method, stunning results... Nothing beats that still 👏🏻👌🏻
@MatthewBrennan
@MatthewBrennan 3 ай бұрын
Thank you! I was worried about ghosting on the greenhouse structure/mullions, but I must have had it dialed in perfectly :)
@trollenz
@trollenz 3 ай бұрын
Haha, you definitely went on a challenge on that one, don't worry I've turned the stuff upside down all the way around... Flawless 😉 Sound atmosphere is also very immersive... I'm about to scan a very similar one... I'm concerned about the hours of deleting reflected points I'm gonna have to spend 😅
@estebantedesco1348
@estebantedesco1348 4 ай бұрын
god damn insane
@user-dv3pi8co2x
@user-dv3pi8co2x 4 ай бұрын
At about six minutes and thirty-nine seconds, what software was used?Looking forward to your reply😊
@MatthewBrennan
@MatthewBrennan 4 ай бұрын
Agisoft Metashape - it's an industry-standard photogrammetry software (formerly called Photoscan).
@NOLNV1
@NOLNV1 4 ай бұрын
That's an amazingly beautiful rock formation, not that it's the topic of the video but just felt like mentioning it
@MatthewBrennan
@MatthewBrennan 4 ай бұрын
It has an interesting backstory too! The legend goes that a utopian community wanted to hollow out the rock to use as a church - and even went so far as to begin chiseling a doorway (you can see the opening in the video/model).
@foolishonboards
@foolishonboards 4 ай бұрын
do you still recommend this technique ? I just saw this video that uses a slightly different technique and I'm wondering which one to use: kzfaq.info/get/bejne/grd-dbenzNLOcas.html&ab_channel=TheNeRFGuru
@MatthewBrennan
@MatthewBrennan 4 ай бұрын
360 imagery won't give you results like properly captured "photogrammetry"-style data - the typical 360 sensors are small, and you're cramming a lot of data into not-many-megapixels. If you absolutely have to use 360 data, good even scene lighting and a good 360 sensor are key, more than the processing technique.
@hammadwalid8428
@hammadwalid8428 4 ай бұрын
Dude, your video looks horrible, why do you upload that like this with 144p resolution being in "HD" or "4K"?
@careclean24
@careclean24 4 ай бұрын
Hi everyone, is it possible to digitize a vehicle so that it is displayed razor sharp with all of its flaws and scratches without using spray color?
@MatthewBrennan
@MatthewBrennan 4 ай бұрын
You'd want to use LiDAR or structured light, or a combination of LiDAR and photogrammetry. I have digitized wrecked cars before using photogrammetry - and LiDAR is often used to document crash scenes.
@lukassarralde5439
@lukassarralde5439 4 ай бұрын
Hi Matthew. Great video explanation. Which drone did you use for this test? Do you have by any chance any more drone footage? Have you use the DJI Mavick 3 pro Cine for photogrammetry? Thanks.
@MatthewBrennan
@MatthewBrennan 4 ай бұрын
I used a Mavic 2 for this model. I have used a number of different drones for photogrammetry in the past, but haven't tried the Mavic 3 yet, although I don't think the Cine model adds anything particularly useful for traditional photogrammetry.
@RiccaDiego
@RiccaDiego 4 ай бұрын
Hi! Amazing information! I think you can help me with some information. I have point clouds from a BLK360 scanner from leica. Do you know if it is possible to turn these point clouds into Gaussian Splatting? Thanks a lot!
@MatthewBrennan
@MatthewBrennan 4 ай бұрын
no, probably not, because the Gaussian splatting is based on image data, not LiDAR data. You could use a photogrammetry program to align your LiDAR datasets to imagery, though.
@ishibaro
@ishibaro 4 ай бұрын
thank you very much for this video :D superb for future developments in archaeology. I am already checking NERF with Kiri Engine, but I loved to see how to do it with the tools you mentioned. Coool!
@user-ph7jh6oo5w
@user-ph7jh6oo5w 4 ай бұрын
.. The building STyle in which were as a daughTer in The KinderGarden is called Villa i had age 5