Photogrammetry Mesh vs. Gaussian Splatting point cloud

  Рет қаралды 3,760

Matthew Brennan

Matthew Brennan

9 ай бұрын

Comparison of the same data set processed with photogrammetry and Gaussian splatting.
Data: 110 images, 42mpx
Photogrammetry: 6million polygons, 10 4096 textures
Gaussian Splatting: 30k iterations, 172k points, 7 million splats

Пікірлер: 17
@realthing2158
@realthing2158 9 ай бұрын
Wow those gaussian splatting results are amazing and your recording quality is very smooth. I like the background audio ambiance as well.
@DJ-Illuminate
@DJ-Illuminate 9 ай бұрын
Maybe make a point splat mesh like this: Direct Mapping: Each splat directly corresponds to a point (or set of points) in the mesh. As the splat undergoes any transformation, the mesh point follows suit. If the splat moves to the left, the point moves to the left. If the splat grows in size, perhaps the point-mesh around that splat could expand or become denser. Fluidity in Motion: Imagine the splats as buoys floating on water. As they move, the net (or mesh) attached to them adjusts and moves with them. This creates a fluid, dynamic motion in the mesh that's directly influenced by the movement and behavior of the splats. Temporal Dynamics: If the splat data is changing over time (like in a sequence or animation), the point-mesh would continuously adjust and evolve frame by frame, creating a moving, dynamic representation. Overlapping and Merging: If two splats come close or overlap, the corresponding points in the mesh might also come closer, merge, or influence each other in some manner, depending on the design and algorithm in place. Interactivity: This approach also opens doors for interactivity. A user (like a designer or animator) could directly manipulate a splat and see real-time adjustments in the corresponding mesh, providing a tactile and intuitive way to shape and design 3D structures or animations. In essence, by directly linking the behavior of the splats to the motion and structure of a point-mesh, you can create a dynamic, responsive, and potentially more intuitive system for mesh generation and manipulation. It's a concept that harmoniously blends data representation with visual aesthetics and user interaction.
@afleast
@afleast 9 ай бұрын
The main issue here for me is the 3D model itself. Currently, there is no way (although I believe it will be resolved) to give gaussians appropriate colliders, shading, and responsiveness to lighting.
@haikeye1425
@haikeye1425 8 ай бұрын
Great!
@smashing_times
@smashing_times 9 ай бұрын
hey! thank u for video. can u tell please wich soft did u use for splatting?
@MatthewBrennan
@MatthewBrennan 9 ай бұрын
repo-sam.inria.fr/fungraph/3d-gaussian-splatting/
@tazztone
@tazztone 9 ай бұрын
would there be a way to clean up those floating splats sometimes blocking the view ?
@MatthewBrennan
@MatthewBrennan 9 ай бұрын
Yes - the current version of the unity project by Aras-p has the ability to use volumes to "hide"/cut the floating splats
@dimaananyev5336
@dimaananyev5336 9 ай бұрын
Hello, colleague! I'm quite impressed with the results you're achieving, and I subscribed to your channel some time ago, which I'm very pleased about. In several of your videos, you mentioned that you have a large database on classical photogrammetry, and now you plan to use the captured materials for visualizations in Gaussian Splatting technology. You're a pro, and I really appreciate what you're doing. I find your comparison videos fascinating and very informative. Thank you so much for your hard work! If you find the opportunity to reply, I would be very grateful. You mentioned that you use Agisoft Metashape in your work and transfer camera location information from there to a file that can be further used by Nerf for data processing. Could you explain how to transfer camera position data from Agisoft Metashape to a service file? Currently, developers are using a very slow and inefficient tool, Colmap. Yes, it's free, but it seems to have its limitations. Half of my reasonably good photogrammetry sets are not understandable to Colmap; it loses camera positions, making it impossible to work with them further.
@MatthewBrennan
@MatthewBrennan 9 ай бұрын
You can export the camera positions from Agisoft as an XML file. Then I’ve been using NeRF studio for nerfs, which can interpret the Agisoft file. For Gaussian splatting there is a script I’ve been using that will export Agisoft in COLMAP format: github.com/agisoft-llc/metashape-scripts/blob/master/src/export_for_gaussian_splatting.py
@dimaananyev5336
@dimaananyev5336 9 ай бұрын
@@MatthewBrennan Thank you very much for your answer, I will try the path you suggested!
@trollenz
@trollenz 9 ай бұрын
​@@MatthewBrennanthanks for that one 👌🏻
@lunabeige
@lunabeige 7 ай бұрын
can you convert gaussian to a 3d model / mesh?
@MatthewBrennan
@MatthewBrennan 7 ай бұрын
In theory yes, because the Gaussian "splat" file is a PLY point cloud with splat information. However, you would lose that color/viewing angle information when you meshed it, and likely be stuck with vertex coloring, or have to create a texture from the imagery.
@dibbidydoo4318
@dibbidydoo4318 5 ай бұрын
@@MatthewBrennancan't you combine the color information from gaussian splatting with the mesh information created from a separate algorithm?
@MatthewBrennan
@MatthewBrennan 5 ай бұрын
@dibbidydoo4318 yes - there's something called "SuGaR" (github.com/Anttwo/SuGaR ) that aligns the gaussians to a mesh, I haven't tried it yet though.
@dibbidydoo4318
@dibbidydoo4318 5 ай бұрын
@@MatthewBrennan thanks!
3D Gaussian Splatting the Medici Tombs
12:02
Matthew Brennan
Рет қаралды 1,9 М.
Gaussian Splatting Large Urban Spaces vs. Photogrammetry
8:24
Matthew Brennan
Рет қаралды 6 М.
Gym belt !! 😂😂  @kauermtt
00:10
Tibo InShape
Рет қаралды 12 МЛН
What is Better? Polycam Gaussian Splats vs Original Gaussian Splats
16:54
Roman Villa Interior
2:02
Nigel Cole
Рет қаралды 60 М.
Why Houdini Has No Rivals in Simulation
10:15
InspirationTuts
Рет қаралды 95 М.
Create Stunning 3D Mesh from Point Clouds (Python Version)
15:23
Florent Poux
Рет қаралды 19 М.
Photogrammetry or NeRF? - Creating 3D Models with a Smartphone
13:31
Robin J Kavanagh
Рет қаралды 8 М.
Gaussian Splatting and Photogrammetry with 360/spherical imagery
29:25
Matthew Brennan
Рет қаралды 13 М.
Photogrammetry vs Gaussian Splatting for Virtual Reality
17:14
Piazza Navona: 3D Gaussian Splatting and Photogrammetry
12:50
Matthew Brennan
Рет қаралды 775