Gaussian Splatting + Blender is AWESOME !

Рет қаралды 91,136

Күн бұрын

👉 My Digital Asset Store: mediamonopoly.co 👈
📌 Patreon: / maxnovakyoutubetutorials
(download project file)
⚡ GET AFTER EFFECTS / Creative Cloud HERE: www.adobe.com/?sdid=49F59KY6
(I get a commission from this link)
📩 (business inquiries: sawickimx@gmail.com)
Gaussian Splatting + Blender is AWESOME !
------------------------------------------------------------------------------------------
👉 Follow me on IG: @_maxnovak
👉 Join Our Community Discord: / discord
(Editing Help, Job Offers, Submit Videos, Interact!)
------------------------------------------------------------------------------------------
LINKS:
GS Made with: poly.cam/
Free Blender GS Plugin: github.com/ReshotAI/gaussian-...
Read about GS: huggingface.co/papers/2308.04079
Thumbnail Frog Model By Adrian Carter on Sketch Fab: sketchfab.com/3d-models/sir-f...
Today we're going to talk about the new successor to photogrammetry - gaussian splatting. There have been some awesome results with GS so I wanted to show you this quick tutorial on creating a gaussian splat and bringing it into blender. I'll also show you how to light, animate, and create effects and transitions for the scene. Enjoy!
TIMESTAMPS:
0:00 - Intro
0:50 - Gaussian Splat Methods
1:38 - Making our gaussian splat
4:00 - GSP to Blender with free addon
6:00 - Controling with Blender
6:53 - Lighting & Camera animations
9:55 - Particle explosion effect
12:30 - Footage to splat transition
#blender #gaussiansplat

Пікірлер: 110

@7spelman 8 ай бұрын

So cool! I work at Polycam and we're going to enable video upload directly on the web next week, so you'll be able to skip the section where you have to extract the frames in AE 🎥We're also going to add upload for Gaussian Splatting, so you can just upload and share the ones that you create in Blender with the addon (there's an option to export it in the addon UI)

@MaxNovakTutorials 8 ай бұрын

Awesome :) I’ve been a big fan of Polycam for a while now. I used them for 3D scanning in the past

@Instant_Nerf 8 ай бұрын

That’s good to hear. Polycams implementation of Gaussian splat seems to work very well with more data. I took aprox 250 images and uploaded to both luma ai and Polycam … Polycam output shows more scene data !! I’m excited by this.. im not sure why the render engine in both blender and unreal are not that great .. and I know that has nothing to do with you guys. The visual quality of thr splats on the web is not what we get in any of the engines that we use.

@pavanrzx 8 ай бұрын

@7spelman Is it possible for you to fix the polycam app in iphone? It seems non responsive when trying to take photos for photogrammetry.

@wrillywonka1320 8 ай бұрын

Will this increase the quality of the gaussian splat?

@Instant_Nerf 8 ай бұрын

@@wrillywonka1320 the Gaussian splats can only be as good as the data you have .. all angles .. 4k .. sharp etc.. poly’s implementation is really good the best I’ve seen and used ..

@FoxMeister14 8 ай бұрын

This is the most straightforward tutorial I've found that includes everything I wanted! Thank you. I think gaussian splats are the next big step in archiving memories and I could foresee it getting exponentially accessible as the tools improve. Super exciting stuff, so many interesting applications.

@oivasquezc 8 ай бұрын

Bro, your tutorials are always amazing. You explain everything well, with enough level of depth without getting too crazy technical 🎉 I'll bee using that work flow for sure.

@patrickcasella 8 ай бұрын

always on the cutting edge of technology, dope video as always

@judgeworks3687 8 ай бұрын

this looks great. will try it out tonight. Thanks.

@OlliHuttunen78 8 ай бұрын

Cool video! I did'n know that some one have made already an add-on of Gaussian Splatting to Blender. Thanks for this information.

@sjuvanet 7 ай бұрын

such a good tutorial, man. thank you very much for introducing me to this incredible technology. i am blessed to have been recommended your videos.

@RobertWildling 8 ай бұрын

Really awesome tutorials! Thank you very much! Subscribed!

@andre_avila 8 ай бұрын

You are the best, bro. Thanks for this.

@InscrutableObjects 7 ай бұрын

Great demo!!!! Thank you for sharing this workflow!

@MrTomyCJ 8 ай бұрын

Ohhh I like that it's made out of geometry points, that makes them very controllable with geonodes. I'm gonna go crazy with this! thank you for the tutorial!

@Because_Reasons 8 ай бұрын

Finally a blender plugin, thanks for this!

@spearcy 8 ай бұрын

Looks like a fun thing to try out. 👍🏻

@filipemecenas 8 ай бұрын

Insane !!! Thank you !!!

@Everything3dAnimation 8 ай бұрын

Amaizing !

@yasunakaikumi 8 ай бұрын

for people who dont have After Effects to make image sequence, Blender can do it with its video editor, and it's faster to render than AE.

@oscarandrade6024 8 ай бұрын

I always use Blender to convert video to PNG sequence and viceversa. It's lighter than AE

@lupsik1 8 ай бұрын

@@oscarandrade6024 If you care about being light, fast and up-to-date ffmpeg is the answer. 24MB, simple to use if youre used to CLI apps, and as far as I remember, Blender uses ffmpeg under the hood either way.

@jonatanhedborg83 6 ай бұрын

You can also do it easily with the command line tool ffmpeg. "ffmpeg -i file.mp4 output_%04d.png". No project setup or anything needed.

@gabriel.centeio 3 ай бұрын

im not gettin any textures or geometry nodes, any fix?

@maxli4858 24 күн бұрын

Thanks very much for sharing. i can say the points in 'modelling' but cannot see anything in layout. is there any setup to be done to fix this issue?

@Atlas_Redux 8 ай бұрын

Do you know any way to export and use edited clouds in Unreal Engine? I have the plugin for 3D Gaussian Splatting for Unreal Engine, but the Stanford PLY that Blender generates is not compatible. I want to edit the clouds in Blender (since it's impossible currently in UE), then transfer it to UE, but I can't find any way to EXPORT a compatible PLY to UE again.

@bladerunner.1984 8 ай бұрын

Question - will it work with any PLY or does it have to be specifically generated by Polycam? I have a whole bunch of my old photogrammetry scans in PLY format and wonder if I could convert them into gsplats.

@Jsitez 8 ай бұрын

yooooooooo .... tsssss

@wrillywonka1320 6 ай бұрын

do you think if i blue screened or green screened my object in video and exported as transparent png images that my gaussian splat would be even better?

@goshawk_fly 4 ай бұрын

Can I use it with texture baking for creating lowpoly models for games?

@ue_abyar 7 ай бұрын

Hi! I can't find blender nodes. So I can't see my models texture. Can you help me?

@DisgruntledPigumon 7 ай бұрын

Thanks for this! And in return I give you photoGRAMmetry. ✌️

@jhildebrand77 8 ай бұрын

I would love to see a breakdown of Eazy Mac's Monkey Wrench video if you're able to as well!!!

@oiganamitio 8 ай бұрын

no gpu acceleration for Ae?

@rongchn_ 6 ай бұрын

Thanks for your tutorial!!! I got a question at 6:00. I don’t know why my blender’s RENDER viewport shading only shows outline highlights instead of the whole object. (already switched to cycles)

@deniscliofas8607 6 ай бұрын

Use older Blender version. Addon that is shown in video at the moment doesn't work with Blender 4.0.

@MingkunLei 8 ай бұрын

I want to ask a question that why this ply file import to blender, it will become dim?

@cadudatoro4998 8 ай бұрын

wow...thank you...

@UNOCASTILLO 7 ай бұрын

works on blender 4?

@milkbath 8 ай бұрын

So sick

@ElectroOverlord 8 ай бұрын

I recently got into the hobby but one thing that freaks me out is the pace from photogrammetry to NeRF to GS....Took me a month to figure out which order was what of better. This topic should have a history written about it or is reality happening to fast for studying history anymore.

@cekuhnen 7 ай бұрын

I tried this on MacOS but it seems not to render. The nodes are also different.

@sagarrathod1533 4 ай бұрын

SAME

@YNGWxRLD 3 ай бұрын

@@sagarrathod1533 i just read in one of the comments it doesnt work on blender 4

@Ch8pter 2 ай бұрын

@@YNGWxRLD I have blender 3.3.1 and it still doesn't work. Just a bunch of dots

@CANS001 6 ай бұрын

No nodes showing up when importing the ply

@user-ko4pt8vj2v 4 ай бұрын

help ! I can't find the “as point cloud（faster）”😑

@theratscratch 8 ай бұрын

Can you link some music videos that have been made with the technique? Curious to see what people are doing with it

@Jsitez 8 ай бұрын

asap ferg green juice

@maxwilledit 8 ай бұрын

W VIDEO

@jiennyteng 6 ай бұрын

Why I can't find the export Gaussian splat button in the add on ?😂

@mrofnoctonod 8 ай бұрын

Great Video. Just one thing - Dot Product is not the size of the dots (6:21). The radius slider on the "Mesh to Points" node is the size of the "dots".

@colepeterson5392 3 ай бұрын

lmao

@fdfg546ghhjs3 8 ай бұрын

Game changer

@koningsbruggen 7 ай бұрын

seems to not work in blender 4.0

@villageidiot181 8 ай бұрын

Can you do a tutorial on 3d animations like aid6n? He’s been making a lot of animations for music videos recently

@basspig 7 ай бұрын

I don't see a way to download this plug in for Blender. It just opens the directory when I click "Go to file". Usually, there's a "download zip" option, but that is missing. If I right click save as, it saves an html file.

@MaxNovakTutorials 7 ай бұрын

on github page click green code button in top right and then click download zip

@simonren4890 7 ай бұрын

it seems like it only works for 8bit png images, right? I tried 16bit, it output a mess.😂

@godzoookie 6 ай бұрын

Doesn't Blender ship with a .ply importer

@scottjohnnyhelgemoaune2951 4 күн бұрын

anyone else getting a broken geometry node structure from the plugin?

@deathtrooper5759 4 ай бұрын

I'm having trouble with activating the lights for the skull. When I enter the shader editor. my principled BSDF is slightly different and I can't just slide the specular, it's instead a tab of its own with a few settings I don't understand. I am using Blender 4, can anyone help?

@MaxNovakTutorials 4 ай бұрын

Ya in blender 4 they changed the node a bit. There should be a drop down you can click that will let you edit the spec value.

@weeq326 3 ай бұрын

@@MaxNovakTutorials I get Geometry Nodes but Shader is completely empty? I can see all the colors though. Any ideas? Blender 4.0.1

@weeq326 3 ай бұрын

Nvm, got it. I just had to select the GaussianSplitting in the Shader Editor!

@cgcrazy 5 ай бұрын

Bro, it would be cool if u replied to some of the comments wanting help. I have a problem where its not showong any geo nodes after importing the file into blender, its just dots, nothing else. Please do help!

@Nimpor_Tekoi 5 ай бұрын

i have the same problem, commenting to see if anyone answers

@andybaker765 7 ай бұрын

been playing with this, pretty cool. but maybe I'm dumb cause getting worse results than regular photogrammetry lol

@kamillatocha 2 ай бұрын

in 3.6 it works but wont display colors of splats

@Ch8pter 2 ай бұрын

Yeah ... same here. Been trying to troubleshoot but I think something is up...

@kamillatocha 2 ай бұрын

@@Ch8pter if u check the script it says it only works in blender 4.0 not 4.1 4.0 is no longer for download on main site had to dig archives

@moondane3907 8 ай бұрын

>Winrar and AE instead of 7zip and Blender itself

@nickkovalenko3398 4 ай бұрын

Tried it - no textures applied, no geo nodes, no shader nodes.. nothing, just a bunch of dots. How did you guys actually get it to work?

@Ch8pter 2 ай бұрын

Bump

@wrillywonka1320 6 ай бұрын

damn i followed these steps but my ply file in blender has no geo nodes and just looks like dots. i noticed polycam has a download specifically for blender but only accessible for pro customers. do think they made it so we can use this workflow anymore for free?

@Nimpor_Tekoi 5 ай бұрын

i have the same problem, but i have the pro polycam version and it doesnt change anything, commenting to see if anyone answers

@wrillywonka1320 5 ай бұрын

@@Nimpor_Tekoi wonder why they have an expott for blender specifically? Almost like its just there to dupe people into goin pro. So far i havent found a solution for blender yet. Not a good one at least

@Ch8pter 2 ай бұрын

@@wrillywonka1320 I started the free trial to download a .ply specifically for blender to see if that was the issue... still all dots for me

@reaganmonkey8 7 ай бұрын

If someone can't afford Adobe, Blender's video editor can also render to PNG.

@no.1_2u32 7 ай бұрын

3DGS + AI = Never believe your own eyes again! 👀

@waymanbryant243 8 ай бұрын

Can you do FTP - Charlie Feat. Chief Keef?

@juangoyeneche7304 15 күн бұрын

Great tutorial video. Now there’s should be done with another application other than premiere. At this point no one should be using any Adobe product anymore. This video was done before the scams came to light with Adobe but now is another story.

@skeleton_craftGaming 7 ай бұрын

Or if you're using 23 H2 you can just use explorer.

@johncarlson3968 7 ай бұрын

Dude, you can use more than 250 frames with Blender on output

@wrillywonka1320 8 ай бұрын

I have to know if this speeds up renders at all. U didnt really giv us much on th render speed

@MrTomyCJ 8 ай бұрын

Point clouds are usually quite fast to render, but I don't think this is usually used as a way to speed up renders, it's kind of like an entirely different technology.

@GiJoe94 7 ай бұрын

You got your things messed up.

@GreenFox1505 7 ай бұрын

Did you call it Gawshin splatting?!

@maxhopnik2229 7 ай бұрын

Can you help please , I downloaded plugin , but when importing .ply file there is an error : " Python: Traceback (most recent call last): File "C:\Users\убийцаа\AppData\Roaming\Blender Foundation\Blender\4.0\scripts\addons\blender-addon\__init__.py", line 1133, in draw row.prop(obj.modifiers["GeometryNodes"].node_group.nodes.get("Boolean"), "boolean", text="As point cloud (faster)") KeyError: 'bpy_prop_collection[key]: key "GeometryNodes" not found' "

@chacecampbell2697 2 ай бұрын

Just got the same error. Wouldn't import anything in 4.1, but 3.6 imported the point cloud but still gave the error. Version 4.0.0 seems to be working though.

@f612CreatorsPodcast 7 ай бұрын

I definitely did not pay 100 bucks for gaussian splatting in UE

@ExploreSweden 8 ай бұрын

Photo-gra-metry 🤣🤣

@stevep8485 8 ай бұрын

And the 'Gau' in Gaussian rhymes with Cow. I'm beginning to this this guy is a bot.

@dalegreer3095 8 ай бұрын

Gauss is pronounced "gowss", and Gaussian is pronounce "gowssian". It's not gawshun.

@aarocka11 7 ай бұрын

Would it kill you to pronounce photogrammetry properly?

@DeceptiveRealities 7 ай бұрын

You might like to learn how to say Gauss's name. It isn't gORshan. It's Gowsian. Ow - as in the pain I get every time I hear his name mispronounced.

@cptairwolf 8 ай бұрын

"photo" "gammetry" "gaussian"... Pronunciation, learn it.

@user-de7gu8id5g 29 күн бұрын

why blender tall me error :Python: Traceback(most recent call last): File "C:\Usersl18 1 54\AppData\RoamingiBlender Foundation Blender 4.1lscriptsladdonslblender-addonl_init_.py", line 970, in executeswitch node.inputs[14] wwwwwwwnwnwnwwwwwwhhh IndexError: bpy_prop_collection[index]: index 14 out of range, size 3

@adamshervey173 28 күн бұрын

same, did u fix it?