3D Gaussian Splatting: How's This The Future of 3D AI?

Рет қаралды 78,171

Күн бұрын

To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/bycloud . The first 200 of you will get 20% off Brilliant’s annual premium subscription!
3D Gaussian Splatting
[Installation Tutorial] • 3D Gaussian Splatting ...
[Paper] repo-sam.inria.fr/fungraph/3d...
[Project Page] repo-sam.inria.fr/fungraph/3d...
[Code] github.com/graphdeco-inria/ga...
NeRF
[Paper] arxiv.org/abs/2003.08934
[Project Page] www.matthewtancik.com/nerf
[Code] github.com/bmild/nerf
MipNeRF360
[Paper] arxiv.org/abs/2111.12077
[Project Page] jonbarron.info/mipnerf360/
[Code] github.com/google-research/mu...
Instant-NGP
[Paper] nvlabs.github.io/instant-ngp/...
[Project Page] nvlabs.github.io/instant-ngp/
[Code] github.com/NVlabs/instant-ngp
Plenoxels
[Paper] arxiv.org/abs/2112.05131
[Project Page] alexyu.net/plenoxels/
[Code] github.com/sxyu/svox2
Dream Gaussian
[Paper] arxiv.org/abs/2309.16653
[Project Page] dreamgaussian.github.io/
[Code] github.com/dreamgaussian/drea...
GSGEN: Text-To-3D Gaussian Splatting
[Paper] arxiv.org/abs/2309.16585
[Project Page] gsgen3d.github.io/
[Code] github.com/gsgen3d/gsgen
MVDream
[Paper] arxiv.org/abs/2308.16512
[Project Page] mv-dream.github.io/
[Code] github.com/bytedance/MVDream
Dynamic 3DGS
[Paper] dynamic3dgaussians.github.io/...
[Project Page] dynamic3dgaussians.github.io/
[Code] github.com/JonathonLuiten/Dyn...
NeRF-DS
[Paper] arxiv.org/abs/2303.14435
[Project Page] jokeryan.github.io/projects/n...
[Code] github.com/JokerYan/NeRF-DS
PolyCam
[website] poly.cam/
Luma AI
[website] lumalabs.ai/
This video is supported by the kind Patrons & KZfaq Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO
[Discord] / discord
[Twitter] / bycloudai
[Patreon] / bycloud
[Music] Massobeats - Serenity
[Profile & Banner Art] / pygm7
[Video Editor] @askejm
This video was sponsored by Brilliant

Пікірлер: 114

@bycloudAI 9 ай бұрын

nerf vs 3d gaussian splatting is gonna be an interesting research topic 1v1 for the next year lol and to try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/bycloud . The first 200 of you will get 20% off Brilliant’s annual premium subscription!

@arthurprangerpellen7402 9 ай бұрын

It's weird how I understand absolutely nothing of every videos you make but still click on them and watch them till the end each time

@ea_naseer 9 ай бұрын

I only have a surface level understanding of what's being said because I do CS... that's my saving grace 😂😂

@carkawalakhatulistiwa 9 ай бұрын

😂just study more men. Just read more chat gpt peper

@rashedulkabir6227 9 ай бұрын

@@carkawalakhatulistiwa Those papers are not published in journal.

@quazar-omega 9 ай бұрын

@@carkawalakhatulistiwastudy more men? I'm not a doctor

@NotSoMuchFrankly 9 ай бұрын

bycloudAI really disappoints me like this. He spends enough time doing research that if he spent less time trying to throw at you a jargon salad, you might actually be able to learn something but instead he wastes your time, too. He at least gets clicks out of it. I get the impression (and he has hinted a couple times) that even he doesn't understand everything he says. There are schools in both East and West that merely require you to regurgitate, i.e. copy/paste your "research." Sadly, it's a missed opportunity.

@marverickbin 9 ай бұрын

Crazy how they publish so fast. I took 2 years developing a method on motion magnification and writing to submit to a journal. and has passed 1 year since I submitted to the journal. Not published yet. It will clearly be outdated when it will be published.

@Angeloi89 9 ай бұрын

Literey the best explanation of what 3D Gaussian Spatting is I have seen so far. And I was realy into getting it and watched basycally every video I could find. Thanks for that bro. Abo for that.

@TheRealZeke2003 9 ай бұрын

Can't wait for 4D AI

@neuvatn 9 ай бұрын

3rd Dimension + time (animation) or the 4th dimension?

@AB-wf8ek 9 ай бұрын

There are already AI motion models, which means temporal information i.e. time - the fourth dimension On another note, machine learning itself is hyperdimensional, so it already functions in way more than 4 dimensions.

@GerardMenvussa 9 ай бұрын

Would be great if you could make a video on AI tools used locally. Like, what are the limitations? The advantages? How have they evolved over time? The system requirements? I'm pretty sure I don't has 24 GB of VRAM >.>" So much stuff going on and it moves fast.

@beautyandthesavage 9 ай бұрын

I love your channel, dude. It's geeky as hell and entertaining as hell, which forces me to go out and learn about the terms you speak of and for that, I am super grateful.

@python_l5367 9 ай бұрын

Would love to follow your windows installation guide but sadly I only have 8GB VRAM.

@ninjatogo 9 ай бұрын

I know it's sort of meant as a joke, but to say that meta spent all that money on Horizon Worlds is incorrect. Most of their spending has been on their Reality Labs teams that produce AI and graphics research projects. Otherwise, great video as always

@DJVARAO 9 ай бұрын

Not a joke at all. Per Wikipedia: Formerly: Facebook Reality Labs (2020⁠-⁠2021) Founded: 2020 Products: Meta Quest 3, Quest 2, Meta Quest Pro, Ray-Ban Stories, Horizon Worlds Revenue Decrease: US$2.16 billion (2022) Operating income Decrease: US$-13.72 billion (2022)

@ninjatogo 9 ай бұрын

@@DJVARAO In your reply right there, it says the same thing, *Meta Reality Labs* They don't just work on Horizon Worlds. Meta has released detailed spending breakdown reports to show those billions are spent across VR and AR hardware development and research, AI research, and more. Most of the money was being dumped into AR hardware research. In the end less than 10% was being spent on Horizon Worlds/The Metaverse.

@DJVARAO 9 ай бұрын

@@ninjatogo Sure, but still spending 13 billion seems unjustified.

@r.m8146 9 ай бұрын

@@DJVARAO That's a different claim to: "they overspend money on the metaverse."

@DJVARAO 9 ай бұрын

@@r.m8146 Is it?

@DJ-Illuminate 9 ай бұрын

Could a splat be used as a vertex for movable 4D meshes?

@logangarcia 9 ай бұрын

Can you link burning gaussian platting 🥺 I can't find it online

@LeonardTavast 7 ай бұрын

I'm looking forward to seeing benchmarks comparing Gaussian splatting to classical shading in terms of performance and quality. I wonder what kind of games will be possible with the technique.

@ShortyTwo 3 ай бұрын

Can someone please explain, how the colors are stored in the spherical harmonics? If I understood it correctly in the original system they used 16 float vec3's (in total 48 float values) that represent the coefficients of the spherical harmonics. So we the red channel is encoded as an sh by the first entry of each vec3, the green channel by the second value and the blue channel by the third value of the vec3(?) Is that correct or am I completly wrong?

@DjeensArt 8 ай бұрын

Hey how are you ? I’m a vfx artist and wanted to ask you, do you know what they use to make those crazy effect you show at 4:30 ? It’s 3D gaussian splatting then blender ? I’m really new in it

@ThreeBooleans 9 ай бұрын

Any way to do this on a 3080 ti? 16vram?

@akjoao378 8 ай бұрын

hey i had no idea about anything in this video, i can make a wooden plank in Blender though, thank you for the valuable channel you have built

@AkaThePistachio 8 ай бұрын

Would a 3080ti be good enough for local install?

@matibuche4897 9 ай бұрын

Thanks for the vid 🌻👍

@TiagoTiagoT 9 ай бұрын

It takes longer to train than NeRF but is faster to render after it's done?

@danzmachinz2269 9 ай бұрын

Been on the splatting hype train lately.i dont understand it enough to know how this can be used for video or with far fewer input images..maybe i'll just give it a couple of weeks for a couple of new papers... oh well before i even finish typing... dynamic splats!

@paxtoncargill4661 9 ай бұрын

3dgs is so intuitive thinking about it

@DrW1ne 9 ай бұрын

YOOO NEW VIDEO CAME OUT

@larrythehedgehog 9 ай бұрын

I feel like you could make an entire rendering/game engine out of this.

@shadowskullG 9 ай бұрын

or you can't do that?

@absence9443 9 ай бұрын

@@shadowskullG or you can't do that?

@kellymoses8566 9 ай бұрын

There are no real modeling tools for the method right now.

@nodelayfordays8083 9 ай бұрын

The other issue is physics. But one day multiple papers combined.

@kelvinpraises 9 ай бұрын

@@nodelayfordays8083 You should check out **Generative Image Dynamics**, it can simulate the response of an object's motion, to a user's interaction from a still image aka *Interactive Dynamics*-although a very limited physics at this moment.

@CassBOTRR 9 ай бұрын

could you do a 3d gaussian splatting of a person and rig it like in blender

@mikesgamelab6369 9 ай бұрын

No, it’s still just a fancy point cloud like NeRF. At best, you could use it as a reference for such a model.

@unrealdevop 8 ай бұрын

Plot twist, Chat-GPT is also just using humans to chat with you.

@jerbear7952 5 ай бұрын

That plot twist thing needs to go especially with all of the dumb AI jokes

@DJVARAO 9 ай бұрын

Dude! This is wild! 😬

@17th_Colossus 9 ай бұрын

Awesome

@johnsherfey3675 9 ай бұрын

There should be 3D Gaussian Splatting acceleration hardware in next gen GPU's.

@LithFox 8 ай бұрын

So has anyone done... movement with this? Cause everything is static renders so far Cause that's going to be the big differential factor. Might be great at static 3D rendering, but if it can't keep up with movement and dynamic objects, then what's the point?

@DougSeven 9 ай бұрын

Mom comes out: I said the tree in the backyard needed pruned!

@ForEveRestOne 8 ай бұрын

what about dynamic light...

@ThankYouESM 9 ай бұрын

Can 3D Gaussian Splatting work perfectly fine to explore in a 8GB Ram laptop that has no GPUs?

@billlhooo6485 9 ай бұрын

so 3d model for modding games yet?

@asatorftw 6 ай бұрын

Great video, the progress in AI is just crazy. Quick call out tho, I would personally not recommend brilliant for ML. I prefered Andrew Ngs course on coursera by far.

@caleb-g1 9 ай бұрын

Weird how there's no comparison to MobileNeRF. Which seems a lot faster with lower system requirements.

@mrrespected5948 9 ай бұрын

Nice

@wolfzert 9 ай бұрын

Zaaz ojalá Konami se hubiera esperado a esta tecnología para revivir silent hill antes de mandar a la niebla al equipo XD

@Dr.W.Krueger 9 ай бұрын

Misleading thumbnail, GS is not "A.I" related; this is a classic algorithm.

@rjameslower 9 ай бұрын

IA Is divide in two. Modern and classical. Modern is based in simulation of biological structures (neural network example) but classical is based in logical, probability y pure math

@waltersixinchsub9861 4 ай бұрын

@@rjameslower so modern 'ai' just isnt ai then? thats literally just an algorithm/equations

@jonmichaelgalindo 9 ай бұрын

Brilliant is starting to feel like a competitor to schools. Also 3DGS is awesome! 🙂

@Forcoy 7 ай бұрын

If you really believe that online service rivals personal tutoring from a human bein, i dont know what to tell you Brilliant is nice, but its not "competing with schools"

@jonmichaelgalindo 7 ай бұрын

@@Forcoy Absolutely nothing I use in daily life came from school (except reading, writing, and basic math). I learned everything from jobs and the Internet. School wastes the best years of a brain's development. Bullying and peer pressure add trauma. I'm guessing you were a bully in school, and you think you were just having fun.

@Forcoy 7 ай бұрын

@@jonmichaelgalindo Buddy, I have head trauma and have moved schools twice as a complete oursider to the rest of the class. Even someone with brain damage can see that school can be an obviously useful tool, its current form is obviously not great, but that doesnt undermine the entire concept.

@jonmichaelgalindo 7 ай бұрын

@@Forcoy I'm like 99% sure now that you're a bully... They all seem to have brain damage for sure.

@wrillywonka1320 7 ай бұрын

For it to be the future we are going to need some real ways to use them. Currently no major software even supports these files. Only ue5 with a plug in that cost over $100

@jerbear7952 5 ай бұрын

Jesus dude be patient

@wrillywonka1320 5 ай бұрын

@@jerbear7952 i wanT it now! 🤣

@gabrielv.4358 5 ай бұрын

Incredible

@gabrielv.4358 5 ай бұрын

awesome

@Aldraz 9 ай бұрын

3D Gaussian Splatting is great, but it has a lot of artifacts added in and also it is not a mesh, we are still talking here about a point cloud.. or should I say gaussian cloud? Anyway, until we will be able to use some really good AI to transform it to really high quality 3D mesh, it won't be that useful in games, etc.

@lemming7188 9 ай бұрын

I would consider using these strange artifacts for artistic purposes tbh.

@graphics_travelers 9 ай бұрын

The issues is that a good portion of real life 3D models are modeled by artists using varying number of references that are not chronological nor are they from the same source most of the time, the camera that is (if that makes sense). While all of these automated techniques require a drone or a cameraman recording a video while orbiting the object(s) of interest.

@DJ-Illuminate 9 ай бұрын

What about 4D?

@gunni1195 8 ай бұрын

dalle 3 is new why are you saying it was revived

@Stripeyy 8 ай бұрын

"you need rtx 3090 and 24gb VRAM" Me with my 4gb gtx1050ti: Yeah I can take it

@norxcontacts 9 ай бұрын

They're called spokes

@DrW1ne 9 ай бұрын

im sad that i cant run most of ai w/ my 3050 but it's ok :,(

@jameslibby5215 8 ай бұрын

4d Gaussian splatting

@dgomez611 Ай бұрын

damn i really wish I was smart enough to understand this

@pva5142 9 ай бұрын

3D Gaussian is already dead. 4D Gaussian Splatting is here. Paper released last week

@harnageaa 9 ай бұрын

I would've named this video : "THE FUTURE OF 3D AI?" or something like that more clickbaity while at the same time not being clickbait

@aciDCXIV 9 ай бұрын

You’re everything wrong with this platform.

@renanmonteirobarbosa8129 9 ай бұрын

No easy way. I wanna pain and suffering to install Nerfs on cloud LOL hahahaha Like installing Gentoo linux

@rw7717 9 ай бұрын

Took me three hours to get splatting working.

@renanmonteirobarbosa8129 9 ай бұрын

@@rw7717 Now try doing that but on a k8s cluster using kubeflow =P

@tabby842 9 ай бұрын

ah most welcome news, another step closer to manifesting my waifu into existence

@keeganpenney169 9 ай бұрын

Im scared I understand 80% of the word spaghetti

@WeaselOnaStick 9 ай бұрын

I was hoping you'd explain to people the most important distinction between 3DGS and NeRF is that Gaussian Splatting doesn't produce a traditional 3D mesh that can be exported, edited and put into other software/renders.

@timmygilbert4102 9 ай бұрын

Neither do NeRF, none use or create mesh. Mesh can be extracted from both using traditional photogrammetry method.

@nathanbollman 8 ай бұрын

I cant wait for AI to be able to create near perfect 3d assets based off of gaussian splats

@GalileoUAS 7 ай бұрын

You can do this with less vram guys.....all im going to say

@DugdoesDigging 7 ай бұрын

we already have the metaverse, its called fortnite

@scaramouche7759 3 ай бұрын

Reality is going to be confusing in the future

@MrKelJar 9 ай бұрын

Admit it. You made 90% of those words up.

@powtatoa 9 ай бұрын

sooo early!

@user-qr4jf4tv2x 9 ай бұрын

mark vr is for rich people vr

@zyxwvutsrqponmlkh 9 ай бұрын

Nearly a quarter of this video was an advertisement for something every single one of your viewers without exception is already fully aware of.

@AuntBibby 9 ай бұрын

i mean ive heard of Brilliant but i hadnt heard of any of the other stuff

@quebono100 9 ай бұрын

Its the most stupid claim, to write a model can see, hear and speak

@johncasey9544 9 ай бұрын

investors and customers are kinda stupid

@opusdei1151 9 ай бұрын

Oh the bullshit with a model can see hear and speak came from openAI. No wonder, that everybody is repeating it like a parrot

@cool-iu1nd 8 ай бұрын

Insisting on issuing virtual reality applications to earn money. I think they should pay more attention to environmental problems instead of wasting young people’s minds on trivial matters.