4D Gaussian Splatting

Рет қаралды 501,571

8 ай бұрын

dynamic gaussians paper: dynamic3dgaussians.github.io/
deformation fields paper: arxiv.org/abs/2310.08528
join discord: hf.co/join/discord

Пікірлер: 477

@smileyp4535 8 ай бұрын

2 minute papers meet 30 second papers. What a time to be alive!

@hhjpegg 7 ай бұрын

60 second papers

@GeneralKenobi69420 7 ай бұрын

This is much more enjoyable than that other indian sounding ass. At least I don't have to watch at 2x speed so I don't fall asleep and skip the first half because it's just padding that everyone already knows about

@Mertiven 7 ай бұрын

52.1 second papers

@fire17102 7 ай бұрын

52.477 second papers actually

@LocusFelix 7 ай бұрын

Hello Scholar

@Terraspark4941 Ай бұрын

this has to be the best advertisement for a technology i wont directly interact with in the near future that i have seen

@vittoriobr_6271 Ай бұрын

Lmao exactly

@vaels5682 8 ай бұрын

GAUSSIAN SPLATTING 2: ELECTRIC BOOGALOO

@shApYT 8 ай бұрын

Starring Jason Statham: featuring Jason Statham.

@lemontechkk 8 ай бұрын

💀

@spyral00 7 ай бұрын

@@shApYT Jason Splatham

@Coolguy_2491 7 ай бұрын

i still don't understand this joke , even after a month

@chaoticdilgins6675 7 ай бұрын

gaussian bukkake

@buggy5079 8 ай бұрын

"but why does this matter, isn't it just a 3D video" JUST A 3D VIDEO, thats ground breaking.

@hootis1 8 ай бұрын

i love how short and to the point this video is, snappy editing and all

@editdev 8 ай бұрын

big time. what a banger

@ac3d657 8 ай бұрын

designed for zoomers that have low iq

@pan6593 7 ай бұрын

It‘s indeed quite brilliant in its making!

@immortalsun 7 ай бұрын

bill wurtz!

@f.u.m.o.5669 6 ай бұрын

It's too quick for my brain to process.

@kindablessed4991 7 ай бұрын

Anyone else think it was jerma in the thumbnail?

@Mana-ig6us 27 күн бұрын

Yeah lolll

@the_ceo_of_skull 7 күн бұрын

Thank you. I'm not insane *_-the ceo of 💀_*

@wizarddude1917 8 ай бұрын

Loving the rapid improvement of tech and AI recently

@hactavis 8 ай бұрын

i believe next year will be very interesting

@SpringySpring04 8 ай бұрын

Also love the rapid movement of this dude's video lol

@TheGreatResist 8 ай бұрын

About one of the few things that still get me excited in the world we are living in.

@jojolafrite90 8 ай бұрын

Oh, yeah, it's great that ONE A$$ hole can now drown KZfaq with TENS OF THOUSANDS of videos all made by an AI, and make MILLIONS OF DOLARS in the process. Great for this already broken society. Great to have billions of videos in our medias that will keep us to see any real content. And nothing new will ever be made anymore.

@yuehan6711 8 ай бұрын

And the absolute stagnation of societal development means every bit of technology only sharpens the ridiculous irrationality of modernity and capitalism. If you were aware at all it should immensely worrying.

@PrivateCCC 8 ай бұрын

"It's all open source" meaning that it will get actual development by people interested in the field and the various uses of the technology and not be strictly tied to development based around the agenda of corporations who mainly only develop new fields and block development further to maximize profits by having the minimum required to have it patented

@qiang2884 4 ай бұрын

A bit late, but you probably never looked at the CS research community before. Nearly all student/professor papers comes with source code repo, and many corp research does as well. Go through a NeuroIPS archive and you can see hundreds of repos. Nearly all of the recent AI breakthroughs in the recent years are based on an OPEN paper published by someone in Google(the transformer paper), which ironically made google stress a lot now because they didn't get the opportunity to profit from their own invention before the other competitors.

@MacroAggressor 4 ай бұрын

FOSS is the only way out of the impending dystopian technocracy hellscape. Change my mind.

@PrivateCCC 4 ай бұрын

@@MacroAggressor agreed until they somehow make it illegal

@MacroAggressor 4 ай бұрын

@@PrivateCCC I totally agree that the powers that be (and more importantly, their donors... Gates, Bezos, Google, etc) have a vested interest in undermining FOSS. As with most things, the best way to make it infeasible for them to steal a Right from the people, is for a critical mass of people to exercise that Right.

@finalcut612 4 ай бұрын

@@MacroAggressor corporations routinely steal the labor of FOSS developers and exploit them all the time.

@micah371997 8 ай бұрын

Bro I work on planes for a living, I have no idea about what even you are talking about. I have superficial general knowledge, and have no reason to be here. Its like a swimmer accidently going to a calligraphy course and they are like "yea Ive written once" thats me. But I like watching your goofy and unique videos that explains concepts I never knew existed or mattered.

@1.4142 8 ай бұрын

Everything is a function

@OrangeC7 8 ай бұрын

They're a function, you're a function, I'm a function!

@youtubehandlesux 7 ай бұрын

Functional programming? More like unfunctional programming

@1.4142 7 ай бұрын

dysfunctional @@youtubehandlesux

@k_otey 5 ай бұрын

my life serves no function 😎😎🤯

@Wooly-chan-in6be Ай бұрын

in Category theory - Maxwell, probably

@mulberry999 6 ай бұрын

I really wish that this video was edited for an audience other than people with a fried attention span because it seems interesting.

@vlc-cosplayer 4 ай бұрын

If you got the attention span, you can do the research yourself 👀

@Lolleka 7 ай бұрын

This is truly amazing. And also very simple, I am surprised we are only seeing this now. Tech for small network has been mature for a while

@Wobr-J 7 ай бұрын

I LOVE YOUR CONTENT I love your fast paced comedic and informative approach to these things, 10/10 :)

@rustytvhead 8 ай бұрын

A minute of my time well spent on a subject I know nothing about, good video

@ZimoNitrome 8 ай бұрын

Wow super quick and condensed recap in a funny way. Nice

@Astra2 8 ай бұрын

This tech is developing insanely fast! This feel like a major turning point in computer graphics, finally photo realistic graphics. Not almost photoreal, it's literally constructed from photos.

@lamsmiley1944 8 ай бұрын

It's the first tech that allows for realistic foliage in a 3D scene (in my opinion). I hope that someone finds a way to effectively use it in games.

@ondrej_hrdina 8 ай бұрын

AFAIK this does not allow any kind of reflection, though. Anything other than rough, evenly lit surfaces won't change realistically depending on the point of view. Maybe there is a way to combine this method and traditional ones.

@lamsmiley1944 8 ай бұрын

@@ondrej_hrdina NERFs do allow for accurate reflections, but only of what was visible to the camera from the training data. Photogrammetry can't do reflections at all

@jojolafrite90 8 ай бұрын

Until people can finally feel how lifeless all this is.

@giantisopod 8 ай бұрын

Remember back in 2023 when we all thought this was sooo photo-realistic?

@chaseddraco Ай бұрын

This feels so much like a Bill Wurtz video I love it

@anotherone3340 7 ай бұрын

your narration is genius, it's non stop, has comic breaks and I loved that idea of using high pass filter to make a second voice. I don't even know what gaussian splatting is, i'm just watching for the fascinating presentation

@immortalsun 7 ай бұрын

It’s inspired by bill wurtz. Still really cool

@polarartifact9863 6 ай бұрын

If you think this is good you should watch "The History of the Entire World, I Guess" by Bill Wurtz. It's like this, but More.

@Infinatummedia 5 ай бұрын

Gaussian is neat! So photogrammetry is the process of taking a giant chunk of images, throwing them into the AI and getting back a 3d object scan of it using dark ai sorcery. Problem is, actual 3d objects are complex, so you're trading size and performance for quality, and if you're just displaying something, its overkill. NeRF took that and made a process where it just makes a giant point cloud and fudges the details, and you get a photorealistic 3d environment with way less work. Unfortunately, it has to exist in its own little weird container to work. Gaussian splatting takes less processing to do the same thing, but can run in a nice lightweight container which is compatible with other things.

@SyenPie 4 ай бұрын

Extremely well said, you managed to describe it perfectly. I began this video relaxed and amused thinking it was just another meme video, but I was physically tense in awe by the end. What a brilliant storyteller this man is.

@AaronALAI 8 ай бұрын

Wow what an interesting time to be alive...gonna lurk in the discord.

@ultrio325 8 ай бұрын

bro really just fit a whole essay into a minute

@rommix0 15 күн бұрын

now THAT is how you advertise an awesome piece of tech. I've recently became interested in 3D splatting and NeRFs.

@demidrol5660 8 ай бұрын

Love this format!

@forty000ne Ай бұрын

i'm in love with this video style

@Octocat 7 ай бұрын

It took 50 seconds to drop my jaw and make me think "holy cow." That's incredible! Can't wait to see what the future will bring!

@DJ-Illuminate 8 ай бұрын

Direct Mapping: Each splat directly corresponds to a point (or set of points) in the mesh. As the splat undergoes any transformation, the mesh point follows suit. If the splat moves to the left, the point moves to the left. If the splat grows in size, perhaps the point-mesh around that splat could expand or become denser. Fluidity in Motion: Imagine the splats as buoys floating on water. As they move, the net (or mesh) attached to them adjusts and moves with them. This creates a fluid, dynamic motion in the mesh that's directly influenced by the movement and behavior of the splats. Temporal Dynamics: If the splat data is changing over time (like in a sequence or animation), the point-mesh would continuously adjust and evolve frame by frame, creating a moving, dynamic representation. Overlapping and Merging: If two splats come close or overlap, the corresponding points in the mesh might also come closer, merge, or influence each other in some manner, depending on the design and algorithm in place. Interactivity: This approach also opens doors for interactivity. A user (like a designer or animator) could directly manipulate a splat and see real-time adjustments in the corresponding mesh, providing a tactile and intuitive way to shape and design 3D structures or animations. In essence, by directly linking the behavior of the splats to the motion and structure of a point-mesh, you can create a dynamic, responsive, and potentially more intuitive system for mesh generation and manipulation. It's a concept that harmoniously blends data representation with visual aesthetics and user interaction.

@braindancecollective 8 ай бұрын

You rock. Thank you for this!

@morgan0 8 ай бұрын

thanks chatgpt

@youtubehandlesux 7 ай бұрын

More botsplaining doesn't make this tech more impressive, you know. New developments in Global Illumination would be far more useful than this.

@Quell__ 7 ай бұрын

@@youtubehandlesux Well, be the change you want to see in the world

@lazerpie101 6 ай бұрын

I'm pretty sure this is just bones in current 3D rendering.

@ShienlanMiitsues 8 ай бұрын

Bill Wurtz sends his compliments 🤣 Jokes aside, this is exciting stuff!

@ozzi9816 7 ай бұрын

A fun potential use for this would be a game where the landscapes and assets aren’t actual objects but props made by artists, kind of similar to how games like Hylics use claymation

@aurisbunni Ай бұрын

jerma took the edibles. again.

@justinpakarno4346 8 ай бұрын

The first Gaussian Splatting that I ever produced? You're drinking it, right now!

@oskar4239 2 ай бұрын

I love the style of the video!

@weeferwafer2316 8 ай бұрын

Short and to the point!!! Thank you!! 💖

@Rokutvvvvvvv 8 ай бұрын

DAYUM THAT SOUNDS REALLY USEFULL

@RenderingUser 8 ай бұрын

So basically, we already developed the software for holographic imagery before the hardware made it there?

@dibbidydoo4318 8 ай бұрын

yes.

@realcoolguy123 8 ай бұрын

technology!

@RenderingUser 8 ай бұрын

@@realcoolguy123 kzfaq.info/get/bejne/fMlhg5ByqsepoGw.html

@dsdy1205 8 ай бұрын

Ever since software existed it has outpaced hardware. Tbe first computer programs were entirely written out on paper before computers that could run them even existed

@RenderingUser 8 ай бұрын

@@dsdy1205 yes it always used to exist a level above. But this adds an additional dimension. That is certainly some progress I also find it epic how 2D photography existed before 2D rendering was a thing but 3D rendering was already a thing ages before 3D phototherapy became a thing

@budstep7361 7 ай бұрын

Thanks for the update! Very cool

@The_mrbob 7 ай бұрын

I thought the thumbnail was Jerma…

@dimakheilyk4079 8 ай бұрын

What a cool video. 50 seconds and I know everything i needed about this! Love it, thanks🙏

@felix-dk9tr 6 ай бұрын

What is splatting, then?

@BobRossCat 7 ай бұрын

Every second I watched this I feel like I’m learning something I regret knowing, but I can’t pause because I’m too curious about what’s next so it’s just a cycle until the video ends and I feel empty inside

@boumex8842 5 ай бұрын

that sounds amazing

@MrMisterMaster 7 ай бұрын

This is how a Two Minute Papers and bill wurtz collab would look like

@Ricoxemani 7 ай бұрын

hahahahah yes

@gozearbus1584 8 ай бұрын

great format, did not waste time and is clear

@emmanuelagudo4918 Ай бұрын

This technology would be the pinnacle of computing. We got to the point where we can make all our fantasies to life becoming closer to a 'perfect world', at least in VR.

@sungvin 8 ай бұрын

That’s my favourite kind of editing

@jennnital 8 ай бұрын

super cool! super curious to use these techniques in unreal

@konstantinwilleke6292 8 ай бұрын

top level content. 10/10

@logangarcia 8 ай бұрын

love that 1 month of Quick change

@armoirestudio 8 ай бұрын

you deserver this sub

@space_1073 4 ай бұрын

Imagine how much further along humanity would be if every exciting new scientific paper were condensed into a 30 second clip anyone can understand / be intrigued by to learn more.

@C_Corpze 7 ай бұрын

Damn, that looks really cool! Wonder if this will possibly also have use cases for video editing or some experimental art with motion blurs or glitch effects.

@EpochEmerge 7 ай бұрын

Finally we will be able to pick a pov for our taste

@tylerwilliams33 Ай бұрын

*you could make a religion outta this*

@devinspencer1678 2 сағат бұрын

Corridor's about to go hard with this

@samsanimationcorner3820 8 ай бұрын

Love the Bill Wurtz style.

@yancamb2202 Ай бұрын

Yeah, I was thinking of Bill Wurtz.

@Estubu775 7 ай бұрын

Super nice video!

@Lord_Vertice 8 ай бұрын

i don't know who you are, or what you're talking about, but this video made me happy

@loleq2137 7 ай бұрын

Incomprehensible

@marthinus.x 8 ай бұрын

temporal splatting. bring it on.

@ipaqmaster 4 ай бұрын

This makes me feel like with enough 360 degree cameras for fidelity we can get 3d videos which can be paused, rewound and slowed down while also being able to move around in the 3d space and look at entirely different parts. Ideally as simply as recording a video with multiple perspectives. I can't seem to find it anymore but there was a recreation of some serious explosion for analysis years back extrapolated from all the footage and positions of each for the event. It feels like we can do that serious work but with just a few phones in a room with a click of a button and in minutes.

@noslowerdna 6 ай бұрын

intriguiging!

@TrionerExpeliozias Ай бұрын

this feels like one of those random Bill Wurtz videos that are really fucking fast

@stuart6478 6 ай бұрын

incredible TWO DEE Gaussian splattering

@Chleosl 6 ай бұрын

This is the Vertor man.

@bobbsurname3140 7 ай бұрын

That rainbow pattern looks like something I created once while messing with color tiling. Where the RGB of a tiles neighbors was slightly different in some random way.

@randylin1871 8 ай бұрын

well this fascinating stuff just went over my head haha

@bernardvantonder7291 7 ай бұрын

beautiful

@Jakes_psyche 6 ай бұрын

I have a playlist called “cool stuff” this is definitely going in that playlist 😂

@Klaypy 4 ай бұрын

I can already see those CSI scenes becoming an actual real thing😂

@AlcharynMusic 7 ай бұрын

Scary, but really impressive algebruh

@MMedic23 7 ай бұрын

What I gathered from this is that, animated p*rn will now be much easier to create. Just lovely.

@NolieRavioli 5 ай бұрын

i like the trap ad libs grraa-ta-ta-ta

@someguy950 Ай бұрын

Yo that’s actually great for computer vision

@nonamenoname1942 7 ай бұрын

"No time to explain, Morty!"

@harrylane4 Ай бұрын

"you've heard of gaussian splatting" me: uh huh totally i definitely have

@anastasiszaro 8 ай бұрын

Dude just spawned dropped a one minute paper and yeeted.

@iamfinky 8 ай бұрын

Oo! Exciting!

@ilanlee3025 7 ай бұрын

Amazing subscribed

@93hothead 8 ай бұрын

The hard part for this is getting training data without any good 360 cameras

@rsybing 7 ай бұрын

The way this video is formatted is an excellent example of why it's more useful to write out important ideas in prose

@garshtoshteles 5 ай бұрын

I'm not sure I understand the distinction you're drawing. As opposed to what, writing important ideas in poetry?

@Randarrradara 5 ай бұрын

yeah. poetry is for cringe essays on youtube @@garshtoshteles

@thedudely1 7 ай бұрын

I appreciate the Bill Wurtz inspiration

@BakeBakePi 8 ай бұрын

that's so cool!

@silvertakana3932 8 ай бұрын

this is lit

@hhhpestock951 8 ай бұрын

I watched a 13 second add for a 53 second video

@Frorideism 7 ай бұрын

Bruh my ADHD is vibing to this shit

@chazcheadle 6 ай бұрын

It makes me think of the video surveillance footage in the movie Star Trek; Into Darkness, where you can pan around the footage in realtime.

@TommyLikeTom 3 ай бұрын

it's basically the difference between keyframed animation and frame by frame animation, assume each frame is an entirely new scene or just a slightly edited version of the last scene

@DerTheoGD 6 ай бұрын

nice editing

@vaccinoholik5562 7 ай бұрын

imagine your doctor is making 3D model of your organs and check you inside using VR xDD

@CharlesLijt 8 ай бұрын

My Apple Vision Pro need this technology!

@deleted-test 8 ай бұрын

this video reminded me of bill wurtzs editing style. pretty good stuff

@matthewromig8748 6 ай бұрын

I want the VR capability that this could provide more than anything

@robokaos69 4 ай бұрын

I thought the thumbnail was a jerma green screen clip the only reason I clicked on this not disappointed?

@80sVectorz 8 ай бұрын

This video is epic

@lennybjorowitz4256 6 ай бұрын

someone reinvented bill wurtz.

@GiusePooP 8 ай бұрын

Loki 2 spaghettification

@A_very_tinly_can 14 күн бұрын

This feels like a Bill Wurtz video

@fideys 7 ай бұрын

You‘ve heard of Two Minute Papers, now get ready for One Minute Papers!

@mrnickhox 8 ай бұрын

This is the future of everything, literally pictures 2, the return of seeing things

@Wholy 5 ай бұрын

ok, i understand

@CartyCreative 7 ай бұрын

This looks like with a little improvement it could be used in 3D camera tracking and 3D scanning from footage. Looks similar to a PositionToPoints node in Nuke from the data of a 3D render position pass

@choiceillusion 8 ай бұрын

I imagine in the future Gausssian splats could take say security camera footage and rebuild a 3d scene into a realtime seekable 3d animation.

@UnofficialCyane 8 ай бұрын

wouldn't it be hard to build a 3D scene from a static camera perspective? It needs movement and different angles to generate the points in 3D space

@choiceillusion 8 ай бұрын

@UnofficialCyane do a Gaussian splat of the building first, then the animated later on top of the Gaussian splat. Indoors and outdoors like a 3d cutaway dollhouse kind of setup. Perfect use for this would be the unreleased footage of January 6th "insurrection" turned into a massive digital scene. Find something useful in the 3d scene then have it relate back to the original footage for use in court etc.

@dsdy1205 8 ай бұрын

Then we can finally have a realistic version of "ENHANCE"

@choiceillusion 8 ай бұрын

@@dsdy1205 its leaning closer to us having Holodeck from Star trek which will beg the question of "is current reality a slow motion holodeck?"

@Axodus 7 ай бұрын

@@choiceillusion FBI RIGHT NOW: NONONONO WAITWAITWAIT-