THIS IS WAYYY TOO INTERESTING TO MISS OUT. And Faraz casually being confidently wrong in 1980 being 33 years ago (when it's actually 43) is another highlight.

1980 is 43 years ago not 33, good video as usual guys

2:18 it is even 43 years old. 😉 Wow! Great video as always guys!

Imagine how cool it could be with 4DGaussians? It is a recent paper about gaussian splats, but with motion. Yes, you can recreate 3d dynamic scenes from videos with this technique!

You mentioned that the video was super sharp despite being so old. That's because those movies were shot on film! If you can get your hands on the actual film of a movie you can basically remaster it in 4k or larger with perfect quality. That's because film is an analog medium, you don't have pixels in film. Those movies were played on a huge movie screen back then, the only reason why we connect those old movies with low resolution is that there was no need to render those movies for old TVs that were not capable of displaying HD. That's why you can now find old movies, music videos etc. with super crispy 4K quality. In my opinion they look even better than modern digital movies, there's just something about film that modern cameras can't replicate. And by the way, amazing use of this technology! I knew about the existence of this but I haven't though about using it to digitize movie scenes. That's genius!

I just cannot process what i have just seen .. this is insane especially that you got it from movies like this will change everything

There are no limits for G.Splatting, I guess.

2:33 guys are living in the 2013😅go grab that bitcoin asap

Great idea to test gaussian on movies. Funny and educational! Well done!

Great stuff guys always entertaining and learning while watching 🙌

I really love the work you guys do. Thank you ❤

3D Splatting is unbelievable! The background process is really interesting

So I have been using Luma interactive scenes. Its pretty good but I know you all mention in a previous video that you can get more control with the method your using by letting it go through more variations. I have a Gpu with a 4090. Do you think its worth doing the setup to get the extra fidelity? Also how long are you all usually training a splat?

This is awfully like lucid dreams if you've had them. Very similar restrictions, like you can't go beyond a certain point where it becomes like an invisible border of less details or something obstructing your view

You guys are excited so much on this concept that its infectious😁 and even I would love doing the exact same stuff like you showed here. What a mind blowing tech 3D Gaussian Splatting is. Will have to upgrade my PC just for playing with this in UE.

Thanks for trying out movies. I was so excited to see how that would turn out. It's a little trickier than I thought it would be, even with some pretty perfect scenes (limited movement within the scene and rotating camera). Video games into VR is a great next idea, since a rotating camera is as simple as moving the right joystick in most cases. I'd also like to see if you can figure out how to edit the capture, delete unnecessary artifacts, etc. Is that possible?

That's crazy, very impressing!

What's the biggest advantage of using GSplats for video games? I am just wondering if the image sequence taken directly from the video game by panning the view joystick in video games to generate a 3D scene would have any practical benefits

In the Trinity shot did you notice the doubling was gone? Also it was squashed, it's like the 3D point cloud stage undid the doubling by squashing them together causing the whole scene to get squashed horizontally.

You guys are soooooo underrated.. the videos are entertaining and educational. Good job!

Love you guys 💗

This technology is amazing!! But you two playing around in your videos make it so much fun to watch. 😂😀

can the gsplats cast and/or receive shadows? like if you put a cube in the middle of the table in that one scene and cast a light, will the table receive a shadow?

YALL ARLREADY ON A WHOLE NEW ERA!

What tools are you using to generate the splats?

Hey can you please try this on apollo 11 or other missions? I tried it with apollo 11, but only with the images. But they aren't overlapping enough :( Is it possible somehow to tell the 3DGS, where each photo was taken and the angle? would that help?

You guys beat me to it!!! I'm wondering how Gaussian Splatting would go with stereoscopic side by side video at full frame.

looking awesome!

Do you have a way to run it on a 1080ti? When I try it complains that it needs performance 7 or something :-D

amazing stuff guys!!

One more thing. Say I want to scan a building with a drone. Could I take interior shots and combine them for an outside and inside model? I assume once loaded into Unity or whatever you could piece the separate splats together.

Guys, you make tech fun again! I LOVE your videos. I wish you all the best.

Really enjoying your info and love of the process. Thank you

amazing ideas!

Y'all are CRAZY and I love it

I love this.

Man the editing of this video is pure art! And the energy of both of you is contagious, you really got me into unreal 💪🏻

Keep ‘em coming!

Insaneeeee!!!! You guys rock

Very clever idea guys. Love your videos.

First thought in my head. I think NEO bullet scene was the second thing I tried after I installed the software. Did not come out so well either. Gaussian Splatting can be used from now on for scenes like this for better effect.

Brilliant idea.👍

OMG this is next level!!! Well done guys!

😳 this insane ! I love how you guys break it down with all the information and knowledge ! 10/10 the edits have gotten so much better 🎉❤

Super cool! I've been wanting to try the same thing with the matrix and NeRFs for a while now.

Excellent!

I love you guys. Talented beyond belief

Good work!

One Love! Always forward, never ever backward!! ☀☀☀ 💚💛❤ 🙏🏿🙏🙏🏼

That's so cool!

this technique would be great for an overhead ring of cameras or partial ring of cameras synchronized similar to the matrix shots - not to take the single output video from per se as you did, but for the filmmakers being able to relight the scene in post

Do you think it's possible to export a 3d scene like to this to twinmotion?

If I were going to have a talk with host and guest I assume I would do a 360 of them in their chairs first before a 2D video interview was started in order to create a 4D splat of the 2D video? How would you do this?

Like this is a new technique to make the world stop time! :D

Would it work for scenes where cameras move across or remain stationary? I'm thinking of using this method to colorize black and white footage, so I'm just wondering

this video is a real gem love you guys love from turkey

Can't wait for these to be used in "we made ...insert movie title... R-rated" by corridor digital.

This is mindblowing

That's actually awsome !! Gg 👏👏 it brings some much exploration to enjoy, understand a scene.... The setting, the composition, the atmosphere.... Super video, actually as you said in a VR viewer it would be craaazy

Awesome, the matrix :3

be interesting to see where this goes. im wondering how long until we see animated gaussian splats and scenes being recorded in 360 from multiple cameras, sync them up and being able to "play" it like a video, or drop it directly into your 3d environment ect.

I think the cool way I would use it would be to build 3d models from miniatures and sculptures for added realism, texture and flavor

Such a great content 👏🏻🔥🔝

How did you convert the Gaussians to geometry to work in unreal engine?

Best 3D/UE edutaiment content on KZfaq🔥

You can tell Gaussian Splatting is simple to do because even obnoxious loud people who can't spell 'Shining' can do it.

You're videos are great

Ok guys I am convinced I am also going to do this stuff, hopefully I will write a worthy research paper about Gaussian Splatting.

What software are you using for generating/rendering these? Did you write it? Is it on github?

Listening to this on 10% volume and it still feels like I'm going to get a noise complaint

They can include moving data and blend it in according to camera angle vs original angle.

Bro this is crazy, future flim making is gonna bring up more creative in pictures 🔥

Fantastic stuff, I had no clue about this technology until I came across your channel guys. Parcham Balast

Too sophisticated and inspirational at the same time

That was 43 years ago you wonderful math geniuses

Just finished the full video. Your video production, knowledge, camera presence and humour will make your channel blow up.

At this point I am not even surprised to see what it can do

That. Is. Insane.

So cool to see brothers working together and having fun together still while adults. Not much of that in the world.

That shot from the Shining is taken at the top of Mt. Hood ski resort in Oregon. There is a glacier there where you can ski even in the summer time. When I skied there, I instantly recognized the lodge as the one used in all the exterior shots in the Shining.

holy moly, turn it down a few notches lads !

What's kind of cool, is even though AI is used to generate these, you can use some other AI to replace the missing "footage" -- for instance trees and mountain behind. (Sure it wouldn't necessarily be exactly what's actually behind the hotel, but it could generate lost information to give you a reasonable facsimile of what might haave been behind it

I think static and long views of fully CG scenes are probably the best bets of getting anything out of this. Which is at least interesting for the idea that you could then take old somewhat subpar CG shots and recreate the scenes with the same camera movement. At least until it's possible to account for the moving elements completely. Video games are cool and all as a use case but most of them are already 3d and can have their assets ripped, so the only real use case with that is putting funny things inside the scenes.

What is the name of the program program?

This is a game-changer 4sure! Lovely experiment guys, keep em comin! (plus what great news to find out that, since i was born in 1983, according to ur math, I've only just turned 30 this year! Thank God, i thought i was 40 years old, **phew** such a relief, i feel 10yrs younger!) 🎉🎂🥳

Now .. thats explains everything from the movie "Deja Vu" :D

Imagine taking one of those KZfaq videos where someone filmed san fran or LA in 1920 and with the forward motion create a 3D splat or 4D splat. Somehow the forward video would have to be interpreted as side view for at least 180 view.

love you videos! 3DGS is such a fascinating technology! and I love that fellow vancouverites are working on it :) I had an idea. to test the versatility of the technology. can you download the google street view spherical photos of a street like robson, and then feed it to 3DGS and see if the outcome is good?

Lol for that first shot you have yo undo the anamorphic squeeze or it looks funny

What's the hardware specs you're using?

"That movie was made in the 80s, that was 33 years ago" what. But then again, you can tell these guys aren't the brightest tool in the shed. They are marveling at something your phone has been able to do for a decade now

Try to do that with Badge Man photo at grassy knoll.

that particular shot in the shining is from the timberline lodge in mount hood Oregon, USA

Good shlt.very interesting. Someday you guys will get a viral +1M video. You deserve.

The software?! that's the only thing i am interested in, what is the software to download?

consider this is tech in it's infancy, imagine where we'll be 1 or 5 years from now.

How much could this change 3D films in VR?

Imagine if they held off doing The Matrix 4 for just a few more years, they could SHOT for the use of this technology and would have been an incredible revolution from the previous version of bullet time. These tests are amazing but imagine it with a Hollywood budget... someone out there is going to do something insane with it.

Commenting to stay on 3D Guassian Splattering algorithm

This is how to watch a movie in the future, yeah