How AI Photogrammetry Is Changing 3D Forever

Рет қаралды 79,819

Жыл бұрын

Thanks to Babbel for sponsoring today's video. Go to strms.net/babbel_bycloudai to get up to 60% off! #ad
Intro Clip by Arata Fukoe
[Twitter] Arata_Fukoe/statu...
Instant-NGP
[My Video] • NVIDIA Just Made AI Ph...
[Project Page] nvlabs.github.io/instant-ngp/
[Paper] nvlabs.github.io/instant-ngp/...
[Code] github.com/NVlabs/instant-ngp
LERF
[Paper] arxiv.org/abs/2303.09553
[Project Page] www.lerf.io/
[Code] github.com/kerrj/lerf
[NeRF Studio Page] docs.nerf.studio/en/latest/ne...
MixNeRF
[Paper] arxiv.org/abs/2302.08788
[Project Page] shawn615.github.io/mixnerf/
[Code] github.com/shawn615/MixNeRF
Zip-NeRF
[Paper] arxiv.org/abs/2304.06706
[Project Page] jonbarron.info/zipnerf/
F2-NeRF
[Paper] arxiv.org/abs/2303.15951
[Project Page] totoro97.github.io/projects/f...
[Code] github.com/totoro97/f2-nerf
Block-NeRF
[My Video] • NeRF With Style Transf...
[Paper] arxiv.org/abs/2202.05263
[Project Page] waymo.com/research/block-nerf/
BungeeNeRF
[My Video] • NeRF Is Gonna Be The F...
[Paper] arxiv.org/abs/2112.05504
[Project Page] city-super.github.io/citynerf/
[Code] github.com/city-super/BungeeNeRF
GridNeRF
[Paper] arxiv.org/abs/2303.14001
[Project Page] city-super.github.io/gridnerf/
[Code]
NSFF
[My Video] • 3D Video Stabilization...
[Paper] arxiv.org/abs/2011.13084
[Project Page] www.cs.cornell.edu/~zl548/NSFF/
[Code] github.com/zhengqili/Neural-S...
ReLight My NeRF
[Paper] arxiv.org/abs/2304.10448
[Project Page] eyecan-ai.github.io/rene/
MSNeRF
[Paper] arxiv.org/abs/2305.04268
[Project Page] zx-yin.github.io/msnerf/
[Code] github.com/ZX-Yin/ms-nerf
Nerfbusters
[Paper] arxiv.org/abs/2304.10532
[Project Page] ethanweber.me/nerfbusters/
[Code] github.com/ethanweber/nerfbus...
Instruct 3D-to-3D
[Paper] arxiv.org/abs/2303.15780
[Project Page] sony.github.io/Instruct3Dto3D...
InstructPix2Pix
[Paper] arxiv.org/abs/2211.09800
[Project Page] www.timothybrooks.com/instruc...
[Code] github.com/timothybrooks/inst...
3D Video Loops from Asynchronous Input
[Paper] arxiv.org/abs/2303.05312
[Project Page] limacv.github.io/VideoLoop3D_...
[Code] github.com/limacv/VideoLoop3D
DyNeRF
[Paper] arxiv.org/abs/2103.02597
[Project Page] neural-3d-video.github.io/
NeRFPlayer
[Paper] arxiv.org/pdf/2210.15947.pdf
[Project Page] lsongx.github.io/projects/ner...
[NeRF Studio] Available
HyperReel
[Paper] arxiv.org/abs/2301.02238
[Project Page] hyperreel.github.io/#teaser-v...
[Code] github.com/facebookresearch/h...
Patch-based 3D Natural Scene Generation from a Single Example
[Paper] arxiv.org/abs/2304.12670
[Project Page] weiyuli.xyz/Sin3DGen/
[Code] github.com/wyysf-98/Sin3DGen
DreamFusion
[Paper] arxiv.org/abs/2209.14988
[Project Page] dreamfusion3d.github.io/
ProlificDreamer
[Paper] arxiv.org/abs/2305.16213
[Project Page] ml.cs.tsinghua.edu.cn/prolifi...
[Code] github.com/thu-ml/prolificdre...
HiFA
[Paper] arxiv.org/abs/2305.18766
[Project Page] hifa-team.github.io/HiFA-site/
[Code] github.com/HiFA-team/HiFA
Neuralangelo
[Paper] research.nvidia.com/labs/dir/...
[Project Page] research.nvidia.com/labs/dir/...
Luma Labs AI (Not Luma AI Labs oops)
[Web] lumalabs.ai/
[App Store] apps.apple.com/in/app/luma-ai...
This video is supported by the kind Patrons & KZfaq Members:
🙏Andrew Lescelius, Alex J, Chris LeDoux, Alex Maurice, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien
[Discord] / discord
[Twitter] / bycloudai
[Patreon] / bycloud
[Music 1] Skies - Slipstream
[Music 2] Celery Fields - Slipstream
[Profile & Banner Art] / pygm7

Пікірлер: 136

@bycloudAI Жыл бұрын

Go to strms.net/babbel_bycloudai to get up to 60% off! #ad and I am also thinking to do a 100K Q&A, feel free to ask me questions here or on my Discord's special Q&A channel! discord.gg/NhJZGtH

@MorbiusBlueBalls Жыл бұрын

congrats on 100k subs!

@AndrewBrownK Жыл бұрын

it feels like the 90s again.... everything moving so fast, a true inflection point in history. Then, the spread of the internet. Now, this stuff. Arbitrary content generation will be spontaneous and nearly free.... the world will be distinctly different before and after.

@Garbanzobear Жыл бұрын

True that, things have skyrocketed to the point that no one can truly keep up. It's exciting but also concerning, like how social media blew up and changed society, both for better and worse. Are we Icarus flying into the sun, or if it's like opening Pandoras box and unleashing endless opportunity.

@0LexuZ0 Жыл бұрын

so true

@mmmuck Жыл бұрын

It's free for now but not for long

@tuna1867 Жыл бұрын

@@mmmuck open source is always free

@XecularOfficial Жыл бұрын

@@tuna1867 That's why companies like ChatGPT are trying to sell AI as a service instead of as a program. They are working to cull open source unfortunately

@KalkuehlGaming Жыл бұрын

I cant believe it. VR Movies are even closer than I expected. Imagine a full blown movie that doesnt look "rendered" and you sit in the middle and can look around. Mixing nerf with real time cgi might be the real deal.

@EddieBurke Жыл бұрын

I asked some guy to make a colab for nerf when the first paper came out, it was barley functional but when it worked, wow it worked. Now its easy as shit

@throwawayaccount759 Жыл бұрын

This will be revolutionary to AR and home assistant robots when they become mainstream

@psiga Жыл бұрын

_Good lawd,_ this is moving so quickly! I love how much of this is open-source, rather than being locked up in ivory towers.

@user-mr9kn2qu9m Жыл бұрын

I LOVE your videos! Thank you for the hard work!

@plokki456 Жыл бұрын

As a phd student, I really liked this video since it made me discover many papers that I hadn't heard of and it gives a very good overview of the current state of the art in the field. However, it's a bit depressing to see this crazy amount of competition. If it looks like a rush from an outsider's point of view, imagine what it's like from a researcher/phd student's point of view!

@nicholash1278 Жыл бұрын

do you feel depressed you didn't invent some of this stuff yourself?

@plokki456 Жыл бұрын

@@nicholash1278 not really since research is about finding new ways to do thing, so there is always something new to be tried. As mentioned in the video, some papers are published with just a few week intervals and yet improve on the state of the art by a wide margin. Having your hard work made obsolete just after you've published, or worse, before you publish, that's the depressing part. It hasn't happened to me yet but I'm sure that feeling is shared among all researchers and PhD students.

@yiboliang8338 Жыл бұрын

@@nicholash1278 PhD Students feel depressed when they realize what they are doing is so crap compared to state of the art, and may never be better than it. Pretty desparate if you choose the wrong subject and not talented enough.

@millthor Жыл бұрын

You are awesome! thanks for all those great news!

@Y0UT0PIA Жыл бұрын

Following your channel has been a real journey - thinking and writing about NNs has completely taken over my life over the past two years, and without your videos there are so many developments that I would probably have missed. (Also: Oh boy, so 3d artists were just one or two years behind in terms of significant aspects of their work becoming automatable compared to 2d. I honestly thought there was gonna be a bit more of a grace period than that.)

@notram249 Жыл бұрын

your definitely not a 3d artist

@user-tk1jj1cp9x4 Жыл бұрын

This is a really terrific video. Thanks for making this.

@nahkaimurrao4966 Жыл бұрын

THIS IS AWESOME, I UNDERSTOOD SOME OF THE WORDS YOU SAID 🌟🌟🌟

@alexandruneag4845 Жыл бұрын

I don't understand why this AI tech is so underated compared to Chat GPT and even Dalle 2?😮‍💨 This thing is game changing!

@graphics_travelers Жыл бұрын

@@kmouratidis Yeah, because people don't play video games and 3D is really scarce.

@lolibozi Жыл бұрын

Thanks for the videos, always interesting.

@yosha_ykt Жыл бұрын

Thanks for the videos! Bycloud

@xZerse Жыл бұрын

Thanks for the video! What paper/video does the source video from 0:32 - 0:40 come from?

@jimj2683 Жыл бұрын

Generative 3d nerf that is trained on tonnes of images and real world 3d data is the holy grail. It will be used to improve all the detail in stuff like Google Earth. It will be so good that it could even be used in GTA 7 with the entire planet in high detail (streamed like MSFS2020 of course).

@arminhejazian5306 Жыл бұрын

Very good content man, keep it going

@worselipreading860 10 ай бұрын

Great video!

@harsh9558 Жыл бұрын

This tbis is so amazing 🔥🔥

@ninjatogo Жыл бұрын

Nice video. At this point I think I enjoy your content slightly more than 2 minute papers for the added memes 😅

@creator-link Жыл бұрын

Also he talks about the paper unlike two minute papers And also slightly less annoying

@games528 Жыл бұрын

Also he makes videos of papers that are not 6 months old already.

@Xenotork Жыл бұрын

basically this has the potential allow AI to become more sentient of their surroundings on a dynamic basis, being able to virtually map an entire space and identify any object scanned within it with high fidelity. It will also allow for AR to use this same data to create highly realistic and lifelike environments.

@lowqchannel Жыл бұрын

any ai that can map flat area to correct scale such as road section

@SMmania123 Жыл бұрын

This tech is advancing so fast these days 😅

@Karasus3D Жыл бұрын

Can anyone answer this question for me can you use this to make into a 3d printable mesh model?

@TheDragonshunter Жыл бұрын

This + Unreal 5. Oh boy indie devs are eating well

@nicholash1278 Жыл бұрын

nah, they are going out of business because there will be too much competition bringing forward games that all look incredible. I think ai will be the death of indie games, because the market will become over-statured with games featuring this ai content. It's kind of depressing.

@QuincyIsCrispy Жыл бұрын

@@nicholash1278 Best possible outcome, as it won't be indie devs that die because of this, it'll be aibros who think just because their game looks good, that it is good who will.

@nicholash1278 Жыл бұрын

@@QuincyIsCrispy AI bro is such a stupid term tbh

@QuincyIsCrispy Жыл бұрын

@@nicholash1278 Perfect fit for them then

@fireaza Жыл бұрын

Now the A.I are coming to spoil our Where's Waldo books! Where will it end?!

@ang_oose Жыл бұрын

wow this is a lot of progress... nice video by the way

@Terminator550 11 ай бұрын

Which software are people using to create LERF images? I would like to use it with motion control to create anime

@electronamstudios Жыл бұрын

With the 3D CLIP stuff it would be interesting to see if it has any effects in forensics where you could scan a house and search for common "bad items" and see if you missed anything or anything else could be inspected.

@darkandblue4118 Жыл бұрын

My favorite nerf is RAW nerf. Idk if other nerf techniques can do this to but they have shown that it can change brightness, fov, focus and more.

@qu765 Жыл бұрын

what a day to be alive!

@senpoo1 Жыл бұрын

6:43 I think you meant depressed

@GMaldonado79 4 ай бұрын

Freeze,Rotate,Zoom,Focus,Enhance is becoming a reality 😳

@StiffPvtParts Жыл бұрын

What a time to be alive!

@canyoupleaserunfast Жыл бұрын

❤❤❤ I love your videos. Thank you very much!

@wisemonkeys4511 Жыл бұрын

Love your work byCloudAI

@32rq Жыл бұрын

The thumbnail isn't doing this video justice. I skipped over it twice, but I'm glad the algorithm was insistent.

@ryanfav Жыл бұрын

I would be curious where the limits of this tech is, I've got Terapixel scale image sets of a town from a few different angles, would be interesting if that is enough to model most of the town in 1 shot, (Shot for panoramas, but data is still data)

@lucao9059 Жыл бұрын

boy this is a bit scary, I was very much excited when the first img generative tool came out. But now I feel like we are bulding hands, eyes, nose and ultimately a real functioning brain to AI

@d34bru Жыл бұрын

i want the camera of bladerunner... having a video, stop a frame, then rotate, zoom... play XD Just a photograph would be awesome too... bladerunner (1st one)

@USBEN. Жыл бұрын

This is FOOKIN EPIC!

@phil.d6449 Жыл бұрын

I see this technology been used in movies, games,... Like a real 3D without glasses

@kwhodabest Жыл бұрын

Hey! Do you have your script for this video? Thanks

@tja9212 Жыл бұрын

we are coming to the point that was described in 70s scifi, where a machine can do anything creative but you need operators which are educated, cultivated and have a big mental horizon to handle what the ai gives them. otherwise we will probably spiral downwards a slide of low effort and superifical stuff.

@QuincyIsCrispy Жыл бұрын

lol

@liam10000888 Жыл бұрын

This is gonna be awesome for games. Holy crap

@potato8236 Жыл бұрын

I mean I like the progress we make in research, but as a compsci student specializing in computer vision, I hate that everything is done with neural networks. Training takes long, you don't know what exactly what is doing, trying out changes can take ages if you have to retrain the model and lastly, I am just a fan of algorithmic processing of data, where I understand exactly how and why something works, but neural networks are still just a black box we still can't even get close to fully understanding.

@fontende Жыл бұрын

And never will, it will always be hidden secret for us as predicted by Stas Lem in 1960s in Summa of Technologia (author of Solaris).

@TavishVT Жыл бұрын

Not to mention the potential errors such as the "ai" cancer image thing where ot labeled any image with a ruler as cancerous. Applied to this video, the part where it shows different cleaning agents, imagine it picking the wrong one and either destroying your house surfaces or something incredibly toxic.

@LowestofheDead Жыл бұрын

What's worse, is that software is becoming more like neural networks - so large and complex that no one knows what's happening or how many microservices are being used. Architecture is designed around existing APIs and tools. Testing happens in production. Software in the '80s used to be like a walled garden, where you could plan everything. And now it's a rainforest. But our mentality hasn't updated as fast; there's still an expectation that you should understand _everything_ in your company's stack. But that's unrealistic and unnecessary - just learn enough to deliver what you need. EDIT: I stole all of this from the talk "Observability for the 99% developers" by Jean Yang.

@TerryThayer Жыл бұрын

I hope they come up with a way to 3d print images from text to image prompts. That would be cool😊

@Narblo 3 ай бұрын

"Look what they have to do to mimic a fraction of our power" - human brain imagination.

@Zeak6464 Жыл бұрын

I would love to see example of how to do this like a tutorial or something

@Blastmaster321 Жыл бұрын

This is incredible

@eggman28 Жыл бұрын

Awesome video ! BTW, it's Unreal Engine that Luma has a plugin currently for, not Unity :-)

@UpRisingCake Жыл бұрын

take a picture in a haunted house then tell it to find the ghost

@RoyerAdames Жыл бұрын

Nice

@brushrunner 11 ай бұрын

So which one is easiest to implement in Blender, and also free?

@ProgZ Жыл бұрын

8:03 : Really looks like an iron throne from game of thrones, I see no difference

@homeyworkey Жыл бұрын

which ai tubers do you watch? i used to watch 2 min papers but the guy is slow and repeats his previous videos content like way too much i just watch ai explained and u u remind me of a combination of fireship + 2min papers good job bruv keep it up

@darkandblue4118 Жыл бұрын

Future videos would need to be made in hours if the research keeps accelerating

@dsfs17987 Жыл бұрын

all those solved captchas man...

@ONDANOTA Жыл бұрын

but can 2 nerf objects collide with each other?

@NiffirgkcaJ Жыл бұрын

Oh my goodness! The tech in RoboCop is becoming real in front of my own eyes!

@user-mr9kn2qu9m Жыл бұрын

8:03 Didn't watch game of thrones but that throne doesn't look iron to me

@timothyclemson Жыл бұрын

One day, the video will never end... 🤯

@DavidBoura Жыл бұрын

No easy Android app such as the one from Luma Labs AI?

@kentjensen4504 Жыл бұрын

Jokes aside. Very good idea. I hate tech videos that waste energy on being dynamic and funny.

@mistavoid Жыл бұрын

imagine the procedural generation games could accomplish with more advanced versions of this.

@stickibug Жыл бұрын

Neuroangelo is blowing my mind! I have nothing else to say lol I am speechless over that one

@nicholash1278 Жыл бұрын

as someone who wanted to become a 3d environment artist one day, it's a bit depressing to see.

@notram249 Жыл бұрын

i hope neuralangelo doesnt take days to render

@culpritdesign Жыл бұрын

Great video! More nerf!

@demonhogo Жыл бұрын

holy crap

@CMDF08 Жыл бұрын

Your videos are great and very informative! It would be great if you spoke a bit slower at times.

@tatianaes3354 Жыл бұрын

*SINCE Apple* has a powerful “neural engine” (most powerful in any consumer SoC/CPU), I guess the company might use similar machine learning techniques to convert many 2D assets into stereo images for its new headset. The issue, though, the headset is too pricey for this to make an impact for any significant number of people.

@monad_tcp Жыл бұрын

Its not more powerful than the RTX on any nVidia. It might be more powerful in mobile SoCs. But I don't know about the new Hexagon from Qualcomm, not too far behind.

@tatianaes3354 Жыл бұрын

@@monad_tcp As I mentioned, we are talking about SoCs/CPUs, not GPUs. (That said, Apple’s solution is faster than what most GPUs have for this, too.)

@monad_tcp Жыл бұрын

@@tatianaes3354 how is their solution faster if you can't use it and the hardware is optimized for their specific model ? Ive spent some time reverse engineering it and I call those claims bullshit.

@tatianaes3354 Жыл бұрын

@@monad_tcp What you can not use? Apple has CoreML API and other ways to use Neural Engine. There is nothing faster in consumer world in SoCs/CPUs.

@heckensteiner4713 Жыл бұрын

It's NeRF or nothin'!

@tabby842 Жыл бұрын

i need this

@tonywang7933 Жыл бұрын

How I can feel so behind on everything on daily basis while trying so hard to learn new things daily at the same time

@alphasiera1757 Жыл бұрын

Imaging watching 3d movies using apple vision pro

@Guedez1 Жыл бұрын

OUTDATED, it's 103k subs now

@N1ghtR1der666 Жыл бұрын

updated local nerf tutorial please

@clockpock6143 Жыл бұрын

is nice

@AB-wf8ek Жыл бұрын

Language models are the msg of machine learning

@tapu_ Жыл бұрын

This could be used to cheat on where's Waldo books

@loadsheddingzim Жыл бұрын

Everything ia revolutionary

@contentfreeGPT5-py6uv Жыл бұрын

YEAH P

@635574 Жыл бұрын

The neurovolution is here

@oliverdive9759 Жыл бұрын

Some day, someone, after maybe 🤔 7 years will come back to this video and will laugh 😂 at the quality of this ai🤖

@daffertube Жыл бұрын

just think of the memes...

@Zonca2 Жыл бұрын

Ok, but how are we on the waifu front?

@suhasanimation6193 Жыл бұрын

nice comments🙂

@nicholash1278 Жыл бұрын

wow... just went I thought being a 3d artist would be safe from ai. Looks like I need to drop out of college (I am studying 3d) and pick a different field. Maybe construction worker.

@deckruler3802 Жыл бұрын

Cyberpunk 2077 stuff

@renanleao5553 7 ай бұрын

@eee1200 Жыл бұрын

I dont get it but cool

@marshallodom1388 Жыл бұрын

I'm still just trying to identify boundaries grrrrr I WILL rule the world, if everyone could just slow down a bit please.

@jurandfantom Жыл бұрын

Thank you for (As always) great and informative videos :) happy to be your sub and watch each single video since "AI Converts Cartoon Characters To Real Life [Pixel2Style2Pixel]" :]

@slackstation Жыл бұрын

This is ironic to have babbel as the sponsor as language learning is being attacked from both sides by LLM. One side, LLMs are excellent teachers so the need for a dedicated curriculum app is reduced and LLMs are excellent translators so that over time the need to learn another language will be reduced.

@Irv.GuidoYT 8 ай бұрын

How can you use this tech to scan 3D figures to Autocad and Solidworks ? 😳😳😳😳 @bycloud

@stevengreidinger8295 Жыл бұрын

Of course. Only a fool wouldn't add "Dino-Regularization." So obvious...

@bulieme Жыл бұрын

Early

@sikliztailbunch Жыл бұрын

this technology in combination with the the new apple vision and we will soon be able to buy and sell braindances on the dark web :-D

@undefined879 Жыл бұрын

This is dystopian

@lostgarbage4055 Жыл бұрын

Nerf and entirety of 3d is redudant. Nobody will (thankfully) need to do all that complex math in their head to position a cube near other cube, and write shaders for it (i mean - who is it even marketed to, harvard geniuses?). In the future every single piece of media you`ll see will be text2video or text2image (or thought2stuff). 3d is a useless 80s fads that's gonna die down same way xbox Kinect did.