EA’s New AI: Next Level Gaming Animations!

Рет қаралды 251,311

Күн бұрын

❤️ Check out Fully Connected by Weights & Biases: wandb.me/papers
📝 The paper "DeepPhase: Periodic Autoencoders for Learning Motion Phase Manifolds" is available here:
github.com/seb...
My latest paper on simulations that look almost like reality is available for free here:
rdcu.be/cWPfD
Or this is the orig. Nature Physics link with clickable citations:
www.nature.com...
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Benji Rabhan, Bryan Learn, B Shang, Christian Ahlin, Edward Unthank, Eric Martel, Geronimo Moralez, Gordon Child, Jace O'Brien, Jack Lukic, John Le, Jonas, Jonathan, Kenneth Davis, Klaus Busse, Kyle Davis, Lorin Atzberger, Lukas Biewald, Matthew Allen Fisher, Matthew Valle, Michael Albrecht, Michael Tedder, Nevin Spoljaric, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Rajarshi Nigam, Ramsey Elbasheer, Richard Sundvall, Steef, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: / twominutepapers
Thumbnail background design: Felícia Zsolnai-Fehér - felicia.hu
Károly Zsolnai-Fehér's links:
Mastodon: sigmoid.social...
Twitter: / twominutepapers
Web: cg.tuwien.ac.a...

Пікірлер: 562

@lambdaspecialist_source Жыл бұрын

Looks amazing. This would be really efficient in making realistic games.

@lambdaspecialist_source Жыл бұрын

Ay thanks for the pin!

@VincentFischer Жыл бұрын

Games and realistic moving humanoid robots come to mind immediately

@delpinsky Жыл бұрын

Hopefuly, after decades of football games and motion captures, we can finally have lifelike transitions! 🙏 But will EA be able to create realistic ball and player physics? 😎

@TasX Жыл бұрын

SOMEONE SEND THIS TO FIREBOX STUDIO!

@murmullito Жыл бұрын

and robots?

@Ken1171Designs Жыл бұрын

Not only incredible the results, but also how FAST it improves these days. It used to take YEARS before we could see little improvements.

@getsideways7257 Жыл бұрын

And the animations in games and movies are still as awkward and unnatural as they used to be. Actually, I take that back - the original Jurassic Park looked MORE natural, because it used real world objects and not computer generated animations.

@skunkwar7468 Жыл бұрын

You can’t really combine games and movies when talking about animations they are different. Animations in games that are actual gameplay animations like today’s paper is showing off use transitions to go from one animation to another. Animations in movies don’t use this technique.

@CmdrWinters Жыл бұрын

@@skunkwar7468 which honestly makes it worse, since the movie isn’t rendering in real-time, so it should be MUCH higher quality.

@getsideways7257 Жыл бұрын

@@CmdrWinters Exactly. And quite often it's barely any better.

@skunkwar7468 Жыл бұрын

@@CmdrWinters true I’ll give that one to ya

@elukok Жыл бұрын

They should create AI that will automatically generate micro-transactions based on game theme and name. Would be more useful for EA.

@WordUser Жыл бұрын

I'm sure they already do use neural networks to learn how people spend money at some level

@orang1921 Жыл бұрын

@@WordUser probably not neural networks but models

@orang1921 Жыл бұрын

@@TasX i guess some systems that you'd call "models" use neural networks, but ones dealing with optimal cost (financial models) generally don't

@orang1921 Жыл бұрын

@@TasX which is still unlikely to be used, dude dont know why you're so persistent over this, it's not like i'm saying they shouldn't be used just that they generally aren't

@Kim-cj2ds Жыл бұрын

@@orang1921 mr smart4ss

@davixx1995 Жыл бұрын

This would be lovely if only EA was still in the business of making good games.

@C.I... Жыл бұрын

Their M.O for years was buying good studios, getting them to make 1 or 2 games, then shutting them down.

@Dekatelon Жыл бұрын

It's open source, so not only EA are profiting from this

@ProfessorRS Жыл бұрын

@@Dekatelon yeah was gonna say .. did they not listen to the last few minutes? I can download this and run it on my home PC, this isn't just huge for EA games!

@smileyp4535 Жыл бұрын

Ikr? Capitalism just ruins everything introduced to it. How do you make great stuff? Remove the profit motive and let people interested in it do the job, that's why mods are always better than the games. And with a basic and increasing standard of living (we could do at any time) literally every business would be better because it's done by people who want to and not for the owners to make profits off of the workers from

@VincentFischer Жыл бұрын

They can shove it in between rare cards and lootbox buying screens

@toxiccan175 Жыл бұрын

This could be used to generate realistic body animations in VR with the headset and controllers as constraints. If they trained the AI with data from both a motion suit and a consumer VR system simultaneously, the AI could go off the data of the VR set and generate the missing data of a motion suit. Endless potential! I want to see it in VR!

@nyahnyahson523 Жыл бұрын

@@Pyxis10 Did... you even watch the video. The source code was released for this

@buldozeris Жыл бұрын

@@nyahnyahson523 Did... you even check the source? "This project is only for research or education purposes, and not freely available for commercial use or redistribution."

@0x0michael Жыл бұрын

meta is doing that already

@dav356 Жыл бұрын

@@buldozeris You can still use it in freeware.

@buldozeris Жыл бұрын

@@dav356 I think the person above deleted his comment. He basically said that EA would not easily allow to use this in non EA games. Then some dude responded to him with "ackchyually source was released". Yes, freeware will probably be fine, but that's besides the point here.

@peri231231 Жыл бұрын

5:12 reminder to anyone watching that the source code being available does not mean it's open-source. This has a proprietary license and cannot be used outside of research-projects. For it to be open-source and usable, it needs an open-source license like MIT, Apache, GPL, or BSD. But it's licensed with Attribution-NonCommercial 4.0 International (CC-BY-NC 4.0). Edit: it's still possible that EA can use it assuming they do own the code. But other studios can't utilise it. And if they do, it's a lawsuit waiting to happen.

@cihadturhan Жыл бұрын

I wonder what would happen if another research team (let's say ubisoft) writes a paper with a better technique using this code and article. They won't be able to use it because cc-by-nc but I guess EA won't able to use the new code either.

@kimonmatara6903 Жыл бұрын

This is what open source means. That the source code is available. The licence is a different matter.

@marcosantos9512 Жыл бұрын

But how does it works? I mean, if someone learns this technique and reproduce, doing the code from scratch and training from scratch, it would still fall under copyright?

@peri231231 Жыл бұрын

@@marcosantos9512 No, if you write your own code that achieves the same goal but doesn't use the original code, then that's fine. But that's easier said than done. The difficult part is achieving the goal, not imagining it.

@peri231231 Жыл бұрын

@@cihadturhan If they use or modify code from this, then they will have to use the same license. If they start from scratch and achieve the same goal without using this code, then it's fine. As I mentioned in a previous comment tho, that's easier said than done.

@ThaLiveKing Жыл бұрын

NICE!! It seems like there's some engineers who are tired of the constant sliding in video games. Foot planting (in sports games) definitely need an upgrade. Canned animations gotta go too. This looks like the step in the right direction.

@norbertnagy4468 Жыл бұрын

Based on the training data alone i can see that only fifa motivated them to do this

@AbsoluteRookie Жыл бұрын

LET'S GO DOG FIFA 2023 CONFIRMED

@UnknownDino Жыл бұрын

@@AbsoluteRookie that's already out 😁

@norbertnagy4468 Жыл бұрын

@@UnknownDino like a yearly fifa needs confirmation, it is like a rule of nature, EA would not miss their yearly cash grab

@andresguerrero3347 Жыл бұрын

damn we lost the fifa name... maybe we should innovate in our football game after all these years

@ewerybody Жыл бұрын

While this new one really seems WAY better the previous technique shown around 1:38 is actually not too bad for a video game! I wish I had seen animations like these all around :)

@godofthecripples1237 Жыл бұрын

Definitely not. The current one allows the character to rotate with much more consistency and control in real time, whereas the other has to constantly stop and turn around. That would feel terrible in a video game, where you want mostly instant reactions to your inputs.

@RafaelBezerraDallaCosta Жыл бұрын

Where is the checkerboard patterned floor in the new method? The foot slide or lack of it would be easier to see on video.

@blaynestaleypro Жыл бұрын

lack of common sense

@ngbrother Жыл бұрын

Very exciting to imagine how procedural animations can be built that will realistically account for the weight and size of the items character is carrying, or respond to injury. Very interesting.

@RiseTheDrake Жыл бұрын

EA figuring out how to make AI boosted games sooner than realising how to be a better and more consumer-friendly publisher in general...

@VestigeFinder Жыл бұрын

that’s capitalism for you. increasing profits is the only thing that matters

@fandyus4125 Жыл бұрын

@@VestigeFinder Except I am not sure that this thing will increase profits that much.

@k1mfor Жыл бұрын

@@VestigeFinder without capitalism there wouldn't be game studios at all

@joshgiesbrecht Жыл бұрын

@@fandyus4125 they could replace their entire animations staff if they're able to get this working at the same level as a human animator. So they're not "increasing profits" per se, but it will allow them to reduce production costs, thus in turn making them more money.

@mostbasedman1686 Жыл бұрын

@@VestigeFinder More greediness than just capitalism.

@masterchief7301 Жыл бұрын

I wonder if this could be combined with the hardware at Boston Dynamics that they are doing to have a robot that can navigate through an environment regardless of how novel or difficult it is with grace and fluidity.

@YorkReacts Жыл бұрын

I bet Boston Dynamics have already been doing something similar in their robots.

@Leon_George Жыл бұрын

@@YorkReacts Agreed, but it's probably kept as a trade secret, especially now that Chinese companies have suddenly started sprouting out of the work Boston Dynamics has been doing.

@stevenlewis9234 Жыл бұрын

I wondered this for a long time too. To build the robot virtually with the same gravity and movement constraints and give it lots of obstacles, to help the real life robot lean the environments saving all the real world leaning.

@GenAIWithNandakishor Жыл бұрын

This will revolutionize the AI Based animation in unreal engine 5. Great potential in AI avatars

@TasX Жыл бұрын

Perfect for r34 animations too especially since it reduces the number of people needed to work on every aspect of a project. All they need now is a better hair sim. Good hair is so computationally expensive because it's a massive non-linear problem. I think Elsa's hair in Frozen 2 required something like 400,000 strands of hair + thousands of vertices per strand. So realistically you could only simulate something like this on a supercomputer. Hopefully, AI will somehow make realistic hair physics much easier to carry out.

@GenAIWithNandakishor Жыл бұрын

@@TasX indeed. When working with custom alembic grooms, which was developed from blender grooming method, the computation required to render is huge and forget about fps 🤣

@annawilson4571 Жыл бұрын

Does anyone know if there is a plugin on UE5 Marketplace for this?

@GenAIWithNandakishor Жыл бұрын

@@annawilson4571 Not yet. But I will be making one soon

@Gamer-kn7fi Жыл бұрын

@@GenAIWithNandakishor how i thought its not allowed to use it for commercial use

@osamaalbanna2200 Жыл бұрын

One of the most useful channels in this era

@martiddy Жыл бұрын

@Silferado If you're into tech channels, I would recommend you Anastasi in Tech, Arxiv Insights and the podcasts of Lex Fridman.

@trappussi5545 Жыл бұрын

I recently tried making my own locomotion system with custom animations on ue5 and oh my god I had no idea how difficult it was! This is absolutely amazing. The transition animations alone were the most difficult!

@sexyolga479 Жыл бұрын

2:54 the dancer at the left defo has the most character AND is the most realistic. that's how majority of people dance in the club.

@drewbola Жыл бұрын

I swear the MoGlow dancing technique is totally trained with my data.

@ceticx Жыл бұрын

So glad the source code was released, I can't wait to see some game or game mod utilizing this

@smallbutdeadly931 Жыл бұрын

"This project is only for research or education purposes, and not freely available for commercial use or redistribution."

@Kim-cj2ds Жыл бұрын

@@tylercs8750 really?

@dav356 Жыл бұрын

@@smallbutdeadly931 Some games are free. Also, a mod is not commercial use.

@goon8002 Жыл бұрын

“Redistribution”

@kweassa6204 Жыл бұрын

EA... EA.. EA... the incredible publisher that has the world's best tech, and somehow still finds ways to screw a game up.

@Sycophantichallenger Жыл бұрын

My god... I hope they use this method for NPC character animation/activities in the upcoming Dragon age game. Character animation has always been pretty terrible in Dragon Age, so it would be nice to see realistic auto-generated character animation. Got my fingers crossed.

@godofthecripples1237 Жыл бұрын

@@mnomadvfx I recommend looking at what Ziva Dynamics is working on. They've pretty much got it figured out, though I understand it's real expensive to implement so nobody has really tried using it yet.

@SarpSerter Жыл бұрын

As an animator I would like to request the construction of a mass grave as we took 20 years to get into this industry and we have now offically wasted our lives with no other work experience.

@issamoshi Жыл бұрын

THIS IS CRAAAAAZY. On fire to see how this is going to change sporting games like Efootball and fifa

@TheAkdzyn Жыл бұрын

Wow wow wow wow!!! This will add a much needed improvement to the immersion of gaming. I'm especially excited to see how characters will intuitively change their movements in response to their environments fluidly. Amazing!! 😵‍💫

@Chyrre Жыл бұрын

Solution to footsliding: Remove annoying checkerboard reference floor! 😋

@DanielTorres-gd2uf Жыл бұрын

New Mode of Transportation Unlocked: Two foot jump + Whirl Arms

@TheYargonaut Жыл бұрын

The phase embedding is really interesting, I like how it turns the motions into shapes about which I can get intuition

@BossKillRatio Жыл бұрын

Nice, so happy to see more and more video game related papers on this channel

@Examantel Жыл бұрын

I just want this in Elder Scrolls 6

@parazels83 Жыл бұрын

Imagine Lara Croft, which perfectly "reacts" to relief, when climbing hills and rocks!

@mycollegeshirt Жыл бұрын

the football dribbling is pretty crazy

@martiddy Жыл бұрын

I wondered how the characters models would react in a slippery surfaces with less friction like ice or soapy floor. I guess the foot sliding wouldn't be a problem there, but the model would have to react quickly to maintain balance.

@piggywahwah Жыл бұрын

Im guessing you just feed it a load of slipping characters, you'll just need tweaks as opposed to the old method of keyframing. Is there a name to this technique or software? Im looking to buy a mocap but if this is coming out?

@chucklefuck Жыл бұрын

This and all other major video game technology should be freely available to all developers.

@erwinmeisel2545 Жыл бұрын

Finally commander Shepard will learn how to dance.

@justterry6135 Жыл бұрын

I'm very curious about its tradeoff with control response time and if it improves that. One of the issue with motion match is that the more delays you allow for a control input, the smoother the animation will be. If you want this be implemented on fast pace game with short animation response time (like DMC), it can look very clunky with existing motion matching technique.

@JoshHarle Жыл бұрын

Worth mentioning it doesn't have any disabled or non-normative body motion trained, and I'd imagine this will have an unseen influence on the sort of bodies that are able to be realistically represented.

@neonraytracer8846 Жыл бұрын

MoGlow(LSTM) dancing had me laugh out so hard!! It looks kind of like Sims, but while they are dying 😂

@muumia4 Жыл бұрын

Now Fortnight could steal a new dance style under 10 minutes. They could even automate scraping tiktok and stealing dances.

@mrWhite81 Жыл бұрын

This is "a few papers further", Great progress! Ty and salute the developer for open sourcing this. ❤️👍🇸🇪

@tschaboo19 Жыл бұрын

„This is the way“ said Sebastian Starke

@dhtoran1 Жыл бұрын

“What a time to be alive” :-) I love the enthusiasm ❤

@luc8254 Жыл бұрын

Now put that in the boston dynamics robots and let's have us some machine AI apocalypse!!

@Unseeable_web Жыл бұрын

What is great is that through these animations we can hook it up into an actual robot and then that robot will know how to walk and stuff. So we can just train it in a simulation and then hook up the best trained AI model and boom we have something amazing.

@piggywahwah Жыл бұрын

Bruh, sharap , they'll start making T-800... Delete this post? The AIs might of missed this idea ;)

@WatchAndGame Жыл бұрын

Correction at 3:38: These are all latent spaces of the same method, just extracted from different places within the model.

@thronosstudios Жыл бұрын

**Sweats nervously** Hehe... it's um... learning a whole lot faster now, huh? 😅

@AaditDoshi Жыл бұрын

Any insight on how heavy the neural net is to run at runtime? While it might be possible to run it for the player only, is it reasonable to run it on 100s of crowd ai or 10-20 npcs? That's what's going to be the limiting factor if this can handle the animation controller.

@martiddy Жыл бұрын

You only need to run the training process for one character model, after the training is complete, you can apply the same training to all character models in the videogame without need of repeating the training process. Unless of course, you want to train the AI for completely different models like animals or monsters. Then, you will need to repeat the training process for those models as well.

@chris-pee Жыл бұрын

@@martiddy This doesn't answer the question at all. Many neural nets are far too heavy to execute in real-time.

@Ryan50Ryan Жыл бұрын

2:54 How did they get mo-cap of me dancing in the middle there? I thought I was all alone D:

@elchampi Жыл бұрын

EA creating a new technology with the source code available? Wow

@NikHem343 Жыл бұрын

Mom, can we have a quadruped?

@moltn_ice Жыл бұрын

WHAT A TIME TO BE ALIVE

@realAlpha Жыл бұрын

at least someone at ea is making Progress

@Kelthor85 Жыл бұрын

Sometimes, I find, that, the pacing, of the words, is slow, or, weird, AND, sometimes, it can be, very distracting. Wow, what a time to be alive. AND: thanks.

@rafj75 Жыл бұрын

What a time to be alive.

@Linkario86 Жыл бұрын

What they need is an AI for satisfying businessmodels and good games

@NewtVervich Жыл бұрын

Every two minutes papers video is another nail in humanity’s coffin

@sparrow7399 Жыл бұрын

the animation papers are my favorite i hope this level of animation are in games soon the possibilites

@piggywahwah Жыл бұрын

is there a name to this technique or software? Im looking to buy a mocap but if this is coming out?

@hanerturk7271 Жыл бұрын

EA's New AI: Next Level Gaming Animations! Here is the in game purchase price list: 15.99$ for Attention-based Technique Upgrade 29.99$ for the Newest Technique Upgrade ps: Looks amazing btw, congrats.

@CreamusG Жыл бұрын

The fact that this is open source makes me really happy. The fact that EA is affiliated with it makes me really unhappy.

@user-ik8vy1rg8f Жыл бұрын

We really need advancements in micro expression facial animation.

@alfonsopineda5989 Жыл бұрын

it's quite amazing that this is open source, I love it

@Connor3G Жыл бұрын

I've never seen one of these animations systems in an actual game... Anyone know otherwise?

@sleekblackroadster Жыл бұрын

Research stages slow your roll

@tmwolf100 Жыл бұрын

EA: DLC motion packs coming up

@PrefoX Жыл бұрын

EA = Early Access, never forget that

@staticbb Жыл бұрын

Starke is straight up the goat. I was talking to my mentor about him last semester. I want to try to build on his work at my university but unfortunately I have sponsored obligations for other research :(

@phrozenwun Жыл бұрын

Waiting for the day when we get personalized coaching from AI kinetics.

@yappygm7433 Жыл бұрын

Hold on to your papers, and hold on to your chair! Very cool to see this technology advance.

@davidmichaels299 Жыл бұрын

I appreciate Dave's approach in presenting his ideas, allowing them to be fully formed and expressed. The woman he featured is a practical and rational conservative. It would be beneficial to have more individuals like her on television

@zohebahmad9633 Жыл бұрын

this is huge for narrative-content heavy games like RPGs the general idea with games that have relatively large narrative-based content is that developers don't have time to take care of all the possible permutations when it comes to animation this AI system could be a revolution for such games!

@SYBIOTE Жыл бұрын

Where can I get my hands on this to develop something ? Do I need to join EA?? And I had an inkling this was Mr Starkes work I was not surprised Edit : oh the source code is available

@steinmov Жыл бұрын

This animation will not cut it. Game animation, either mo-cap or hand keyed is adjusted and enhanced.

@acesyspe Жыл бұрын

EA New Method: Fluid movements EA Fifa 25: Ice Skating

@ShadowBanned0 Жыл бұрын

is robot talking? Edit: He posted it on github, so I can read it. Appreciated.

@kylebowles9820 Жыл бұрын

Love the phase manifold idea!

@LonelyAncient Жыл бұрын

EA's Dev team is incredible if only who ever decides monetization were more different.

@nolram Жыл бұрын

And Starke is at it again !

@adamfilipowicz9260 Жыл бұрын

this will be huge for Biped Robots

@aimedaddy Жыл бұрын

manual animations have foot sliding , *shows AI animations with foot sliding What a tiMe tO bE ALiiiVe !

@jeffg4686 Жыл бұрын

Really nice. EA really coming through for the community. The amount of open source stuff the large game makers, and GPU makers are contributing to the community is just awesome.

@JustSomeAussie1 Жыл бұрын

I've never had a problem with foot sliding or those types of things. When you're actually playing a game you don't really notice it, and if you do notice it - who cares? It's a game.

@SIZModig Жыл бұрын

Hey the robot from 1:30 is the same as in Love, Death & Robots season 3, the Adam episodes!

@rlira8072 Жыл бұрын

I bet they will put a price tag on it like the nemesis system

@SSFFSsFsdf Жыл бұрын

2:55 WTF SHE DOING ON THE LEFT??? 😂😂😂

@chad0x Жыл бұрын

This blew my mind. It's *so* close to *REAL* movement.

@AMR-bf8nx Жыл бұрын

It was about time!

@6TheBACH Жыл бұрын

Amazing stuff. WHAT A TIME TO BE ALIVE!

@local9 Жыл бұрын

Thats some advancement from the Ubisoft Zoobuilder, recommend looking it up if you've not seen it before.

@owenlarson07366 Жыл бұрын

So could you train this on video of individual people and get useful data about the way they move. I’m thinking of physiotherapy kinds of applications.

@mrmm1110 Жыл бұрын

Aaah this is for their FIFA 2077 and beyond right ?

@tommyjon Жыл бұрын

didn't rockstar already figure this out like 5+ years ago

@iYehuk Жыл бұрын

Cant' wait to see how it will be implemented in future and other new technologies

@madjimms Жыл бұрын

I want to see this is games already damn it!

@anonymous-one Жыл бұрын

imagine a boxing or UFC game with this level of animation. Hopefully we get one on PC soon.

@ThaLiveKing Жыл бұрын

Sebastian has a video where there's fighting movement. It's very possible this is in UFC and the rumored fight night.

@anonymous-one Жыл бұрын

@@ThaLiveKing who is sebastian? (sorry new here to these channels)

@ThaLiveKing Жыл бұрын

@@anonymous-one Just type Sebastian Starke on KZfaq. The work in the video is his along with others.

@Leon_George Жыл бұрын

Say in Assassins' Creed, you'd no longer have repeating animations, but potential new animations better matching the context of the scenario you're in. Open world games would have a whole new level of movement. Bwoah.