Dyna: A Model of Dynamic Human Shape in Motion (SIGGRAPH 2015)

Рет қаралды 101,073

Күн бұрын

SIGGRAPH 2015 Paper Video:
Dyna: A Model of Dynamic Human Shape in Motion,
Pons-Moll, G., Romero, J., Mahmood, N. and Black, M.J.,
ACM Transactions on Graphics, (Proc. SIGGRAPH), 2015.
pdf: files.is.tue.mpg.de/black/pape...
project and data: dyna.is.tue.mpg.de/
Abstract:
To look human, digital full-body avatars need to have soft tissue deformations like those of real people. We learn a model of soft-tissue deformations from examples using a high-resolution 4D capture system and a method that accurately registers a template mesh to sequences of 3D scans. Using over 40,000 scans of ten subjects, we learn how soft tissue motion causes mesh triangles to deform relative to a base 3D body model. Our Dyna model uses a low-dimensional linear subspace to approximate soft-tissue deformation and relates the subspace coefficients to the changing pose of the body. Dyna uses a second-order auto-regressive model that predicts soft-tissue deformations based on previous deformations, the velocity and acceleration of the body, and the angular velocities and accelerations of the limbs. Dyna also models how deformations vary with a person’s body mass index (BMI), producing different deformations for people with different shapes. Dyna realistically represents the dynamics of soft tissue for previously unseen subjects and motions. We provide tools for animators to modify the deformations and apply them to new stylized characters.
Supplemental material:
All 40,000 training alignments are shown in this video:
• Dyna/4Cap -- SIGGRAPH ...
This gives a sense of the alignment quality, the training motions, and the variety of soft-tissue deforms exhibited by different people.

Пікірлер: 44

@ShaneMcGrath. 9 жыл бұрын

Looks amazing, Another step closer to realism. Would love to see this in next gen games!

@anthony_leckie 8 жыл бұрын

This is such impressive work. The tissue dynamics and general feel of the physicality is a core aspect of what is limiting modern CGI. This was very inspiring to watch.

@WhiteDragon103 8 жыл бұрын

Michael Black, you have an interesting obsession with jiggle physics.

@WaitButHow 9 жыл бұрын

Sorry, I couldn't focus on the narration, all I was thinking is how unfit those people are. EDIT: rewatched it, it's actually pretty awesome

@3Daver 9 жыл бұрын

Amazing work! I would buy this!

@roidroid 9 жыл бұрын

i can't wait to see Shrek's giggles ogredone.

@dejayrezme8617 8 жыл бұрын

Wow that's amazing

@Rallion1 7 жыл бұрын

Did you end up releasing this as a plugin for any mainstream 3D software? I'd be very interested in it.

@EnterReality 9 жыл бұрын

Very interesting! I guess that something like that could be achieved inside Maya/Max using some of the tools available ( ncloth, syflex & co ) but this custom solution looks very promising and efficient... Quick question: I read one of your comment which mention the possibility of having this "skinning feature" inside UE4/Unity...well, it would be interesting to know how the dynamics will work inside them ( extra helper joints or a combinations of blend/corrective shapes, custom tool )? Also, I'm thinking that the same "behaviour" could be inherit by clothes as well given the material of the cloth itself... Looking forward more news, really great job!

@SteveMicAndTheHoldTights 4 жыл бұрын

I am a 3D apparel designer that designs tight fitting body wear. To have soft body avatars would be an amazing breakthrough!

@MichaelBlackMPI 4 жыл бұрын

FYI, the AMASS dataset has hours of SMPL avatars in motion with DMPL soft tissue motions. Maybe this is useful. Because the soft tissue motion is computed from standard mocap marker sets, it is not as realistic as when one uses markers to explicitly capture soft tissue. amass.is.tue.mpg.de/

@SteveMicAndTheHoldTights 4 жыл бұрын

@@MichaelBlackMPI, Thank you for the website. What my industry needs is 3D apparel software that includes dynamic soft body avatars that can squish when say a tight swimsuit is simulated on the body. This would be a major breakthrough when trying to do virtual fittings of a garment. Right now the current avatars available in the 3 major applications (Clo3D, Browzwear and Optitex) are rigid. Keep up the great work!

@MichaelBlackMPI 4 жыл бұрын

@@SteveMicAndTheHoldTights I agree that this is an important problem. We have done some other work that extracts physical soft tissue parameters from motion sequences like these and then one can do physics simulation with the resulting model. We defined a volumetric SMPL model for this purpose but have not pushed it to a point of application. More info here: ps.is.tuebingen.mpg.de/publications/meekyoung-siggraph

@jonatassantos2799 8 жыл бұрын

Can't wait for Fat Girl Simulator Early Access on Steam.

@trousersnake81 2 жыл бұрын

how is this still not a thing

@pro_rookie_gamedev 2 жыл бұрын

@Lapid Palid this work seems fairly obscure

@AntonBarcelona 8 жыл бұрын

amazing... future is here =)

@mmnissanzroadster9 9 жыл бұрын

Next up, a plugin for Blender! XD

@MichaelBlackMPI 9 жыл бұрын

Marcus_Mravik In fact, yes. Stay tuned.

@mmnissanzroadster9 9 жыл бұрын

Michael Black You'd better not be just teasing me! lol

@plavix221 8 жыл бұрын

+Michael Black Yes! It would be awesome to see this code implemented in Veiviev's VR erotica simulator. XD They have currently soft tissue deformations working in UNity. vine.co/v/eZewOJV5h65 SFW ;)

@harunDMC 4 жыл бұрын

@@MichaelBlackMPI liar

@EVAUnit4A 9 жыл бұрын

(not an animator) Looks good to me! Next up: changing lighting and texture to _not_ have models look like plastic when animated. EDIT: "Young boys everywhere- you're welcome." (director David Twohy, _Pitch Black_ audio commentary)

@obidapogi 9 жыл бұрын

Wow, amazing work, some kinda revolutionary methinks. People will pay good money to have this and MOSH in unreal engine. Also, do you have something similar for faces? or even quadrupeds? How do you suppose this can be blended with physics/IK/collisions??

@MichaelBlackMPI 9 жыл бұрын

Oliver Baldenero. We are working on compatibility with Unreal, Unity, Maya, and Blender. We have not yet worked on faces but plan to combine face and body movement soon. We'd love to leverage this data to learn a physics model but our initial efforts failed. We still think it is a good way to go. So stay tuned for more!

@32BitJunkie 8 жыл бұрын

Hi there, it's been a year, any progress on releasing this as a usable plugin? And can it run fast enough for real time VR?

@RikkTheGaijin 9 жыл бұрын

Impressive! But I'm more interested in how you guys retargeted the 3d scan with your retopologized mesh. Is that a proprietary software?

@MichaelBlackMPI 9 жыл бұрын

RikkTheGaijin Given a new mesh, we manually click a few points that are in correspondence between our template and the new mesh. We then run a fairly standard mesh alignment method that transforms our template to fit the new mesh. It is our own software but there are commercial alignment methods that work similarly.

@RikkTheGaijin 9 жыл бұрын

Michael Black thank you for the reply. I have used R3DS Wrap, but often the results are not good, while your software looks really good.

@MichaelBlackMPI 9 жыл бұрын

RikkTheGaijin Thanks. We are thinking about making some sort of web service available where you can upload a mesh, click some points, and we align it. It will only work for fairly human meshes though. Stay tuned.

@dxhanse9163 5 жыл бұрын

0:30 oh god

@SevanaS 9 жыл бұрын

Animated human flesh is starting to look real

@rogribas 9 жыл бұрын

a 3d twerking revolution is coming..

@karlhilton6641 4 ай бұрын

I'm sorry did you say something?

@jonathanxdoe 7 жыл бұрын

I created a new plug-in to make a 3D mesh feel ashamed of itself. We should work together.

@madmuffinz 9 жыл бұрын

Get ready for those lewd games

@marcinbbox 9 жыл бұрын

I dont get it. Muscle tissue and fat tissue have known elasticity. Why not make it once for good, by computing or predefine both rather than making thousands of scans? Why bother if math already got this?

@trousersnake81 2 жыл бұрын

I think its cause math don't got this. i think that is endgame, but then every pixel has to be treated as a multi-d tensor with non-linear relationships to every other pixel. sorry for the necro

@FloMoonYeah 6 жыл бұрын

ok that's cool but... I mean, it seems there are more and more research on how to render jiggling flesh but we're still struggling to make characters move in a really natural and adaptive way...

@confuseatronica 8 жыл бұрын

Now CRANK ME OFF

@do0myk Жыл бұрын

tech to simulate americans. Have this ever been used in videogames? I cant remember any examples (they probably prefer wasting processing power on 4K models of random garbage everywhere).