Meta-commerce in the Age of Avatars
35:38
Perceiving Systems: 2016-2021
23:24
2 жыл бұрын
Пікірлер
@persian_travellers
@persian_travellers 20 сағат бұрын
Excellent talk, thank you Michael and the rest of the MPI / ELLIS / Cyber Valley team!
@shaofeng8teng990
@shaofeng8teng990 Ай бұрын
Thanks for your great job. If I reconstruct 3d model from one 2d image using smpl-x, how can I use this to random shape. I have tryed it, it seams not work. It gives error "line 366, in execute for key_block in obj.data.shape_keys.key_blocks: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'key_blocks'"
@shaofeng8teng990
@shaofeng8teng990 Ай бұрын
I drag my own obj file into the blender
@tomiinai
@tomiinai Ай бұрын
👏🏽👏🏽👏🏽
@youtou252
@youtou252 Ай бұрын
this just looks like random hand motion tbh
@user-kx1je6bq4d
@user-kx1je6bq4d Ай бұрын
Thanks for this solution
@Abcd-kw4cp
@Abcd-kw4cp Ай бұрын
I try to test code but while running code in colab. What should i upload in colab as input image to see output? By the way, Nice work!!
@bithigh8301
@bithigh8301 2 ай бұрын
Awesome. Objective of life: (1st) work with human mesh modelling and graphics. (2nd) Have 1% of Michael's research skills.
@user-yc3zv6gp3w
@user-yc3zv6gp3w 2 ай бұрын
Very much enjoyed the history. Thanks for all your work and making knowledge availble to general audience like me.
@karlhilton6641
@karlhilton6641 4 ай бұрын
I'm sorry did you say something?
@reactus2291
@reactus2291 4 ай бұрын
how can I get the username and password
@Jay-kb7if
@Jay-kb7if 6 ай бұрын
fantastic lecture, thank you. I wonder if the next iteration of smpl will be something akin to segment anthing. Which processes millions of masks given a prompt to find the most likely match.
@mancumbus
@mancumbus 7 ай бұрын
Hello guys, but may be do you have video how to install code if you a not programmer? Because i 3d character animator in maya, and very interesting to try! OR maybe detailed instructions? Thank you!
@user-db2wp9df9v
@user-db2wp9df9v 8 ай бұрын
Are the Unreal environments that were used to record the scenes available for research purposes? Or do I need to buy them on the Unreal marketplace?
@MichaelBlackMPI
@MichaelBlackMPI 8 ай бұрын
You need to buy them from Unreal Marketplace. See paper supplementary materials Table1 for details. PDF available via BEDLAM website: bedlam.is.tue.mpg.de
@Digi9vfx
@Digi9vfx 9 ай бұрын
THE FUTURE
@wesleybarlow8870
@wesleybarlow8870 9 ай бұрын
Michael you are an extraordinary person!
@MichaelBlackMPI
@MichaelBlackMPI 9 ай бұрын
Thanks Wesley. I'm sure you are also.
@nitinrawat5061
@nitinrawat5061 9 ай бұрын
Hello bro please tell me how I can annotate it manually on a human image
@fynnh.8460
@fynnh.8460 9 ай бұрын
Very interesting video. I also find it interesting how the animated model (3:06) is leaning forward and not having an vertically aligned posture as the effects of f.e. locked knees, forward tilted hips and the effects on the spinal curves determine the breathing mechanism. In walking (and standing), kinethic energy can be transmitted troughout the body to the diaphragm and ribcage, affecting its tone and activity, too. Hand and arm movement influence the breathing muscles, too. This was just a slight insight but I wonder how biomechanical aspects of this kind are thought about, too?
@janelano7637
@janelano7637 9 ай бұрын
Hello, is there any way that I can set the collider on the SMPL-X character? Appreciate it!
@lizziezhao5358
@lizziezhao5358 11 ай бұрын
Fun!
@MaxManAnimations
@MaxManAnimations 11 ай бұрын
Please make a tutorial
@ericmlevy
@ericmlevy 11 ай бұрын
Michael, are you aware if anyone has retrained DECA on synthetic data?
@MichaelBlackMPI
@MichaelBlackMPI 11 ай бұрын
No. Sorry. Note that we don't use any 3D data here in training (academic exercise). I am sure that a bit of 3D data will improve accuracy significantly. For a real-world system, I'd definitely do this.
@ericmlevy
@ericmlevy 11 ай бұрын
@@MichaelBlackMPI I'd love to see how DECA would do using SPIGA instead of FAN for the landmarks on the real world dataset. I reached out to some vendors of synthetic data, I expect it'll be prohibitively expensive for our small operation.
@user-mg8sm3yb2x
@user-mg8sm3yb2x 11 ай бұрын
Hello, I was trying to transfer smpl-x action data in UE to Metahuman with IK Retarget , but I found that hand action is distorted and that's why.
@MichaelBlackMPI
@MichaelBlackMPI 9 ай бұрын
The finger motions are not perfect in BEDLAM. They are from the GRAB dataset. Retargeting them requires some care since the finger joints in SMPL-X have more degrees of freedom than most hand models. Each joint is a ball joint. So for the fingers there are over parameterized. We have more anatomical hand models but they are not released as part of AMASS/BEDLAM yet.
@phizc
@phizc 11 ай бұрын
To me it looks like it totally loses the identity compared to DECA. Also, the expressions also look exaggerated and not like in the original image. It would have been interesting to see the rendered deformed mesh with the extracted textures.
@figozhao3335
@figozhao3335 11 ай бұрын
Does this add on have any scripting documentation? Wanna load our params into the system.
@welsonfy5246
@welsonfy5246 11 ай бұрын
Good job. Most of the camera views of the source videos are from the front, but if the camera is mostly overhead will the animated 3D reconstruction be as correct?
@user-ew8ec6rb9r
@user-ew8ec6rb9r 11 ай бұрын
LOL
@starstar-cr2hr
@starstar-cr2hr Жыл бұрын
Thank you for the amazing work! I’m wondering if there’s a way to apply this code to create a lively animated face, similar to Apple's Memoji, to replace man head in a video?.
@starstar-cr2hr
@starstar-cr2hr Жыл бұрын
Like, I will create a 3D animated character by analyzing the features of a person's face in a video. Using your code, I'll then map the appropriate facial expressions to this 3D character and replace the person's face with this animated figure. Does this sound feasible to you? Thanks in advance!
@amyrobeson
@amyrobeson Жыл бұрын
😍😍😍👏🙌 love this
@maqi9266
@maqi9266 Жыл бұрын
Can imagine how much time to prepare such realistic dataset!
@MichaelBlackMPI
@MichaelBlackMPI Жыл бұрын
Datasets take so much time but are worth it. We had a lot more that we wanted to add but had to make some hard decisions to get it out. We plan to keep updating and improving the dataset.
@pblpbl3122
@pblpbl3122 Жыл бұрын
wow so cool
@hyunkim2172
@hyunkim2172 Жыл бұрын
awsome!
@WhiteDragon103
@WhiteDragon103 Жыл бұрын
I too wonder how it would perform on poses with rapid acceleration where the center of mass is not necessarily supported by a center of pressure directly below. For example, an athlete making a sharp hairpin turn would have significant lean, but because of the acceleration AND gravity, the center of mass would be supported despite the lean.
@owenlarson07366
@owenlarson07366 Жыл бұрын
I’m convinced that this is how we get there! Of course your team is the one to do it.
@mokhtarzadehhossein
@mokhtarzadehhossein Жыл бұрын
Great job on understanding the importance of maintaining a stable body and its connection to slow movements like Yoga. I'm curious if you've explored its effectiveness in higher-intensity activities such as fast walking, running, or jumping. Considering deformable surfaces adds another layer to consider, especially when the ground is not always a non-deformed surface, like when people play on grass, for example. It would be an excellent addition to your original concept and research model. Keep up the fantastic work!
@javlontursunov6527
@javlontursunov6527 Жыл бұрын
Professor, can U tell me if this dataset can be used for camera synchronization or not ?
@heejuneAhn
@heejuneAhn Жыл бұрын
In fact, when someone gets weight the skeleton also changes a little bit anatomically. Also, the visual joints are not always the same as the anatomical joints/skeleton. So it changes a lot when get or lose weight, I think.
@heejuneAhn
@heejuneAhn Жыл бұрын
Thank you for sharing the presentation, I have a couple of questions: Firstly the global position and orientation is obtained through camera motion estimation or directly for each tracking object? Secondly, the re-identification is based on the shape parameters of SMPL models of humans or others? If yes, what if the people's body shape is similar to each other. Finally, It only works for humans or other types of objects?
@yusun986
@yusun986 Жыл бұрын
Thanks. 1.global orientation and translation are directly estimated as one of the outputs. 2.tracking is performed by associating detections to complete trajectory, uses cues are not only body pose and shape but also the unique 3D translation of each subject. 3. TRACE only support human.
@hetedeleambacht6608
@hetedeleambacht6608 Жыл бұрын
wow. now only need to differntiate between different weight, weft and material of fabrics, they all drape different
@funsensei
@funsensei Жыл бұрын
is there any tutorial on how to implement this on a persnal image? i have no background in the feild but i am curious about it. i'd like to have a first hand experience.
@ericmlevy
@ericmlevy Жыл бұрын
1. Can the model be exported without cropping to the roi box? 2. What can be done to improve the temporal stability / shakiness? Thank you!
@MichaelBlackMPI
@MichaelBlackMPI Жыл бұрын
1. The result is a full 3D FLAME head model. This cropping is only for display here. 2. EMOCA v2 is more stable (github.com/radekd91/emoca) and you can always run a 1-Euro filter if you still want more but it's pretty stable. 3. but also check out MICA, which is very stable. justusthies.github.io/posts/mica/
@Steve-lu7nu
@Steve-lu7nu Жыл бұрын
How to do it ? Full tutorial please
@DieterV3
@DieterV3 Жыл бұрын
Is there any way to create these animations online to use as video for your website?🤔
@ada-ihueze1066
@ada-ihueze1066 Жыл бұрын
Code is filled with bugs and errors
@borlean4691
@borlean4691 Жыл бұрын
Is it possible to get a model with texture?
@MisaAcim
@MisaAcim Жыл бұрын
Truly amazing, would very much like to collaborate with you at some point in my career.