No video
Motion Capture Animation in After Effects
Рет қаралды 166,440
Күн бұрынHeard of Tigtone? It's a cartoon that uses motion capture to warp puppet mesh pins in After Effects. I'm a fan of the show and so I wanted to try to create my very own "face rig," but unlike the animators working on Tigtone, I've only relied on the built in face tracking -- in other words, there's no need to glue tracking markers to your face if you use this method. Of course, it's not perfect, but I've made a lot of progress on this over the last month, and I think I'm close to building a completely automated system of facial animation!
If I can figure this out, I'll be able to post videos more frequently, with more sophisticated animation. NOTE: I think Adobe Character Animator is still a great option to use in conjunction with this technique, and I bet that by next year, most of these features that I've scripted using expressions will be standard in character animator.
More updates SOON, I promise.
- G ♥
@STIMULUSVIDEO 5 жыл бұрын
Please ignore the fact that my shirt is inside out. I've been working on this rig for a couple months and it's not perfect yet, but I'm very close. I think this is going to be the game changer once I work out the bugs. Oh, and watch Tigtone.
@STIMULUSVIDEO 5 жыл бұрын
I'll probably do a follow up video that goes into more detail
@eobiri 5 жыл бұрын
I am a new subscriber......Kindly do a video on the Parallax Effect.... Thanks
@STIMULUSVIDEO 5 жыл бұрын
@@eobiri I could do that. In the meantime, Character animator is a good place to start and this is a comprehensive tut that includes a very effective parallax effect kzfaq.info/get/bejne/g7ukhdF-srW4naM.html
@STIMULUSVIDEO 5 жыл бұрын
kzfaq.info/get/bejne/m-B3lami0t-0d2g.html oh this one too, really good
@henryphillips7960 5 жыл бұрын
thats the trick.. when your shirt is dirty, just turn it inside out. boom, new shirt. the armpit stains are on the other side
@CarpinchoLopez 2 жыл бұрын
This is very valuable. Could you explain in a little more detail how to copy all the face tracking information into the puppet mesh?
@GokdenizCetin 4 жыл бұрын
Do a detailed tutorial please
@makamadkat 5 жыл бұрын
I would love to see an in depth tutorial on how you did this. I'm a digital portrait artist and have always been fascinated with this feature of animating art to make the portraits life like
@STIMULUSVIDEO 5 жыл бұрын
I figured out a better way to do it and will probably post something soon. It's after effects heavy and requires a couple plugins. Character animator is the easier way, which took me less time to figure out, but it's a little less sophisticated kzfaq.info/get/bejne/bdlhprKUz7iln4k.html
@BWayMotion 5 жыл бұрын
I had made a couple tutorial of this effect in the past. 1) kzfaq.info/get/bejne/q61hgLWrr9bFgKs.html 2) kzfaq.info/get/bejne/q9J4YNOm0rfGf2w.html
@zyuniverse9254 5 жыл бұрын
Solid! Keep up the vids, lots of great information we'll be using!
@thedope-ness4012 5 жыл бұрын
This shit is amazing!!!!! It looks so perfect. Can’t wait to try.
@crudecharacters2716 4 жыл бұрын
I subbed as soon as you said “you don’t need to do any of that shit”
@BrandonAEnglish 5 жыл бұрын
Cool stuff, man. 700th like! I'm working on building an animated-from-live action workflow myself. It seems like it should already be easier than it is.....but I'll keep trying
@STIMULUSVIDEO 5 жыл бұрын
Thanks! FYI, I've pretty much ditched this technique and am playing around with live2d cubism 3 right now, but haven't figured it out yet. Apparently has some support for camera tracking animation. I'm pretty skeptical of the whole endeavor at this point...
@PegiBruno 5 жыл бұрын
This looks fantastic!
@STIMULUSVIDEO 5 жыл бұрын
thanks!
@5Pectral 5 жыл бұрын
This is going to be super cool in conjunction with your art style. could you solve the rotation issue with an additional capture set up? One for straight ahead and one for a profile view and where one setups angle starts to get jenky perhaps the other angle can compensate and then interpolate between the two in order to get the head to look left or right more smoothly? The parallax is an awesome touch its looking great already :D
@STIMULUSVIDEO 5 жыл бұрын
thanks, yeah multiple angles is one solution for sure. I think I can get this to work with some basic trigonometry and better capture footage (higher res, 60fps would probably track better)
@user-dy7qh8tq7l 3 жыл бұрын
I know that I'm a fan of yours, and this will sound strange, but you should start a new channel, the algorithms of KZfaq clearly do not notice you. I have watched all your videos, and the potential of the content is comparable to an iceberg, 20% of which we see on the surface and 80% of which is hidden from us. I want you to know that you are universally underestimated! I hope you will read this message and if you do not start a new channel, you will know that the great work that you have put into your videos has not gone unnoticed!!!
@jwwwun 3 жыл бұрын
This. If STIMULUS isn't recommended that must mean there must be 100s of similar channels with this quality that we haven't found yet. Unfortunate that this site gets flooded by endless amounts of vloggers and clickbait videos. More proof that creativity and innovation can't be algorithmically measured at least.
@user-dy7qh8tq7l 3 жыл бұрын
@@jwwwun This makes sense, then the question remains how to promote your channel in such a competitive environment, if you already have a unique style.
@Kirmm 5 жыл бұрын
awesome. can't wait for more reuslts
@ossie200 5 жыл бұрын
Holy shit this is cool!!! Keep it up dude!
@parapoliticos52 3 жыл бұрын
It's beutiful. In few years you could make an aniamate picture in day using similar but more advance technology.
@sonnyslaughter6110 3 жыл бұрын
This guy is unique!
@uknighthuntingvision93 4 жыл бұрын
Pretty cool
@bahri4real 5 жыл бұрын
i seriously need a step by step tutorial in face tracking please
@STIMULUSVIDEO 5 жыл бұрын
I might put something out, but I've also learned some new tricks that might make this irrelevant
@carakalem 4 жыл бұрын
@@STIMULUSVIDEO then why are you waiting brother please we are waiting for it and also I didn't get it how you matched with cartoon
@STIMULUSVIDEO 4 жыл бұрын
@@carakalem check out cubism live2d, it's what I'm messing around with right now, but it's a manual process to animate faces instead
@shiranui2844 5 жыл бұрын
You need sleep.
@glecko9241 2 жыл бұрын
Your content is amazing! Really inspiring
@Kirmm 5 жыл бұрын
Hey man, love this stuff. Looks amazing. Could you add a tutorial of your rig please? I don't understand how you parent the face rig to those tracked points.
@STIMULUSVIDEO 5 жыл бұрын
it can be as simple as dragging the pick whip from the tracking point to the puppet warp pin in your effects dropdown.
@o.aboelazm 4 жыл бұрын
Dude you promised for more updates soon , and that was the last year ! Where is the updates then ? :p I'll be thankful if you made a tutorial about that shit man :D
@STIMULUSVIDEO 4 жыл бұрын
Minor update in my podcast video kzfaq.info/get/bejne/q7FgfM-mur_bfGw.html And a test animation made with different software NOT motion captured kzfaq.info/get/bejne/eLCooMZnxMqyZ2Q.html I think that is going to be better but I'm still playing around with it. The mocap kind of sucks IMO
@zinism 3 жыл бұрын
This is awesome man ! But why so sad, the music and all feel like you have depression or something lol. You should read night stories too. So relaxing
@STIMULUSVIDEO 3 жыл бұрын
I was hungover...
@natewoods5225 Жыл бұрын
Can you release a tutorial on how to do this?
@SkyShazad 4 жыл бұрын
I love how you talk man no nonsense shit, also do more video on this after effects motion capture shit ,its amazing, gonna sub u bro
@pegbars 4 жыл бұрын
Yes, the gutter language appeals to the lowest common denominator.
@rataratarata 3 жыл бұрын
This is awesome!
@aeris360photography 4 жыл бұрын
very cool!
@chrism4041 3 жыл бұрын
Hi, so theoretically we would be able to overlay effects and CC stuff over the face as well? patterns, textures, glowing lines, etc?
@maximmakhrov2043 10 ай бұрын
Нравится твой стиль повествования )
@PandemoniumPirateRadio 3 жыл бұрын
This is dope. I was looking at Live2D and Facerig for this kind of stuff, but I've got AE and figured there has to be a way to do this. I'd love it if you posted an update on this kind of method 👍 I have an idea for a very inhuman/Stylized character I'm very curious to see whether or not I could achieve a good rig for. Don't have the money currently for the Live2D module for Facerig unfortunately 😑 (just reading up on this stuff today for the first time)
@STIMULUSVIDEO 3 жыл бұрын
I've moved away from the automated animation, I don't like the result personally
@PandemoniumPirateRadio 3 жыл бұрын
@@STIMULUSVIDEO Right. I don't think it fits for actual film, the use is probably only really suited for comedy or for livestreaming purposes to my mind. I'll try to replicate your method at some point 👍 thanks for posting it.
@STIMULUSVIDEO 3 жыл бұрын
@@PandemoniumPirateRadio if livestreaming, try adobe character animator
@PandemoniumPirateRadio 3 жыл бұрын
@@STIMULUSVIDEO Yea no I've tried that the other year. The results are not very good, it's as you've commented on it in your other video. I've seen some good stuff being made with Live2D and facerig however. Seen some good rigs made by Iron Vertex (I think they basically rig for peoples original characters etc. lots of Anime tho). But yeah, it would only work for KZfaq level stuff, so who knows if it's even worth getting into.
@Aleksandr_Alex 5 жыл бұрын
Восхитительно и удивительно.
@klebergermano330 5 жыл бұрын
Great video, pls do a more depth tutorial about this
@shizuoh2792 2 жыл бұрын
1:40 you haven't seen my eyes yet
@memegazer 5 жыл бұрын
Cool stuff
@lauricazio7473 4 жыл бұрын
Brilliant!!!!
@jefflewis8765 4 жыл бұрын
Can I do this with a whole body? When I say "I", I mean where would I hire someone to do this with a whole body. Wanna digitize a pro tennis serve.
@STIMULUSVIDEO 4 жыл бұрын
Not really. I mean, different technique, you'd have to do motion capture like where they put the little white balls all over someone and shoot them from multiple angles and convert the mocap footage to 3d animation
@thetiger3223 3 жыл бұрын
Very cool
@parapoliticos52 3 жыл бұрын
Please Please Please try this with a comic character. LEt's see how well it can serve a motion comic.
@rhysseddon7279 3 жыл бұрын
Can this be done in blender with a 2d rig instead of 3d
@garnetflame6856 5 жыл бұрын
Hi Stimulus This is really amazing what you are doing here There is not much out there on how to take a cartoon and facerig it with after effects. I've always been intrigued by Live2d and how they can use The models created with live2D to make face rigs. I really like what you have done here and would like to try and replicate it with my own cartoons. I'm really wanting to learn how you achieved this on After effects and would even be willing to Pay for it and I know others would be keen to do so as well. I understand the concept of how this can work. But Working with the actual layers and masking and using bones to get your end result is what I am interested in learning. Please let me know if you will be making an in depth course on how to take a cartoon and rig it in After effects including the whole process from start to finish! Again something I would pay for and I know others would want to do so as well for sure.
@STIMULUSVIDEO 5 жыл бұрын
Thanks yeah I was thinking about putting together a course on skillshare or something, but that's not happening anytime soon. This is where I started: cgi.tutsplus.com/tutorials/fantastic-facial-motion-capture--ae-20164 it's of course out of date, since you can now use the built in facial tracking points instead of dots, but that's the only tutorial I found like that. Also make sure to use Character animator, which does 90% of the work for you. Not as customizable, but a more efficient animation tool than after effects in most cases. I'm still figuring out how to utilize both
@BWayMotion 5 жыл бұрын
@@STIMULUSVIDEO kzfaq.info/get/bejne/q61hgLWrr9bFgKs.html kzfaq.info/get/bejne/q9J4YNOm0rfGf2w.html
@prashanthvarma9355 4 жыл бұрын
Hi, can you explain, how you made the character to close/blink eyes? I am unable to get that.
@STIMULUSVIDEO 4 жыл бұрын
yeah so that's a separate comp where I'm using the eye "openness" data variable to move some puppet points up and down. I found that tracked data to be unreliable and ended up correcting a lot of it along with the eye position data which was terrible
@prashanthvarma9355 4 жыл бұрын
@@STIMULUSVIDEO yes. That's was not accurate but helps me in some extent. How do we connect puppet points with eye openness data? I create one puppet point to connect to eye openness but it went completely out of the picture. And the eye openness data is calculated as percentage and puppet points is based on position. So do we need to write a script for that or we can do it manually? Thanks
@STIMULUSVIDEO 4 жыл бұрын
@@prashanthvarma9355 you have to play around with some numbers in the script. it will vary depending on your image but you will need to write some simple arithmetic like (pin position) + (open percentage)*(scaling factor) obviously that isn't the correct syntax, but you'll figure it out
@prashanthvarma9355 4 жыл бұрын
@@STIMULUSVIDEO got it. Thank you so much. Thought that I have to do it manually. Thanks for taking your time to respond
@BaronesLoveyDeLuxe 2 жыл бұрын
Can you do this with a photo?
@slaverecords 5 жыл бұрын
Cool 😎
@thirasheela8334 3 жыл бұрын
which type of mobile we want use for a facial motion capture pls comment mobiles name too pls bro
@isampera 2 жыл бұрын
Hello, I'm new to after and I wanted to try this. But I don't understand once it has tacked the motion what do I do? I mean, so that it looks like a drawing. What are the steps? I followed all the steps, but I'm lost. Thank you
@akeelak8482 4 жыл бұрын
very good .. i have problem when I need link the puppet pin with the null object I don't shown the parent in the puppet pin
@Jakeuh 4 жыл бұрын
Do you think there would be any chance this could be used in a live setting? Maybe with a simpler model?
@STIMULUSVIDEO 4 жыл бұрын
use adobe character animator or cubism live2d
@shapeofyou5587 4 жыл бұрын
cool
@Velldog 5 жыл бұрын
Isn't this what Adobe Character Animate is for?
@STIMULUSVIDEO 5 жыл бұрын
Yes. Similar but lower fidelity. I did a short video that too kzfaq.info/get/bejne/bdlhprKUz7iln4k.html
@JustMKollum 2 жыл бұрын
Does this work in After Effects CS6? Can't afford CC.
@ThatAmine Жыл бұрын
Crack it
@juanted11x 4 жыл бұрын
how did you connect the face to the "puppet" it does not look like you used the pinwhip tool
@STIMULUSVIDEO 4 жыл бұрын
You can pinwhip or just copy/paste the appropriate script, which I think is what I did but I don't remember
@aimanallimin1235 4 жыл бұрын
DAME DANE DAME YO DAME NA NO YO
@klojeter0094 4 жыл бұрын
GET STICK BUGGED LOL
@TapoTalent 4 жыл бұрын
how you changed face into cartoon face....that was not explained in video
@STIMULUSVIDEO 4 жыл бұрын
I drew it
@TapoTalent 4 жыл бұрын
@@STIMULUSVIDEO not that how track that face and cartoon as same ....that i asked ..how you match that as same
@SurajSuresh_ 4 жыл бұрын
@@TapoTalent @STIMULUS please make a detailed video I'd love to try out this
@user-sp9ox2vi5i 4 жыл бұрын
That's not important
@HalloFilmz 4 жыл бұрын
Make tut bro how to connect cartoon and face ^^
@SaffireAnimation 4 жыл бұрын
Is there requirement around updating the Graphic Card of your computer?
@GENIUSGT 5 жыл бұрын
Would this work in CS6?
@STIMULUSVIDEO 5 жыл бұрын
You would have to draw dots on your face for custom tracking points. The "detailed face tracking" was released 2 years ago in CC
@-retrocat6191 4 жыл бұрын
Good job but scary
@EpicChubs05 5 жыл бұрын
Great vid! What's the name of the background music? Very relaxing.
@STIMULUSVIDEO 5 жыл бұрын
Thanks! The music is just me playing random chords though
@claudiotena5962 5 жыл бұрын
@@STIMULUSVIDEO Dude! Could you release an mp3 of it? Did you use fl studio or something? It's so good!
@STIMULUSVIDEO 5 жыл бұрын
@@claudiotena5962 So, I *think* it's a pad synth from LuSH-101, which of course can be loaded into FLStudio. Maybe get a torrent of LuSH-101 and play around with those ambient pads?
@claudiotena5962 5 жыл бұрын
@@STIMULUSVIDEO Thank you!
@DESMOND-rs9qs 5 ай бұрын
What application or site did you use Sir?
@hankersonmedia6134 2 жыл бұрын
I died at "There's no need to do any of that shit!" :41
@dkl1752 4 жыл бұрын
Cám ơn bạn đã chia sẽ 1 video thật bổ ích
@generalawareness101 3 жыл бұрын
Shit, I wish DaVinci Resolve could do this.
@SpacelandZoo 4 жыл бұрын
And check this shit out.
@TomisaLami 4 жыл бұрын
ok so how do we start it
@bewrb 3 жыл бұрын
Can we use it in a stream ???
@Darkbulb1 4 жыл бұрын
any updates on this?
@scottynightbell1393 5 жыл бұрын
do you think this is the type of technology that all those virtual youtubers use to capture their faces?
@STIMULUSVIDEO 5 жыл бұрын
who?
@scottynightbell1393 5 жыл бұрын
@@STIMULUSVIDEO it's a huge thing in the Japanese sphere of KZfaq right now. they're called virtual youtubers or vtubers for short. they use some sort of body and facial motion capture with a 3D model. if your interested just search "kizuna ai" I believe is her name.
@STIMULUSVIDEO 5 жыл бұрын
oh god I remember seeing that now. Kizuna Ai just looks like traditional 3d animation to me
@scottynightbell1393 5 жыл бұрын
ah so you think they might just be doing most of that animation by hand then?@@STIMULUSVIDEO
@STIMULUSVIDEO 5 жыл бұрын
I can't tell. But the mouth animation is so simple my guess is that they synced that up to the audio waveform -- louder volume, bigger mouth shape
@hgwgromit9955 5 жыл бұрын
Ooooooooooo! Wow
@altsoy5069 4 жыл бұрын
Doesn't Character Animator do this better?
@STIMULUSVIDEO 4 жыл бұрын
kzfaq.info/get/bejne/bdlhprKUz7iln4k.html
@Perritobonito123 4 жыл бұрын
Bro just recently subscribed and I gotta tell you your music creeps me out. Maybe something more chill? It's a friendly opinion. Keep it up man!
@anubisunchained 4 жыл бұрын
Lmao I get Ur point but for me it makes it more intriguing somehow
@sanarehman2989 4 жыл бұрын
Whats d name of the show? Tiktone?
@arsalanmalik488 4 жыл бұрын
Tigtone cartoon!
@wrillywonka1320 3 жыл бұрын
Check this shit out..bad ass video lol
@iconsworld9 3 жыл бұрын
I know you got all the skills, and I respect that a lot. But I want you to smile little more. Smile some more life is short.
@bleujaun 4 жыл бұрын
there is much easier ways to do this with other software and an iphone
@GDriss 4 жыл бұрын
Tell me how please
@psychotech3927 4 жыл бұрын
such as?
@bleujaun 4 жыл бұрын
Reallusion Crazy Talk or for your phone there’s an app called Mug Life that is decent too
@bleujaun 4 жыл бұрын
If you need to do live motion capture Realusion Cartoon Animator is good
@parishna4882 3 жыл бұрын
@@bleujaun You need to manually do everything in CT.
@SilverWagonStudio 3 жыл бұрын
Let's collaborate one day
@carmelhirsh1829 5 жыл бұрын
Still playing RDR 2?
@STIMULUSVIDEO 5 жыл бұрын
SEKIRO ugh
@karenmartinez3517 4 жыл бұрын
Lastima que no sé ingles :c
@spacykid 3 жыл бұрын
why so grumpy though
@evilsWa Жыл бұрын
0:29 is that…Mr Plinkett?