Blender 4.0 Facial Animation with NO RIGGING!

Рет қаралды 249,124

Күн бұрын

Shape Key Selector (DEPRECATED) is OUT NOW!
blendermarket.com/products/sh...
vertexarcade.gumroad.com/l/Sh...
www.vertexarcade.com/store/p/...
Example Head Mesh download:
bit.ly/3QuBdUd
This tutorial walks through the set up of a "rig" that uses images to drive the value of shape keys. This allows you to easily choose your character's expression from an intuitive visual menu and all you need to do is create shape keys for your character. No rigging required!
To follow along with the future development of Shape Key Selector, follow me on Twitter/X! / vertex_arcade
00:00 Introduction
01:13 Creating character shape keys
05:02 Setting up the Images and Selector
09:55 Drivers Explanation
11:01 Setting up the Drivers
13:36 Animating

Пікірлер: 230

@JAYROUTHIER26 8 ай бұрын

In my opinion the best workflow as an animator reside in the mix and match of both. You animate with bones, then you add the icing on top of the cake using shape keys.

@Violn95 8 ай бұрын

Maybe do that the other way around? Might be better to get general placement of expressions and then fine tune things with bones

@SymbolCymbals2356 8 ай бұрын

@@Violn95 You have it backwards, with bones you can put the face in any position without limits but it’s missing finer detail like smile lines for example which is why you use a shapekey on top to fix any issues or add little details like that since they excel at fine detail and specific shapes Video games (for hardware performance purposes) do use shapekeys for the entire face but that can run into the issue of shapekeys not interacting well together and creating artifacts that are difficult to find and diagnose beforehand. You also need a TON of shapekeys to make the facial expressions not look repetitive, 52 is a common number of shapekeys and that’s a ton of work just to mimic what bones do for a fraction of the work

@Violn95 7 ай бұрын

@@SymbolCymbals2356 sorry, I did have that backwards

@DimensionDoorTeam 6 ай бұрын

It always depends on your goals. For game engines, I prefer focusing on bones first because it gives much more control.

@bobsteven2363 8 ай бұрын

shape key rigging is how you create photorealistic facial animations. It doesn't end up choppy because you can blend all of the shape keys together at the same time. You can even use apple ar or any facial tracking but you do need to create at least 52 blendshapes which takes forever :((((

@VertexArcade 8 ай бұрын

However, this method of rigging the shape keys uses the distance to the images, so as the selector moves over the images it turns on any shape keys it passes over, that's what causes the "choppy" animation in this instance.

@ngophap6706 5 ай бұрын

try Face it addon

@TOAKSuriFox 8 ай бұрын

Wow! I never imagined shape keys being used so effortlessly and conveniently. They've always been a bit of a hassle to work with, especially when dealing with a large number of them. However, this approach changes the game entirely.

@mirkocianferoni4648 8 ай бұрын

I really appreciate this, I was waiting for this tutorial. It's a game changer for the "Stylized Look" that this method can add on expression...Thanks for sharing your awesome work!

@MrHumbuck 8 ай бұрын

I'm going to save this video to come back to in the future, this seems really useful! Thanks for making it

@LinkiePup 8 ай бұрын

I appreciate that you took the time to make a tutorial on how to do something, while not just shoving a addon down our throats. Like- “This Method requires this addon, and can only be done with this addon.” Absolutely stunning man! I’ll go an support you when I can! Even if I don’t plan on using the addon version.

@kazumi_vr 4 ай бұрын

Omg this is insane was tearing my hair out at how daunting face animation was this deserves an award, amazing tutorial and reignited the flame for animating please keep making these tutorials! ❤

@AnonAnon-du2ho 6 ай бұрын

OML what a savior. cant imagine how on earth you figured out how to do all this but glad you did!

@gagz9k 8 ай бұрын

Awesome, I'm buying the add-on, the work put on explaining and creating it is just superb.

@VertexArcade 8 ай бұрын

Thank you!

@rileyb3d 8 ай бұрын

This is a really hard topic to explain in such a clear way. Great work!!

@dr.einbrein176 7 ай бұрын

This is awesome! I really like how you explain some steps so we learn how everything actually works and not just how to use everything!

@leethememerwolf 8 ай бұрын

this was a very helpful video and lesson. Shape key driver setup is so nice looking being able to have a preview of the emotion is very handy

@willyamcarkey717 8 ай бұрын

This is life changing knowledge for me!! I had no idea it can be done in that way!

@vanished001 8 ай бұрын

Ive never seen this method explained more clearly, excellent video 👍

@kuromiLayfe 8 ай бұрын

personally i would recommend both rigged and shapekeyed .. shapekeyed for expressions and the rigged for subtle after motions with bendy bones (dynamic phone or physbones)

@VertexArcade 8 ай бұрын

Yeah, that's a valid approach!

@BlenderVedaEnglish007 7 ай бұрын

10:48 you have cleared my doubt on a whole another level especially about the drivers

@tommythecreator7941 8 ай бұрын

That's just awesome! Thank you so much for the lesson!

@activemotionpictures 8 ай бұрын

This is so cool! Thank you for sharing this amazing tool!

@darrennew8211 8 ай бұрын

Very nicely presented!

@Blaxpoon 7 ай бұрын

This extremely high quality. It helps so much thank you !!!

@A-W80 5 ай бұрын

The models I'm working on won't benefit from this, but I'm still listening just because this guy has a really soothing voice

@tonylinks1013 8 ай бұрын

I'm new to blender. I don't fully get it now but I know I'll understand it later. Thank you very much.

@puppetmaster442 8 ай бұрын

its the MOST underrated thing ive ever seen

@costaluca78 6 ай бұрын

Wow that's an amzing tutorial, well done.

@RTKdarling 8 ай бұрын

Great work! Subbed! This really got me thinking too. I mostly do abstraction and motion graphics, zero character work. This same method might work with a selector that's being randomly moved via geometry nodes. This might be a workflow for creating seemingly greater variation between multiplied models...

@PityMauArt Ай бұрын

This is a really good tutorial!! Super clear thank youuu

@toshigen 7 ай бұрын

Awsome!! great applied for expression

@D_Van 6 ай бұрын

a very useful tutorial, thank you!

@YourBlenderJourney 5 ай бұрын

Thanks you so much for this tutorial!

@brellos7220 7 ай бұрын

It's a great video! Thanks for helping a lot!

@pinklady7184 7 ай бұрын

You are God-sent. BIG THANK YOU.

@LeanNavarro 8 ай бұрын

I was wondering this thing ! thanks

@DuskstarShine Ай бұрын

omg that adon is gonna be a life saver.... me.. animating complex facial motion with about 20 RAW blendshapes. no bone drivers... just the raw shapekey values 🙃

@thomasmann4536 22 күн бұрын

i like this in principle (it's similar to blendspaces in game engines), but by using snap, you're basically robbing yourself. you could easily smoothly blend between multiple shape keys by arranging each section in a 2d space and have no snapping, thus creating basically an infinite variation in face shapes, which would work for both cartoony and realistic animation :)

@FF7EverCrisis 3 ай бұрын

Very informative. Helped a lot

@Crashsune 8 ай бұрын

Super awesome!!! 💖💖

@cocozozo2021 Ай бұрын

This method is everywhere in VRchat. Very easy to use!

@v4p 8 ай бұрын

it's great

@wakegary 4 ай бұрын

it really is.

@AniHasiro 8 ай бұрын

Wow, it's super.

@NottanALias 5 ай бұрын

massive props for making a tutorial on how to set the basic version of the addon you made up yourself while explaining how the addon works and can be used. just truly amazing! im an indie dev and not yet very fluent in animation. what are the potential downsides of shapekey animation in a stylized context?

@ultraozy4085 3 ай бұрын

awesome tutorial✌, shape key or morphing workflow has been around forever in other 3d programs its very good not just for faces, blender has it too but most people will just use that default bone face rig thingy

@thffkfltm 8 ай бұрын

great tutorials

@DuskstarShine Ай бұрын

Id imagen if you want more controll and to smoothly blend the shapes, instead of bringing the selecter to the shapes, bring the shapes to the selecter. You can probably set it up so all the images are in a circle around the selecter, and just bring them in towards the middle to turn on and off those indervisual shapes. Then there is no need to worry about passing over blendshapes to get to another, or mixing ones on oposit sides ^-^ Id imagen it could be made as a "base" in like a clock shape, then you only need to add the shapekeys that are in use for that part (say the eyes) and you can leave whatever is spare blank, just changing the shape its blending and the plain's texture to indicate the shape. ^o^ I have to try this!!

@Txour 8 ай бұрын

minor nitpick, but no, this isn't how most 2d animation is done, i know that you didn't mean anything bad by it, but by reducing the painstaking process of hand-drawn 2d animation to "picking and choosing" you're kinda contributing to the idea of "the computer does everything" which i know that as an animator you're annoyed by too. anyway, I think the reason a lot of animators like to have this absolute control over their work is that, unlike real life, every frame should be controlled, handled carefully and generally be pleasing to look at. this mindset is what leads to great moving pictures that also look like great normal pictures.

@VertexArcade 8 ай бұрын

I completely understand, I didn't mean to undersell the 2D process, I was mostly talking about the tween style animation that it widely used in TV shows on a tight schedule. Hand drawn animation is definitely its own art form

@snakkattakk 8 ай бұрын

That's an amazing addon but you really should show people how to go through and make one of these stylized models for this. Cause I would love to do this cause it seems a lot easier than 3d facial expression modelling, but I have no idea how to make these.

@VertexArcade 8 ай бұрын

I'll add it to my list of videos to make!

@snakkattakk 8 ай бұрын

@@VertexArcade Please do! These stylized models would be much easier for people to make than more detailed ones!

@Dr.R. 6 ай бұрын

lovely, i have to (re)build this :-)

@hongannguyen8000 7 ай бұрын

Magnificent!

@KeysPlays 8 ай бұрын

this is fire

@JayM928 Ай бұрын

Awesome video! Two things: 1. Despite the couple negative comments about the method. This is EXACTLY what I needed for my project, which did NOT need the complexity of rig. Simple. Straightforward. Got me to my objective way faster than I thought. THANKS. 2. I love the model style of the black hair model in this video. Did you make this from scratch? Can you do a video how to make something like this?

@thorn- 5 ай бұрын

On the refrain of "shape keys animate linearly" - they don't have to. You can set interpolation of a driver to be non-linear, as well as just non-linear for set keyframes.

@Jorybei2 8 ай бұрын

Nice!

@MasterCreator1998 Ай бұрын

10 out of 10

@FancyFun3433 7 ай бұрын

Hello! I practice realtime animation in blender and have been looking for somewhat of a puppeteer tool for it. Daz3d has the best one but this interests me. Does this work on bones? Can I store multiple poses and then blend between them?

@NightmareCourtPictures 3 ай бұрын

Bro went and created an animation editor with models... And, its probably universal! lol This dude went omega brain.

@ParakeetDSi 5 ай бұрын

I'm pretty sure Minecraft Story Mode did something with the Mouths. Is this similar?

@QUENROUTE66 8 ай бұрын

Great tutorial! Any plans on making a video on how to make stylized faces like this?

@VertexArcade 8 ай бұрын

Rigging isn't my strong suit so probably not. I can make stylised models, but rigging them correctly for animation just isn't my forte. If I really needed to rig a face I would just use something like the FaceIt addon that generates one automatically

@TrickDigitalYT 8 ай бұрын

You Should do a thing showing from opening blender to getting to the point where you can edit the face...

@blacksyrup2562 20 күн бұрын

After I enter the key frames and values for both points on the my 3rd mouth driver it makes the purple number of the driver into 0.716 instead of 1 and the expression is not fully displayed when the selector is on top of it. I changed the transform space to local space and that seemed to fix it but do you think this will cause me problems later?

@rakeshrasapalli3554 7 ай бұрын

you are really Osm man

@GraphicalRecruit 2 ай бұрын

I did what u did but for some reason, it doesn't have a mixed expression instead went from the expression then the default then the expression what should I do.

@domolutz 8 ай бұрын

Cool addon but I can't work with face rigs only using blendshapes, it's too repetitive and all the blending is linear. Adding bones on top of blendshapes can make sure that you're hitting your nicely sculpted poses but you can give more variety by offseting things using the bones, and you can create nice arcs for things like mouth transitions.

@VertexArcade 8 ай бұрын

Yeah, there's a preferred use case for this and that would be very stylised choppy animation that doesn't necessarily require blending between frames. You could get creative with the shape keys though, like in these examples. It's a different way of thinking about animation but I think there's use cases for both methods. kzfaq.info/get/bejne/aplpgqWC0Z20kmw.htmlsi=68uqAKIyMky01dcy&t=695

@pikachufan25 8 ай бұрын

Gonna head to sleep after This xD: Just Search: live2d mouth chart Repetive Hell Yea!: But "Bad Results cause of X Reason" i disagree... since Live2D uses a Very Similar Workflow which can get Very Smooth Results if Done Propertly... (and Yes i know there are Differences between them but its Close Enough that you can probably get a Really Good Result just Using them...)

@clements3715 3 ай бұрын

Yeah we use to learn facial animation like that on 3DS max, it's called morpher in Max like in morphing. very easy and user friendly but efectively less realistic on realistic caracter.

@johntheco 4 күн бұрын

Hey, thank you for that video! I just wanted to ask if that method is exportable into Unreal Engine? Looks really cool!

@laxly9937 Ай бұрын

Just a quick question. How did you get the mouth to open?

@BuzzKirill3D 2 ай бұрын

Thanks. Good method but as you said, the selector moving between expressions can mess up the transition, touching unwanted expressions in the process. Also, if your selector is an object and not a bone, then the animation won't port properly to game engines.

@mertensiam3384 5 ай бұрын

How do I make that circle thing that deforms the mesh appear? I'm on edit mode and I don't know what you're using

@anastasiaklyuch2746 8 ай бұрын

Just note that this will not work with more complex faces, as shape keys animate linearly, and thus cannot make curved movements. For example, a model with giant eyes, where lids need to be rotated down to close - would clip through eye balls if done with shape keys.

@VertexArcade 8 ай бұрын

Yeah, although you can get creative with the way you make shape keys. If I ever needed some curved motion, I would create an intermediate shape key, and then blend from the open blink to the intermediate then to the closed blink, it's a little more work, but it is possible. I've seen some videos where people actually separate the XYZ coordinates of a shape key and then animate them using drivers. It's not the most flexible approach but it can be done

@MaiamiPaw 6 ай бұрын

Great tutorial! Will your addons work fine on newest Blender version?

@Mr.ShaxaIT 8 ай бұрын

Огромное спасибо

@rmt3589 8 ай бұрын

Deffinately looks like the style I want to use. Can I put in my own svg files, and swap them for different character setups?

@VertexArcade 8 ай бұрын

Do you mean the images? Yeah, you can set up any character with shape keys and they can have their own set of images that match to them, then you can have more characters with separate shape keys and separate rigs

@web3.0_metaverse_XR 2 ай бұрын

i want to use it with 3d images. does it work with 2d images to create different facial expressions?

@MetaKirb7 4 ай бұрын

Is there a way to have 2 selectors for 1 driver of a facial expression? I try to add another selector for a driver of a facial expression and while the new selector works, it overwrites the previous selector and the previous selector no longer works. I would have to delete the second selector so the original selector can work again. I want to achieve this so I can mix multiple face expressions at one time. So say I have 2 mouth expressions, one is Smiling and one is Angry. I want to mix them both together at full values and I don't think I can achieve this with only 1 selector. Any insight? Thanks for your time.

@VertexArcade 4 ай бұрын

The only way to do that would be to have 2 images overlapping, so one for your smile and angry, and then do the same driver setup, so as you move the selector it will activate both of them. The only other way would be to make a new combined shape key that's Angry Smile using the Shape Key Mix option

@MetaKirb7 4 ай бұрын

@@VertexArcade Got it, that makes sense. Thanks again for your time!

@cyd_hunter99 5 ай бұрын

how many more times are we going to reinvent blend shapes

@lawrence4301 6 ай бұрын

this didnt work at all for me, there was no establishing link i could see between the object and the shape/face made wit hthe shape keys, did i miss something?

@indianastilts 8 ай бұрын

Ive seen a video explaining this but this video seems much more detailed wbich i love. Question...would it be good to use this process set up for facial animations this way for Games. Im creating a game and need facial animations. Would shapekey facial animation be better used for film and poses or would you be able to use them in game engines

@VertexArcade 8 ай бұрын

Yeah, shape keys to control facial animation is definitely an easy way to do facial animation. Most game engines can read shape keys/morphs/blendshapes, so if you have them as part of your regular animation (walk/run etc) then the face will be animated as well!

@indianastilts 8 ай бұрын

@VertexArcade amazing would it be easier to use this method for games then using the rigging face method?

@VertexArcade 8 ай бұрын

I would say yes. It all depends on the style of animation and game. For a game that focuses on the characters faces a lot, you might need the extra control of the a proper rig, but if the game is more simple and the facial animation isn't going to be complex, then that would be the easier method

@indianastilts 8 ай бұрын

@VertexArcade amazing and prompt response so thank you soo soo much. Moulding the face this way seems fun also and freeing to make it exactly how you want then a face rig. I'll have a look at the addon also when I get to the animation stage of face for my game. Loooove this and subscribed from me and liked. Will check your other videos out

@Koda.Fisher 8 ай бұрын

Heyy I LOVE your Gwen Spider-Verse Model! How do you add the 2D lines for the facial expressions??? a tutorial on that would be sooo awesome! thank you! SUBED.

@VertexArcade 8 ай бұрын

They're just tiny meshes that I put in front of the model! I'm actually making a tutorial on it right now! Different ways to get line art and I cover that method!

@Koda.Fisher 8 ай бұрын

@@VertexArcade Omg no way!? Thank you sm, I am so excited! Ive been looking for a tut on this forever!

@Stargorithm 7 ай бұрын

Yoooo How did you make that spiderverse material for gwen? Not like the hatching or halftone but like the base material used on her face?

@VertexArcade 7 ай бұрын

It's just a basic toon shader, mix a diffuse shaded into a shader to rgb node, then using a color ramp you can control the sharpness of the shadows

@Stargorithm 7 ай бұрын

thank you!@@VertexArcade

@edgarortiz6975 8 ай бұрын

Its there a were of form to make the controls three times with the same model?? You Know, maybe 1 controller for the right eye, 1 controller for the left eye, and another controller for the 2 eyes at the same time??

@VertexArcade 8 ай бұрын

You could always separate the shape keys into Left and Right using a Vertex Group, then create a second Selector and repeat the same process, this time using the distance between the new selector and the image to control the left or right shape key, then you can move them independently and if you want to control them together you can just move both of the selectors at once

@SleeperReaper 2 ай бұрын

Is it possible to rig this with a face tracking program?

@mildrice9781 8 ай бұрын

This addon seems amazing but i'm not sure about the poses not being able to blend smoothly. How would u get that done and why does it need python?

@VertexArcade 8 ай бұрын

With this version, to animate we are keyframing the position of the selector, so if the selector has to move from the first image to the last image, it will activate all of the images as it moves. The addon version keyframes the shape keys directly. However, in Blender, you can't have a driver on a shape key AND keyframe it, so I had to come up with a method that used custom properties and some fancy code to set the values of the shape keys WITHOUT the drivers so that we can keyframe them. So the addon version would keyframe the first shape and the the last one and smoothly blend between them because it doesn't have to activate the shapes as it moves, we have keyframed the shape keys directly

@olamidesamuel9734 8 ай бұрын

@@VertexArcade so all the weird problems like the selector moving across other images and it not transitioning smoothly between key frames is solved by the addon version of thus tutorial

@kevinsantoso9956 2 ай бұрын

does anyone know how one would control the direction of the eye with this type of rig?

@VertexArcade 2 ай бұрын

It's the exact same process as the facial expressions, however this time instead of smiling,frowning etc, you make a bunch of different shape keys for the eye direction, so Eyes Up, Eyes Left, Right etc. then you create the image planes the exact same way, but this time put them in a grid, so the Default eye position at the center, eyes Right to the right, eyes left to the left, Eyes up at the top. The only difference is the shape keys, the rest of it is exactly the same

@canowaui 8 ай бұрын

Hey where is that gwen model from? Need it

@Draw26 4 ай бұрын

Porfavor, dime se puede en 3DsMax?? Y comoooo

@kaletziiii6668 8 ай бұрын

What happened if you export fbx animations like that? Is there still face animations?

@VertexArcade 8 ай бұрын

Yeah! As long as you enable the Shape Key/morph checkbox when you export, your shape keys will be part of your animations in your fbx file

@uo2265 4 ай бұрын

Anybody can tell me, Can we do this on Adobe After Effect?

@effiongsamueljames 8 ай бұрын

Unfortunately I tried mine but the shapekeys contradicts other shape keys when I try to combine it it

@VertexArcade 8 ай бұрын

That sounds like your distance drivers aren't set up correctly. Just make sure that the distance driver uses the correct image and that the values are correct. At a distance of 0, the shape key should be on and a distance of 1 the shape key should be off

@KensleyInnocent 7 ай бұрын

Is there any other software out there that has these inbuilt?! Like C4D, Maya, 3DS Max, etc?

@VertexArcade 7 ай бұрын

No, this is a custom built setup for Blender. I've never used the other programs so you might be able to set it up but this driver and shape key method is Blender only

@xalener Ай бұрын

my brother in christ this *is* a rig

@ryangrant6249 3 ай бұрын

Can you make a vid showing how to use your add on plzz

@ryenis 8 ай бұрын

is it possible to bake these animations so it can be exported into unity or unreal?

@VertexArcade 8 ай бұрын

There's no need to bake them, if you keyframe the shape keys they'll be exported when you export your model/rig!

@ryenis 8 ай бұрын

@@VertexArcade ty!

@beyounickvlog5285 6 ай бұрын

Hey, can you tell me how much it will cost to make a custom anime looking male character for using in blender and as a vr avatar. from you or other artists.please answer if possible.

@VertexArcade 6 ай бұрын

I don't do that myself, but if you were to commission a full anime character you would be looking between $500 - $2000 depending on the quality and the artist. VR avatars are difficult to make and need a lot of time to get right

@beyounickvlog5285 6 ай бұрын

@@VertexArcade ok.Thank you.

@legendarygamerboydragon1728 3 ай бұрын

Animation is so hard. Is there anyway to do animation for beginners?

@John.Animation-nx4dy 7 ай бұрын

Hello! This tutorial is absolutely insane, thank you! I have a question, I'm trying to achieve this using bones instead of cursors, any Idea why it's not working? I think it's the transform space.

@VertexArcade 7 ай бұрын

Yeah I couldn't get bones to work! It's something to do with the the fact that the bones are children of an armature, so the spaces don't work the same way as the transform space of an object. I'm not really sure how to get it to work, I tried everything I could but nothing ever worked

@John.Animation-nx4dy 7 ай бұрын

Thanks a lot!@@VertexArcade

@blacksyrup2562 25 күн бұрын

Hello, I'm really interested in this tutorial I just have one question: Are the eyebrows and face joined or parented together?

@VertexArcade 24 күн бұрын

They are joined together! For the shape keys to work correctly they should all be one object, you could keep them as separate objects but then you would have to have the same shape keys for each object and then assign the drivers. It works but it's a little more complicated

@blacksyrup2562 24 күн бұрын

@@VertexArcade Thank you ♥

@coreragestudios3430 7 ай бұрын

Can the rig be transported in unreal engine and also works with this addon?

@VertexArcade 7 ай бұрын

No, the addon is made for Blender. If you animate using the rig it'll keyframe the shape keys and those can be imported into Unreal, but the rig itself can't

@coreragestudios3430 7 ай бұрын

@@VertexArcade damn

@forestlong1 8 ай бұрын

OK! But you don't explained how to do left/right parts of mimic separately.

@VertexArcade 8 ай бұрын

The left and right parts are tricky to do. It's the exact same process but this time we have a second Selector and and a second shape key, then we just add the drivers for this second shape key and the selector and it will control the other side of the face. It was too complicated to go over in this video