AI to 3D Characters: Next Level For Blender, Unreal Engine and more!

Рет қаралды 65,173

4 ай бұрын

I'm exploring the innovative app AI Character creator called 'Chat Avatar', a cutting-edge tool that has been in development since last year. Join me as I guide you through the entire process in blender, from the initial creation of your AI character to the intricate steps of re-rigging and implementing iPhone motion capture and body animation.
An Unreal version will be coming soon, just wanted to separate the videos.
Please note: This video is not sponsored, nor am I affiliated with the 'Chat Avatar' company. However, I did have an enlightening meeting with the developers to gain insights into the current state of their technology. Dive in to experience first-hand the blend of art and technology!
Chat Avatar:
hyperhuman.deemos.com/
Accurig:
actorcore.reallusion.com/
Mesh Data Transfer:
mmemoli.gumroad.com/l/tOKEh
LiveLink for Blender (Face Mocap):
nickfisher.gumroad.com/l/tvzn...
Any iOS device with a TrueDepth camera (iPhone X or higher)
Actorcore (Body Mocap):
actorcore.reallusion.com/3d-m...
Chatavatar Discord:
Discord forum / discord
Patron
/ promptmuse
🥤If you want to buy me a coffee, I'd really appreciate it:
ko-fi.com/promptmuse
FAQ
1. DreamFacev2 CURRENTLY at the time of posting will be the only model to provide Rigging and body options. Thanks @binyaminbass
2. Website may be slow (Its still in Beta) . Works fine for me atm, but there has been times it's been slow. Discord forum / discord
3. If packing fails and you have paid...It should be free to repack, this has been the case for me :) . It will display a 0 as payment when you redownload. If unsure just ask on their discord above
#aiactor #ai #midjourney #stablediffusion #aianimation

Пікірлер: 210

@promptmuse 4 ай бұрын

I'll Pin an FAQ etc here when they come in :)

@promptmuse 4 ай бұрын

1. DreamFacev2 CURRENTLY at the time of posting will be the only model to provide Rigging and body options. Thanks @binyaminbass 2. Website may be slow (Its still in Beta) . Works fine for me atm, but there has been times it's been slow. Discord forum > discord.com/invite/AhYWCT8WNH 3. If packing fails and you have paid...It should be free to repack, this has been the case for me :) . It will display a 0 as payment when you redownload. If unsure just ask on their discord above

@DeltaNovum 4 ай бұрын

This is mind blowing! In a few years indie devs will be able to overtake AAAA studios. Being able to combine ideas will become more important than anything, every year. Thanks for sharing! Also great in depth, no nonsense tutorial 👌.

@ahmedboshra7625 4 ай бұрын

would you please leave your emailaddress ? for business inquiries

@davy4842 3 ай бұрын

When is the next vid about hairtools haircards and metahumans ?!

@promptmuse 3 ай бұрын

@@davy4842 on its way!! Sorry for the delay!

@geoatherton5214 4 ай бұрын

Amazing workflow tutorial. Thanks for all the effort that went into producing it. With this new wave of interoperable tools, crazy to imagine how many indy projects and studios can suddenly bring their dreams into reality. Way to explore the frontier!

@pongtrometer 4 ай бұрын

Thanks PM, Always such clarity in your tutorials, making 3D seem less daunting for newbie’s like me venturing into 3D/BLENDER creations. Cheers

@sigma_799 4 ай бұрын

this is so valuable. even with hand modelled characters we can use accurrig to quickly attach mocap

@aipsong 4 ай бұрын

Hello and thanks again for your clear and logical presentation of a complex process!!! The pace of your presentation is like a swift stream, and your mellifluous voice is mesmerizing!!!

@MultiFlashone 4 ай бұрын

Ummmmm.......that was amazing!!! Thank you so much for your time and efforts regarding this!!

@thedaltlaplanaworld 4 ай бұрын

Hello Muse I love your videos, even with little time and I always use the translator, I love all the information. The daily changes and news that emerge are truly crazy, it is impossible to follow everyone, but always follow you.🤩🤩🤩

@promptmuse 4 ай бұрын

Thank you so much! Yes I try not to post content too much but content I think could be useful to viewers. I am so glad you enjoy it. What language are you speaking and where in the world are you?

@frescolaveen3139 4 ай бұрын

Wow this is so informative!!

@promptmuse 4 ай бұрын

Thankyou tried to pack a lot in in under 20 minutes haha

@JesseJuup 4 ай бұрын

🔥 This was awesome !

@3djimmy 4 ай бұрын

So awesome! Deep thanks! This is such a great workflow, and much appreciation for being so concise. Cheers, keep looking up.

@apatsa_basiteni 4 ай бұрын

Amazing. This will come in very handy in my future projects 😁❤

@promptmuse 4 ай бұрын

Awesome , would love to see your work when you are complete !

@IntrovertBliss 4 ай бұрын

love this! thank you

@Fraunzi 4 ай бұрын

Great tutorial, I’d love to see you animate a short 2 minute scene someday using all these tools. You are so talented.

@vuggish 4 ай бұрын

I cannot live without your Earnest Coati Eyes, teaching me how to do stuff. 🐼🥰

@aq-xe6oe 4 ай бұрын

Great video, like always!

@promptmuse 4 ай бұрын

Thanks for watching once again 🫶

@herladion 4 ай бұрын

I didn't know this kind of add-ons exist. I was doing it the primitive way! thank you so much for this very informative tutorial. ❤

@promptmuse 4 ай бұрын

It’s been around since last year, so kind of known, but not massively known. It’s nice we get a preview before launch in April 🙏

@heshjohans5331 2 ай бұрын

What a useful guide ..! Thank you ..!

@user-kx5hd6fx3t 4 ай бұрын

Thank you for your detailed explanation

@promptmuse 4 ай бұрын

You are more than welcome 🫶

@gadget-de 4 ай бұрын

Great tutorial thx!

@EdVizenor 4 ай бұрын

Excellent

@AlexPlayerDigital 4 ай бұрын

Aweome tutorial!

@character-creator 3 ай бұрын

I just wanted to say that your videos are awesome thank you so much for such great content love the accent

@kamikazeeOG 4 ай бұрын

I love all your videos.

@promptmuse 4 ай бұрын

Thank so much, that’s really kind ❤️

@CEODeliveryBoy 3 ай бұрын

Not only was this the ish I could listen to you talk all day :) TU

@MouthyProductions 4 ай бұрын

Hello, I really enjoyed the video & workflow shown but my only question is how we're you able to texture the rest of the body shown at 12:54. I'd appreciate any help or tips given, Thank you!

@jounalansman1769 3 ай бұрын

Amazing video. Got everything working except the hair library. I know you did another tut on it, but i think it would have been great to see how to install the things without having to go to find other tut. Keep up the good work! you are amazing :)

@CuBixxx86 4 ай бұрын

Great stuff

@promptmuse 4 ай бұрын

Thanks do much! Glad you enjoyed

@ECHSBACHS 4 ай бұрын

Cool!

@rodrigoreis7 4 ай бұрын

Thank you!

@gh0stpyram1d 4 ай бұрын

excellent!

@davidbell6101 4 ай бұрын

Bravo!!

@promptmuse 4 ай бұрын

Thankyou!

@JonahHache 4 ай бұрын

amaaazing

@Caveboy2011 4 ай бұрын

Great video! Will try this out for sure. What model iPhone will work I have an iPhone 8 Plus Thanks for the very good tutorial

@promptmuse 4 ай бұрын

Iphone 15. Any iOS device with a TrueDepth camera (iPhone X or higher) should work

@Creatixion-lt6qo 4 ай бұрын

Great info > Compact video editing

@promptmuse 4 ай бұрын

Thank you!

@pulasthithennakoon5389 Ай бұрын

Thanks

@ian2593 4 ай бұрын

What did you do to get the clothes and body texture? Thanks.

@fabersoul 4 ай бұрын

I tried the chat avatar and after using the credits, i got to "mine" and the status just says "packing". no option to download

@promptmuse 4 ай бұрын

You should be able to repack for free once you’ve paid if that one has failed. However if there are issues just go to their discord on the bottom of the chat avatar page and let them know cause they’ll fix it for you.

@fabersoul 4 ай бұрын

@@promptmuse cheers, thanks

@itsjxomusic 3 ай бұрын

AI Really is saving us so much time.... There is so many pros and cons, but I see so many pros. It really will take time off the overall development. There's even world map AI now :O

@RSProduxx 4 ай бұрын

Oh yes, Unreal version please :)

@EdVizenor 4 ай бұрын

Wow. You are amazing.🎉🎉🎉

@promptmuse 4 ай бұрын

Thanks Ed! Not amazing but just addicted to this life ha

@EdVizenor 4 ай бұрын

@promptmuse love it. Well I am entitled to my own humble opinion and you can't change my mind... so there! :P P.S. I sent you a message on insta.

@kallesamuelsson8052 4 ай бұрын

Omg, that more clicks then used during a starcraft2 gradmaster league match, but you sure explain it good! =)

@promptmuse 4 ай бұрын

Haha 🤣

@rosuckmedia Ай бұрын

Hi, PM you make really cool tutorials, thank you very much.👍👍👍👍 Best regards Robert

@promptmuse Ай бұрын

Thanks so much, Robert!! 🙏

@3RDEYELOVE 4 ай бұрын

what?? that looks good

@nothinhappened 4 ай бұрын

You are a godsend. Its criminal you dont have more subs, cos you are deffo putting out some of the best and most useful content in this area.

@promptmuse 4 ай бұрын

Thank you so much ❤️ That’s really kind

@IamSH1VA 4 ай бұрын

4:36 Is there any way to get like lower topography version? *to use in mobile app/ games, etc*

@promptmuse 4 ай бұрын

In it's current form no, there are lots of plugin to do this in blender but you will lose you blend shapes...but that's pretty each to recreate. hopefully in April there will be this option as many users have requested this. I'll pop it on their discord as a suggestion and see if it's built into the release timeline.

@Massinissa-AM3 4 ай бұрын

Hi Please I want to know how I could delete a model I created? And thank you very much

@SumNumber 4 ай бұрын

Interesting . Blender needs to address AI because AI is out doing all of the 3D programs . Krita image editing software has done this and it works great and , like AI itself , it is addicting . AI is such a threat to so many platforms . Art that has taken some years to complete can now be done in a single click . It is a mind bender. From my point of view AI is not our friend and will , eventually , take over everything . Thanks for the tips . :O)

@promptmuse 4 ай бұрын

It does feel like it’s a Trojan horse. The speed it’s going at, does not seem to be much regulations. Which on one hand promotes innovations, but not all have good intentions.

@wallacesousuke1433 4 ай бұрын

I for one fully welcome the massive advance in AI, I doubt it will truly replace all artists/creative jobs, and on the positive side, it will allow solo devs and artists/small teams to accomplish way more, since we will be able to allow AI to do most tasks, streamlining boring steps, create tons of assets and procedural stuff, and in the end, the artist can assemble them together into whatever they want, like, create an entire open world game or animation. I mean, if legions of cheap artists from third world countries haven't killed the industry, what makes you think AI will?

@binyaminbass 4 ай бұрын

Is it possible to use these shapekeys in iClone for acculips and the like?

@promptmuse 4 ай бұрын

Iclone and CC use slightly different shape keys. I’ll give it a go today and see if it works (but doubtful!) If you have headshot you can bring it in via that method as it will convert it to a CC character automatically with all their own blend shapes. However, I know that character are working on a plug-in for Iclone but unsure if that will create transferable lens shapes. It will be interesting if it does!

@deekay5487 4 ай бұрын

wow what a tutorial! Thanks so much for sharing your knowledge! i will spend some $ in the future...!

@ZimMabu_GameDev. 4 ай бұрын

thank you

@promptmuse 4 ай бұрын

You're welcome 🫶

@jroobertom 4 ай бұрын

muito bom !

@promptmuse 4 ай бұрын

Muito obrigado, com amor do Reino Unido

@oneeyedfox 4 ай бұрын

you are the best thank you sharing

@nickarthurnight1019 4 ай бұрын

Wow! Simpy Amazing! How did you get textures onto the body? And the dress? Thank you for sharing! Subscribed...

@promptmuse 4 ай бұрын

Just making a video about clothes for the character 🫡 Also body wise I just took the face texture map into photoshop and colour picked it and made a new body texture. I’ll probably do a quick video on this and link in the description 👍

@mkstudiop Ай бұрын

alem de ser muito linda mmaravilhos tambem é muito talentosa , parabens por seus tutoriais execentes

@AllenJonesabstractpaintings 4 ай бұрын

Very informative and entertaining can you use an android phone for this?

@FaithIgnitor 4 ай бұрын

Is it possible to export a character in a chosen pose for 3d printing?

@genepardy7884 Ай бұрын

Thanks for the great content. How much did it cost to make this?👍

@soa_so Ай бұрын

I have some problems with my eyes, when choosing a material, the whole eye is selected, and when transferring textures, the eyeball itself is crooked, I do not understand

3 ай бұрын

Accurig is absolutely phantastic. Better than all these "AI thingies".

@lord_gillespie 4 ай бұрын

Do you know if live link is available for android?

@setanbelangdedelduel 3 ай бұрын

Do you have any alternative for android to motion /face capture?

@kouroshpcsmgameng2269 28 күн бұрын

its very god tnx

@promptmuse 23 күн бұрын

Thank you so much for comment 👏

@stealth2951 4 ай бұрын

Great video, well done explaining everything. Honestly, glad this was so in depth.

@promptmuse 4 ай бұрын

Thank you 🫶

@Skycers 4 ай бұрын

Like Fuse, but with prompts!

@remonmichel2195 16 күн бұрын

do u have way to make that in MAC ?

@RosieBunny-wi9bf 24 күн бұрын

for some reason after transferring to the new rig, my eyes wont work they are still blurred and i dont know what to do

@princematthew 4 ай бұрын

I wonder what graphics card ur pc should have for this. I got a 3070 but getting a 4090 soon. Does RTX help or make it more realistic

@promptmuse 4 ай бұрын

Nice, to be honest nothing crazy is needed. I'm just running it all in blender. Have you looked the the 4080 Super? Might save some money if your looking for a new card but want to save some £££. RTX is great for 3D, I've just purchased a 4080 and loving it (Annoyingly got it before they annouced the 4080 super). NVidia's shares have gone crazy (up by 225% over the past year) as everyone is buying their cards for AI. Always been the go to for 3D in my opinion too.

@princematthew 4 ай бұрын

@@promptmuse I"ll start creating as soon as I get my 4090 as well will try the Unreal engine too. I want a 4090 because I play games .... Thanks for the content you make 👍

@promptmuse 4 ай бұрын

@@princematthew Awesome, getting a new PC is good times. Enjoy it when it arrives!

@buster5661 4 ай бұрын

@@promptmuse something better gets released after you buy it? Welcome to the graphics card game 😛

@vjcodec 4 ай бұрын

This is epic! These tools are the future of ai. Basically just plugins. ❤ thanks for the knowledge 🫶

@promptmuse 4 ай бұрын

THIS is why I love blenders open source policy :)

@milkglass1863 8 күн бұрын

I've got problems with the eyelashes, while i want to select -> metarial for eyelashes it selects the eyes and the eyelashes. How to fix that?

@kevinyang3298 4 ай бұрын

when I install mesh data transfer into blender, it pops up an error saying "ModuleNotFoundError: No module named 'mesh-data-transfer-2'", any help?

@promptmuse 4 ай бұрын

Hey! Which version of blender are you installing it to (I’m on the latest version) 4.0.2 off the top of my head. May be a version issue? Just checking are you installing as a zip? Needs to be a zipped files. Preference>addon>install the zip.

@promptmuse 4 ай бұрын

Also if none of the above was an issue I’d redownload from the gumroad page in case the file was corrupted during downloading

@davy4842 4 ай бұрын

Can you make some sort of half stylized hair for metahuman?

@kevinlopez-vo3wv 4 ай бұрын

mi muse

@lubospejchal498 12 күн бұрын

Is there variation of LiveLink for android ?

@binyaminbass 4 ай бұрын

Good to mention that only the Dream Face style offers body, and blend shapes

@promptmuse 4 ай бұрын

Will pin this 🙏 hopefully they are the bodies out for the other models very soon. I did find with the dream face, I could get a stylized version by prompting anime etc. I had to go in manually fix the eyes blend shapes in blender though, as they were slightly terrifying 🤣🤣🤣🤣

@themightyflog 4 ай бұрын

What if I change out the body they provide? Will it still work the same way?

@promptmuse 4 ай бұрын

You would have to redo the blend shapes for the face but that does take too long to adjust. If the vertex order changes the blend shapes will stop working. 👍

@themightyflog 4 ай бұрын

so as long as I keep the face the same I can transfer over the facial blendshapes? Basically want to change the body out and adjust then use accurig to rig it like you did. but with a different body. @@promptmuse

@DannyOnateArt 4 ай бұрын

Great video. You are so beautifull and inteligent 🫶🏻 Cheers from Ecuador 🇪🇨

@CEODeliveryBoy 3 ай бұрын

idk if anyone else had this problem but every time i got to transferring the mesh it would transfer them all fd up. took days for me (newbie) to figure out but I had to transfer them manually by selecting a material on og, drop down arrow n hit copy then go to accurig select corresponding material and then dropdown arrow paste. repeat. i did all the eyelashes on og rig to the one spot on accurig.

@sanaaijohnson Ай бұрын

This literally saved me! My eyes were messed up too and I couldn’t figure it out! Thank you!!

@CEODeliveryBoy Ай бұрын

@sanaaijohnson for sure! I knew if anyone else had gone thru what I did, and are like me, would've gone 3 more days until you finally cried ur eyes out and gave up. So I wanted to try n help someone 😆 glad u understood what I was trying to say. Could've just said copy n paste all separately between rigs, even eyelashes. I don't actually know if only doing one of the eyelashes works for all but I wasn't gonna chance it

@sanaaijohnson Ай бұрын

@@CEODeliveryBoy omg I copy and pasted all 12 eyelashes too lmao

@marcelocosta2612 4 ай бұрын

What do you think about Meshy AI?

@user-on6uf6om7s 4 ай бұрын

Not sure what I'm doing wrong or if you have access to different features but I didn't get any options for bodies, rigging or blend shapes, just 4k or 8k textures and then "Pay" which uses your credits. I don't even really need the body or rig (blend shapes would be nice) but it also comes in with most of the head being white like in the review which isn't great. Edit: I figured it out, only V2 produces anything other than the bust with the face texture. Wish I would have known that ahead of time so you might want to add that info somewhere.

@promptmuse 4 ай бұрын

Currently (as it keeps changing day by day) you can only get those features with the Hero model V2. But I’m assuming they will roll it out to the other models by or before April ! Oh just read you edit as I write this 🤣 yes I’ll had it in the description or try and add text to the video 🙏

@user-on6uf6om7s 4 ай бұрын

@@promptmuse Hopefully they do as the more stylized models do open up your options a lot. I just took a deep breath and bought the $120 commercial package which feels weird for a AI tool but you couldn't get a single head commissioned at this quality with all of the maps for $120. I guess there's Metahuman but there are all sorts of issues using those outside of Unreal.

@promptmuse 4 ай бұрын

@@user-on6uf6om7s metahuman is great but simply adjusting the mesh is a bit long winded. I have to use maya and quite a pricey add on. Also the licensing seems very flexible with chat avatar. The body textures are on their list as well. For now I just use the Uvw map they supply as it’s all unwrapped and make my own in photoshop. I’m excited to see what other features they bring. They are also very active on Discord and if you have any suggestions they take them on board because I’ve been suggesting stuff 🤣

@Riker20 4 ай бұрын

aaaaaaaaaah quicker than a quicky

@avnikadubey8979 4 ай бұрын

Hi Prompt Muse, Can you make a Video on using Metahuman with real world footage as composite background footage for metahuman animation. Also, Adding Jewellery and Clothes to Metahuman. Thanks in Advance. ❤❤❤❤

@promptmuse 4 ай бұрын

That would be great just making a quick clothes ❤️*4

@joskun 4 ай бұрын

You, Olivio and Matt wolf are my favorite Ai youtubers. Absolutely love your passion for art, ai and technology :)

@promptmuse 4 ай бұрын

Aww thankyou, that means a lot. I know them both,and they are very passionate and driven and know their stuff 🔥

@Echoesofpositivity2 Ай бұрын

Does LIve link work on android?

@citygxd9443 4 ай бұрын

Ok now im scared lol everything i spent so many years learning .. time to adapt😅

@promptmuse 4 ай бұрын

I totally get it I spent many years learning 3-D and art like many others here. I get the worry from people, it is moving very fast.

@Lisalopezze 4 ай бұрын

Do you take in clients?

@promptmuse 4 ай бұрын

Sometimes I do, I have insta if you want to message there :)

@edoard3 4 ай бұрын

I have an issue when i try to copy the materials. In fact the eyelashes model explodes after accu rig. Great content keep it up!

@promptmuse 4 ай бұрын

Hey did you find a resove at all? Just check in Accurig when you are placing the face joint that it’s on the mouth of the character as that will determine the eye joint positioning. Also that output is Blender(I’m sure you did that). Perhaps also try and select your character before exporting to accurig and Alt+ A > all transforms then export selected mesh to fix once again and run it through 👍 good luck

@edoard3 4 ай бұрын

@@promptmuse Thank you so much for replying, but unfortunately it's not working :(

@omegablast2002 4 ай бұрын

my character didnt have his beard, and eyebrows were just painted on is that normal?

@promptmuse 4 ай бұрын

Yeap, it doesn’t currently create hair. Developers say they will add this in at some point. I use Hair tools (blender market) Has beards and eyebrows etc but there is a bit of a learning curve 👍

@ThegreatHera420 4 ай бұрын

Doing faces is honestly not that hard and you might more intentional and good decisions that way, but it seems it’ll be so good for background characters

@joelankamah4633 4 ай бұрын

Did you make the body skin yourself

@promptmuse 4 ай бұрын

Yeap I just slapped a colour png from photoshop 🤣 colour picked from the face texture. I did speak to them. They will be adding a body texture hopefully soon to the program. 🤞

@christophe2582 3 ай бұрын

just a question, did you write Robert di Niro on purpose, to avoid censor? because his name is "Robert de Niro", maybe the reason why you didn't have a "perfect" portrait of the actor

@shrayrathore7011 4 ай бұрын

upload the hair part soon

@n0ahg1 4 ай бұрын

Take care

@promptmuse 4 ай бұрын

Thank you, you too !

@JuzoSan-pf1ep 4 ай бұрын

Please you didn't explain how you added cloth and the skin color

@promptmuse 4 ай бұрын

I will be doing this is the next tutorials 👍

@omega3productions-bj555 Ай бұрын

@@promptmuse Where is that

@woolfwoolf-so2jl Ай бұрын

top

@promptmuse Ай бұрын

Thank you Woolf 🐺

@Hunty. 2 ай бұрын

whenever I try to use this site it just doesn't even let me download the face I make, is there something wrong with it? is it a scam? Not your video, but the site that is.

@betz3000 4 ай бұрын

I love the fact that you use bing and search google😂😂

@albiceleste101 4 ай бұрын

They will directly compete with Tafi

@promptmuse 4 ай бұрын

Daz is working on something as well. I imagine there will be a bit for a space race.

@buster5661 4 ай бұрын

The website is either slow or doesn't work 😔

@promptmuse 4 ай бұрын

It does work, however they are continuously developing it as it’s still technically in development and test. So when they update stuff it can crash/ slow. The launch date for release when everything is ironed out is April this year 🙏 try it again tomorrow it should hopefully be fine 👍 they are also very responsive on Discord as well so will let you know if they’re having issues on the site.

@buster5661 4 ай бұрын

@@promptmuse oh ok thank you. The whole website just went black after logging in

@jakepablojakepablomedia7593 4 ай бұрын

Blend shapes are completely not working at all and i followed all steps correctly. The mesh stretches crazy

@promptmuse 4 ай бұрын

Just check that your models align exactly on top of each other. Otherwise the vertex order gets messed up (produces crazy results).

@jakepablojakepablomedia7593 4 ай бұрын

@@promptmuse still not working after importing the fbx. what step do i need to make sure the models align on? specifically, the mouth opening gives some weird stretching thing where the lips are attached. the eyes also get distorted in shape and the teeth material dont transfer