Create Consistent, Editable AI Characters & Backgrounds for your Projects! (ComfyUI Tutorial)

Рет қаралды 58,020

Күн бұрын

I'll show you how to use ComfyUI to create consistent characters, pose them, automatically integrate them into AI-generated backgrounds and even control their emotions with simple prompts.
If you like my work, please consider supporting me on Patreon: / mickmumpitz
Follow me on Twitter: / mickmumpitz
I developed this ComfyUI workflow in preparation for one of the next AI 3D rendering workflows, in which we will look at animating characters. But you can also use this workflow for many other exciting things: to create children's books, AI movies or one of these AI influencers everyone keeps talking about!
You can download the FREE workflows here: www.patreon.com/posts/new-vid...
Chapters:
00:00 Intro
01:09 Character Sheet
04:49 Loras & Midjourney
05:48 Controllable Characters
10:42 Outro

Пікірлер: 202

@BobDoyleMedia Ай бұрын

Outstanding! Thanks for sharing these workflows so generously!

@xnovamix Ай бұрын

This was an amazing tutorial. Thank you!

@Srcfrvr 23 күн бұрын

This is amazing. Thanks for everything, brother.

@dennisliebelt3951 Ай бұрын

Hey thanks for your great content. Always enjoy your videos !

@beker-aman Ай бұрын

i dont even remember liking this video, this is mind blowing.

@IsiOmoifoJr Ай бұрын

Great tutorial. Thanks!

@laemon300 14 күн бұрын

bro, you a lifesaver!

@vrynstudios Ай бұрын

Genius work.

@unterwegschloe1017 3 күн бұрын

Incredible! Thanks for your work~

@tstudying5319 Ай бұрын

that is really cool and helpful!!

@user-zl8yq7jt9f 11 күн бұрын

Excellent video, congrats and ty

@farcfoxguerrilha Ай бұрын

Very good! Thank you!

@larziz573 18 күн бұрын

great work !

@SahiShah-ru3ib Ай бұрын

Great work bro that's what i want thinking of creating model for character

@ivanprokounin4029 Ай бұрын

Dude! God bless your curious mind and a generous heart!

@KapitanAI. Ай бұрын

some good stuff right here

@sake4941 Ай бұрын

Very interesting. Not only about workflow but your quick explanations are very great and valuable. Thank you a lot for that !

@user-lr4to2lr9r 8 күн бұрын

真是个相当棒的创意工作流😁

@maureenbenner7588 Ай бұрын

This workflow worked great for me! thx

@endedbrand2324 28 күн бұрын

how did you get the workflow he imported into ComfyUI?

@clementfrerebeau5458 13 күн бұрын

@@endedbrand2324 it's Mickmumpitz_CharacterSheet_v01.json

@alpaykasal2902 24 күн бұрын

you're so frikkin' awesome.

@johannezz 7 күн бұрын

Excellent!

@amostarca9758 19 сағат бұрын

Subscribed! I hope you live happily forever and ever after

@pn4960 Ай бұрын

The ultimate goal

@hugodom 14 күн бұрын

Great video and finally a useful tutorial…

@mottentotten Ай бұрын

Definitely gonna try this! Thanks! 🧀

@Mrim86 Ай бұрын

Man, I wish I wasn't so intimidated by that UI. This looks really incredible.

@DaCashRap Ай бұрын

Just go ahead and give it a shot. It's not complicated at all once you try it

@davidpenn4024 Ай бұрын

Checkout Olivio's Comfy Academy and you can go from 0-competent

@A5h3n. Ай бұрын

Yeah try it out. I've only made 2 workflows myself, it is pretty hard, but the workflows the community give out help understand more.

@digitus78 Ай бұрын

Just try it. Download some pre-made workflows and play with the settings. Won't even touch another webui now. None are as versatile not even close

@laurosf Ай бұрын

Try it! This is my first day exploring and it's actually very intuitive once you start to understand how things work

@yorkane123 Ай бұрын

greate video!

@FabioAngela Ай бұрын

very interesting!

@Bloodysugar 19 күн бұрын

Oh boy this is an amazing workflow ! Thank you so much for sharing !

@davidpenn4024 Ай бұрын

Top Tier!

@oneshotonepic8319 14 күн бұрын

Amazing

@DiogoVKersting 5 күн бұрын

very nice

@legshots3124 Ай бұрын

always doing something unique and helpful content

@amkire65 Ай бұрын

Fantastic, this is the sort of thing I've been after for a while. I suppose when it comes to the consistency of the clothing the simpler the costume the better?

@ismgroov4094 Ай бұрын

thanks a lot

@magicmaxx6346 16 күн бұрын

Awesome

@ZooDinghy Ай бұрын

Jesus Christ! This is awesome! 🎉

@cihatfg Ай бұрын

perfect : o

@o3ulag 14 күн бұрын

Beautiful

@Cevherbenn 26 күн бұрын

Teşekkürler.

@snick9314 Ай бұрын

incredible tech, scary how few real artists the industry will probably have in 5 years time. Overall depreciation of quality and interesting character design over time in the interest of turning the cog wheels of consumption content out as fast as possible. 10% will use this for good the rest of it will be used to save money and time in an area where money and more importantly time should be spent on this subject. Awesome tech, horrifying corporate application.

@armaxkovalenko1230 21 күн бұрын

Man, you are simply God! A year ago I tried to do the same thing in A1111, and it didn’t work. What you created is a masterpiece. Thank you!

@torq21 Ай бұрын

I just watched the image to 3d model video. I don't see why you couldn't generate multiple views using this method and then generate a more complete 3d model from the output. It would be more like photogrammetry.

@Ancient_AI 22 күн бұрын

Thank you! I've been trying to figure out a good workflow for this for some time now. Well done.

@FabioAngela Ай бұрын

I'd find interesting digging more into the LORA, explaining how to use the saved faces to train lora.

@WeekendDive Ай бұрын

Absolutely fascinating video. So let's say I generate 2 keyframes, one where Hans grabs the cheese, and a second where he is holding the cheese over his head triumphantly. Is there a way within comfy to generate the 12 or so frames inbetween, creating a custom animation out of our custom poses?

@user-bj5cp8qy2p Ай бұрын

The best consistent character workflow so far. How about saving separate workflow between sdxl and sd1.5 for easier use?

@vrynstudios Ай бұрын

Please write a book or make a UDEMY tutorial. I will join. You know what you do and perfectly. Love the work. Thank you,

@niaschimnoski882 Ай бұрын

I'm commenting so I remember to watch this soon once I have more stamina charged up (just woke up) (been chronically sleepy and cranky for the past like 7 or 8 months 😢)

@lefourbe5596 Ай бұрын

Why is that also me X) ?

@SudarshanAshiya Ай бұрын

Wow

@juxxcreative 22 күн бұрын

This is very cool. Can you do also this for a very realistic person, please?

@SolveForX Ай бұрын

We really need to have different camera angles, though. The character consistency is great, but we need to be able to take this same premise and be able to, like, take a picture or a rendering of a 3D model and get the angle on the consistent character.

@naturalborngamer169 Ай бұрын

I'm not quite there yet...Thx for the vid

@user-sh7sl7ys7b 14 күн бұрын

Which hardware are you actually using to create those awesome images and videos?

@marcos13vinicius11 20 күн бұрын

that's awesome! I've just finished a personal project which this would have been so helpful and I wouldn't have to generate literaly thousands images and compose everithing with photoshop and hour and hours of inpaint and outpaint. I'm looking foward to use it in a new project. Could you show us now how to make it with multiple characters?

@chiselpeakstudios2593 Ай бұрын

This is amazing! I keep getting an error that says "clip Vision" model not installed.

@JussimirPasold 10 күн бұрын

Hope midjourney releases a pose reference feature with openpose support soon

@shixiongsong Ай бұрын

May I ask what posture editing software you are using, as well as the software for generating hand depth maps

@JoyDavidson Ай бұрын

I just can't believe this is real life.

@reza2kn 11 күн бұрын

@02:29 "I'm really happy that it's THIS type of moustache!" BRUH!💀🤣 Awesome tutorial and channel btw❤

@whadoyaneed 12 күн бұрын

Great tutorial. finally someone, who explained the whole procedure, how to turn the character sheet to actual images. The main problem is still with the background, which is always blurry with AI generated images, makes them unrealistic. If you check real photos, the backgrounds mostly as sharp as the subject, even if you look for photos like ... climber in the mountains or whatever. So there is any way to maintain the sharpness of the background?

@MyBearo 15 күн бұрын

Hi where can I get the IpAdaptorunified loader node and also the IPAdaptor (also missing in manager) ? Thanks in advance :)

@dannylammy Ай бұрын

Very interesting, how does this do when you combine it in conjunction with your previous videos with control net? IIRC there were programs like Stable Projectorz, so wouldn't it be possible to get nearly perfectly consistent characters by projecting character sheets like these onto 3d models? Hmmm...

@USBEN. Ай бұрын

Automation is soo fun!

@leandrogoethals6599 Ай бұрын

Mick how did u display the stats in comfyui is that a extension? U know like the vram and such

@Jimwatl 8 күн бұрын

Hello, thank you for sharing your work. Is it possible to create a Model Sheets from a reference character image ??? and if so, what node would you add? In short, how would you proceed?

@needsomenice 14 күн бұрын

Super tutorial, thanks. I have a question, with you in comfyui the photos look super zero distortion, ugly eyes, face or hands. With me, on the other hand, it is always in ComfyUi. What do you do to make everything look this good?

@zhaoyongDin 26 күн бұрын

Killing it with Midjourney! But if you're ready to take things up a notch, Stylar's your go-to. It's like a design powerhouse, especially for interior, 3D, and character work!

@endedbrand2324 28 күн бұрын

I got everything, but I don't understand where I can find your Workflow (template), please help!

@moritzryser 23 күн бұрын

do u think the character creation could be enhance by integrating IPAdapter on top of checkpoint and lora?

@user-wy4uf3jx4f 28 күн бұрын

I would like to input an Image instead of the Positive and Negative prompts connected to the Apply ControlNet (Advanced) node. How can I achieve this? The intention is to create an Image -> CharacterSheet, rather than a Text -> CharacterSheet. I would like to use my favorite character, but I'm tired of having to create new characters all the time. I am using the workflow effectively! Thank you.

@futanari-eo5np Ай бұрын

Any help so I get add nodes to get a consistent background with your workflow ?

@Mind_ConTroll Ай бұрын

Can we add an image prompt instead of a text prompt to use a character we already have? I know it's prolly easy, but I'm new to comfyui.

@BobDoyleMedia Ай бұрын

Your "IPAdapter" node is different than the "Load IPAdapter" node by your expressions. I'm getting an error in my "Load Adapter" mode, and there are no models in the dropdown list there, although I have all IPAdapter models loaded.

@juxxcreative 20 күн бұрын

Same here. I have tried to download whole model but no luck. Still getting the same error.

@ernienosoul 8 күн бұрын

@@juxxcreative did you solve that? same error

@juxxcreative 8 күн бұрын

@@ernienosoul unfortunately no

@ernienosoul 8 күн бұрын

@@juxxcreative @sam5519 hace 1 día For people facing "IPAdapter model not found." and using ComfyUI from StabilityMatrix. ComfyUI Manager downloads model to StabilityMatrix\Packages\ComfyUI\models\ipadapter, but workflow trying to load model from StabilityMatrix\Models\IpAdapter. What you need to do is copying all models to StabilityMatrix\Models\IpAdapter

@ernienosoul 8 күн бұрын

it worked for me :)

@offmybach 26 күн бұрын

Can this wf be altered to begin with an existing image that you've created instead of text?

@MrWiki_ 16 күн бұрын

amazing vid, i have one little issue, where do i get and put the upscale model at? it seems i am missing this ? edit: nvm i seen the file name so i just google it and found the upscale model and everything runs good.

@PixilGraphics 22 күн бұрын

Thanks you so much, can i download the character as FBX file?

@Liqwalker123 23 күн бұрын

So we can create these sheet and then use a image2image faceswap right? im looking for faceswap, same clothes, different poses workflows ^^ need consisten characters, as an exapmple for an comic book

@AcquiredCents 2 күн бұрын

You look way better with the haircut btw. I'm looking for an editor with skills like that, I get some of it.. but stuff like mouths moving gets incredibly difficult for me. I'm behind the curve.. I can edit videos, I can't do characters well.

@eddiej.l.christian6754 Ай бұрын

Clip vision model not found error What am I missing?

@chiselpeakstudios2593 Ай бұрын

same here

@chccreative Ай бұрын

same

@kordou 21 күн бұрын

Thanks fo this greate tutorial!!! in the second workdlow theese two nodes, CannyEdgePreprocessor DepthAnythingPreprocessor because the ComfyUI Nodes for Inference.Core conficts with lots of elements. trie to install manually alnso bu still nothing. any solution so that we can follow ?

@CaptainSnackbar 21 күн бұрын

as an artist i have to admit this is impressive and if this helps me create stories so be it. i'll still do art but this will speed up the pipline

@joedoe6737 27 күн бұрын

Im having an error on the second workflow, on the first Ksampler : Error occurred when executing KSampler: Expected query, key, and value to have the same dtype, but got query.dtype: struct c10::Half key.dtype: float and value.dtype: float instead. (And gibberish after that...) I don't know what to change...

@phi1s0n Ай бұрын

Anyone having issues loading IPAdapterUnifiedLoader node in the workflow?

@chiselpeakstudios2593 Ай бұрын

Same here!

@phi1s0n Ай бұрын

@@chiselpeakstudios2593 the ipadapter custom node has been updated, the model paths changed and you might need to update comfy.

@FuadOrko 28 күн бұрын

same @Mickmumpitz Error occurred when executing IPAdapterUnifiedLoader: IPAdapter model not found. File "S:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "S:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "S:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "S:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 515, in load_models raise Exception("IPAdapter model not found.")

@myytjourney 7 күн бұрын

Did you able to fix? I am also getting same error- "Error occurred when executing IPAdapterUnifiedLoader: IPAdapter model not found." I cloned entire IP Adapter repository in mentioned folder. Is this wrong?

@itsthejdquest 18 күн бұрын

Super complicated for someone with no coding or IT experience. Could not figure out how to run the manager as there is no run feature after getting it from github. After seeing the rest of the instructions, I know now I do not have the level of proficiency to do this tutorial. Any resources for learning this kind of thing?

@bluebearh3 4 күн бұрын

❤🎉

@pn4960 Ай бұрын

Nice haircut btw

@hvsciverius 21 күн бұрын

I am no longer wanted to learn AI, I just want cheese!!

@eddiej.l.christian6754 Ай бұрын

Where do I get the Upscale model that's missing in the first workflow?

@stockiom 20 күн бұрын

me 2 , have you found it ?

@yanamorim5747 Ай бұрын

looking for a workflow not for generating a scene but to add more detail to a 3D render

@xueqinghuang5021 8 күн бұрын

where to get the "perfect hand v2" lora, thx

@alejandrogarcia9472 12 күн бұрын

Thanks for your amazing tutorial. I've followed all the steps, and I still don't know why, when I start the process, all I get are black images. Can someone help me, please?

@gastonm 13 күн бұрын

Can you create this from an image? i mean if you allready have a character.

@dariodol 11 күн бұрын

can you load a character from an image? thanks

@EinMann123 3 күн бұрын

wie änder ich den input prompt zu img to img von einem bereits vorhandenen charakter?

@DeanCassady Ай бұрын

what happen to your vRam 2:38

@-Belshazzar- Ай бұрын

Thank you! Great video. Though I must say, sdxl openpose is very lacking, completely off and not accurate. No matter what you do, it's no where near as accurate as 1.5 which is my main issue with sdxl and why I am a bit fed up with stable diffusion in general

@n3bie 28 күн бұрын

Hey I got these workflows installed in comfy and everything looks great, but I have one little holdup. Where do I get the 4 image files that you're using in the 2nd workflow (the posable character flow) that are briefly showing @6:16? You have them as Face_upscale_00019_.png, Face_upscale_00053_(3).png, pose_2024_04_15_19_23_png, and depth_2024_04_15_19_23_30(11)png, but when you download the workflows it shows them as FaceRefine_00087_(1).pgn, FaceRefine_00059_(3).png, Pose_2024_04_26_16_31_12.png, and depth_2024_04_26_16_31_12(1)png. I've searched for these filenames on the web and can't seem to find them on Get or Huggyface. Not sure where to go from here :/

@vibeshkarayil 11 күн бұрын

Hi, thanks for putting together this video. As a creator myself I truly appreciate all your efforts. Positively i manage to generate charachter using the first workflow, but got stuck when i got error "Error occurred when executing IPAdapterUnifiedLoader: ClipVision model not found." Similarly when i went to compositing I have the same error. Any pointers on what i could be doing wrong? I downloaded ip adapter models and clip vision models (but renamed them to clip vision 1 and clipvision 2 ) because the instructions was not clear. Could that be the problem?

@vibeshkarayil 10 күн бұрын

Ok it was actually my bad. I installed ipadapterplus nodes from the comfyui interface which solved the issue! Once again, this is the best tutorial on comfy UI consistent character!