ComfyUI LORA training workflow

Рет қаралды 6,093

2 ай бұрын

Comfy-UI Workflow for training LO
This workflow allows you to train a model on a certain style or on a certain object. which makes it possible to show consistent results
#comfyui #stablediffusion #ipadapter #mask #Relighting
follow me @ / pixeleasel
Mix Any Style - video and workflow
• ComfyUI Any Style comb...
workflow
drive.google.com/file/d/12yos...
Image-Captioning-in-ComfyUI
github.com/LarryJane491/Image...
Lora-Training-in-Comfy
github.com/LarryJane491/Lora-...
ComfyUI-WD14-Tagger
github.com/pythongosssss/Comf...

Пікірлер: 49

@thatguy9528 Ай бұрын

Nice that you can explain that in 5 min while every other KZfaqr babbles on and on.

@antoinedon9160 27 күн бұрын

yeah they try to milk their 30 fucking minutes. fuck that. this guy is a genius

@lefourbe5596 2 ай бұрын

FINALY A LOAR training ❤in comfyUi ! lov it ;)

@DJVARAO 2 ай бұрын

Thanks! 😁

@ramirocoloma8096 9 күн бұрын

I love your model! have you made it available for us? i would love to make a short film with it! 🙏🙏🙏

@typogram4297 2 ай бұрын

I waited for this tutorial for a long time. Thank you 🙏. Can I train embeddings in the same way? If not can you please make tutorial for train embedding in comfyui?

@PixelEasel Ай бұрын

thanks!, i'll make one on embedding

@ismgroov4094 2 ай бұрын

nice sir, resect you.

@Lastnamefirstname289 2 ай бұрын

Can you show me the background change for portrait? Not product. It’s a bit hard for me to imply nice light and shadow

@PixelEasel 2 ай бұрын

i'm not sure what do you mean

@Lastnamefirstname289 2 ай бұрын

@@PixelEasel Can you change the background of a portrait photo for me? Not for a product. When I do it, the shadows and lighting look awkward.

@ZedZero-z7e 15 күн бұрын

Great write-up, but something broke since you posted it. I keep getting the following on a fresh install of ComfyUI and all the nodes you suggested. Error appears in training, labelling works just fine: ModuleNotFoundError: No module named 'accelerate'

@PixelEasel 13 күн бұрын

not sure why, but pay attention to the folder name and the path of the folder

@yavuzselimarslan2961 Ай бұрын

I installed it and comfyui doesn't work anymore,

@PixelEasel 27 күн бұрын

did u try to update?

@trsd8640 14 күн бұрын

Same here. This workflow wrecked my ComfiUI installation.

@madmed6672 2 ай бұрын

hey guys, i'd appreciate some help, i've repeated the steps, been able to caption etc, but when i queue the training, it executes very fast and i'm not able to find the lora file in the loras directory, even tho i specified it, any assistance is much appreciated!

@PixelEasel Ай бұрын

Hi, this usually happens, the folder path is not set correctly, note that in the training node you need to set the folder that contains the data set folder

@MatthewHardyMusical Ай бұрын

I selected the folder that contains the data set folder and still have the same issue. It runs in seconds and doesn’t produce a LoRA file.

@fotszyrzk79 17 күн бұрын

@@MatthewHardyMusical I have the same problem. did you solve it?

@MatthewHardyMusical 17 күн бұрын

@@fotszyrzk79 I was able to use Comfy to caption my photos but I couldn't get it to make the LoRA. Kohya doesn't work on my Mac so I tried Draw Things to create my LoRA but I'm not happy with the results.

@fotszyrzk79 17 күн бұрын

@@MatthewHardyMusical Thanks, it is sad :(. For me it's been two full day struggle with this to work... I think I'll pass and check Kohya instead.

@Wreck_Crimes Ай бұрын

Lora Doesn't appear and train

@MatiasRabaglia Ай бұрын

Can this work as product placement using the same data training ?

@PixelEasel Ай бұрын

yep

@TheStoryteller-xyz Ай бұрын

it doesn't work, i got this error: cannot access local variable 'image1' where it is not associated with a value

@MaghrabyANO Ай бұрын

Same here, any solution?

@MaghrabyANO Ай бұрын

I figured it out bro, you need only PNG format, you cant use JPEG or any other format, a 3 letter image format, preferably png.

@TheStoryteller-xyz Ай бұрын

@@MaghrabyANO thx a lot bro, now i have many other errors XD, gonna give up lora training on comfy

@MaghrabyANO Ай бұрын

@@TheStoryteller-xyz same :D tell me what error maybe i can help

@TheStoryteller-xyz Ай бұрын

@@MaghrabyANO raise RuntimeError('Error(s) in loading state_dict for {}: \t{}'.format( RuntimeError: Error(s) in loading state_dict for CLIPTextModel: Unexpected key(s) in state_dict: "text_model.embeddings.position_ids".

@kobiverbrater6061 Ай бұрын

got the error "Error occurred when executing LoRA Caption Load". Any solutions?

@PixelEasel Ай бұрын

the most important thing, is the folder path, and the name of the data folder, check it again

@dennischo2140 2 ай бұрын

Hey~ Spelling mistake on the subject title~

@PixelEasel 2 ай бұрын

thx!

@mr.entezaee Ай бұрын

ModuleNotFoundError: No module named 'transformers.modeling_outputs'

@PixelEasel 27 күн бұрын

Ensure you have the transformers library installed and updated to the latest version. You can do this by running: pip install --upgrade transformers

@mr.entezaee 27 күн бұрын

@@PixelEasel ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. datasets 2.13.1 requires dill=0.3.0, which is not installed. yolov5 7.0.13 requires seaborn>=0.11.0, which is not installed. optimum 1.18.0 requires transformers[sentencepiece]=4.26.0, but you have transformers 4.42.3 which is incompatible.

@SedidNewEnvironment 10 күн бұрын

I have this error: Lora-Training-in-Comfy/sd-scripts/train_network.py The following values were not passed to `accelerate launch` and had defaults used instead: `--num_processes` was set to a value of `1` `--num_machines` was set to a value of `1` `--mixed_precision` was set to a value of `'no'` `--dynamo_backend` was set to a value of `'no'`

@MaghrabyANO Ай бұрын

I got an error saying: Error occurred when executing LoRA Caption Save: list index out of range on the LoRA Caption Save node, any help? @pixeleasel

@PixelEasel Ай бұрын

You have to pay close attention to the path of the folder, and the name given to the folder, it should be in this format 1_name

@DDBM2023 2 ай бұрын

I got error message like this: The following values were not passed to `accelerate launch` and had defaults used instead: `--num_processes` was set to a value of `1` `--num_machines` was set to a value of `1` `--dynamo_backend` was set to a value of `'no'` To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`. E:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\diffusers\utils\outputs.py:63: UserWarning: torch.utils._pytree._register_pytree_node is deprecated. Please use torch.utils._pytree.register_pytree_node instead. torch.utils._pytree._register_pytree_node( Do you know how to fix? Thank you!

@PixelEasel Ай бұрын

nop, ill try to search for an answer

@---Nikita-- 24 күн бұрын

@@PixelEasel same here. Any news?