You've made my day, no more waiting 30 mins on my potato pc for a generation. Thank you so much

As others have mentioned, not using this LCM at full strength helps if you are having issues with messy/distorted images. I'm getting pretty good results with setting the LCM at 0.5 with 16 steps. Still really fast, but with better looking generations. Also, I recommend trying this if you are having issues with the LCM while using models and lora's that are trained on a particular subject.

it actually works very well, to create small samples then upscale them img2img, even SDXL is quick.

Sometimes you give us quite the gems from the industry. Your research and sharing the knowledge is highly appreciated.

Sebastian, I really like your videos and your simple way of explaining things. Could you create a tutorial or recommend a video for Stable Diffusion or CmofyUI on how to insert an object that has been generated into other scenes? Generate the same element in different scenes? For example, I generated the design of a new bottle and then, the prompt gave me a perfect result, after which I want to create an image of this same bottle in a scene with different angles or different poses (like a new photo of someone holding the bottle of juice, for example) It would be very interesting to have this type of video.

Tip for experimentation: use it like a regular lora and play with the weight. Some custom models that give horrible colors at 1, will actually work better at 0.7.

I am also using an RTX4090 setup and i gotta say that i dont see much of a speed difference, however finding out about the comparison capabilities made it so much better to choose what model to use based on what i wanted to create. thank you for the info

Duuuude, ive been using the sdxl one for a few days and it is a gamechanger, didnt know there was one for 1.5, awesome!

I made the same grid as in the video with 8 sampling steps for 2 cases: 1) with this LoRA and 2) withOUT it / None. The time to generate is basically the same (actually without this LoRA is 10 seconds faster) => so the speed depends on the sampling steps rather than LoRA. While quality => depends on the sampler but there are some VERY good effects without this LoRA at all for the same sampling steps. I can't see much difference in either speed or quality if the right sampler is used.

I am a big fan of you. Thanks for sharing knowledge in easy to follow language while everything is explained within the details not like other radio just repeating information that sometimes is not fully useful. Your stuff is good. Got my like and sub and a long time follower. I am one of you as AI researcher. Thanks very much.

My not so "ptato PC" and my impatience thank you very much, I am your fan. I already passed the information on to my brother, I'm sure he will be happy too.

JUst started a week ago and ive been loving it. Sweitching to comfy

This helped a lot, i dont want to wait 1 hour to generate one image 😅

fuck das ist das beste SD Video dieses Jahr, ich kannst nicht fassen, wie schnell man jetzt damit arbeiten kann! Nvidia kann ihre TensorRT extention in die Tonne hauen!

I've tried this with my ancient gpu gtx 970😂, generating 512x768, cfg 7, 30 steps image usually takes 42 seconds. With LCM it takes only 7 seconds, the result is comparatively good 👍

I found out the picture quality is worse ONLY when applied to custom SDXL models, when applied to SDXL vanilla, or SDXL SSD-1B, it's somewhat par in quality yet SUPER FAST!!! (Tested on ComfyUI, LCM SSD1-B, LCM Sampler, 8 Steps).

Update: I wasn't able to get it to work, then found a post on Reddit which suggested deleting the "cache.json" file in the webui directory. I renamed mine to cache2.json (just in case) and sure enough the Lora tab was showing ssd-1b in it and noticed speed improvements. Must be a bug of some sort as the cache.json file showed up again and everything seems to be working

Dunno if it's bc I'm on AMD windows system and on the DirectML branch of A1111, but it doesn't seem like I have any improvement in speeds with this LoRA and even with reduced weight to 0.5 still seems like all it does is reduce generation quality. Oh well. Thanks for sharing Seb, still love your content! Edit: Finally got it to work, my generations went from 38 sec/image with hires fix and ADetailer inpainting all the way down to 12 sec/image... Only downside is that the quality is worse than I'd prefer, most likely due to the requirement of low cfg scale basically ignoring negative prompts and embeddings

LCM's are what we call Rice Crispy Treats in Australia. Used to love when Mum put them in my lunch box for school 🤣

FYI: install the animatediff extension in A1111, this will automatically install the LCM sampler.

Doesn't work

This is amazing!!! Thanks!

Thanks for the mega grid comparison - most of the comparisons so far are probably using the DPM 2M Karras, long time best performer, and seemingly terrible with LCM. I'll let the community do a few more evaluations with sampler and CFG before switching over.

The SDXL lora does not seem to work for me. My RTX3060 with 12Gb VRAM gets 100% loaded and freezes the whole system for several seconds for each iteration. The outcoming images are usually a jumble of pixels. SD1.5 lora, however, seems to somewhat accelerate things for SD1.5 trained models.

Wow so instead of creating a hundred images every day that nobody cares about I can create 10,000 images a day that nobody cares about, fantastic!!!

Thanks for the research, will try it out !! :)

Cool video. Thank you

I'm using the DirectML version because I have an AMD and I have to use my CPU and It's PAINFULLY slow. Will this help with that? Or is it only for those using GPUs? I actually have a really decent GPU (RX 5700 XT) but I sadly can't use it since SD hardly supports AMD.

my god! it works !!!!thankyou !!

In A1111 I don't see any difference in speed, the results are just worse

Any chance you can show how the live webcam setup can be done? Thanks!

Amazing!!! Thank you :)

i have a 3060 12GB gpu, was getting vram errors with this workflow on XL. process was rerouted to cpu. 50-70 seconds. so i suspected my vram was being squatted by orphan processes. rebooted and it's now working the way you describe. thanks.

I'm confused with trying to get this working with SSD-1B. I downloaded, put in the correct folder, renamed and it shows in the add to network prompt drop down, but so far notice no improvements and quality seems poor. I keeps seeing something about diffusers but not sure what that is all about . Going back to the drawing board lol

'thanks but it doesnt make it faster...its the same speed...3-4 secs sdxl with or without lora in between ... any ideas why? i have old rtx 3090, 8g

HAHAHA 😅 I ::: honestly ::: look forward to the Dad jokes 🤣 Even if I don't have time to watch the entire video when I initially see it, I will watch until the joke and then come back later 😆👏🏾

Thanks bro!

Its even slower for me and looks much much worse using XL

I already did the --xformers edit, can I still use this Lora or would the quality of images be affected?

I've got a 4090 as well, and I can't not reproduce your results in A1111. Will keep trying.

Strange, I did everything you said, but it took 7 seconds longer to generate. cinematic, techwear car Steps: 30, Sampler: DPM++ 3M SDE Exponential, CFG scale: 7, Seed: 4128880464, Size: 1024x1024, Model hash: 74dda471cc, Model: realvisxlV20_v20Bakedvae, Version: v1.6.0-400-gf0f100e6 Time taken: 17.2 sec. cinematic, techwear car Steps: 30, Sampler: DPM++ 3M SDE Exponential, CFG scale: 7, Seed: 4128880464, Size: 1024x1024, Model hash: 74dda471cc, Model: realvisxlV20_v20Bakedvae, Lora hashes: "lcm-lora-sdxl: 2fa7e8e56b09", Version: v1.6.0-400-gf0f100e6 Time taken: 24.1 sec. Tried it on another sampler, get a 2 second gain. Apparently it doesn't work well enough on all samplers

still have to experiment with this more but wow.. zoom! a 960x640 usually takes at least 1.5 minutes (RTX1080), this is done in seconds. Not quite happy with the detail yet however. But great for a quick try of a prompt I guess until I do more tweaking.

Lmao this crashes the crap out of my amd card. I have a 7800xt and it steals all of my vram immediately which forces me to restart

After my first generation, the following generations are much slower. Any idea why this happens and how to avoid it?

At a cfg scale of 2, how well does it adhere to complicated prompts? I get that it's amazing for AnimateDiff or real-time applications, but is the quality good enough to replace workflows for image generation?

hey :) did the KSampler changed with the last update? i get errors on all my animatediff workflows since i updated all comfi-ui. Error occurred when executing KSampler: local variable 'motion_module' referenced before assignment

Thank you! It works nice, Both A1111 and Comfy as well. But I have a rookie question. I can't save the Comfy workflow explained in the video, with the Lora loader node installed. If I save it as a .JSON file or PNG image it does not reload....

And how to manage weight of lora in that upper menu? If you add lora to prompt field it is possible to manage as .

Is there also a way to enhance performance for image2image generations? I selected the Lora, adjusted the steps and the CFG Scale but the render time is still the same if not worse. Please help :'D

hey do you think we can have more than 0.7 frame par second if you render only 500X500 with a 4090 as hardware

Oh and @sebastiankamph... I almost always laugh at your jokes even if my wife hates when I tell her them. Said the facial hair one to her yesterday because I DON'T like facial hair and she knows that! :)

This is WILD! This ecosystem continues to boggle the mind. There's certainly some amount of "too good to be true" in here, such as the lora not playing nice with a lot of samplers, but cool nonetheless. Btw, a couple things I would have liked discussed / to see is how this performs with common current settings (i.e. higher steps ~20 / CFG ~5), and on other models even if just sd1.5 / sdxl based models. Even if it was just like 15-30 seconds showing a good model vs a bad model that you've found. ofc, there's always the whole "try it in your workflow to see how it is for you," just would be nice to know if I can expect this to work outside of vanilla sd.

Vanlandic can't even see the files. They won't show up in the list after dropping them in the folder and restarting.

Do you know how to make it faster for pony diffusion? I dont think this works for pony models

Hi! Thanks for the lessons, they are great!!! I cant set the sample steps below 20... Am I missing something?

Ok first run of video, very confused what the one step use to make it 1000% faster??? download "1" file?? you started download several files and what so lost..

How much faster is it really? A comparison would be nice, also this could be used with the new tensorCoreRT?

Thanks as always! I have an off-topic question, is there any way to make StableDiffusion not show people but only clothes? I put no human, no girl, etc. in the negative prompt and it still shows people.

you mentioned animateDiff? how can you use LCM with animateDIff? great video, btw

Not working for SDXL. Always bad quality, it should be also 8 steps/1CFG Scale at SDXL?

Does this trick only work with the dreamshaper model or would it work on any models?

I'm kinda new, but isnt it a problem if i have to use this LoRA? I mean, I can only use 1 LoRA at a time right? And if Im using this one it means I can't use another, which sort of defeats the purpose...

I assumed this video would be about the RT in A111, what's going on with that is it out yet? I've break from AI since March.

I have a M1 16 unified memory MacBook Air I wonder how has it would be on it

hello sebastian love your videos can you also make video on how to use 2 character loras in image to image generation without inpainting ? thank you

Not optimized for a1111 yet. Im using a custom checkpoint, a1111, 1.5 same settings as in video. Im on a 1080ti, and the quality is worse and the generation speeds are faster, but lower quality image.

thanks but mine is still very very very slow... what else can i do?

How do I make the interface like yours ? At the top where you select the model/checkpoint you have two more dropdowns to the right called SD_VAE and Add Network to Prompt. If somebody else than the video creator has the answer feel free to reply

The video title is wrong. 10 times faster is 900% faster. The percentage is always 100% lower than you would intuitively expect from the factor. Just like 50% more is 1.5 times as much and 100% more is 2 times as much.

Hmm... why is it working for you and not for a lot of us in automatic1111? * Downloaded and renamed both Loras and put them into their Lora directory * Enabled sd_lora in User-Interface Option in main UI * Reloaded UI * Updated complete automatic1111 with all extensions * Restarted automatic1111 (ORIGINAL) * lcm Loras do NOT appear in the Lora Tab Gallery, Only in the unusable dropdown list if you have a lot of Loras * Tried all my Models AND Samplers for 1.5. and XL, all with really bad results with 8 sampling steps My Options in main UI (like the "Add network to prompt" dropdown is shown in the left column under CFG scale, seed, etc. Are you using a different version of automatic1111 or ist there something else that has to be anabled what a lot of us maybe don't have?

test LCM on stable diffusion - seems that img2img lcm and vid2vid has an error - TypeError: slice indices must be integers or None or have an __index__ method

IS this LORA affecting the outcome of the artwork look or style, other than speeding it up? If this changes quality for the worse, I would not see the point of using it because SD is pretty fast as it is.

i don't have the option to add the lora setting to the UI

tried this with sdxl with no good resaults. sdv1-5 worked great though. any ideas? was using sd_xl_base_1.0.safetensors [31e35c80fc] with the lcm-lora-sdxl on mac m1 if that makes any difference

Great video. What I don't get is why the CFG needs to be so low?

How to make common image like yours? With all generations results in one table with methods and scalers?

Will this work on Apple silicon like M1?

hmmmm for SDXL the result is a total mess : D it's like the cfg is at 30 and steps to 1 xD

your link for civitai is no longer working

I am confused. my pictures look worse using this :-(

I used LCM sampler in A111 - the results were awful.

I am super confused, when I go to download the LCM model for SDXL, are we downloading the "pytorch_lora_weights.safetensors" file? I did that and used it as LORA, it is stuck! I am using a RTX 4090.

I'm using LCM in ComfyUI but any time I go above 512 x 768 in resolution, it just craps out and starts adding all types of different things like double heads, 3 arms, etc. but doesn't do it at all if in 512 x 768. I don't change any other settings besides resolution. I have no idea why it's doing it. LCM gives good results in 4 steps which is great for my 4GB 1050 ti. I can generate an 850 x 1200 image in 40 seconds with it so no need to even upscale (upscale tacks on another 2 minutes almost since I prefer to use USD Upscale). I may have to try Euler even with this instead.

i would like to find a way to use that with deforum and control net. does anybody have an idea how to make it work in automatic1111?

so is this for sdxl only? Or will the 1.5 lora do the same thing etc

I am seeing a lot of Comfy UI and Automatic 1111. Is there and advantage to use one over the other? Is one better at "A" and another at "B"?

It gives me trash result with a lot of noise no matter what sampler I chose even with a CFG

How i can use it with fooocus?

Need to try for my gtx 1060. yesterday, with xformers and medvram it took 30 minutes to do a single image with sdxl and no refiner

Is it possible to do on Silicon M2? I try, but have some issues

Unfortunately, nothing change for me.

i played with it for a while and decided the quality was vastly subpar compared to what you'd get using better samplers and schedulers

does having A1111 installed on a HDD or SSD matter?

sdxl doesnt work, not sure why. probably need latest pips. will test again later.

can this be done with animation ? animated diff or video to video ? not sure I am setting it up right - in Comfy

Newbie question - would this speed up image generation on my Nvidia GTX 1060 gaming laptop with 4GB VRAM?

Does the LCM model work only with SDXL, and not SD 1.5 based models?

can this work on SD 3 ?

this will work with intel arc???

mine is not even generating any pic