Prompt Engineering - Part1 : Prompt Tricks You Probably Missed for Stable Diffusion

Рет қаралды 26,822

Жыл бұрын

I am back from a break from the channel! After taking the QA job at Stability (the company that makes stable diffusion) I needed to balance life and work, so needed to take a break. However, now that convention season is pretty much at an end, I can get things back on the road! This week I wanted to cover some AI prompt engineering tricks I don't see people using that are a core part of my workflow. Today we are working with the concept of allowing the prompt to be changed as it is inferenced (known as the FROM:TO:WHEN method), so we have a lot more control over the scene that we do with just prompting. This is just part one, as there are some other things I use that I also don't see out and about, so we are going to fix that. Cheers, and it is good to be back!
#stablediffusion #automatic1111 #aiart
Is your PC a potato? Use Run Pod for pennies an hour: tinyurl.com/ydu6rkpk
Print and sell your own artwork! tinyurl.com/22qwnrqu
Join my Discord server! Do it! / discord
Twitter: / sedetweiler
Instagram: / sedetweiler

Пікірлер: 104

@SouthbayCreations Жыл бұрын

This is exactly what the community needs! Back to basics, well sorta. Expanding on the tools we already have. Everyone (including myself) are quick to jump on a new tool/extension but then we forget about all the other cool stuff we already have. Great video! Welcome back!

@sedetweiler Жыл бұрын

Thank you! I also felt that some of these amazing tools had uses we just kinda skipped over. I will try and hit those as I also work on the bleeding edge of things. Cheers!

@MonzonMedia Жыл бұрын

The master has returned! Congrats on the job with Stability! Your install video is what got me into auto1111 and I've since fallen down the rabbit hole! Long story short, started covering AI platforms, mostly online....ended up with a job with one of them 😁 you were one of the many sparks that led me down that path. Thank you Scott! Oh and yes, looking forward to part 2!

@sedetweiler Жыл бұрын

Dude! That is amazing, and I am so happy for you! Just imagine where all of this will be a year from now, as a year ago we would not have even dreamed this was possible. So happy for you!

@MonzonMedia Жыл бұрын

@@sedetweiler indeed! It’s progressed so much. It’s been a fun journey so far. Again can’t thank you enough my friend and I’m super stoked for you as well! Here’s to more growth and opportunities to come! 🍻🙌🏼

@sedetweiler Жыл бұрын

We have a lot of new goodness coming out soon. Not going to be lacking content any time soon. Cheers!

@timothymaggenti717 Жыл бұрын

Fantastic, great job, thanks. This is the first time I understood how the prompt process works. I am new to all this and finally the light came on. 🎉

@ThoughtFission Жыл бұрын

yours are the most useful videos I've come across so far. Direct, to the point and easy to understand. Not always the case with AI tutorials.

@sedetweiler 11 ай бұрын

Thank you!

@KiZzymesl Жыл бұрын

welcome Back !! and thank you for dropping those gems, I didn't know this technique !

@sedetweiler Жыл бұрын

More to come! I am glad it wasn't old news. :-)

@alex-ender Жыл бұрын

Scott, don't leave us for so long. I was starting to get worried. Thanks for the awesome video.

@sedetweiler Жыл бұрын

It's a deal! I had a bit too much on my plate and have since learned to balance a bit better. More videos will keep on coming. Cheers!

@davewaldmancreative 5 ай бұрын

Dude. your guides are super cool :-) many thanks

@sedetweiler 5 ай бұрын

Glad you like them!

@clifforderskineart Жыл бұрын

He has returned!! Glad to see you back

@sedetweiler Жыл бұрын

Thank you! It is good to be back!

@jankvis Жыл бұрын

Nice to see you back and thx for the tutorial, cheers :)

@sedetweiler Жыл бұрын

Hey, thanks!

@itdreamsme Жыл бұрын

So happy you're back!!!! 🙌

@sedetweiler Жыл бұрын

Yay! Thank you!

@charb423 Жыл бұрын

I love this video, I just got started and up and running with Stable Diffusion so I appreciate these tips! Congratulations on your position at Stability! New subbie❤❤❤❤❤

@sedetweiler Жыл бұрын

Awesome! Thank you!

@LoneRanger.801 Жыл бұрын

This is such an awesome video. I learned something new today. Thank you.

@sedetweiler Жыл бұрын

Glad you enjoyed it! Cheers!

@clairearcher2549 Жыл бұрын

This was very helpful. Thanks Scott!

@sedetweiler Жыл бұрын

Very welcome!

@10master31 Жыл бұрын

Very informative video, waiting for part 2...

@sedetweiler Жыл бұрын

Coming soon

@themonotropicguitarist Жыл бұрын

Awesome! Thanks for this info. I feel like I need a little cheat sheet of all these tricks. Maybe an idea for those who know the ins and outs of them all.

@sedetweiler Жыл бұрын

Not a bad idea!

@OriBengal Жыл бұрын

Very useful. Thanks!

@sedetweiler Жыл бұрын

Glad it was helpful!

@coloryvr Жыл бұрын

Thank you very much for that video! Although I've been using SD since release, the complexity is often confusing now.... Anyway: Many thanks to Emad Mostaque and everyone at SD for the free open source version! To me, Local SD is a tremendous gift to humanity! And if my art was used for "training": It's an honor! Happy colored greetinx

@sedetweiler Жыл бұрын

Glad it was helpful!

@sikknikk100 11 ай бұрын

Excellent video and tutorial 👍😎👌

@sedetweiler 11 ай бұрын

Thank you 👍

@blackvx Жыл бұрын

Hey, i remember you!Welcome back😊

@sedetweiler Жыл бұрын

hehe! Thank you!!!

@Arewethereyet69 Жыл бұрын

thanks, need more!!! lol

@LouisGedo Жыл бұрын

Welcome back!

@sedetweiler Жыл бұрын

Thanks! :-)

@royceahr Жыл бұрын

Well presented...

@sedetweiler Жыл бұрын

Thank you 🙂

@GerryLouis1 6 ай бұрын

🎉🎉🎉good learning

@hatuey6326 Жыл бұрын

very useful thanks !

@sedetweiler Жыл бұрын

You're welcome!

@alexwan811 Жыл бұрын

I humbly grovel to thee!! thanks!

@Nitrowing1500 Жыл бұрын

Yeah, I knew none of this! Thank you.

@sedetweiler Жыл бұрын

Happy to help!

@davedm6345 Жыл бұрын

wow i lose all my time experimenting with the SD web guide with percentages to merge two tings LMAO, you make it more simple thanks!. I was having lot of problems putting camera angles and negative prompts as an example: car front or front view i do not want and i ended with lots of car front Photos :( it's ridiculous why? sometimes the text broke or some in the interpretations broke the line and end without the merged texts. Can you make a video to control camera angles in the prompts? THANKS NEW SUB!

@merek1 Жыл бұрын

Woooooo! Missed your videos. Glad to see you back.

@sedetweiler Жыл бұрын

Thank you! It is good to be back.

@amorgan5844 3 ай бұрын

Did you ever start a podcasts? Im hoping so, just found the channel and have been binge watching

Жыл бұрын

Welcome back! I have learned a lot from you, I hope I will continue to do so in the future!

@sedetweiler Жыл бұрын

Glad to hear that! I have a lot to pass on that I have learned since starting at Stability.

@randymonteith1660 Жыл бұрын

Love the new tricks you taught in this video! I do have a question though? What is that Heading you have called " Stability API Settings " ?

@sedetweiler Жыл бұрын

I will cover that in a video soon. It is an extension.

@generalawareness101 Жыл бұрын

Welcome Back.

@sedetweiler Жыл бұрын

Thank you! It is good to be back.

@WiLDeveD Жыл бұрын

Pure Content. thanks. what brand and model is your GPU ?

@sedetweiler Жыл бұрын

Thank you! I have an Nvidia 3090 TI.

@rahulchakraborty4770 11 ай бұрын

Hey Scott! Really love your content! I am a Stable diffusion enthusiast like yourself. I really want to take this seriously and want to make this as my career. Can you please give me some tips of how to find a job at StabilityAI or any other company with specialization in Stable Diffusion and AI? Thank you.

@sedetweiler 11 ай бұрын

Just master the aspects you enjoy and become an expert that someone will see as a benefit. That pretty much works for and career, but the important part is making sure it's something you enjoy.

@IlRincreTeam Жыл бұрын

Hey, where did you get that Clip Guidance tool? Does not seem to be available in any extension for Auto1111

@sedetweiler Жыл бұрын

Which one? Sorry, I thought I had most of those things turned off for the tutorial so I didn't complicate things.

@IlRincreTeam Жыл бұрын

@@sedetweiler Below the sampling steps there is a box to tick saying 'clip guidance', I'm sure that most of the initiate to expert users of Stable DIffusion would like to know ;)

@sedetweiler Жыл бұрын

Ahh, that is related to using the dreamstudio sapi connection. You can use that and a few other options to have the inference completed on our huge GPU cluster rather than the local GPU. It also opens up other models we host there, and I will do a video on that soon as well. Cheers!

@fatenathan Жыл бұрын

how did you get the pink overlay?

@muledeer1766 Жыл бұрын

Is there something similar to the square brackets [ : ] prompt in ComfyUI ? or does it work there?

@teambabaganoush7035 Жыл бұрын

youre wondering how to engineer on a Mac interface? and the manner to do so?

@Klaaninka 8 ай бұрын

Loved this revelation. Thanks! Only thing is: Where did the pirate ship come from at 4:47. Also, at 6:16, you state that the 2nd bracketed item, the pirate ship, is rendered for the first 20% of the render. Don't you mean that the race car is rendered for the first 20%? Fully clarified later though!

@sedetweiler 8 ай бұрын

Glad you enjoyed it, and thank you for the support on the channel!

@adumont 6 ай бұрын

Is it front-end/tool specific? Does it only work in Automatic1111, or is it more generic and would work on other SD tools like Fooocus?

@kkbbxx Жыл бұрын

would combining 3 or more ideas also work, [car|plane|ship|bike]?

@sedetweiler Жыл бұрын

Yes, you can do as many as you like.

@TheDanEdwards Жыл бұрын

Your use of "brace" for the character "[" took me off-guard initially. In my math (and comp sci) classes we always called that a "bracket", with "brace" being used for "{". Anyway, the lexical tricks you show are for automatic1111, correct? Other UIs may or may not work the same way, yes?

@sedetweiler Жыл бұрын

Ahh, you are correct! Yes, as far as I know each piece of software has their own "standard." :-(

@TheSporkimusPrime 6 ай бұрын

Can you do [from : to : when] in Fooocus in any way?

@masterzed1 Жыл бұрын

another headache... 😢.. but i understand ... ty....

@aifreeart Жыл бұрын

Is it only possible on model v1.5-ckpt? Not in other models

@sedetweiler Жыл бұрын

Works on any model.

@tauseefahmedmemon9148 Жыл бұрын

What site is he using?

@metronome003 11 ай бұрын

Does these also work with comfy UI?

@sedetweiler 11 ай бұрын

Yes, as that is just a front end to the models.

@lioncrud9096 10 ай бұрын

does this work in comfy

@sedetweiler 10 ай бұрын

It's actually better in comfy. Video coming soon!

@TKPaulChan 11 ай бұрын

Does this feature exist in ComfyUI?

@sedetweiler 11 ай бұрын

Yup!

@RamonGuthrie Жыл бұрын

Does this same technique work with two different people LoRAs and could I blend two peoples faces to create unique faces?

@sedetweiler Жыл бұрын

I would imagine so, as it is simply layering the results.

@QVsense Жыл бұрын

its very nice, but the title said trickS i only seen one trick

@sedetweiler Жыл бұрын

Did you watch the entire video? There are several here, including the use of the | without a when? parameter, using the blank :: and using the : without a start.

@QVsense Жыл бұрын

@@sedetweiler yes iv seen it to the end, for me it was one trick with some variations or sub parts. but that was kinda knitpicking on my side, its a good video