Massive Adobe Firefly & Photoshop AI Update!

Рет қаралды 28,676

Күн бұрын

Big news coming out of Adobe, Photoshop and Firefly just got some massive updates! In this video I'll cover everything that came out of Adobe's latest announcements. Firefly version 3 is here, and it is a massive improvement over the previous models.
Plus, I'm taking a look at the new AI Features coming to Photoshop that will utilize the new Firefly model. There are some real gamechangers here!
Finally, we'll round out with a look at the latest research coming out of Adobe. Could these be some features we'll see at during this year's Adobe Max Sneaks?
LINKS:
Adobe Firefly: www.adobe.com/products/firefl...
My Interview w/ Adobe:
• I Talked To Adobe Abou...
Chapters:
0:00 - Intro
0:33 - A Look at Firefly v3
1:07 - More variety and prompt understanding in Firefly v3
2:00 - Style Reference in Firefly v3
2:45 - Better structure in Firefly v3
4:18 - Creativity in Firefly v3
4:56 - Structure Reference in Firefly v3
5:47 - New Photoshop Features
9:01 - Adobe Research
11:43 - Wrap Up

Пікірлер: 126

@TheoreticallyMedia Ай бұрын

Check out my Interview w/ Adobe about Premiere/Sora and More: kzfaq.info/get/bejne/qb2IiLScvZyudH0.html

@LouisGedo Ай бұрын

👋

@ChuckStaley 27 күн бұрын

For someone who started with a box camera in the '30s and then updated years later to a Kodak Brownie Hawkeye, this has certainly been an exponential ride. But it keeps me young, at age 92, and that's good!

@futuremakers7787 Ай бұрын

00:02 Adobe unveils new Firefly V3 model with enhanced features. 01:35 Firefly now has a style reference feature. 03:06 Adobe showcases impressive AI updates and image generation capabilities. 04:33 Adobe Firefly 3 update brings structure references and style variations for better image generation. 06:03 New tools for generative fill and background removal in Photoshop. 07:39 Exciting updates in Adobe Firefly & Photoshop AI 09:10 Adobe Max sneaks feature new video upscaling and enhancement technology. 10:49 New Adobe features showcased with potential use cases

@cinevisionaryfilm Ай бұрын

Great stuff. What I'm really hoping for is the ability for AI in photoshop to recognise different elements in an image, separate them into different layers and use gen-fill to build the parts of those elements that were occluded by others. Would be amazingly handy for animation and VFX.

@TheoreticallyMedia Ай бұрын

Totally-- I mean, you more or less can do that currently, it just takes a good amount of elbow grease and layer management to pull it off. Plus, a bunch of lucky rolls with Gen-fill. It'll be interesting to see if Adobe takes an LLM approach, where you can "chat" with Photoshop to describe what you need done. That was something Dall-e 3 heavily implied it would be able to do, but failed to deliver on it.

@cinevisionaryfilm Ай бұрын

@@TheoreticallyMedia I'd be interested to see a workflow video on that. Anything that saves time manually selecting and rebuilding. Select subject works well with clearly defined things (people against backgrounds) but not so great at selecting elements from more abstract images. I'd love it to be able to do that (choose this half a triangle behind this sphere and rebuild it). I'd also like the more LLM approach you mention. I use Midjourney by default but ChatGPT's conversational ability is much nicer to use - not that it translates into better images than midjourney.

@TheoreticallyMedia Ай бұрын

@@cinevisionaryfilm you might want to check in with Midjourney if you haven't in awhile. The prompt model has gotten a lot better and is moving more toward a narrative style. You still can't "chat" with it, but you can now direct it in a more conversational tone.

@cinevisionaryfilm Ай бұрын

@@TheoreticallyMedia I'll give it a go. I got upgraded to the website from the portal - which is much more user-friendly. The style ref stuff is great for consistency. Still struggles to do certain angles - low angle close ups, over shoulder shots, etc. but it's getting better. I'd love a zoom in as well as a zoom out.

@paelnever Ай бұрын

@@cinevisionaryfilm You actually can do that combining fooocus with gimp or with a complex comfyUI workflow. The quality of the images generated by AI models both fooocus and comfyUI are using is higher than firefly.

@circelink Ай бұрын

Thanks Tim, great updates as always, you're my favorite morning show!

@TheoreticallyMedia Ай бұрын

Appreciate it!! This one went up pretty early, as I was fighting against UK time to get it up! But, made for an great excuse to have an extra cup of coffee!

@Eyez7676 Ай бұрын

LOVING the reference to Papyrus Bold! 😂😂😂

@TheoreticallyMedia Ай бұрын

What to do for a sequel? GO BOLD!! Haha, so great!

@thewebstylist Ай бұрын

Awesome additions and highlight vid Tim brah! 🎉

@TheoreticallyMedia Ай бұрын

Thanks so much man! Not a party until you show up in the comments!

Ай бұрын

great coverage as usual. thanks for your great channel.

@TheoreticallyMedia Ай бұрын

1000%! Thank YOU!

@ronnykhalil Ай бұрын

best breakdown i've seen of the new toys. thank you!

@TheoreticallyMedia Ай бұрын

Appreciate it!

@liviere1 14 күн бұрын

In terms of hands and fingers Firefly done a great job Vs midjourney in my last work. This update is really great, but in terms of composition midjourney keep being the master, in my experience. Love your channel! 👍🏼🙌🏼

@HistoryIsAbsurd Ай бұрын

Thanks as always kind sir! I think for this im most excited in that video upscaling method I wonder if we will ever get that open sourced

@TheoreticallyMedia Ай бұрын

Yeah, if that gets rolled into Premiere, it'll be great-- considering I think the other major player in that area is Topaz, which does cost a pretty penny. Always on the lookout for a good Open Source version as well! As soon I I find one, I'll let you know! (There was one I covered awhile back that would let you upscale per video. I'll see if I can find that!)

@noNumber2Sherlock Ай бұрын

Awesomeness as usual Tim! As for the lady who is fantasizing "leaving it all to go to Venezuela to be wit Hector", I think she is wanting to leave it all for Cassandra and opening up a fish store by Enrique's and Tobias' candle boutique. :) Love your humour!

@bluefernlove Ай бұрын

I'll be impressed when they implement all of these things into after effects.

@TheoreticallyMedia Ай бұрын

Did you see the interview I did in the previous video? I'm not sure they're really stressing AE right now. I think the priority is PR.

@carolyneaarsen413 Ай бұрын

Thanks so much for this. Loved the Papyrus reference.

@TheoreticallyMedia Ай бұрын

Haha, file that one under "If you know, you know!"

@user-gj5ml9ik2s Ай бұрын

A lot of people say that Firefly imagery is a lower standard to the likes of Midjourney... but Firefly photo imagery looks far more realistic IMO. Midjourney, as striking as it is, just has that 'blatantly AI' kind of look to it

@TheoreticallyMedia Ай бұрын

There was a bit in the video that I cut (mostly because it felt like I was rambling) during the Rainbow Bear section that echoes your point. MJ would have crushed the Rainbow Bear prompt, because those aesthetics are what MJ is good at. It isn’t where FF’s strengths are. FF does do great with assets/images you might need for a commercial campaign though.

@thokozanimanqoba9797 Ай бұрын

perfect timing

@TheoreticallyMedia Ай бұрын

Thank you!! Bit of a hustle to get it up, but I think...I'm the first video on Firefly v3? I need some sort of KZfaq Achievement badge!

@achliscantplay4202 Ай бұрын

Wow-wow, coming out of the gate with rapid-fire dad jokes 🤘😂🔥 May have to re-watch to actually focus on the information 😅

@TheoreticallyMedia Ай бұрын

Haha, I was having a little extra fun in this one! Got a good night's sleep and had an extra cup of coffee before hitting record on this one!

@achliscantplay4202 Ай бұрын

@TheoreticallyMedia ...and the dadest follow up 🤘🤘🤘😂 Remember when you were 8, would fall off of a tree, walk it off and keep playing? And now - a shoulder joint hurts for life, 'cos you slept wrong? Bet Hector drinks coffee because he wants to, not because he needs to! 😉

@AG_before Ай бұрын

Hector, Anne Hathaway and Papyrus Bold! HA! Made my, well, few very happy minutes, and that's worth it! Great content. Thank you for sharing. I can't believe MJ isn't hitting guitar chords better. What, I'm tired. Thanks again. 💯

@tomberault4434 Ай бұрын

but now i can't have the generative fill interact with MY IMAGE by going the quick mask, filling with a percent of gray, leaving quick, put in my prompt and watch the generative fill INTERACT with MY IMAGE. I SHURE HOPE ADOBE DOES NOT TAKE AWAY THIS FEATURE as they have with the Beta version

@TheoreticallyMedia Ай бұрын

Oh, that’s not good. I haven’t played with the beta yet, but I will 100% let them know about that when I talk with them again. Thst seems like a pretty big oversight. Hopefully, it’s just due to the beta!

@High-Tech-Geek Ай бұрын

1. Do Adobe products support upscaling images similar to Magnific? 2. I must have missed discussions on Structure Reference. What is that exactly? I still don't grok it. Thanks Héctor!

@TheoreticallyMedia Ай бұрын

Hector is the BEST! Haha. So, we haven’t seen a creative upscaler like Magnific out of Adobe yet. You can normal upscale, but nothing quite like Magnific. Structure reference seems to be a bit of Pose reference, and overall scene reference. Almost like image to Image, but taking it really seriously. Unlike a lot of other I2I models which just give you a vibe of your input image.

@alkrevit4755 Ай бұрын

What attention have they directed towards improving the resolution of generative fill?

@TheoreticallyMedia Ай бұрын

Not sure-- they didn't mention. I did in my previous interview w/ Adobe (linked in description) ask about resolutions on the video side when you generate, but that was a full on "no comment" So, I guess we'll see when it drops.

@KIngaiune Ай бұрын

Did they fix the issue with gen fill where if you make a large selection it makes lower resolution than the original image?

@TheoreticallyMedia Ай бұрын

unsure, but I think there should be an improvement, considering it is an updated model. I never do the PS Beta thing, just because I've had some bad experiences w/ it, so I'll wait to see how it looks when the full update comes out.

@KIngaiune Ай бұрын

@@TheoreticallyMedia Just tested it the resolution does seem to be lower than the source resolution if it is above a certain level or the expansion area is larger.

@JanineMKartist Ай бұрын

Could be cool for generating reference photos to do actual canvas psintings from . Helps to realize what’s in one’s creative brain then put real paint to canvas.

@TheoreticallyMedia Ай бұрын

That’s a great way of looking at it. Kind of like a mood board or inspiration generator. Lots of different approaches to take with this new technology!

@llamarage Ай бұрын

I used AI to generate my mascot for my channel. Is there a tool that can take that character and produce new images from it for different thumbnails etc?

@johnnyeaton Ай бұрын

Hector is a renowned finger surgeon...

@TheoreticallyMedia Ай бұрын

The greatest comment this channel has ever gotten. Right here. Chicken Dinners for life!

@tonon_AI Ай бұрын

and all just trained in our Midjourney images, YAY

@TheoreticallyMedia Ай бұрын

Haha, I'll point out that I called that WAYYYY back in March of last year (It's a terrible video! kzfaq.info/get/bejne/qZujdcuXusXZmp8.htmlsi=BY0htByDOl-Curfl) Personally, I don't take any ire with it, and I generally think the who issue with training data is going to fade out-- considering that a number of other countries (Japan, and I believe India) have already OK'd it. Not saying it makes anything right, but in order to stay competitive, it's just a reality that training data will eventually need to be swept under the rug.

@tonon_AI Ай бұрын

@@TheoreticallyMedia im ditching everything for local SD, at least the community is nice and not focus on profit over others works

@eliezerjimenezsanchez8556 Ай бұрын

And Midjourney was trained from?

@TheoreticallyMedia Ай бұрын

@@tonon_AI fair. But by the looks of it, post SD3, we might not be looking at open source from Stability. That said, we've got quite awhile to go before SD4, so I'm sure some other major open source model will come along. Fingers Crossed!

@TheoreticallyMedia Ай бұрын

@@eliezerjimenezsanchez8556 Initially the same training data that all the other models were trained on. But that goes back to like, MJ v1 and 2. Since then, no one outside MJ really knows what their data set is. Plenty speculate, but no one actually knows.

@climber950 Ай бұрын

I don’t care so much about image creation. But greatly improving low resolution images and better clone stamping are incredibly impactful features for my. Just saw a SpaceX launch in Florida and only had my 24-105 and not my 100-400. It would be really nice to greatly sharpen up the moon.

@TheoreticallyMedia Ай бұрын

You might want to try Topaz? That seems to be a pretty rock solid upscaler that doesn't add any additional hallucinations or AI creativity to the original image. PS/LR has a "Super Upscaler"-- but, I've found the results to be fairly middling. Still, might want to also give that a shot.

@erikaazarcoya2785 27 күн бұрын

I compared those and by far topaz Gigapixel is the best

@jackiekerouac2090 Ай бұрын

Will some of those be available in Photoshop Elements 2025? I'm not a fan of monthly fees, and I've got no use for the full Photoshop. So Elements would be plenty for my minuscule usage!

@TheoreticallyMedia Ай бұрын

I'll put that on a list to ask them! They have Sensei in Elements, so I can't help but think at least some of these features will be ported over! But, I'll confirm w/ them next time I get a chance!

@edwardferry8247 Ай бұрын

The hand on the guitar isn’t ’remarkably accurate’ fingers aren’t shaped like that and if he is fretting an A minor chord his fingers are in an odd place, his little finger would be dropping down so the fretboard could be seen, not over the strings. Not sure AI is quite up to specific chord positions on instruments quite yet.

@TheoreticallyMedia Ай бұрын

Yeah, y'know, as I was looking at it a little later it is a bit off. Kind of fake a min? technically his middle and ring fingers should be up a fret-- but still, that's the closest I've seen to accurate fretting thus far. Still, it's a lot better than that "what chord is this" meme that pops up on every guitar forum! I do love that meme!

@ECHSBACHS Ай бұрын

Very Sharp

@TheoreticallyMedia Ай бұрын

Much appreciated! This was a fun one to cover! Adobe was pretty slow going at the start, but it looks like the engine in roaring up. Really jazzed to see Firefly starting to look good!

@zippythinginvention Ай бұрын

That 'RotAIte' feature will be great for product ads. Highly requested AI feature. RotAI? AIRoto? RotoScape?

@TheoreticallyMedia Ай бұрын

You need to work at Adobe in the “name stuff” department! I don’t know if that department actually exists. But it should! You’re hired!

@BillyVerden Ай бұрын

Is the generative fill still low resolution?

@TheoreticallyMedia Ай бұрын

Not sure, haven't played with it yet-- HOPEFULLY not though. I'm sure it's gotten better with an updated model.

@Amadi1 Ай бұрын

I've yet to see an AI image that accurately generates a piano keyboard layout!!

@TheoreticallyMedia Ай бұрын

same! I haven't counted all 88 keys, but I have yet to see the correct ordering of the black keys. Have you ever seen the Janko Keyboard? All AI Pianos seem to be trained on that layout!

@Amadi1 Ай бұрын

@@TheoreticallyMedia No... I actually don't know much AI... I do use photoshop and since I just learned about Firefly, I am curious to see how I can make use of it if at all for my piano video projects... I'll look it up! thanks!

@lunazamoraart Ай бұрын

The aesthetic is like Dalle

@TheoreticallyMedia Ай бұрын

I'll be the first to admit, I don't love it-- but, I will say that they're honing in with each update. I think FF's real strength is going to be with "stock" type images that will require a lot of post manipulation. For more imaginative stuff, I think MJ or Leo is going to be the tool.

@lunazamoraart Ай бұрын

@@TheoreticallyMedia I’m a big mj user. I was hoping they would partner up, but I don’t think it’s a path for them. Bummer!

@Crazy_Truth Ай бұрын

What do you think... AI models should have a feature that allows us to generate a specific image using existing images we have, and we just want to incorporate them into the generation with subtle changes. For example, if I have my own product, I would provide the product image to the AI model and instruct it to take this product image and create a creative commercial promotional post!! It would be great feature...!

@TheoreticallyMedia Ай бұрын

That's moving into the area of training a model. Which, you can do-- just not in Photoshop yet. I presume at some point it'll come though! I'm going to have. video on training models coming up pretty soon, so keep an eye out for that!

@Crazy_Truth Ай бұрын

But we have to train model for just single image! It will be very time consuming...

@videos6505 Ай бұрын

Adobe still not at the top of AI but good to see they are progressing. The video upscaling looks really good.

@TheoreticallyMedia Ай бұрын

They kicked off slow to be sure-- but I think it was necessary on their part to tread in lightly. Had Firefly V.1 kicked off with full canvas generation, the majority of the user base would have flipped out. "Photoshop wants to be Midjourney" would be the headline of every KZfaq video. But, they've eased in, and for the most part GenAI has been broadly accepted. I think we're going to see a big throttle up from them. (On the other side: I do actually applaud their efforts on the AI Content ID system. That's an important aspect of this weird future we're headed into)

@myronachtman4304 Ай бұрын

How did Adobe come to choose Firefly as the name of this AI generator?

@AlanBerry Ай бұрын

Great video, but why the music bed?

@TheoreticallyMedia Ай бұрын

Thanks so much! The music is something that I pop in from time to time just because I enjoy making it. Funny enough, with all the AI content of the channel, it actually isn't AI Generated, but rather made the old fashioned way. Experimenting back and forth with adding it in-- sometimes I feel it just adds a bit of movement to the video, or helps fill out the monotony of just me speaking. Still playing around with best uses-- next video I might just try it out for a few segments as opposed to through the whole thing.

@lamsmiley1944 Ай бұрын

It doesn’t seem great at following prompts. That elephant definitely wasn’t in a rainforest. That’s the savanna.

@TheoreticallyMedia Ай бұрын

That's a good call. I wonder if it was the call for Giraffes that tripped it up. Admittedly, that's a bad prompt they chose for an example-- but, you called it! And as the first comment: You are the winner of the Chicken Dinner!

@IFMstudio Ай бұрын

Yeah, that Papyrus sequel was pretty bold ಡ⁠ ͜⁠ ⁠ʖ⁠ ⁠ಡ

@JanineMKartist Ай бұрын

Still don’t get how the darn thing works

@TheoreticallyMedia Ай бұрын

From a technology standpoint? I believe the answer is “Magic Elves” …I mean, it’s the only logical answer.

@morrisjessup6515 Ай бұрын

Love your stuff a lot Tim, but you better tell them there are no elephants in the Amazonian rain forest

@TheoreticallyMedia Ай бұрын

Haha, my guess is it was "Let the Intern Prompt" Day!

@Laternite Ай бұрын

Sooooo….whats a sub of PS cost these days now? First born child? Left foot?

@TheoreticallyMedia Ай бұрын

Haha, PS alone I think is 19 bucks, but you can also bundle it with LR. I think the full package (all apps) is $59?

@SamuraiG Ай бұрын

On the guitar its also very hard to get them to animate in anything resembling strumming the guitar without morphing fingers. Drums are even worse, someone should teach the ai how to play musical instruments. 😁

@TheoreticallyMedia Ай бұрын

Haha, I did have a drummer joke in there, but I cut it out because I felt I was getting too hammy!

@SamuraiG Ай бұрын

@@TheoreticallyMedia 😁

@Crazy_Truth Ай бұрын

Why Sora disappeared!!

@TheoreticallyMedia Ай бұрын

That's more on the Premiere side. Hasn't actually dropped yet though!

@rhein-erft-art Ай бұрын

An elephant in the Amazon Rainforest? AI really? Who taught you that?

@shadyendeavor Ай бұрын

Wait a second, guitar players are super super super picky... and no pause or anything after saying that. Nothing?!? I know, I shouldn't FRET about such a thing though.

@TheoreticallyMedia Ай бұрын

Ahhhhhh, how’d I miss that pun?!!! Ok, I’ll turn in my dad-joke card until I can prove myself worthy once again! I’ll try to “pickup” my game!

@max22able Ай бұрын

02:00 - I have no faith in AI if it's prepared to accept that elephants, giraffes and baobabs live in an Amazonian forest.

@TheoreticallyMedia Ай бұрын

Haha, I maintain it was “let the intern prompt” day. But yeah, it clearly ignored the rainforest keyword.

@ChurchofCthulhu Ай бұрын

Hec. . .tor! 😂

@TheoreticallyMedia Ай бұрын

The most interesting man in Venezuela!

@mikrobixmikrobix Ай бұрын

Papyrus XDD 😁

@TheoreticallyMedia Ай бұрын

Papyrus BOLD!

@barryobrien1890 Ай бұрын

Again ai is just making up stuff. The prompt was a rain forest, but it showed a desert as that's just easier. The biggest shortfall is just trying to get AI to actually follow the prompt if it contains something that is not common, so it's fine if you want young women with large chests, but forget Komodo dragons. The referencing is either too strong, or too creative and again it does not accurately follow prompts. Let's hope they solve this and not just more wild flashy images

@TheoreticallyMedia Ай бұрын

Agreed. I’m curious to see how well the style/structure reference will work. It is still dependent, at the end of the day, on if the model knows what a Komodo dragon is. Sidenote: speaking of which, I once ran an image through a creative upscale and it turned a dead tree into a Kimodo dragon. Not at all what I was looking for, but I’ll admit, it looked REALLY cool!

@barryobrien1890 Ай бұрын

😊

@u2bAriel Ай бұрын

Papyrus 😬

@TheoreticallyMedia Ай бұрын

BOLD!!

@castielvargastv7931 Ай бұрын

You still cant use it for adult stuff which makes it useless for fetish and nude art photographers

@TheoreticallyMedia Ай бұрын

Early days-- but I totally understand the validity of NSFW Adult content as an art form. Interestingly, Midjourney seems to be on the forefront there, as they've been discussing and testing how to implement adult content for users-- but obviously, it can be a tricky slope that can easily land you on the front page of every major news organization if you aren't careful. Adobe, being the massive/public company they are, aren't going to be the forerunners in that area.

@EDDIEGARAGE 12 күн бұрын

Thanks, the intro went too far for me

@TheoreticallyMedia 11 күн бұрын

How's so?

@Ian_Walsh Ай бұрын

Since when have Elephants lived in an Amazonian forest? Rubbish in Rubbish out 😆

@TheoreticallyMedia Ай бұрын

Haha, yeah-- it's interesting they went with that as the example prompt. They called out giraffes as well. Maybe they let the intern prompt that one?

@Ian_Walsh Ай бұрын

@@TheoreticallyMedia maybe chatgpt wrote it

@NickFallon88 Ай бұрын

Pity it's so woke it's unusable

@martinhommel9967 Ай бұрын

Fakery rules. Sad times

@jensbovijn Ай бұрын

AI takes away all skill and the fun of learning a software… it will make a large amount of people even dumber as everything will be generated and gets automated. To me AI makes no sense.

@TheoreticallyMedia Ай бұрын

I don't think that's Adobe's aim here. I think you'll have a toolset that allows for some AI management, but you'll always have "standard" PS under it. For example, the adjustment brush thing-- that's more a Lightroom feature, and something that could already be done in PS, it just took a few extra steps to get there. Some people will stop at the "basic" level, and most of that imagery will be fine. Just fine. But those that go the extra 20% with manual adjustments and really know PS inside and out? Those are the folks who will be getting client work or creating work that actually sells.