"NOT SORA" - Zeroscope In Depth - full Workflow & Tutorial

Рет қаралды 6,690

Күн бұрын

I've spent way too much time generating 1000's of videos and I'm not SORA (get it?) hahah I need to sleep / discord
Workflow (v4) is at flowt.ai/community/universal-...
🤗Help keep this channel brutally honest: ko-fi.com/stephantual
▬ TIMESTAMPS ▬▬▬▬▬▬▬▬▬▬▬▬
00:00 Introduction
00:30 Overview of Zeroscope/Modelscope
01:32 Required downloads and installs
02:13 Let's get noodling! (basic)
07:16 Let's add the second model + a bus
09:03 Keeping parameters in line (optional but useful)
10:22 Adding the upscale before the 2nd stage
11:48 VERY important information about the 2nd upscale (SUPIR Test)
13:16 Exploring the full workflow together
20:00 Super cool tips for super cool people
▬ EVERYTHING IN THE VIDEO ▬▬▬▬▬▬▬▬▬▬▬▬
The whole enchilada: flowt.ai/community/universal-...
Model: huggingface.co/cerspense/zero...
Features: huggingface.co/docs/diffusers...
Controlnet for Zeroscope: huggingface.co/crishhh/animat...
▬ COOL LINKS ▬▬▬▬▬▬▬▬▬▬▬▬
Discord: tinyurl.com/URSIUM
Socials: linktr.ee/stephantual
Hire Actual Aliens: www.ursium.ai/

Пікірлер: 50

@stephantual 5 ай бұрын

V2 of this workflow with an even more photo-real output is out on my discord at tinyurl.com/URSIUM. I added an SDXL Lightning upscaler in addition to AD LCM, and given the option to switch the zeroscopeXL upscale to a SUPIR node. I'll continue working on this because I think it has legs. Next up: I'm adding the new modelscope implementation in v3.

@ckhmod 24 күн бұрын

You’re tutorials are so on point. You actually get “under the hood” Cheers! 🍻

@musicandhappinessbyjo795 5 ай бұрын

Bro your channel is underrated.

@stephantual 5 ай бұрын

I'm new to YT, so I'm probably not doing things 'the right way'. But that's okay, I like our community and the videos are very fun to make! Thank you for your kind words! 👽

@697_ 3 ай бұрын

I only have a 3060 laptop but I can get some nice images with your workflows you are a god at tweaking settings and I learned how to do that myself now by watching you

@Rico-nj3vl 4 ай бұрын

Pretty new to Comfy and quickly stumbled upon this workflow. I feel like a monkey trying to handle a particle collider right now but I love it ! I hope you channel blows up man, your work is awesome

@stephantual 4 ай бұрын

I've already recorded the second part of this video (oh yeah it gets better 🙂) and took your feedback into account - more detailling over what's going on, without taking an hour to explain the workflow :) hard editing work but worth it! thanks! 👽

@luman1109 5 ай бұрын

best comfy channel

@Artof3drendering 5 ай бұрын

Top tutorial, thank you for the effort i really enjoy your videos

@loubakalouba 5 ай бұрын

This channel is Gold! Merci beaucoup!

@stephantual 5 ай бұрын

De rien! :) 👽Merci!!!

@WhySoBroke 5 ай бұрын

Great tutorial and amazing workflow!

@stephantual 5 ай бұрын

Thank you! glad you enjoyed it! 👽

@ronnykhalil 4 ай бұрын

Love this. So helpful. Thank uuuu

@stephantual 4 ай бұрын

You're very welcome!👽

@johnlenoob6951 5 ай бұрын

Merci encore !!!

@pandapanda3385 4 ай бұрын

So cool!!!!!

@stephantual 4 ай бұрын

Oh if you liked this, you gonna love the next one! been hard at work on it! 👽

@hiddenbesidesone 4 ай бұрын

🔥🔥

@TR-707 5 ай бұрын

whow this looks quite good! although i suspect it has more to do with your skills

@bryanbrewer4272 5 ай бұрын

I tugged on my "workflow" while watching this.....

@stephantual 5 ай бұрын

😂👽

@SoftYoda 4 күн бұрын

Can the model take animated sequence of depth-map as input (or even better, refeed modified depth-map as input while in the running process to continuously move the scene how we wish)?

@nocnestudio7845 Ай бұрын

great job, but for render video we need quantum pc...

@blender6665 5 ай бұрын

The quality is very good, thank you for sharing the workflow

@stephantual 5 ай бұрын

With pleasure! Thanks for watching! 👍

@adrianmunevar654 5 ай бұрын

Hey! Great tool and great wa9to explain it. Is it possible to use it on image to video? I haven't seen the whole video, sorry if you already show it here 💪🏻

@stephantual 4 ай бұрын

Well the t2v model is, as it's named, t2v, and the v2v engine, specifically designed for upscaling videos from the first. However, there's a new modelscope set of nodes i'm currently recording a video on, that have an input inside the t2v for a clip and model from any sd15 models, it's mind blowing, I'm still not believing the output i'm getting, especially with supir at the back of it. I can't wait to show you guys!

@adrianmunevar654 4 ай бұрын

@@stephantual thank you for the explanation, English is not my mother language so sometimes my mind gets like [Error: 404] 😅 I'll be waiting for those news you wanna show us! 💪🏻

@sni-bd4kh 4 ай бұрын

Thanks for the tutorial! Superdope. I'm getting this error When loading the graph, the following node types were not found: ComfyPets IPAdapterApplyEncoded where I can get them? Thanks!

@stephantual 3 ай бұрын

ComfyPets is just a funny tamagochi game I put in there because it's quite funny and it's supported by Manager, but feel free to remove it. IPadapter was updated by Mat3o (the creator) and therefore is now fully out of date as it's been what, a whole 2 weeks and that's how fast things move I'm afraid :( - I will try to update all my workflows and push them to flowt.ai , I had good results with them.

@kuroderuta 5 ай бұрын

is there a way to make the clips look less high framerate/slow motion?

@stephantual 4 ай бұрын

Of course, just lower or disable the interpolator. Until recently (48h ago) it wasn't possible to generate more than 24f, but now there's an sd15 input on modelscope, so we can pass it through AD LCM , i have a video coming up on that!

@user-lk7ct8te7b 4 ай бұрын

Great tutorial, Only hiccup is when trying to download the Modelscope model, time runs out. Can you please share the link to DL the model locally? And I can put it in checkpoints folder right?

@stephantual 4 ай бұрын

They may have changed location - try huggingface.co/cerspense/zeroscope_v2_1111models under 'files and version' - mine come from this. In the next video I point out the speed of innovation and the impact it has on download in more detail. Thanks for the feedback!

@user-lk7ct8te7b 4 ай бұрын

@@stephantual Thanks, after a few retries it downloaded. Can I ask I am on your discord, but cannot find the V2 of this script, can you post a link or share it on your comfyui workflow page please?

@dukenukem8381 5 ай бұрын

I never programmed anything , what is this program you use to construct this?

@stephantual 5 ай бұрын

Oh that's comfyUI! It's useful because instead of writing code, and using tons of different libraries, you simply use 'nodes' that are connected with cables (like maybe something you used in synth software or maybe blender or nuke). This way you can be very productive very quickly! You can download it on github if you search for 'comfyUI'.I have a video on how to install it :) Cheers!

@dukenukem8381 5 ай бұрын

@@stephantual Thanks alot, i will try, however i dont think i will be successful as you.

@hongyongzhang2301 4 ай бұрын

@PeteStueve 5 ай бұрын

check out my animations so far cant wait to try this out though see if can make better.. so far your vids have been really good keeep it up

@dark9y8 4 ай бұрын

Banger @optimbro

@renwar_G 4 ай бұрын

Great video but I get this error (Primitive integer [Crystools] is missing)

@stephantual 4 ай бұрын

Just install crystools: github.com/crystian/ComfyUI-Crystools. Not all the nodes i use come from manager, these days i use it less and less as you lose control over what version of which node is installed (it's a 'all experimental' or 'all main' binary choice, and i need the flexibility).

@robertogonzalezrey5220 4 ай бұрын

Thanks for the tutorial! Superdope. I'm getting this error "When loading the graph, the following node types were not found: Primitive integer [Crystools] ComfyPets" No idea where can I find any these nodes. Could you point me to where I can get them? Thanks!

@stephantual 4 ай бұрын

Comfypets: it's a dog simulator - a bit of fun :) you can ignore it safely but it's in github if you want to play with it :) 🐶 Crystool is what i use to display the gpu/cpu stats on the side, you can replace that node with any primitive node, should work just fine 👽 Oh and, because things move FAST in our little space, I already have a v2 of that worfklow on my discord (link in desc), where I added an sdxl lightning upscaler and a supir 2nd stage for modelscope. Cheers!!!

@robertogonzalezrey5220 4 ай бұрын

I deleted the ComfyPets :-P, Also replace the integer node and all good. Thanks for all your hard work!

@robertogonzalezrey5220 4 ай бұрын

Ok, I encounter another wrinkle. I'm getting this error now: Error occurred when executing Modelscopev2v: The size of tensor a (0) must match the size of tensor b (24) at non-singleton dimension 0

@robertogonzalezrey5220 4 ай бұрын

ok, that Integer node needed a value of 70 in order to work, I had it at 1

@stephantual 4 ай бұрын

Can you please bring this to discord pleas? KZfaq comments are not very well suited for code/technical stuff :)