7:28 You got me at multiple consistent characters in scenes. It’s really important for storytelling to be able to have multiple consistent characters interacting with each other.

I make music in a band, and I create music videos for our songs on the platforms. I have used AI as a collaborator on a song, and I use scenes created by AI as best I can, with what I can find. Your channel keeps me on the cutting edge of Music and Video Creation. I am very excited at the idea of me putting myself and my other band members in some AI videos. Thank you for this channel.

the tech would be great to pre-vis shots before an actual shoot or better yet render the whole movie to perfect the flow before shooting begins

This is the first time I seen multiple character interact with each other

long ago, around 2007, I remember watching something on Discovery channel, a special. The person who was being filmed said these words. In the future, actors will no longer be used because movies will be created without them. We're just about there. Good or bad, it has its applications.

8:19 The ability to use this AI tool for creating comics (and graphic novels) would be amazing.

When I see glitches such as the ball going through the metal rim I can't help but to think what this technology can do someday for special effects that are closer to realism than CGI while also being simpler to accomplish.

For what i read in their paper, their attention method work through batch generation, video length is limited by memory and that is probably why resolution is so "low".

man i love your channel and your videos, thanks so much for all this updates and news, you rock!

looks great and will only improve over time cant wait to see what the future brings!

I'm trying to test a video in the github page, but I keep getting an "ERROR" in the render section a few seconds after... Although this has happened without an image reference, I'm not sure if I fully understand what they mean by "𝘪𝘧 𝘺𝘰𝘶 𝘢𝘥𝘥 𝘵𝘩𝘦 𝘙𝘦𝘧-𝘐𝘮𝘢𝘨𝘦, 𝘮𝘢𝘬𝘪𝘯𝘨 𝘴𝘶𝘳𝘦 𝘵𝘰 𝘧𝘰𝘭𝘭𝘰𝘸 𝘵𝘩𝘦 𝘤𝘭𝘢𝘴𝘴 𝘸𝘰𝘳𝘥 𝘺𝘰𝘶 𝘸𝘢𝘯𝘵 𝘵𝘰 𝘤𝘶𝘴𝘵𝘰𝘮𝘪𝘻𝘦 𝘸𝘪𝘵𝘩 𝘵𝘩𝘦 𝘵𝘳𝘪𝘨𝘨𝘦𝘳 𝘸𝘰𝘳𝘥: 𝘪𝘮𝘨, 𝘴𝘶𝘤𝘩 𝘢𝘴: 𝘮𝘢𝘯 𝘪𝘮𝘨 𝘰𝘳 𝘸𝘰𝘮𝘢𝘯 𝘪𝘮𝘨 𝘰𝘳 𝘨𝘪𝘳𝘭 𝘪𝘮𝘨" I suppose you have your image subject and just put the letters img right after that word in the prompt? Any idea how to make the thing work? Tried in 2 browsers as well, and still getting that Error in red....

How well does it perform with dynamic action like people fighting or playing sports etc?

I’ll have to try this one. Thank you for the videos ❤️

no way to download and take advantage of this model on iPad's DrawThings app?

Is there any video generation feature released yet? I couldn't find an option to generate videos in the github reference

I tested the demo page, and i have only images when generating.... not a video, have you got it to work?

tbh my hopes are still on LTX. It is an awesome platform already but certainly has to learn alot. Time will tell how well it´ll turn out, but I´m rather positive at moment.

Very nice. Will try to use this in my ai music videos.

Thanks you. This is really cool. Now all we need is a tutorial on how to run this locally.

Absolutely extraordinary. AI video is developing faster than we can keep up with it.

What are the vram requirements though?

Leon Ding leaked a lot of Google AI technology to the P R C

Thank you Samson once again an amazing video...

I've tried it today and I would just say it's ok but far from what the demo has shown. It still suffers from the typical Stable Diffusion problems which is prompt understanding and complex scenes. In its current state, I don't think it is useable. It is an improvement from what we had. Hopefully future updates could fix some of the obvious issues.

Thank you for this video!! Very useful to me :) You explain very well.

I have tried to make this work using the demo, It never does though. I am not sure about what I am doing wrong. I always get an error.

What is the software?

I try it on Hugging face, on white tiger with armor, and there is no consistency of the armor, what do I do wrong ? this is far from this video

Open Source is still very underrated but things like these demonstrate the potential in AI.

This looks great; AI creating video content is a trend for the future.

When can I use this?

Anyone know how to install this locally?

I hope they add a landscape 16:9 aspect ratio, so we can create clips for AI movies.

what kind of computer do you need to run this at home?

Anyone knows how to get a consistent background using Gradio or ComfyUI ?

Hmm... I can't get it to work. It just keeps saying error.

13:01 that's not a scene in England...it's an astoundingly accurate rendition of a view probably across Princes Street up towards the mound in Edinburgh, Scotland. I've seen that view often. Details like the unusual lamp and recognisable buildings are astoundingly accurate, actually. I nearly fell off my seat when I saw it! Good grief the bus is even the 900 city link Edinburgh to Glasgow bus and the text on it is legible!

hey Samson i love your videos... I was wanting to ask you a couple of questions if you have time to answer...1 What is the AI video generator out there that anyone can just use that has the longest videos? and 2 When do you think Sora will be ready for people to use? like how long will it be before just anybody to use it ? i know you may not know the answer to #2 but maybe you can give me your best educated guess at it ... thankyou so much for making these videos for people like myself

I’m here for an open source Ai 👏🏾 but any indication what it’s trained on?

amazing cheers

Is there just a paper? How can we run the code?

Woah. Exciting times. Things are improving so fast now. I can handle some of the glitch if i get more continuity and length 👍

I'm waiting for the day when we can scan in the pages of Japanese manga and also load in a episode or two of the related anime series have ai figure out the characters the voices and the music and create all new episodes based on the manga.

This is crazy bro

Opensource, sounds more than good. Will give it a testrun now

2:24 a glitch spotted on her eyes!

honestly asking, but has anyone ever made one the huggingface demos make run? I mean of any ai animation tool made by any bytedance group. Up until now no colab or demo page ever worked same in this case.

I KNEW that wolves spawned at different spots in the woods! There had to be a reason they put it in so many games!

Dude how do I install locally? Would you consider doing a setup tutorial please?

My heart is breaking for visual artists, genuinely. I used to wish for the advancement of technology, now I regret for what I wished. I'm super impressed with all of this, but genuinely, I say sincerely, this scared me and fills me with existential dread. It seems like we're gaining something amazing, but deep down I know we're losing something we won't get back. God help us all.

Maybe I'm missing something. But all the stuff I've seen from Sora recently and in this video looks way better to me.

It seems like this isn't actually open source yet (the video generating part)... Am I correct in this understanding?

I don’t think Sora AI is out to the public yet but we will see it’s great to have good competition though

AI is going scarily fast. Mainly in algorithm optimization. We're getting ultra powerful models on consumer hardware. Insane stuff This is going to go out of control

can you make locall install turorial?

I can't testify to the video stuff. However, I tried the "comic book" (think graphic novel) stuff on 2024-MAY-09. Here's the problem. The system ignores your "story beat" prompts and just generates five different versions of your "character" prompt. Now, that's not a bad thing because you can then take that into Photoshop and move everything around into place. However, this is not a one-stop shop for graphic novel generation. Second, if you say "speaking", the character is not speaking. If you say "knock on door", the photo looks like a selfie. If you choose "photographic" you'll still get comic book style. Also, it does not apply the images to a "page". So if you ask for a 1024x512 page, you'll get five 1024x512 panels and you'll have to build your own page in Photoshop. Unlike a Stable Diffusion site that will give you four images per press of the button, this site will give you the same quantity of images but make sure the uniforms are consistent. It seems as if the system uses text-to-image to make a baseline and then runs that through an image-to-image to get a final result. So far, there are a lot of promises but very few victories. We'll see.

The only problem is that I have tried this thing several times and it always says _"Error."_ So, this doesn't count as an AI video generator to me until I can actually GENERATE some videos.

Video related code is not yet released. Only makes images so far.

Embarking on a journey of storytelling and video exploration, and VideoGPT seamlessly integrated into my process, amplifying the professionalism of my content.

Awesome :)

so when will there be a full movie Christopher Reeve Superman v.s. Bizarro?

- [00:00](kzfaq.info/get/bejne/oMCHhah_1qnQZn0.html) 🎥 Overview of Story Diffusion Model - Introduces "Story Diffusion," an open-source AI video model. - Highlights the model's ability to maintain character consistency and adhere to reality and physics in videos. - Discusses the model's advancement in character consistency, including facial, clothing, and body type consistency. - [01:03](kzfaq.info/get/bejne/oMCHhah_1qnQZn0.html) 🖼️ Creation of AI Comics using Story Diffusion - Demonstrates the generation of AI Comics with consistent characters and movement. - Explains the process of creating sequential images and animating them for comic generation. - Discusses the potential of AI Comics production enabled by Story Diffusion. - [02:56](kzfaq.info/get/bejne/oMCHhah_1qnQZn0.html) 🤔 Comparison with Existing AI Video Generators - Contrasts the capabilities of Story Diffusion with other AI video generators. - Highlights the realism, consistency, and fluidity achieved by Story Diffusion. - Discusses limitations and minor imperfections observed in Story Diffusion's output. - [07:11](kzfaq.info/get/bejne/oMCHhah_1qnQZn0.html) 💻 Accessibility and Usage of Story Diffusion - Addresses the accessibility of Story Diffusion, available as open-source but lacking a usable interface. - Describes options for accessing Story Diffusion, including downloading/installing or running online on a Cloud Server. - Discusses the significance of Story Diffusion's multiple character inclusion feature for scene consistency. - [09:45](kzfaq.info/get/bejne/oMCHhah_1qnQZn0.html) 🧠 Mechanisms Behind Story Diffusion Model - Explains the technical mechanisms employed by Story Diffusion, including consistent self-attention and story splitting. - Describes how consistent self-attention ensures visual coherence across generated images. - Discusses the process of story splitting and motion prediction in creating narrative sequences. - [14:48](kzfaq.info/get/bejne/oMCHhah_1qnQZn0.html) 📈 Evolution of AI Video Generation - Reflects on the advancements in AI video generation enabled by Story Diffusion. - Emphasizes the potential for creating realistic and cohesive scenes with AI-generated videos. - Encourages exploration of Story Diffusion's capabilities and contributions to the field of AI video production.

Getting better and better. New storyboard less, actor less movies soon on the way.

nice share

It is crazy

Not bad at all!!!..

Phenomenal

Real question: Do you have access to Sora or Story Diffusion? If not, how are you drawing any of these conclusions?

How do i download it and install it please/ I tried but it didn't work - There was no.exe file or anything to install in the folder i got and extracted from github.... how the heck does this work?

Hmmm, thus far it draws the same character ok, but does not draw even basic story panel ideas for my explorer on a strange planet comic, so like 'leaving ship', 'discovering ancient ruins', just give the same character in same pose with slightly different backgrounds.

Impressive stuff! But it also frustrates me that some new A.I. papers present all their examples in a square video. No one wants square video's, they should give examples in 16:9. I'm hoping for a platform that combines different features, like adding the audio (speech and singing) from a file to a video. Everything is so scattered right now, technologies need to merge into a basic set of video and audio features. Hard to say what we'll all be able to generate in one year's time.

... all of the physics and context consistency issues gets solved by an inevitable linkup between something like unreal engine and AI ... to a large degree these crude iterations aren't worth getting into too deeply because a year from now they'll be seen as something like mid-journey 1 ...

2:25 scared the crap out of me

I only wish that the term *create* when using AI would be replaced by *having AI generate* whatever is labelled AI "art".

Nice vid. You need to do this stuff for a living.

Google VEO Is the king

I love you bro

Apakah wajah yang dibuat Sora mengambil dari real person?

6:09 Sora still looks at least one generation farther .... but beeing open Source makes Story Diffusion very very interesting!

I get nothing but errors on the demo and when I did get a generation, it was garbage and couldn't even download result from the hugging face site. Until I see this working locally, I can't take Story diffusion seriously. Something seems off🤔

What is this pleasure. Could it be made. Digital Renaissance here in my stay. I am so happy. My Ai-Asian isekai desire in this reality.

An Advertising company can literally spend pennies with this breakthrough

Guys plz inform about tool which r coming soon, not like Sora and LTX, which God only knows when they gona released

Bro you made so much ai video software video I don't know which one to watch

this would be much cooler if it actually worked...

Actually, the bear isn't as consistent as you claim. Note his chest at 5:05-08 compared to 5:09 where his chest has a vanilla inset.

It doesn't work

So is it available for use now or??

Does not work even test demo program does not work needs more work, even test examples do not work.

SORA KILLER!

In the demo clip with the black girl and headphones her necklace disappears as she moves.

Until they add mouths that move with voice (either within or addon or after effect), there won't be movies as we understand them.

thanks for the vid, website is down/overload by now :D

This is like Stable Diffusion 2 trying to do videos. It's literally no more impressive than Sora...

The Demo seems to be cooked at this point, no matter what I do it results in an error.

what about music?

_Story Diffusion_ looks much more impressive than _Sora_ when it comes to the characters' animations and emotions. By the time that _Sora_ is actually released to the public, people won't be as excited for it as they were before. Just look at how it's only been two months and a half since _Sora_ was first revealed but we already have _Vidu_ and now this. And keep in mind that _Sora_ doesn't have a release date yet. Something tells me that certain _"Open"_ company could be about to be dethroned...

What about the cannabis leaf in the middle of the book lol😂

What I like about your video the most? The explicity of the title... like cheapest yellow-press. THE SORA KILLER. Eye witnesses saw him lurking the streets. Before he attacks he politely asks... Is your name SORA? If you reply YES. YOU ARE DEAD. Please report any relevant details to the next police station or your desktop lamp.

how can we earn from this skill?