Even Sora 3.0 will be a killer

Haha. You have a point.

Been out for a year? will smith spaghetti is about a year old

Haha, I don't know if I'm ON the ball, as it does move very quickly, but I try to run behind it as quickly as I can!

Much Appreciated!!

Haha, camp Temu Sora! Agreed though-- more of these models is better! And each one will get better and better. The race is on!

That's my biggest hope. That a lot of these models start getting released and forces OAI's hand to drop Sora. The big swell of AI Video is happening this summer, I feel.

To be fair, it's obvious that Sora heavily curated their videos.

​@@TheoreticallyMediaSORA is bogus. It uses so much compute no regular people could ever afford it. It's never going to be released until it's somehow been optimized. I would wager that this VIDU can also do SORA level generation but they have it nerfed so it can be affordable to the public.

​@@mehfacetheir videos certainly required WAYY more compute to produce as well.

​@@mehfaceOpen AI is saying they won't really SORA because it's dAnGerOuS but the real only reason is it's too expensive and they don't want to admit that it makes it sound like some clunky far off thing. They want it to sound like they already really have it. It's to expensive, maybe movie studios will be able to afford it eventually but as things stand I doubt SORAs goof stuff will be available to the public.

Paul Trello*

100%! Got to meet Paul very briefly during that Vegas trip from a few weeks back-- sadly, I didn't actually know his work at the time. Maybe better for him, since discovering it afterwards, I would have been all "Man, you're sooo cool! How'd you do this? How's you do that?!" haha, again-- maybe for the best for him!

Totally. It has some photorealistic elements...and some gens look really good (the detective one I really like)-- but I'm really curious to see more animated looks from Vidu. I think those might be really interesting!

Yeah, that is 100% on the to-do list. I've been mulling a newsletter and (super basic) website. The site would serve as a spot to archive all the stuff I've yammered about over the last 100 or so videos. You'd be surprised (maybe not?) if you knew how often I was trying to track down one of my OWN videos to find something I knew I talked about at some point!

If you check out the back half of the video, where I talk about Shy Kids (Air Head) and Paul Trello, I think you'll see what I'm more excited about with this tech. Particularly the segment on Paul's work.

Well said 👏

I have the feeling that Runway is for SURE working on a really big update

Thank you SO MUCH! Always really appreciate see you here!

Haha, this one just happened to land on a weekend where I had a free Sunday afternoon, so I took a little time to record/edit it! But yeah-- there are 10000 other things still on the list!

Thank you so much!! Rushing ahead to keep up with that rolling ball!

I tend to think it'll be at 24p. That seems to be fairly established by most of the video generators at this point. Haven't seen 60p yet, but I'll cheat that by running it through Topaz. As far as color gamuts, nothing that I've seen yet. Although, with Sora integrating into Premiere, that has to be a must at some point.

I'll say, the captures I got from Vidu were 720 compressed videos. So, the actual quality is likely better.

they're letting folks into the beta now. I think mainly sourcing from the Discord, so join that for sure! They just reached out, so I might be doing another video on them soon-- which, hopefully means they're ramping up!

@TheoreticallyMedia Good, thanks. 👍 I watched one of those comparison videos on the best ai video generators that someone did a few days ago, but ai is so much in constant flux, that the best image, video and editing generators will continually be changing. The best ones a month from now won't be a month later, and the one leading the pack a month later will be a different one still. But the long term winner of that competition will be consumers. As long as there's healthy competition instead of a monopoly, the market will always benefit.

I knew it! hows the price of bitcoin?

@@bigbadallybaby around million...!

​@@Crazy_Truth What does $1 million buy in 2050?

​@@richardhall5489"What does $1 million dollars buy in 2050?" 1 semester of college.

@@richardhall5489 a tank of gas

To be honest, we can't be sure. I think it likely was generated by Sora, the question I have is: how many regenerations did it take, and how long did it take to render?

Hah! Saw that in the edit too-- the Canon seems intent on focusing on the mic! Gonna try to get that sorted out for the next video! Sigh just when I had Studio A tuned in...

The one in this video? That's a track I recorded awhile back but never figured out what to do with, so I figured I'd pop it in here. YT sometimes gets finicky w/ striking based off audio, so I'll often strip out the background music and replace it w/ my own.

oh, was it as silly as that?! Ok, back to submitting!

@@TheoreticallyMedia Still not working. I tried 1, 01, +1, +01 and using hyphens. Couldn't find a working combination.

Haha, I miss the onion!

the form seems to be borked right now. Another comment mentioned putting a 1 on the phone number part? Basically Country code? Seemed to work for him.

@@TheoreticallyMedia my advice to any supernatural 3.0 AI engine ? get your 2.0 website running

One of the things I've been thinking about is generating in v4 (for that dirty, grimy, surreal look) and then popping over to one of the creative upscalers to see if it'll "modernize" it. That might be an interesting way of keeping that v4 punk rock look, but update it a bit. Not to say there's anything wrong w/ v4 as is. I'm just happy that MJ lets us play with those old models!

@@TheoreticallyMedia Oh......I like that concept! Please experiment and share with us......... this could be amazing! 🙏

Also love to use MJ v4 quite often, because of the "cursed style", then I inject the pictures made as a Sref in V6

the direct link to google translate might not be working right. Try the main URL and running it through Google Translate.

@@TheoreticallyMedia Yeah, that doesn't work right now either. That's alright though, I'll give it a day or two and then try again. Thanks for letting us know about this one anyways. I never would have thought to go looking for advanced AI tools on Chinese sites like that, lol 😉

One of my favorite ones was the Detective shot, but there is some clear morphing at the start of that shot as well. I think that's just going to be something we have to deal with for a bit-- but, invites some creative solutions to get around!

oh, I missed that! That's excellent to hear!

couldn't agree more!

Yes!!! And soon! I think this year. We’ve got skyboxes already, so it isn’t far off!

Well underway!

Ask and Receive: Title: "Strumming Paws" Plot: In the quirky town of Bearton, music is everything, but no one has ever heard a bear play guitar-until now. Meet Benny, a charismatic brown bear with an unusual talent and an old, dusty guitar he discovered in the forest. Benny’s musical journey begins when he strums his first chord in the woods, inadvertently live-streaming himself using a lost smartphone. Overnight, Benny becomes an internet sensation, capturing the hearts of music lovers and the curiosity of animal behaviorists alike. As his popularity soars, Benny is invited to compete in Bearton’s legendary "Rock and Roar Music Festival," a competition traditionally reserved for humans. With the help of his eclectic group of friends-a hyper-intelligent squirrel, a fashionista rabbit, and a grumpy old porcupine who doubles as a drum guru-Benny must learn to refine his raw talent. However, not everyone is thrilled about a bear joining the festival. The reigning champion, a haughty rock star named Lance Lightning, sees Benny as a threat to his title and plans to sabotage his performance. Amidst this, Benny must navigate the complexities of fame, his instinctual habits, and a mysterious figure from the forest who claims to know the origins of his beloved guitar. As the festival approaches, Benny and his band of misfits not only have to face Lance’s tricks but also rally the town to see beyond their prejudices and embrace the music in everyone, human or bear. (To be fair, I've actually seen worse films!!)

@@TheoreticallyMedia I would legit make this. The bear needs to be played by Jack Black obviously.

There's a making of video on KZfaq. Pretty sure they still left in some distorted humans in the video despite amending it heavily.

Yup. TON of cleanup work. And from what I've read, they were looking at a ratio around 100:1 in terms of generation. So....yeah. Might have been easier just to shoot the thing.

Yup. I think in the interview, he even refers to it as a Slot Machine. There was a follow up interview where one of the Shy Kids said something to the effect of: I invite Studio Execs to try it out, just so they can see it isn't what they think it is.

Consistent Characters are not a thing in Sora yet. I presume the same in Vidu? But that remains to be seen. It's why in that AirHead video they (creatively) went with a Balloon head. It's "easy" to have a character like that. I say easy, because even then they ran into a lot of trouble. My general solution here is to prompt for very generic characters: "Man in a Black Suit with Dark hair" and then faceswap after the fact. It's a cheat, but it does tend to work. (The suit might change here and there, but usually a black suit is basic enough that no one notices)

Also, the "Tokio Walk" lady in Vidu's version is just visibly limping. Great for a zombie film 🧟‍♀️

EXCELLENT use case! I can't wait to generate a Zombie Epic!

You raise a good point there. It's funny how good cut scenes have gotten over the last few years, but there is always that uncanny valley aspect to them. I think that'll be status quo for quite some time.

It’s true. That’ll be the case for a bit. But I’m ok with it too. I think AI video can/should have its own look. Doesn’t mean you can’t tell a cool story with it!

Agreed-- although to be fair, they opened the door here, considering they called out Sora in the reel. Admittedly, I think they were being cheeky with it. Still, impressive considering the investment difference at how close they've gotten!

@@TheoreticallyMedia Yes, but here the difference in technology is the money invested, not even Google, Apple, Amazon, are close to this.

I think we'll see the very beginnings of it later this year. 3D is going to come in HARD.

Haha, WAYYYYY too much, or too little coffee in this video! haha, I messed it up a bunch, caught it in the edit and I was thinking about correcting it-- but man, I fumbled so many times I figured: just let it go and get roasted in the comments! haha

Ah, Vid-You is a good read. Haha, I need phonic company names! I can't wait for someone to let me know how badly I butchered the company and uni names!

Totally understood! I'll keep an eye on it and report, so at least you can keep up from afar!

I thought this was a different architecture? I defer to you, as obviously you're in the field-- I'm just speculating from the sidelines at best! For sure on the copy/paste-- I've seen a lot of that. I'll say, the ones I respect put their own sauce on it.

@@TheoreticallyMedia it’s a modified DiT, with temporal self-attention. They take architectures and scale the F out of them. I don’t really consider that hard nose science, just brilliant engineering. Just a strong assumption, since sora release slew of Chinese research papers popped up. Make sense.

Ngl, have thought about it! Maybe in an upcoming video!

Oh for SURE Sora was cherry picked. In that Shy Kids BTS-- I mean, the amount of work they put into the post process? And, from what I'd heard, the ratio was somewhere around 100:1 for shots. In some ways, you get the feeling it probably would have been much easier to just shoot the damn thing!

@@TheoreticallyMedia Imagine having the ability to do a script breakdown, (like a real shoot), and you have the art departments breakdown with set design, props, etc. From there you can load that up images, references or a style and it builds the scene around the breakdown and then when you prompt for that location it refers to the script notes and the breakdown and adheres to the details. Would be like having a real art department on set. Same goes for the vanities, wardrobe, etc - even a script supervisor could be working in the background. But that is going beyond far at this stage of the game. But being able to do a full script breakdown by department would seem the only way to truly get a decent short film or feature to the next level.

That's a great take. And agreed on its placement in terms of ranking. I think Runway will be making a big jump very soon!

I don’t know why anyone would see this as a Sora competition that’s really spent any time looking at what Sora can do. There’s so many indications for why Sora and OpenAI is unmatched and will likely remain so for the foreseeable future. F The thing is, it also appears to be able to do STILL IMAGES as well, so really it’s likely also better at still images than every other model. From what I saw Sora beats their own DallE3 unless DallE3 is better, and maybe they just nerfed it for public release (possible…) I bet they also have a killer Music AI that beats everyone else as well, they just haven’t announced it at all. We know Google has one they’re keeping to a small closed beta and the only reason we know about it is they released like one video promo telling us about it, and that Udio is amazing and the devs are Ex Google engineers. (I’m surprised Udio engineers were apparently not in trouble with Google for leaving and then using their Google knowledge to release their own model. Isn’t that something you’re usually not allowed to do?

I don't think it was the best call to release footage directly calling out Sora. I get that it is kind of funny, and I think meant as a fun jab, but I also think it invited comparison, which...yeah. Vidu looks like a great model (and 16 seconds!)-- it can be its own thing!

Sora actually has already been reverse engineered. Like, there's an understanding of how that model was made. Vidu apparently pre-dates Sora in terms of development, and does use a different method. Kind of fascinating really-- I think we'll be seeing a lot of new models popping up soon. And for sure, someone is already using the Sora approach for something in development.

Every once in awhile, I like to go back and watch my videos on like, Gen-1 or Gen-2 when it first launched. We've got a LONG way in a short amount of time. (I also don't watch for very long, since I hate watching myself!)

Haha, totally! That was kind of my joke with the Thumbnail. Sora Killer...which, y'know hasn't even been released yet!

Haha I was going to say Wonderwall!

and 4 months later ... OpenAI might have made improvements..

Did they update with that? There was no indication of that earlier.

I feel that. Luckily, we'll all be wearing universal translators soon! As it turns out, that Humane Pin might be worth something after all!

@@TheoreticallyMedia Well, seeing that a rather simple text-to-video tool (don´t remember which one, was mostly for educational/ commercial use and sticking stock-videos together) could translate my german, rhymed texts into english, also very well rhymed texts, within seconds and in perfect context... I don´t think you´re exaggerating when you say "soon"...

Maybe someday tech will develop a VR suit with AI control. Some people may never come back to reality. Yikes

I know one developer working on a real time game. It is still really morphy and weird, but I’m keeping an eye on his progress! Folks are working on it!

Ready Player One, indeed!