GPT-4o is WAY More Powerful than Open AI is Telling us...

Рет қаралды 251,755

Күн бұрын

OpenAI just unveiled their new GPT-4o model, and it's more powerful than we ever imagined! In this video, we dive deep into what makes GPT-4o truly multimodal, capable of generating text, images, audio, and even video. Discover the groundbreaking features and hidden capabilities that OpenAI didn't fully reveal. From stunning image creation to lifelike audio generation, GPT-4o is set to revolutionize the AI landscape. Watch now to uncover the full potential of this game-changing model!
▼ Link(s) From Today’s Video:
GPT-4o Page: openai.com/index/hello-gpt-4o/
Min Choi's Awesome Thread: / 1790416703404302463
Open AI YT channel: / @openai
Greg Brokman GPT4o image gen: / 1
Smoke away prediction: / 1791142705244127481
► MattVidPro Discord: / discord
► Follow Me on Twitter: / mattvidpro
► Buy me a Coffee! buymeacoffee.com/mattvidpro
-------------------------------------------------
▼ Extra Links of Interest:
AI LINKS MASTER LIST: www.futurepedia.io/
General AI Playlist: • General MattVidPro AI ...
AI I use to edit videos: www.descript.com/?lmref=nA4fDg
Instagram: mattvidpro
Tiktok: tiktok.com/@mattvidpro
Second Channel: / @matt_pie
Let's work together!
- For brand & sponsorship inquiries: tally.so/r/3xdz4E
- For all other business inquiries: mattvidpro@smoothmedia.co
Thanks for watching Matt Video Productions! I make all sorts of videos here on KZfaq! Technology, Tutorials, and Reviews! Enjoy Your stay here, and subscribe!
All Suggestions, Thoughts And Comments Are Greatly Appreciated… Because I Actually Read Them.
Timestamps:
00:00 Introduction and Initial Reactions
00:36 Overview of GPT-4o and Multimodal AI
01:42 Comparison with GPT-4 Turbo
03:22 Text Generation Capabilities
07:22 Audio Generation Capabilities
12:22 Image Generation Capabilities
19:04 Advanced Features
23:27 Video Understanding Capabilities
27:34 Conclusion

Пікірлер: 1 100

@MattVidPro Ай бұрын

I think the image editing is one of THE most mind blowing pieces of this... What do you guys think?

@CallMeThyme Ай бұрын

I think its Amazing. Also, love your videos. Ive watched for almost 2 years!

@muuuuuud Ай бұрын

I'm wondering how far off we're from a universal real time translator between humans and some animals. O.O We might get an earful soon. X3

@The_MostHigh Ай бұрын

When are these image capabilities released, i tried recreating the samples with chatgpt 4o by copying the prompts and steps but could not generate consistent characters?

@nathanbanks2354 Ай бұрын

I think it's the latency of audio -> GPT-4o -> audio (around 200ms) vs audio -> whisper -> GPT-4-turbo -> elevenlabs (around 800-1200ms).

@Fytyny Ай бұрын

@@The_MostHigh 4o available for users is only used to output text. They said they are going to release it step by step and for the next step they will release audio output for pro users in couple of weeks. So we will have to wait for all that.

@itsallgoodaversa Ай бұрын

14:17 Matt, the multiple whiteboards/chalkboards at the top ARE realistic. This is actually how chalkboards in older classrooms used to work. They would have multiple chalkboards on sliders that you could pull up and down.

@DeceptiveRealities Ай бұрын

Note that it also inset the top one inside the bottom one, as one would expect.

@neelmodi6693 Ай бұрын

Most chalkboards I've seen are still of this variety--several overlapping chalkboards that slide up or down depending on which one you want to write on in the moment.

@jnxmaster Ай бұрын

Yes, these are still commonplace on universities.

@AmazingArends 29 күн бұрын

I never saw a multiple chalkboard like that… 🤔

@82NeXus 29 күн бұрын

It might be 'meant' to be a multi blackboard, but if you look at it, it's structure isn't at all realistic. I wonder if current models such as GPT-4o use their understanding of basic physics, structure and mechanics when they create images, like a human who's used to living in this world would? They do display some understanding of those things in their text output. But unlike humans, they don't have tactile experience of the world to draw on. And does GPT-4o have 3D vision? Most of it's training images will be 2D!

@reifuTD Ай бұрын

One of the things I think I would have try with GPT-4o is take a photo of a page from a manga or comic book or even a novel and ask it to read back the text in voice of of the characters as they speak.

@ReLapseJunkie Ай бұрын

Nice

@fynnjackson2298 Ай бұрын

...and then to generate sidequests and with Sora to convert them into Marvel style video imaegs while GPT reads it in a emotionally dratic voice.

@1x93cm Ай бұрын

Bruh, with Sora you could have it animate its own anime.

@justinwescott8125 Ай бұрын

Don't forget sound effects and background music

@ClayMann Ай бұрын

I'd like to see how Sora level A.I could re-imagine comics. Imagine if each panel was fully animated. so trees blow in the wind, characters breathe and of course talk what's in their bubbles. A running character would have the scenery fly by and all the animation would be derived from the panels. I'm not even sure how you would read such a thing. As one long flowing video going from panel to panel? or have panels execute as video as you hover over them? Maybe something far more bizarre where what a comic is melts away to be replaced by some fusion of photorealism and motion translating the comics intention into actual little movies. this kinda sounds crazy but seeing what is coming I don't think its beyond Sora level engines from Google and OpenAI.

@chrisbtr7657 Ай бұрын

I don't know about everyone else but most of the people I come in contact with have no clue about the rapid developments in AI. Kind of eery...

@SignumEternis Ай бұрын

Yeah, I've been saying for a while now that a lot of people are going to be completely blindsided by how much things are going to change soon with how fast AI is advancing. Even as someone actively following it I find myself being blown away fairly often. The future is gonna be wild.

@chrisbtr7657 Ай бұрын

@@SignumEternis Oh yeah big time and if you follow it and have a somewhat tech savvy / biz mind then there are so many oh sh$! moments. On my end most are not paying attention and going on with business as usual. That is unless they are in an industry that is suddenly being directly impacted.

@jros4057 29 күн бұрын

I tried showing family that gpt 4o vid and they didn't get it and turned it off half way though.

@CJ-jf9pz 29 күн бұрын

I some what follow or try to and even I feel blindsided how far they've come. Then I imagine how far they have actually gone but have shown us yet

@chrisbtr7657 29 күн бұрын

@@jros4057 yeah and just one of the scenes from that video - the ai teaching the kid math. That is a major paradigm shift. To think teachers could soon be replaced with a much smarter and more efficient system in ai. Not saying that's a good thing but it is what it is and we have to deal with it. Just that piece alone is normalcy shattering news. But yeah most people don't seem that interested. It's wild

@helge666 Ай бұрын

GPT-4o is also A LOT more reliable when it comes to long-form text processing. Not even comparable to either GPT-4 or Gemini. It follows the prompt much better, doesn't get lazy so easily, and doesn't start to hallucinate so quickly. I tried four hours to get GPT-4 and Gemini to do what I wanted, and they failed miserably. GPT-4o completed the whole damn task in 40 minutes without so much as a hiccup.

@ronilevarez901 Ай бұрын

How come? I got kicked back to 3.5 after 4 messages. I can hardly do anything with that time. And having to wait 4 hours to keep the chat is not convenient.

@helge666 Ай бұрын

@@ronilevarez901 Good question. GPT4 threw me out after countless attempts to get it to do what I wanted, and GPT-4o just did it. I'm in Germany, maybe it's a time zone thing, less traffic at my CEST time, and therefore less bandwidth/token restrictions? I gave it this prompt (in German language, because I was working with German PDF documents): Bitte lies das angehängte PDF-Dokument vollständig durch und formatiere den Inhalt gemäß den folgenden Anweisungen: - Entferne alle Bindestriche (-) aus dem Text. - Korrigiere das Spacing von in Sperrschrift geschriebenen Wörtern, sodass sie normal dargestellt werden (Beispiel: aus "R a u m s c h i f f" mache "Raumschiff"). - Entferne alle überflüssigen Sektionskennungen (z.B. "B-20" oder "C-1"). - Vermeide doppelte Überschriften und stelle sicher, dass jeder Abschnitt klar und einmalig betitelt ist. Ändere oder erfinde keine Worte oder Inhalte. Bitte erstelle keine Zusammenfassungen. Verwende lediglich den originalen Text. Formatiere den Text in sauberem Fließtext, achte dabei auf korrekte Absatzbildung und Zeichensetzung. Bitte führe die Bearbeitung in einem Durchgang durch und präsentiere das vollständige Ergebnis.

@V-ob5zf Ай бұрын

@@ronilevarez901 He probably had a Plus Account. The limit rates are 5 times in plus accoutn

@matiascoco1999 29 күн бұрын

@@ronilevarez901probably using the API, so different rate limits

@therainman7777 29 күн бұрын

@@matiascoco1999Or just a Plus subscriber.

@MikeWoot65 Ай бұрын

Idk if i'm more impressed with the life-like sound of the voice, or how human it feels to interact with (ie. it understands our emotions)

@dmitrysamoilov5989 Ай бұрын

It doesn’t actually work when you use it, the demo must be a better model

@The1QwertySky Ай бұрын

@@dmitrysamoilov5989it's not out yet fully

@DeceptiveRealities Ай бұрын

@@dmitrysamoilov5989 That hasn't been released yet. It's coming in the new app.

@DeceptiveRealities Ай бұрын

I hope it has a changeable voice and can have that over-the-top expression dialled down. For my non-American ears it sound raucous and emotively fake.

@tracy419 Ай бұрын

@@dmitrysamoilov5989it's being released over several weeks

@MattVidPro Ай бұрын

Timestamps for yall: 00:00 - Introduction and Initial Reactions Introduction to the video. Reaction to OpenAI's real-time AI companion. 00:36 - Overview of GPT-4o and Multimodal AI Explanation of GPT-4o. What does "multimodal" mean? 01:42 - Comparison with GPT-4 Turbo Differences between GPT-4o and GPT-4 Turbo. Audio capabilities of GPT-4o. 03:22 - Text Generation Capabilities Speed and quality of GPT-4o's text generation. Examples of high-speed text generation. 07:22 - Audio Generation Capabilities Demonstration of GPT-4o's audio generation. Examples of emotive and natural voice outputs. 12:22 - Image Generation Capabilities Explanation of GPT-4o's image generation. Examples of high-quality image outputs. 19:04 - Advanced Features Image recognition and video understanding. Examples of practical applications and scenarios. 23:27 - Video Understanding Capabilities Discussion on GPT-4o's video capabilities. Potential future developments and limitations. 27:34 - Conclusion Final thoughts on GPT-4o's impact and potential. Invitation to viewers to subscribe and join the community.

@mylittleheartscar Ай бұрын

Can't wait till they cracked their own 1M+ tokens

@ouroborostechnologies696 Ай бұрын

"yall" is not a word

@LAIDBACKMANNER Ай бұрын

@@ouroborostechnologies696 Yeah it's "Y'all", you fuckin' grammar Nazi, lol.

@AmazingArends 29 күн бұрын

@@ouroborostechnologies696 neither is "gentleladies" but they now use that in Congress 😂

@NinetooNine 26 күн бұрын

I am curious, what do you think about Open AI getting rid of the Sky voice (the one that sounds like the voice from "Her") from their Chat GPT 4o model.

@fynnjackson2298 Ай бұрын

Services like Audible should release AI that reads the books, but also allows you to talk about the topics, do quiz tests, and more, making the entire book library an instant interactive homeschooling study resource for anyone wanting to level up in life. In contrast to just 'consuming' audiobooks as we do in todays passive one way relationship dynamic.

@Ahm.elzain Ай бұрын

I have indeed been saying it’s the inhabitants of digital by spiritual beings jins to interact and communicate with human through “ technology “ tree frame ayyyy!! The final form set but rolling out gradually in order to be accepted normalise it.. collect consciousness

@Suhita-ys6hd Ай бұрын

pretty sure theres a pdf reader chatgpt bot, you dont even need audible to do this, just need your book as a pdf file.

@JBDuncan Ай бұрын

@@Suhita-ys6hdDo you know the name of it?

@AmazingArends 29 күн бұрын

That would be cool, but they have to get rid of the bias first, so if you read a book with a conservative point of view, the AI won't lecture you for engaging in political incorrectness! 😂

@fynnjackson2298 29 күн бұрын

@@Suhita-ys6hd nah, I'd like the low latency and choice of reading tone with GPTo. Other current apps still feel like talking to a robot so to speak

@evil1knight Ай бұрын

Chalkboards often have multiple boards that slide onto of each other

@fobusas Ай бұрын

My old middle school used to have ones that swing over to the side

@ta1k2t0ny 29 күн бұрын

my thought exactly

@kfrfansub Ай бұрын

the most mind blowing think is the speed. With that speed and variety of natural voices you can make a real rpg game with Ai NPC

@markmuller7962 Ай бұрын

Can't wait

@JaBigKneeGap 15 күн бұрын

even an entire game by it, i been already trying to get it to make me Js rpg, the visuals are stuning

@kfrfansub 15 күн бұрын

@@JaBigKneeGap if you have a video of this running on a rpg, I'll love to see it

@starblaiz1986 Ай бұрын

15:53 Actually no, the image generation didn't screw up. If you look that's actually EXACTLY what is written, including capitalisation (or lack-thereof). What's even more impressive is that it actually split the word "sound's" across multiple lines and it did it completely corrctly! Actually mind-blowing! 🤯🤯🤯

@JonasMcDonald Ай бұрын

This

@Omii_3000 Ай бұрын

FR Mattvidpro failed English 101 Lollll

@freecivweb4160 Ай бұрын

No, hyphenation happens between syllables of multisyllabic words, that's the rule.

@JREinaNutshell331 Ай бұрын

I'd even say its more impressive that it seems. They deliberately made a mistake with "sound's" and Chatgpt4o didnt correct the mistake (which it should have done due to it's correct training). So ChatGPT4o did exactly what the prompt said even tho it's against its training Or am i wrong here?

@quarksandaces2398 29 күн бұрын

It got "everything" wrong

@SpikyBlade Ай бұрын

Man, the image understanding of GPT-4o is crazy

@Angel-Azrael 29 күн бұрын

Yes, asked it to transcript scanned hand written birth certificates from the 1800s that I can't read most words, in portuguese, it works, some errors but its mind blowing

@peterlang777 29 күн бұрын

at this level of functionality hooked to a global database like the internet it would be able to do 80% or more of human jobs

@dot1298 27 күн бұрын

is there a risk, the US gov could confiscate it away from OpenAI and use it for the Pentagon etc?

@dot1298 27 күн бұрын

…under Trump?

@peterlang777 27 күн бұрын

@dot1298 yes see ISA act of 1952 by Eisenhower. (invention secrecy act) its unlikely though as the public knows about it already

@johannesdolch Ай бұрын

Honestly regarding images: What we really need IS multi-modality. The images produced by common models like SD are good enough. The problem is that it doesn't really understand what it is doing. If they can keep the quality of current models and just add a deep understanding to it, that multiplies the actual quality of the outcome by orders of magnitude in the sense that you get what you actually want AND can change specific things instead of getting images that so-so follow a prompt somewhat and then inpainting and hoping for the best.

@jaredf6205 Ай бұрын

No other image AIs have access to language models that good.

@antonystringfellow5152 Ай бұрын

Yes, I've been saying this all along. The human brain isn't separate modules, trained separately then cobbled together. It does have specialized regions but it learns together, as one. In doing so, it makes many associations. Most of our knowledge/memory is formed through multiple associations. For any AI to have truly general intelligence, it must be able to do the same. This is how we are able to transfer one set of knowledge/skills to a new area or novel task. Other image generating AIs often screw up the hands because they don't understand what fingers are, let alone that we have eight fingers and two thumbs. If you watch AI generated videos, you'll see similar strange things happening like people walking into walls then disappearing. They can generate photo-realistic videos but don't understand what the images represent. A truly multi-model model solves these problems.

@14supersonic Ай бұрын

These aren't really LLMs anymore. @@jaredf6205

@LAIDBACKMANNER Ай бұрын

In order for it to have true "understanding" it would have to become conscious... Which, in the field of A.I., will enviably happen someday. Hopefully later rather than sooner, lol.

@minimal3734 Ай бұрын

It seems that when learning multiple modalities, they reinforce each other and interact in a way that increases intelligence in a non-linear way.

@fabiankliebhan Ай бұрын

About the chalkboard. I think the dual chalkboards are not unrealistic. We had those a lot when I was studying. You could move them up and down to have more space.

@yt45204 Ай бұрын

Our lecture halls had high ceilings and triple chalkboards

@nathanbanks2354 Ай бұрын

An odd thing about GPT-4o is that it's better at poetry than it used to be. It has a better idea of the meter of a limerick or a sonnet than it did before it had a multimodal understanding of what words sounded like. Words like "love" and "prove" don't rhyme any more. You can see this by asking GPT-4 turbo and GPT-4o to produce poems using the existing text interface. It's also the first time I found a model that can reliably produce a Petrarchan/Italian sonnet instead of a Shakespearean/Elizabethan sonnet--previous models always used the much-more-common Elizabethan rhyming scheme.

@Rantarian Ай бұрын

There's only a handful that can do poetry properly. GPT-4o is one of them. I've experimented with having non-rhyming poems, mixed meters, and a focus on a variety of poetic techniques. It is absolutely capable of creating a poem using metaphor at a distance to talk about something apparently unrelated to what it seems on the surface.

@82NeXus Ай бұрын

@@Rantarian That's incredible. But I can believe it. I think maybe these models have more understanding than a lot of people think. People often saying they don't understand things the way humans do. I don't get it. To me a thing is either understood or it is not. The mode or mechanism of understanding of ML models vs humans may be very different; but to me that's irrelevant! Understanding is an abstract capability that has nothing to do with physical process or mechanism. I'm sure it is in AI companies' interests to downplay the intelligence / understanding / power of these models, so that they can get on with developing, releasing and in some cases commercializing them, without too much pushback or regulations!

@minimal3734 Ай бұрын

@@82NeXus I agree with that. The statement that AI models don't “really” understand is absurd. Understanding cannot be simulated. It is there, or it is not.

@alexmin4752 29 күн бұрын

It make sense since rhyme is basically sound. If a model has no comprehension about what sound is it all, it can't generate poetry. It can only roughly mimick writing style of real poets. It's the added sound modality that made it better at rhyming.

@nathanbanks2354 29 күн бұрын

@@alexmin4752 Precisely.

@user-xj6ke4qk8t Ай бұрын

The ability to read / show screen share your desktop and dictate is game changer for context as you can demonstrate what you want done rather than just trying to describe it.

@allanshpeley4284 28 күн бұрын

It really is. This is the main tech I've been waiting for. Unfortunately it's only rolling out for Mac initially. And I'm not sure we'll be able to screenshare with it in real-time and train it to use our programs/tools. But that can't be far off.

@wannaBtraceur Ай бұрын

This is the first AI model that I feel the urge to use. The capabilities are incredible.

@iamjohnbuckley Ай бұрын

Cracked me up at “I wouldn’t even be able to tell you this was a missile in the first place! This things a professional!” 😂

@82NeXus Ай бұрын

Has anyone verified that it got the missile picture right? Coz ChatGPT 3 could've convinced you that that missile came from anywhere 😂

@apache937 28 күн бұрын

i dont even see a missile

@stevelamb6720 12 күн бұрын

I thought the missile was actually part of the question, which is what triggered it to think it was.

@alansmithee419 Ай бұрын

14:10 many university blackboards like this come in sets of three at different depths above the wall. You can slide them up and down to access the other boards. It allows the lecturer to keep writing on new board while allowing students to still see previous steps in the lesson if they need to look back and also means the professor doesn't have to waste time erasing the whole board every 5/10 mins.

@WordsInVain 24 күн бұрын

12:27 Unless it's an app specific feature, GPT-4o in the ChatGPT interface explicitly states that it generates images using DALL-E 3.

@TrueTake. Ай бұрын

It’s understanding of the world is next level. That understanding translates to, what Open AI even said is, abilities still being realized… They don’t shy away from saying AGI is imminent, I think if you give it video and indefinite memory that WILL be AGI.

@fynnjackson2298 Ай бұрын

yupp, pretty much , just ad in memory and video and its AGI, however I'd love it to have a say 160 IQ aswell

@JohnSmith762A11B Ай бұрын

@@fynnjackson2298Could Einstein speak 50 languages? IQ cannot capture what an intelligence like GOT-4o really can do. No, it’s not perfect, but perfection isn’t required for AGI.

@TrueTake. Ай бұрын

@@fynnjackson2298 I think It’s already at child level now and will shoot past 160 pretty fast after AGI level to SGI, depending on the guardrails.

@minimal3734 Ай бұрын

@@TrueTake. "at child level"? I think it's light years ahead of average human capabilities in most areas.

@AtliOddsson 24 күн бұрын

The 4.0 supposedly had a calculated IQ of 155

@fynnjackson2298 Ай бұрын

Just the fact that we have to rethink the trajectory of our lives and how we operate because of all this new tech is so awesome. AI + humanoid robots on mass scale, plus robo taxis plus compounding technical advancements in all areas. The future is coming and its coming faster and faster. What a trip!

@ihatekillerclowns 26 күн бұрын

You sound like a tech slave to me.

@johnwilson7680 29 күн бұрын

Another great video. It's so strange that they didn't mention any of these breakthroughs during the demonstration. Can't wait for it to be fully rolled out.

@moxes8237 Ай бұрын

I remember reading Nick Bostrom book “Superintelligence, paths and dangers,” and in one of his chapters I remember reading somethings That stuck with me that goes somewhat like this “ I can see a scenario where any one entity who is six months ahead of everybody else is enough to win the game”

@antonystringfellow5152 Ай бұрын

Less than 6 months ahead is probably more than sufficient.

@1x93cm Ай бұрын

yeah but the game of money is soon coming to an end. Once you make AGI, ASI is a step away. How long can the current system function when nobody is necessary. They just released a chinese robot that costs 16K and can do most anything. Add in this GPT4o and the BTFOs all low skill wagies.

@Brax1982 Ай бұрын

@@1x93cm Ah...did China tell you that they did that?

@14supersonic Ай бұрын

@1x93cm I think you misunderstand how AGI and ASI will actually change humanity necessity. Even with the most advanced AI and robotics, humans will always be necessary. Resources and work are needed, and if anything human intelligence will become even more of a commodity. Machines can't replace our creativity no matter how smart they might get. Getting rid of humans in labor how we think of it now would be beneficial, but removing human power out of the equation entirely would be foolish. Don't forget the greedy people who will not allow the machines to take their resources and money away from them to begin with. What do you think all the regulations are for? It's to protect them from AI, not us.

@1x93cm Ай бұрын

@@14supersonic if there is an economic incentive for something- it happens. If there is an economic incentive to replace most if not all human labor itll happen and nobody will care about the consequences. After seeing drone videos from ukraine, it would be very easy to put down any uprisings that result from mass unemployment or unlivable conditions. The solution will be the creation of a sideways economy similar to the localized economies of favelas.

@levonkenney Ай бұрын

whats scary is that sora ai video generation is this good now imagine ai video in 1 year 2 or even 3 its going to be crazy

@fynnjackson2298 Ай бұрын

film remakes on demand.k, but so good they all get a 9.0 IMDB rating.

@michaelmcwhirter Ай бұрын

Great video Matt! Thank you for all the helpful information 🔥

@gpierce6403 Ай бұрын

Great video, thank you for keeping us all informed on the latest AI!

@I-Dophler Ай бұрын

The image editing capabilities are truly mind-blowing. With music, video, and audio generation advancements on the horizon, the creative possibilities are endless. Many thanks.

@alansmithee419 Ай бұрын

The moniker "omni" implies to me something bigger also, though I doubt it's true: "omni" meaning "all" suggests that the AI is capable of using literally any modality, and working with all modalities together. Since this is clearly not the case, it may instead be that it actually means it is in some way modular, or easy to retrain to add extra modalities that it is currently not able to use without hindering its ability to work with previously learned modalities. Again, very much doubt it, but that's what the name should suggest. OpenAI probably just thought it sounded cool.

@blisphul8084 Ай бұрын

Mixture of experts with some experts having additional modalities perhaps?

@brexitgreens Ай бұрын

"Omni" instead of "multi" because seamless and arbitrarily generalisable to any modality. A prelude to embodied GPT.

@FredPauling Ай бұрын

Maybe there are some modalities it trained on that are not yet exposed. I can imagine robot joint angles, torques, velocities, accelerations being important for their robotics partners using end to end learning

@antonystringfellow5152 Ай бұрын

I believe it is true. They even give a strong hint of this on their website. "Since this is clearly not the case," - Can you explain this for me? I must have missed something.

@therainman7777 29 күн бұрын

I think Omni simply means “all” as in “all commonly used modalities.” I don’t think it’s much deeper than that.

@kingofkings652 Ай бұрын

Last time I was this early there weren't even animals on land.

@brexitgreens Ай бұрын

I know that feeling. 🥇🏆

@echoes28 Ай бұрын

Ha ha you're old

@choppergirl Ай бұрын

I know right, the first time we visited this planet everyone was dinosaurs. So we interfaced with you as dragons. Then there were people in togas playing lyras so we interfaced as Greek gods. Now there are little men everywhere playing video games, so we interact with you as AI deep fakes.

@nuttysquirrel8816 Ай бұрын

🤣😂😆

@Paranormal_Gaming_ Ай бұрын

You was not we know it"s bullshit

@corsoandcanvas 28 күн бұрын

Such a great breakdown! I really appreciate how deep you went on all the elements that weren’t presented. Big fan!

@tsforero 28 күн бұрын

Matt, you ponder the question a few times whether the answer to these new capabilities is really just the multimodal aspect. I absolutely think that this is the case. The key, as we now all understand, is context and memory. With a greater diversity of context clues (modalities), it makes sense that the contextual understanding of the model becomes more complex. And we now know greater complexity = greater intelligence. We now have the following levers for increasing intelligence in AI: 1. Neural connections 2. Context, memory, attention 3. Input training data 4. Diversity in modalities Would love to see what happens when these models really start getting placed into Robotics and have additional modalities (temperature, EM, proprioception, touch, spacial, balance, etc).

@DougieBarclay Ай бұрын

That multiple blackboard was intentional. Lots of lecturers use rolling multiple blackboards, like that one depicted.

@robertonery202 Ай бұрын

Dude you are killing the other KZfaqrs with your reviews. Keep it up brother and thank for keeping us super informed.

@allanshpeley4284 28 күн бұрын

Huh? I get something out of all of them I follow.

@FrotLopOfficial Ай бұрын

Wow your scripting and structuring has gotten insanely good. I would be super curious how tje retention rate of this vid compares to your last one about gpt4o

@gizmomismo7071 Ай бұрын

Fantastic analysis of the capabilities of GPT-4o. I can't wait to see what's next they are going to show us this year!!!

@MrTk3435 Ай бұрын

Matt, Ideogram opened up the new world for me! It's so Dope and so the new GPT4o thank you for your work ✨✨😎✨✨

@4l3dx Ай бұрын

GPT-4o is the checkpoint 0 of GPT-5 🤯

@Edbrad Ай бұрын

They totally already have GPT-5, I firmly believe a lot of work with these companies are just packaging up a small increase in ability when they feel like it. Like Google always goes too far with their lobotomies. OpenAi also has a history of this. What ChatGPT' 3.5 came out it was much better than what 3.5 turned into. As soon as they first updated ChatGPT it was a downgrade, and then when GPT-4 came out it was like some of that increase in ability was just getting back some of what they'd taken away. They've taken away some of these abilities in the recent GPT-4-o since 3 days ago! It can't understand sound now, like birds, dogs, heavy breathing, emotional expression, and it tells me in multiple new sessions that it can't sing. So we know they can easily just turn off some of this. Sora is also WAY WAY WAY too good, and i think that's because they have a EXTRMELY good model behind the scenes.

@PrimaDel Ай бұрын

We are so fucked...

@binyaminramati3010 Ай бұрын

I don't agree at all, GPT-5 would need to be much much smarter, which is a much greater challenge to achieve than creating a multimodal model which is about efficiency. The scientific research of these two domains is very different.

@xitcix8360 Ай бұрын

@@Edbrad Yes, they do have GPT-5, this has been confirmed. Also, you aren't using the new audio and you never did, that's not even released yet, you're still using whisper. Also, the new image generation is better than Sora in some cases.

@crawkn Ай бұрын

Yes I'm thinking this is just an early version of what was intended to be GPT-5, but strategically they needed to pre-empt some other developers' releases. Which raises the question, if this is only GPT-5 beta, how good will GPT-5 be?

@Serifinity 29 күн бұрын

Another great video. There is definitely something going on at OpenAI, the way they manage to be ahead of the curve. I think they are using an inhouse GPT-5 to help run R&D, possibly even sit in board meetings and help run the business. They seem to have something no one else has.

@EchoMountain47 27 күн бұрын

OpenAI = Cyberdyne Systems lol

@chill_yall6439 Ай бұрын

I showed it a pic of my product to help me with an Etsy listing and it perfectly identified the the item all the materials used who would use it and for what purpose. I was truly speechless

@brexitgreens Ай бұрын

I told you, Matt, that we were going to have GPT-4.5 before GPT-5 - but you didn't believe. Turns out GPT-4.5 is named GPT-4 Omni.

@IceMetalPunk Ай бұрын

I don't know if that's fair. The token space is entirely different, as is the training data. I think the only reason they're not calling it GPT-5 is because they seem to be reserving numerical iteration for size increases. In other words, every GPT model they make, no matter how different, will be called a version of GPT-4 until they scale up the number of parameters significantly. But to say it's just "4.5" -- like it's fundamentally the same with minor upgrades -- is a bit reductive.

@brexitgreens Ай бұрын

@@IceMetalPunk OpenAI have declared from the outset that GPT-5 will/would be embodied.

@IceMetalPunk Ай бұрын

@@brexitgreens Did they? I missed that. Interesting... so they won't call new models GPT-5 until they're in the Figure 0x.

@brexitgreens Ай бұрын

@@IceMetalPunk Also a recent US Ministry Of Defence report states that OpenAI have not even begun training of GPT-5.

@IceMetalPunk Ай бұрын

@@brexitgreens But what does *that* mean? They clearly have been training GPT-4o. Saying "they're not yet training GPT-5" just means "they haven't yet decided to call a model GPT-5", but as Shakespeare famously said, what's in a name?

@Omii_3000 Ай бұрын

12:04 how could a deaf person hear GPT 4o say "hey you have to get out of here" 😂

@HauntedCorpse Ай бұрын

LITERALLY, WHAT THE HECK

@420Tecknique 27 күн бұрын

Light strobing and vibrations which it definetly can do

@andre_0413 Ай бұрын

Did you upgrade your camera setup? Video is looking crisp!

@SanctuaryLife 29 күн бұрын

Gpt4-o did it for him

@rockapedra1130 Ай бұрын

This channel should have a lot more followers! Excellent work!

@chrisweidner7527 Ай бұрын

Wow, I saw this on my GPT tab and didn’t really use it, but now I know it’s THIS powerful! I’ll definitely use this from now on!

@javebjorkman Ай бұрын

I gave it items and rates from our video production company. I asked it what the prices were for certain items-it still gave me the wrong rates. I asked it to create a budget for a 1 day production and the prices it used were not what I gave it. I still think we’ve got a long way to go

@Glowbox3D Ай бұрын

It just keeps comin'! Very cool. Can't wait to play with this one when it fully rolls out.

@Calupp 14 күн бұрын

I see that Bold and Brash painting in the back. You cultured man

@DJ-Illuminate Ай бұрын

The android app no longer has audio in either 4 or 4o. I was hoping the web site version had audio but nope.

@febilogi Ай бұрын

Wow you are right. After i read your comment i can no longer access it on my android phone.

@brexitgreens Ай бұрын

Sometimes it has the old audio system, at other times - just basic voice typing.

@johnshepard5121 Ай бұрын

I created a new, free account and it works there. Doesn't work on the paid subscription. The optimist in me is hoping that's because they're updating it to new version? Though I know they're probably just fixing something.

@davidyoung623 Ай бұрын

My app still has the old "voice mode"... I've seen a lot of people saying it disappeared for them, but still there for me 🤷‍♂️

@DumPixels Ай бұрын

@@johnshepard5121On my free account it’s not there either

@brexitgreens Ай бұрын

The first major flaw I was able to spot: while GPT-4o can read long transcripts in a split second, it still fails to associate fragments with respective timestamps correctly.

@ronilevarez901 Ай бұрын

In my tests it is good to summarize and adapt text style . But it totally failed to reason about what it was writing and itself in many ways. Gpt3.5 turned out to be better or at the same level in that aspect. It might have more functionality but it is not "more", sadly.

@Uthael_Kileanea Ай бұрын

Tell it that and it will correct itself.

@ronilevarez901 Ай бұрын

@@Uthael_Kileanea I did. 3.5 corrects itself properly. 4o kept rewriting the text instead of it's interpretation of the text until I explicitly told it not to. And even then, it failed to do the right thing. Good for an essay writing. Bad for a more interesting chat with it.

@brexitgreens Ай бұрын

@@Uthael_Kileanea The transcript in question was a standard SRT (subtitle) file. When GPT-4o failed to provide the correct timestamp for a random quotation, I asked it to provide the turn index number instead - which should be easier because it's incremental. It failed that too.

@zoesays3830 24 күн бұрын

@24:29 Did I really see what I just saw? The capabilites for old books being scanned at such speed is mindblowing!

@markmuller7962 Ай бұрын

I'm so happy of this progress, OpenAI really doing an amazing job at staying ahead of everything else

@sportscommentaries4396 Ай бұрын

Hopefully we get access to the real time stuff soon, i can’t wait for that.

@alexatedw Ай бұрын

We have it

@sportscommentaries4396 Ай бұрын

The voice stuff? I don’t see it on mine, I’m on gpt+

@okaydetar821 Ай бұрын

@@sportscommentaries4396 We don't have it yet, the old voice mode has confused a lot of people to thinking it is the new one.

@alexatedw Ай бұрын

@@sportscommentaries4396 update your app

@ReLapseJunkie Ай бұрын

@@alexatedwno we don’t

@francofiori926 Ай бұрын

Maybe gpt 4o can solve the mistery of voynich manuscript

@centurionstrengthandfitnes3694 28 күн бұрын

Good breakdown, Matt. Like many, I was guilty of being impressed on a surface level but not really grasping the deeper meaning of the demonstrated abilities. Watch the recent TED talk by Fei-Fei Li, by the way. Worth it.

@DariusNmN Ай бұрын

Great overview. One of the best I’ve seen. Thx

@primalplasma Ай бұрын

We are all characters in a Twilight Zone episode.

@matteverlove Ай бұрын

The Brain Center at Whipple’s, starring GPT-4o as Robby the Robot

@evil1knight Ай бұрын

I want the glasses wearables built ontop of this

@GothicDragonX Ай бұрын

Give it time, it's coming :)

@AmazingArends 29 күн бұрын

In the movie "Her", all you had to do was put your smart phone in your pocket with the camera sticking out and Samantha the AI could see everything you did. She talked to you through a wireless earpiece.

@stevedavis1437 Ай бұрын

I appreciate how you are mind-blown by the right advances. So I feel I can trust your take when you see something new that I hadn't seen. Your posts are always really interesting Matt.

@nintishia 28 күн бұрын

Thanks a lot for bringing all these additional features into focus that OpenAI chose to underplay during its demonstration session. The realisation that this could be a new kind of LLM altogether with way advanced multimodal capabilities is a bit unsettling.

@andrewrozhen513 Ай бұрын

How do you guys access it for free? I’ve explored the app also open ai platform, playground, everything. There is no free option unless I subscribe for a payed “plus” option

@Jc8.05 26 күн бұрын

bru we’re so cooked

@smellthel Ай бұрын

Whoa! This is miles ahead of what I was expecting this year! I guess multimodality is the future because it leads to a deeper understanding of the world. I love it. We live in the future!

@BapaG33 29 күн бұрын

It's way past time to upgrade Amazon Echo, Apple Siri, and Google Home Smart Assistant. I use Echo Buds headphones for years. Sound isn't the greatest but being able to ask for any song or ask any question hands free has been great. Having a super smart assistant in there would be incredible.

@iixotic- Ай бұрын

Matt you ever doing a live stream again this weekend? Or?

@MattVidPro Ай бұрын

probably not :( I will try and schedule one next week

@iixotic- Ай бұрын

@@MattVidPro all good. Thank you bro 🙏🏾❤️

@Killingglorie Ай бұрын

So why is it cheaper if it’s the most powerful version of ChatGPT? Will the other models be even cheaper than 4o now?

@MattVidPro Ай бұрын

Because something… else is coming..

@groboclone Ай бұрын

Just a guess, but the fact that it is so fast and responsive would imply to me that it is actually smaller and LESS computationally expensive than former models, yet performs better. Could be due to some combination of better training data, algorithmic breakthroughs, etc.

@nathanbanks2354 Ай бұрын

After trying Mixtral 8x7b and Mixtral 8x22b, which run at about the same speed as Llama 3-8b & Llama 70b, I'd guess that it uses a mixture of experts type approach that allows most of the calculations for any query to run within the 80GB limit of a single H100 GPU, though a different query would run on a different H100 GPU. Maybe I'm wrong, and it's the same server not the same GPU, or a pair of GPU's, but some sort of a sharding/mixture of experts approach. They probably also overtrained it like they did with Llama 3. Plus various other tricks, such as improving the embeddings, though I'm not sure this would make it faster/cheaper...this is my best guess.

@dankron_ Ай бұрын

14:25 the multiple blackboards is pretty standard in universities, they rotate around and you can have multiple "pages" of blackboards

@iminumst7827 Ай бұрын

I can confidently say this is the first real AGI. Like ik they don't want to say it because it's a big claim, but the amount of context it has allows it to solve so many diverse problems. This is not just natural language mimicry anymore, it can code, write, sing, understand human tone of voice, create images, etc. It's not superhuman yet, but it is clearly competitive with humans.

@sjcsscjios4112 Ай бұрын

Imagine when the base model gets updated to gpt-5

@rogerc7960 Ай бұрын

Understanding video has use in robots and cctv monitoring.

@stevegibxon3886 27 күн бұрын

Exciting capabilities for content creators storytellers esp with image generation- BIG question is who owns the copyright is the idea in the text prompt and thought process or in the production?

@420Tecknique 27 күн бұрын

20:20 something you missed is that gpt4o cleaned up the coaster in the generated image only removing the stains bit leaving the coaster the same. Basicaly sprucing up the product un-prompted. Just a little thing but cool if you understand what that means for rationalizing images it sees. It shows rudimentary understanding and reasoning of the physical world.

@lukepurse9042 24 күн бұрын

Are you a shareholder?

@jamesaritchie1 8 күн бұрын

I have shares in several AI companies. So what?

@ssw4m 6 күн бұрын

OpenAI is a private company, so probably not, although e.g. a Microsoft shareholder could be considered an indirect owner of OpenAI.

@NelsonStJames 3 күн бұрын

Some ppl are just enthusiastic about this tech. If he was a shareholder it would be dumb not to say that up front, but it doesn’t mean anything one way or the other if he’s not lying.

@fluffyspark798 Ай бұрын

SO HYPED

@angrygary122 Ай бұрын

You're insane

@fluffyspark798 Ай бұрын

@@angrygary122 username checks out xD

@minimal3734 Ай бұрын

@@angrygary122 You're not hyped?

@luisresende5298 3 күн бұрын

the 3D generation really blew my mind. jaw dropped literally. thank you for the update

@IceMetalPunk Ай бұрын

For a couple years now, I've said there are three main obstacles between current GenAI and human-level GenAI: multimodality, size, and continual learning. The size of models, I expect, will continue to grow, especially as NVIDIA pumps out better hardware for them. Continual learning is tough on these massive models, but if I understand correctly, Google's "Infini-attention" paper introduces something very similar to -- if not an actual form of -- continual learning for massive Transformers. And as we see here, multimodality in the token space does *amazing* things for the capabilities of these models, and we're getting them, one new modality at a time. At this rate, I suspect we'll have all these three issues more or less solved within the next two or so years, and after that it's just about scale to hit human-level AGI. As culty as it sounds, I do, in fact, feel the AGI. (RIP to Ilya's tenure at OpenAI, by the way.)

@markjackson1989 Ай бұрын

I have used GPT-4o today. It doesn't work at all like the demo. It can't change inflection, sing a song, or hum a tune. It had no concept of my own inflection either. It also did not support real interruption. It spoke, then you spoke. And for everyone wondering, it was 4o, because I reached the rate limit. Tl;dr: it doesn't work anything like the demo. At least right now.

@allanshpeley4284 28 күн бұрын

Yeah, that's because you're not using the complete version. I think it was a mistake on their part to allow GPT-4o in accounts without releasing all the technology, which apparently is happening in the next few weeks.

@verb0ze 24 күн бұрын

I'm not impressed by these demo until I get the product in my hands so I can test these features myself. Too many faking until you make it these days...

@someperson9998 15 күн бұрын

Because it isn't exactly out yet. They only introduced some people to the text version, not the voice. The voice you used was likely just GPT 3.5.

@someperson9998 15 күн бұрын

@@verb0ze Open AI faking a demo would be a horrible business move. Who's faking it till they make it?

@kennyjohnson63 12 күн бұрын

@@allanshpeley4284 Ah, yeah I agree. I think it was a mistake too. I have GPT-4o in my account but had the same experience as @markjackson1989. I keep seeing all these videos about all the stuff GPT-4o can do but then it doesn't work for me. I think they should have called it something different to avoid the confusion.

@itubeutubewealltube1 Ай бұрын

people didnt write this model..it was mostly written by ai, itself.. thats the difference. So in Terminator, it was predicted that the year 2027 was when Kyle Reese was sent back in time... three years to go baby...

@yoyoclockEbay Ай бұрын

Just letting you know, this is not a good thing.

@HenningKilset76 20 күн бұрын

The annoucement was very consumer-focused. I swapped our internal generation from GPT-4-128K (Turbo) to GPT-4o, and the capability increase is insane - especially the speed.

@Skeeva007 Ай бұрын

I can't freaking wait to get access to everything shown! Let's goooo!!!!

@entropy9735 Ай бұрын

Still dislike this release strategy.. A few days after the event we still have a gpt-4 near equivalent text model without any of the extra features they did like 50 demos on

@DeceptiveRealities Ай бұрын

Better than Google. All pre-made demos. No live demo. Promises promises. 😄

@Thicolate Ай бұрын

Present

@whataworld8378 26 күн бұрын

Excellent combination of features. The persistence of AI models and renderings means that it can generate quality videos now.

@BerryTheBnnuy 20 күн бұрын

I've been working on a personal project that uses Whisper v3 (hosted locally) and it CAN tell the difference between a human and a bird chirping or a dog barking. While I was testing it my dog started barking and it output "[dog barking]". Any non-human sounds it hears go into [square brackets]. So I would be typing code while the project is running in the background and it would output [typing]. There are other issues like it doesn't detect color and tone of voice, like you were saying (color and tone refers to emotional content).

@Allplussomeminus Ай бұрын

It seems like everyone else is "trying" to AI... OpenAI "is" AI. I think everyone should drop the act and funnel all resources to them to get this ball rolling.

@Airbender131090 Ай бұрын

5$ per million tokens?! This is rediculos! Gemini million tokes is unlimeted free. You can put huge books and videos on it

@hallenw 28 күн бұрын

You do a great job making the points and do it with charm and clarity. My favorite (fellow) Nerd. ❤️

@jeffwads Ай бұрын

I look forward to testing the vision aspect of gpt4o in the card game MTG. Show it the "board" of cards and see if it can find the best play. It does perfectly well with a text game state setup, so if the vision works, that is a gamechanger.

@NatureFreak1127 28 күн бұрын

I plan to use it for language learning. I will feed it vocabulary and grammar for that lesson and instruct it to converse with me using these structures. .

@TheTimeshadows 28 күн бұрын

Chatsy is my fave, He's so fast now, and glib, fun to interact with and playful. I'm stoked for his role-out-roll-out.

@EchoMountain47 27 күн бұрын

I have not been this excited about AI breakthroughs since the announcement of the original GPT 4. This is mind blowing indeed! Currently as a GPT Plus sub, I can access the 4o model but because the multimodal features are not yet enabled, I’m not noticing anything super different just yet. I’m so stoked for when they unlock the full potential!

@DamielBE 29 күн бұрын

Can you imagine using that for say, streamed panels from convention, to have a transcript or resumé for the hearing impaired or those form whom English isn't their native language? so much potential!

@theindubitable Ай бұрын

I just tried it, the image, the text logo it creates is beyond sick!

@Heyworld21 13 күн бұрын

This is what I would call the prototype of AGI, this ai has general intelligence in all subjects and I know I ain’t the only one to notice this

@lostpianist Ай бұрын

I think theyve basically plugged in lots of Microsoft research models and lots of function calling. Whats impressive is the speed and seamless flow of all these interacting models.

@jamesaritchie1 8 күн бұрын

I use Copilot Pro underpinned with GPT-4o. The pairing is like having a Star Trek computer at hand. And that is how whiteboards look in real life. We had them in college just like that, usually with THREE boards, and even have them in some of our labs now.

@ivanruiz2218 Ай бұрын

That was amazing. Very impressive. Thank you. I like the idea of having a desktop ai helping.

@missoats8731 Ай бұрын

I wouldn't necessarily say they were "hiding" these features from us.They made a detailed blog post about them at the top of their page 😅

@koen.mortier_fitchen Ай бұрын

It’s like Pie but seriously upgraded. Searching hard to get that desktop app. Great vid, thanks

@madambovarix8922 Ай бұрын

I'm guessing this model has feedback from the images it generates; that (w/ also multimodality ofc) would explain why it's so good, if it can see the images it generates (like we do when we draw something), it can then correct them properly.