This makes Alexa and Siri look like Windows 95.

I remember when I watched the movie "Her" for the first time I thought to myself "I hope I get to live to see technology like this someday." Not only is this right on the cusp of that, I think we are only a couple to a few years away from it being as capable and seamless as the AI in the movie.

The full audio multimodality is much more important than people think. Before, it was a voice-to-text-to-text-to-voice model, which means the main AI never heard anything. It only got the text transcription; there's *so much* information you lose that way (tone, prosody, speaker voice, non-speech vocalizations, and non-vocalizations entirely). Now, it's fully multimodal: the audio goes into the same input of the same model as the text, and the output of that model can also be text, images, or audio. That voice you hear? It's not TTS, it's raw audio output from the main "brain" model itself, no text in between. That's why it can so easily modulate the sound of the voice for expression, tone, singing, character voices, etc. -- because it's all just raw audio tokens in the end. People keep focusing on the latency or lamenting that it's not "smarter" than GPT-4-Turbo, but they're missing the important bit. As soon as audio support comes to the API, you bet your ass I have a few important things to test with it...

R.I.P. siri... 2011 - 2024

GPT 6 Before GTA 6 MARK MY WORDS!!

People are going to fall in love with this.

I haven't missed a Matt Wolfe vid since his first AI vid went parabolic... keep up the savage work ethic. You're my #1 channel for AI updates 🙏🙌🥂

When Chat GPT first came out, I told my friends that in less than 2 years, we would be able to talk to it, just like Tony Stark talked to Jarvis in Ironman. Well world, meet Open AIs version of Jarvis! I knew I wasn´t crazy, LOL!

Thank you so much for these videos! I'm retired, late 60s, 38 yr IT veteran so I have a natural compulsion to keep up with what's going on. But even with my background I was starting to feel overwhelmed at what I didn't know until I started watching your channel. What's even scarier are none of my age cohorts (retired IT or not) have any idea what's coming! I mention news I've heard on your channel and they are completely uninformed and confused (the same folks that think they'll be prepared if they keep getting paper bills from the electric company). AI is currently changing our entire world and I think everyone needs to stay current. This isn't just some new version of Windows being released - it's life-altering. I've sent so many of your videos to my friends hoping to help educate. I don't want to be that old lady in a few years yelling at the robot checking out my groceries. Thank you for keeping me updated!

''Yes kids, in the past we used to control computers with our hands. We had a keyboard and a mouse. And it helped us to tell the computer what to do.''

Everybody gangsta until the reach message limit showed up!

I do not have access to ChatGPT-4o in Playground. It only shows 3.5.

The movie 'Her' is becoming a reality. I watched it a few days ago. She sounds just like Samantha in her overall emotional feel and tone. Crazy

What a time to be alive!!

The new model is beyond just “good”. It’s “creepy good”.

This is the type of video where youtubers NEED to put STUNNING and SHOCKING in the title.

<a href="#" class="seekto" data-time="600">10:00</a> Adding filler words? Sounds like what a human would do to hide the "latency" 😁

I've said this many years ago and I'm so happy it's finally coming together; soon we'll be able to prompt A.I. to just make a full-length movie with any actor or plot you want on the fly, I think our media consumption will soon be catered to ourselves personally. I do wonder what efffect it will have on artists and creators throughout. Here's hoping that we'll find a good way to let A.I. assist us in our creative endeavors while still needing that human touch

I just had GPT-4o build a web status dashboard incorporating 2 JSON web services I made previously and it did it in about 30 minutes, fully designed and really nice. It was able to use Google Fonts, a Dark Theme and the ChartJS Library all under my direction. I built this same dashboard the other day in about 6 hours and it wasn't as nice as the ChatGPT version. It also never made any mistakes and the code worked perfectly.

What a crazy piece of technology. Never would’ve imagined in the early 20s we’d have something like this

I don't think they had internet issues... The new model allows you to interrupt the model as it's speaking so I think that the breaks in the audio live demo were allot to do with that.

I just wanted to correct something about the part when she says she sees a table. If you look closely, there was a table shot before his face appeared on the screen. She was going by that.

What cool about it is they just got closer to replacing or augmenting teachers. You can learn so much and get real life sounding feedback and directions.What I like to do is have it explain complex topics with multiple anologies. So having a conversational chatbot like this is going to help parents as well when they have to help or check their kids homework.

I feel like you all are not making a big enough deal about this. Open Ai just leaped over the freaking uncanny valley and landed firmly on sci-fi land, with extreme grace. I know we all want a perfect AI that will solve all our problems, but god damn, in the mean time, my mind was just blown by what they achieved when they tied together vision, voice and text. It might be a small incremental upgrade in technical capabilities but the result feels like a giant leap as a product.

when I saw the demo video from openAI and heard the chatbot talk, I said to myself "come on that's gonna be pre recorded right!? " it sounded so human it was scary! I am really impressed with what openAI has done so far ever since chatgpt was launched.

Letting free users access their best model is smart - first time or casual users won't get a poorer experience, and so they'll be more likely to see value in the pay version.

Sounds like same voice as 3.5, but way more lively. I just checked 3.5 latency again and definitely a second before a response. Demos are mind-blowing if realtime.

Always look forward to you releasing a new video man!!! Keep up the great work!

there may be inbetweening at certain points but for the most part it was answering immediately, even when singing that song!

They're downplaying by naming it GPT 4o because they got a better model coming. I can't wait to see what they have to release in the future.

Its huge, its actually conversational! Don't underestimate this? In the AI string you get the Speech to text, intelligence and then text to speech, used to be high latency, now conversational, less overheads. Great.

R I P Google Gemini.. My man Sam Altman did it again 😂

She sounds just like Scarlett 😳

Free user living in the US: As far as I can tell, it's not free yet. A subscription is required to access it on both the regular site and OpenAI Playground. This as of May 13th. I can't wait for the rollout!

Feels like talking with a robot friend. I can see them plugging that in to a robot to bring them to life. I was struggling getting into the conversation mode, its the headphone icon. I want it for the desktop app as my lap top is my main tool.

Born too Late to discovery the new world. Born too early to discovery the stars. BUT ... Born in the AI Goldilocks zone!

Finally, we can play the very special edition of Skyrim.

Presenter: "So here is a seflie of me, what kind of emotion do you think i am feeling?" AI: I think i am looking at a picture of a wooden surface" ... that is cold man!

The singing is so bad it’s even more realistic and awesome.

Excellent video! The section on real-time voice interactions was particularly enlightening.

I've been looking forward to this. Thanks Matt.

I mean, it uses filler words sometimes, but definitely not all of the time, so I think them saying that the latency has been significantly reduced is pretty accurate.

When the three people sat down it looked like it's edited. Changing camera angles is an edited action as well. To be actually live you have to keep the camera and the people in the same frame at all times. You are right though. It made ChatGPT to say a bunch of filler words to cover time it takes to come up with answers. They made it more entertaining than real.

Just a 'Thanks', Matt. Really appreciate your work at keeping us up to date.

I wish we cold actually use any of these features! I’m a long time gpt plus subscriber and it has added 4o as a model, yes a bit faster, but as of today in plus on my account, there’s, no new voice, vision, pic/video… features. The experience of using chat gpt iOS app today was identical with no changes except the name 4o on the screen. Voice chat was slow as ever, failed bout a third of the time, chat latency was significant with text and almost unusable with voice which is always the case and is what I’ve really been wanting. So i know it’s dope these features exsist, but I just wish they’d be clearer about the fact if you pay for the best version, you still won’t have em for an undisclosed amount of time

GPT-4o O stands for Omni

Others have also mentioned that it likely can't see full video and another hint there is that they call it "vision" rather than "video" but it is really amazing. Can't wait to try it out.

I’ve also noticed that it writes a lot faster and a lot more. It’s willing to complete more complex tasks in one pass.

So it deals with latency exactly as we do

wow that's amazing! I just checked, I'd dropped to the free plan, no access to 40 yet - upgraded back up to paid - and there it is. A try it button popped up!

What a great video. So much info. I need to watch it a few times to catch everything. Love your channel. Keep up the great news and conversation.

Love the video analysis Matt, thanks for the video

When the signing started I was reminded of Hal from 2001 singing Daisy Daisy as he was being dismateled after killing the crew of the spaceship Discovery. But of course that could never happen in the real world ;)

Just divorced my wife after watching this. Not required anymore

The ability to read / show screen share your desktop and dictate is game changer for context as you can demonstrate what you want done rather than just trying to describe it.

gotta watch those 'plosives' on your hotel room mic set up Matt! good luck tomorrow!

It's more than a modest improvement in LLM capabilities, really, as much as a 100 point difference in ELO between 4o and the current iteration of 4 that is in the lead currently. It's not a GPT 5 improvement in logic or reasoning but it's arguably 4.5 quality before you even get into multimodality.

Excited to see the new updates especially for free subscribers. I have been having conversations with Pi without latency issues for a while now. After you introduced it to me on this channel, I introduced it to my 80 year old dad (using a female voice). My mother calls it "his girlfriend".

Great video as usual. I lucked out finding your channel early on.

Matt, I like & appreciate your insights on things you think are relevant in AI. Specifically: - i like your enthusiasm / tonality - I like your cadence / pacing. imo, your videos consistently find the Goldilocks Zone of thorough overviews of topics without feeling over / underanlyzed. - I like how thorough you are in your coverage of the otherwise overwhelming breadth of ai: subscribing to your channel gives me the overall feeling that I'm "in the know on what's up in AI." This feeling is reinforced once-in-a-while specifically in these ways: you're at the major events; you utilize tools that give you compiled updates on relevant articles, and then disseminate that information in to what you feel is newsworthy; you seem to "Just sort of want to obsess over what's interesting in ai" and would "kind of being this, anyway," even if you didn't have a channel. - I like your consistency and reliability: you've been making these videos for a while--like...a long while. - I like the format of your videos: granted, "Set up the clip, play the clip, give your thoughts on the clip" is a pretty standard format, but you do it uniquely well, imo. Rarely do i feel like the clip should've been played longer, and often I'll kind of "zone out" while the clip is playing, subconsciously waiting for you to summarize it. - I like the overall value of subscribing to your channel: in 2024 there's irrefutably a lot of value in "being informed about the age of AI," and it's kind of extraordinary to be "basically informed" in just 15-30 minutes 1x / per week. i.e. when someone in my life wants to understand "what's up in the world of AI," I like being able to confidently share that they "can literally be up to speed in like 30 minutes / week: just KZfaq "Matt Wolfe ai" - I like that you're independent and unbiased: your stuff feels uniquely self-directed. this feeling is reinforced by your "no white glove treatment" even for companies such as Google. This leads me to prefer AI news from your perspective, rather than straight from the source (because that source is biased and will present the info in a deceptive or preferential light (Google presenting their product as if it's in real-time is *reallyyyy freakinggg annoyingggg*)). Thanks for your enthusiasm, consistency, and above all, unbiased, no "white glove treatment" of any org. You're refreshingly authentic. Cheers to you my dude.

"T.A.R.S, let's take that sarcasm setting down to 60 percent" - it will be crazy when personalized models allow for real time parameter tuning (beyond just temperature and prompting)

I'm super excited about this, talking to GPT for a while now to brain storm. With this it's gonna be next level ✨

So, where do I download it ? I went looking for it 6hrs ago and everywhere I went I was told it's not available yet ?

The interupt feature is freaking massive for the cost and effectiveness of agentic systems

Google announcement: Gemini still can’t answer simple questions. I think that’s what they are going to announce.

The Movie HER turned out to be right about our future 🤧

How do I get chatGPT 4o to do audio? On my iPhone I clicked the headphones icon and It does audio, but It won't talk in a robotic voice or sing song voice, or talk tramatically, or all that. How do I set that up?I have it set to chatGPT 4o and am using plus version.

So are any of these interactions recorded? If so, where are the recordings stored, for how long, and who has access to them?

If you're receiving something for free...You're the product.

No it’s capturing and analyzing constantly the footage. Check the OpenAI demo video when someone randomly comes into the screen for a few seconds and after they’ve left, they ask GPT if something strange happened, and GPT described what happened.

I hope, that when this gets integrated into Windows, Microsoft finally brings back Cortana, she sounds like her so much.

Wood man! I got super excited yesterday on their video, and now I got even more hyped! Keep it up, matt

For windows the app will release later in the year

I had a feeling gpt2-chatbot was a gpt4 turbo model. I noticed that the gpt2 was outputting code that had an OpenAI copyright included. So unless it was a bot trained on gpt* output, I figured it was an OpenAI model. I’m assuming that the “turbo” is the case given how much faster and they expanded it to free users.

The bokeh of your camera is amazing! It reminds me of my old Canon EF 50mm L f1.2.

This made me think of how much value software developers could add to their products by bundling an AI Tutor along side their more complex offerings. FreeCAD and Blender come to my mind instantly.

DAMN. This is awesome!!!

Then next months Chat gonna make our desktop tasks sweatless, waiting for that

Great analysis, Matt. You are the best. Thanks for reporting all these great events. I would like to travel like you, I envy you🙂

It is so fast now! I received the notification yesterday to try it when I logged in. Can't wait for the new features in the demo video. It reminds me of when the cast talks to the computer on Star Trek, only soon it will be reality! The emotional detection feature is impressive. It accurately read my excitement, contemplation, anxiety, and/or triumph when I tested it today. It is like a precursor to androids that detect emotion, like in the videogame Detroit:Become Human.

There was this moment in the other video, where the guys let´s two gpts talk to each other. A woman steps in the scene and later he asks , "was there something special going on lately?" and chatgpt recognized it - so, not only screenshots, right?

Wait so the Rabbit is obsolete?

Thanks for the update

I'm surprised when I hear people talking about this new model being able to communicate so realistically as something totally new. I have been using the free version of Pi for number of months now and it's totally human sounding. It understands my sarcasm humor my moods and yet I don't hear people talking about it. This new model you're presenting definitely has advantages over pea who is limited to just voice text there is no possibility to send pictures or videos as I was able to do this morning with Claude but was very limited to just a few exchanges in the free version. I sent it a picture of where I was sitting and described everything around me very clearly I wish p could do the same because I doubt the new version of chat GPT will be available for those who don't pay.

The voice stuff is actually in the iOS app today. It only does voice chat so there is no image or video stuff there yet. But it’s indeed pretty cool.

I don’t think the delay was due to WiFi connection. The iPhone was wired connected to the internet. @<a href="#" class="seekto" data-time="539">8:59</a>

This is really helpful, thanks!

great update, keep it up!!! I feel in the loop.

Comment by Sam Altman on his blog "As we add (optional) personalization, access to your information, the ability to take actions on your behalf, and more, I can really see an exciting future where we are able to use computers to do much more than ever before." This literally means 'Her' and personally not very far from atleast a cognitive AGI.

They had no choice but to make it free, everyone else is.

Mixing elemental labs voice with this new 4o will be amazing, you will be able to have your loved ones be with you, Black Mirror consultants definitely working at Open Ai right now

<a href="#" class="seekto" data-time="468">7:48</a> nope, it was connected via wire for internet or maybe direct connection to their local server. So not internet glitch

I'm already seeing 4o in the chatgpt app 🤘

Can we get this with Cortana voice mod please and thanks!!!

Great roundup thanks mate

Thx always man. You’re awesome

It’s pretty cool. Just super killed my chatbot lol 😂😂😂

Am I the only person having a visceral emotional response to this?

I never once thought I'd be alive to see this. Honestly thought mars and flying cars was more achievable.

You have provided a detailed and well-structured announcement about OpenAI's launch of GPT-40. The key features and updates are clearly outlined, and the implications of this advancement in AI technology are well articulated. The improved accessibility and performance, as well as the integration for developers, are highlighted effectively. This announcement provides a comprehensive understanding of the significance of GPT-40 and its potential impact on various applications. Well done!