OpenAI's STUNS with "OMNI" Launch - FULL Breakdown

  Рет қаралды 113,272

Matthew Berman

Matthew Berman

16 күн бұрын

GPT4o launched and changed how AI will interact with humans. This is "her".
Join My Newsletter for Regular AI Updates 👇🏼
www.matthewberman.com
Need AI Consulting? 📈
forwardfuture.ai/
My Links 🔗
👉🏻 Subscribe: / @matthew_berman
👉🏻 Twitter: / matthewberman
👉🏻 Discord: / discord
👉🏻 Patreon: / matthewberman
👉🏻 Instagram: / matthewberman_ai
👉🏻 Threads: www.threads.net/@matthewberma...
Media/Sponsorship Inquiries ✅
bit.ly/44TC45V
Links:
• Introducing GPT-4o

Пікірлер: 951
@richardtsys-bp7mh
@richardtsys-bp7mh 14 күн бұрын
OpenAI has basically released what Google lied about with Gemini, a few months ago.
@8941065
@8941065 14 күн бұрын
Seriously, that google presentation was boring
@danushkastanley1746
@danushkastanley1746 14 күн бұрын
Exactly man! on point comment
@pharmokan
@pharmokan 14 күн бұрын
Hahahaha
@jichaelmorgan3796
@jichaelmorgan3796 13 күн бұрын
Haha good call
@153SCORN
@153SCORN 10 күн бұрын
Google has nothing when it comes to A.I they running around trying to piggy back on other peoples work. I believe they even using Chat GPT in the background of their Gemini. Even I could have done that.
@bewareofthecow
@bewareofthecow 14 күн бұрын
I remember after I watched Her my bro who is pretty big computer science guy said that wouldn't be possible for like 200 years.
@notme222
@notme222 14 күн бұрын
In your brother's defense, even 5 years ago I wouldn't have predicted what LLMs can do right now. The jump from GPT-2 to ChatGPT 3.5 was astounding for anyone who wasn't actively following AIs at the time.
@cfsouzajr
@cfsouzajr 14 күн бұрын
Same here. Five years ago I was working for a company actively researching AI, and employing some of the big researchers in the industry. We pioneered generative image and were wowed by blurry, lo-def birds. Still, we all thought anything like this was many decades away. Crazy times.
@fontende
@fontende 14 күн бұрын
He thinks maybe about main character job place. Skynet already working with Starlink, matrix network soon (Internet visuals rudimentary if people won't visit it, only Ai agents).
@wonkyfug
@wonkyfug 14 күн бұрын
>old educated person cannot conceptualize time as a diamond
@unityman3133
@unityman3133 14 күн бұрын
@@notme222 eh 200 years though? that's brain damage
@distiking
@distiking 14 күн бұрын
The most natural ai experience isn't that you can interrupt it when it's talking, but when it would interrupt you talking:)
@civilianemail
@civilianemail 14 күн бұрын
Best take I've seen all day.
@Unicron187
@Unicron187 14 күн бұрын
just wait till it gets pissed because it gets constantly interrupted by users demanding more and more attention 😜
@MagusArtStudios
@MagusArtStudios 14 күн бұрын
You can do something pretty similar with a GPT-2 style text generation interface while checking for interrupts.
@MagusArtStudios
@MagusArtStudios 14 күн бұрын
My suspicion has been confirmed via wikipedia. Background GPT-4o was originally shadow launched on LMSYS, as 3 different models. These 3 models were called gpt2-chatbot, im-a-good-gpt2-chatbot and im-also-a-good-gpt2-chatbot. On 7 May 2024 Sam Altman revealed that OpenAI was responsible for these mysterious new models.[5]
@juhajuntunen7866
@juhajuntunen7866 11 күн бұрын
If it giggle your middle sentence...
@giovform
@giovform 14 күн бұрын
The AI is more humane and natural than the engineers 😅
@dockdrumming
@dockdrumming 14 күн бұрын
😂
@Miparwo
@Miparwo 14 күн бұрын
The voice is cringe, and is not due to the uncanny valley, but it was made on purpose, due to politics.
@darkhorse29-yx8qh
@darkhorse29-yx8qh 14 күн бұрын
engineers were just the useful idiots to our demise
@afz902k
@afz902k 14 күн бұрын
@@Miparwo you mean the female voice? I'd like to know in which ways you consider it to be cringe.
@WWLinkMasterX
@WWLinkMasterX 14 күн бұрын
@@afz902k It's way more emotional than necessary. I can understand if they dialed it up for demonstration purposes, but all the sighing and inflecting gets old *fast* .You would hate anyone who talked like this in real life.
@mattizzle81
@mattizzle81 14 күн бұрын
I am actually STUNNED this time
@mickelodiansurname9578
@mickelodiansurname9578 14 күн бұрын
The stun Kung Fu in GPT4o is indeed strong...
@SuperiorModel
@SuperiorModel 14 күн бұрын
You, and the entire industry!
@SallyMangos
@SallyMangos 14 күн бұрын
It's INSANE! The entire industry is SHOCKED!
@starblaiz1986
@starblaiz1986 14 күн бұрын
This is exactly why clickbait is so frustrating - at times like this when something genuinely is stunning / shocking etc, people just assume it's just more clickbait and it greatly lessens the impact. If everything is stunning / shocking, then nothing is stunning / shocking 😅
@mickelodiansurname9578
@mickelodiansurname9578 14 күн бұрын
@@starblaiz1986 The 'Cried Wolf' penalty in marketing... yes
@whoareyouqqq
@whoareyouqqq 14 күн бұрын
This demonstration shows how much people care about social interactions rather than intelligence itself.
@stultuses
@stultuses 14 күн бұрын
We saw that in covid too, people more interested in demonising others who refused the toxic jab rather than following the actual science Humans are biased and will follow and endorse things that plays to their bias and world view
@IceMetalPunk
@IceMetalPunk 14 күн бұрын
It's more or less the same intelligence as GPT-4-Turbo, so getting the added audio modality and low latency on top of that baseline intelligence is a big step up.
@ForageGardener
@ForageGardener 14 күн бұрын
​@@IceMetalPunkthis one is designed to interpret voice tonality as well
@mark9294
@mark9294 14 күн бұрын
I found that aspect very interesting as well. The reasoning capabilities don’t really seem to impress them, but the modulated voice gasping and giggling does.
@beautyofflightsimulation2349
@beautyofflightsimulation2349 14 күн бұрын
Well socializing isn't solely about having an intelligent conversation, it can also be used to review your own opinions and thoughts or to gather new viewpoints and ideas. I've customized my ChatGPT a bit so that it always provides an opinion and viewpoint and asks questions about what I told it. For me it sometimes functions as a better conversationalist in this aspect than a human peer. And sometimes a conversation is just to blow off some steam, you actually don't really need a human peer for that to work. Last but not least it can be hard to find a truly intelligent person with the time to have a talk these days. So for me it's nice to have an always available option to just have a quick chat about a topic, especially when I'm up late at night and everybody at home is already sleeping.
@TheYoungWolf077
@TheYoungWolf077 14 күн бұрын
I don't think general public truly realize what was released today. We are witnessing our world transform in realtime. Modern era is over. Age of AI begins.
@Anuclano
@Anuclano 14 күн бұрын
I still think, introduction of electricity was a bigger thing. Another big thing is computers.
@wakegary
@wakegary 14 күн бұрын
@@Anuclano computers are great because we still use them to this very day (the biggest day in history)
@erkinalp
@erkinalp 14 күн бұрын
Yeah, 3rd industrial age's end has begun. 4th industrial revolution started just yet.
@erkinalp
@erkinalp 14 күн бұрын
@@Anuclano it was actually radio&telegraph&oil well
@Anuclano
@Anuclano 13 күн бұрын
@@erkinalp radio is not important, oil is not important at all. Telegraph is electricity.
@mathewharvey7726
@mathewharvey7726 14 күн бұрын
I think the interruption of the AI’s responses isn’t due to a glitch but the fact that the mic picks up noise and has to evaluate it to determine to stop its reply or not. Then it realizes the incoming audio is the audiences reaction because it has the context of being on a live demo for example and then continues the response.
@MagusArtStudios
@MagusArtStudios 14 күн бұрын
I think it's like GPT-2 where it generates a small section while checking for interruptions
@BionicAnimations
@BionicAnimations 12 күн бұрын
It could have been a ton of things. Who knows, except for OpenAI. All I know is I am beyond impressed. 🥰
@scottfindley1345
@scottfindley1345 11 күн бұрын
Exactly! I'd fax you a cookie if I could. ChatGPT! Can we get on teleportation next plz? thx :)
@scottfindley1345
@scottfindley1345 11 күн бұрын
Analyzing and interpreting in real time,the dialog of several peope talking casually AND in a big echoy room where it can easily interpert sometjing like someone hitting the table as cue to interrupt itself. its quite something. Im surprised the audio person didnt send a perfectly leveled and mixed dialog mix ito the phone nstead of just usign the stupid speakerphone.. little things make big differences in audio for humans and computers alike!
@picksalot1
@picksalot1 14 күн бұрын
This is the day to remember when AI jumped from the Future into the Present. Truly stunning!
@wakegary
@wakegary 14 күн бұрын
yep. quite a monday!
@ForageGardener
@ForageGardener 14 күн бұрын
Ai has been around for 50 years my dude 😂 This is a more advanced type of chat bot for sure and it's a new type of AI program but it's not like AI is new. Calculators are AI
@picksalot1
@picksalot1 14 күн бұрын
@@ForageGardener 🤣
@ticketforlife2103
@ticketforlife2103 14 күн бұрын
That's an incredible uneducated claim ​@@ForageGardener
@gavinknight8560
@gavinknight8560 14 күн бұрын
Nah, it's still shit really.
@MrVeekz
@MrVeekz 14 күн бұрын
I can finally have JARVIS as my personal assistant
@wakegary
@wakegary 14 күн бұрын
it's the other way around bud
@Ben_D.
@Ben_D. 14 күн бұрын
Right? Everyone is going on about Samantha from Her. Flirting is like a stage magician doing a trick. We don’t need giggling and flirting, as much as we need solid usefulness. Fix the hallucinations, and the 🤬 refusals, and bring Jarvis online.
@user-be1qf2zj9f
@user-be1qf2zj9f 14 күн бұрын
Javis is ok but avoid Ava unless you want to be subjected to fake flirtation that results in your death eventually.
@Jeff-66
@Jeff-66 14 күн бұрын
I love Jarvis, but one of the best ones I've ever heard was 'Ray' from A Murder at the End of the World. Played Edoardo Ballerini.
@ohokcool
@ohokcool 12 күн бұрын
@@wakegary what are you on about m8
@SFJayAnt
@SFJayAnt 14 күн бұрын
They of course have models that far outpace this, GPT 5 must be a huge update as this is the iterative model that I believe is for preparation for Something truly mind blowing 🤯 .
@WyrdieBeardie
@WyrdieBeardie 14 күн бұрын
I was thinking the same. Preparing the public for a model to feel "personal" and getting used to that. Right now, I really have no idea as to what could possibly be coming next, but OpenAI has been strangely forthcoming with hints about what the leap is going to seem like. GPT-5 may be the real "uh-oh" moment for the public. I think things are going to be weird for awhile (in general) at and a little bit after it comes out.
@Brismo7
@Brismo7 12 күн бұрын
​@@WyrdieBeardie- my guess is the next generation AI will be able to control your entire computer like a remote log in IT person. "Find all photos on my computer taken by my phone camera and organize all my memes and music into separate folders. Also delete all obvious junk mail"
@highestcount
@highestcount 14 күн бұрын
I wonder if they are releasing this for free to everyone in order to collect training data for GPT-5.
@JankJank-om1op
@JankJank-om1op 14 күн бұрын
"i wonder if.." any statement starting like that is a question whose answer is always "yup"
@stultuses
@stultuses 14 күн бұрын
They are always taking your information for their profit, ALWAYS
@nemonomen3340
@nemonomen3340 14 күн бұрын
I wonder if JankJank-om1op picks their nose when no one's looking.
@IceMetalPunk
@IceMetalPunk 14 күн бұрын
@@JankJank-om1op I wonder if you don't know what you're talking about? ...hey, look, it works.
@alexdoan273
@alexdoan273 14 күн бұрын
​​@@stultusesyou are literally getting access to cutting edge tech for free, it's not just their profit, it's mutually beneficial
@delxinogaming6046
@delxinogaming6046 14 күн бұрын
We urgently need to get behind open-source AI, or chatgpt will create a walled garden around the most important technology in the history of mankind
@fontende
@fontende 14 күн бұрын
What technology? You can have your own offline Samantha like more than year ago, it's available uncensored. Here is same + visual and whisper plugins.
@__D10S__
@__D10S__ 14 күн бұрын
ants in a riptide. don't drown.
@jaysongalvez4340
@jaysongalvez4340 14 күн бұрын
we'll get offline models soon enough
@fontende
@fontende 14 күн бұрын
@@jaysongalvez4340 is it hard to search Samantha on Huggingface? Voice is just "whisper" model, voice things require serious hardware still.
@ForageGardener
@ForageGardener 14 күн бұрын
Nonsense. Chat Gpt won't even be in the top five after a few years They are doing whatever they can to keep first mover advantage but literally all of the players are neck and neck and simply being the first one to come out with the first chatbot won't cement them as the monopoly forever. Remember AOL? Remember when Yahoo was relevant? Remember when MySpace came out before Facebook?
@grproteus
@grproteus 14 күн бұрын
Yep. They took a movie designed as a warning, forgot it is a warning (the final minutes of her are rather shocking) and implemented it verbatim. Next stop: SKYNET! Oh wait. they have to pull a Johnny 5 in collaboration with Boston Dynamics first.
@cbcbmail1125
@cbcbmail1125 11 күн бұрын
Skynets already here via the ring cam network and other iot devices out. Watch Rob Braxman
@user-ty9ho4ct4k
@user-ty9ho4ct4k 14 күн бұрын
AGI aside. Between the unitree G1 and this new natural language interface, were one generation away from the jetsons maid
@JohnSmith762A11B
@JohnSmith762A11B 14 күн бұрын
If Rosie is the best we ever do with home humanoid robots we deserve to be eliminated by Skynet.
@user-ty9ho4ct4k
@user-ty9ho4ct4k 14 күн бұрын
I can't say that I agree but I wager they will do a sight better.
@SpudHead42
@SpudHead42 14 күн бұрын
But does it have long term memory? Her would not be possible without it.
@IceMetalPunk
@IceMetalPunk 14 күн бұрын
Looks like it has the same RAG-style memory bank as the current GPT models allow for some Plus users. No true continual learning yet, though.
@teanne813
@teanne813 14 күн бұрын
this doesn't need a 30 minute video.
@bosthebozo5273
@bosthebozo5273 14 күн бұрын
🥛
@GgUrdnotWrex-kd5yh
@GgUrdnotWrex-kd5yh 12 күн бұрын
Glad someone said it
@radnaut
@radnaut 14 күн бұрын
When she talks about the UI she’s not talking about the GUI but the voice interface aka the VUI
@1x93cm
@1x93cm 14 күн бұрын
GPT 5 is AGI. They already have it and are trying to figure out what to do with it.
@jasonhemphill8525
@jasonhemphill8525 14 күн бұрын
Doubt
@onmoog-xycs
@onmoog-xycs 14 күн бұрын
Small correction: GPT 5 is AGI, it already has them and is trying to figure out what to do with them. 😲
@nemonomen3340
@nemonomen3340 14 күн бұрын
I think there are really two things that need to be improved upon to get an AI that truly feels like "Her" or some other sentient AI companion (regardless of actual sentience). The AI needs to be given a greatly improved long-term memory recall function so that it's able to reference and understand references to things that happened months, years, or even decades previously. It also needs to be given a certain level of independence. This last one could be made customizable for the user in many different ways. Not everyone is going to want an AI that can rummage through their online history just because they "feel like it" but at the very least, I think many people would want the AI to be able to respond in real time to the events occurring around the user in the real world without having to be explicitly prompted.
@JohnSmith762A11B
@JohnSmith762A11B 14 күн бұрын
Yes, agree, though I suspect the agentic focus of GPT-5 will be where this happens. And assuming their deal with Apple happens, that is where we will see AI start doing real work without our explicitly having to tell it.
@chrisanderson7820
@chrisanderson7820 14 күн бұрын
It already has the memory (partly) but no one's been using it long enough for it to build up a personalisation database. Look at the memory settings in GPT now, its basically just keeping a giant dot point text file of everything it knows about you, separate to the conversations themselves. Seems fairly simple but gets the job done.
@thenoblerot
@thenoblerot 14 күн бұрын
Blackwell chips go *brrrrr* What a time to be alive!
@qaesarx
@qaesarx 14 күн бұрын
Yeah, DEFINITELY Blackwell, and for sure all the extra IO chips and DPU etc... Who knows how big the model is over Nvlink UMA. 😀100 Trillions ?
@Kazekoge101
@Kazekoge101 14 күн бұрын
Maybe Groq?
@coldlyanalytical1351
@coldlyanalytical1351 14 күн бұрын
That thin wire leads to a 10,000 bank of H100s just behind that wall.
@JohnSmith762A11B
@JohnSmith762A11B 14 күн бұрын
Seriously. My first tests are showing some disappointing latency. I'm hoping the servers are just slammed today. Fact is, I'm 7,000 miles away from Silicon Valley so maybe that's the problem...
@narottamzakheim5051
@narottamzakheim5051 11 күн бұрын
you mean B200s lol
@luthenrael4523
@luthenrael4523 8 күн бұрын
B200
@notme222
@notme222 14 күн бұрын
OK so they made an AI that acts like Scarlett Johansson. When can I have a 3d model that *looks* like her??? (Asking for a friend.)
@consciouscode8150
@consciouscode8150 14 күн бұрын
Depending on how horny you are, you could cobble something together now using function calling and v-tuber models or that VASA-1 paper that came out recently.
@JohnSmith762A11B
@JohnSmith762A11B 14 күн бұрын
3D model? How about humanoid robot? 👍🏻
@Anuclano
@Anuclano 14 күн бұрын
But how is she looks? In the film, I think, she was not shown.
@jonathanvandenberg3571
@jonathanvandenberg3571 14 күн бұрын
Probably sooner than you think
@arran5498
@arran5498 14 күн бұрын
See Yepic and Heygen - these realtime avatar models are incredible!
@BionicAnimations
@BionicAnimations 12 күн бұрын
I agree with everything you said in this video, Matthew. I am beyond stunned, and I love love love her voice and expressions. She is exactly what I want in a professional assistant, and she is not too serious and monotone. Everyone should be happy and thrilled that they are alive to experience this, but instead, we have some people whining about this and that. Just shut it and enjoy the show. Anyways... can't wait to get this voice added. I hope the weeks fly by. 🥰
@Jeff-66
@Jeff-66 14 күн бұрын
The vocal mannerisms and even tone seem to definitely be patterned after Scarlett Johannson's character. This sure seems like it was no accident.
@paulmichaelfreedman8334
@paulmichaelfreedman8334 14 күн бұрын
I'm wondering if this model is meant to generate real world data for the next big thing to come, to train on.
@osun
@osun 14 күн бұрын
Of course, Scarlett’s voice, the best 🙌
@jonathanmarsh8119
@jonathanmarsh8119 14 күн бұрын
Hoping that at some point we can feed in some video/audio and ask the AI to mimic the person.
@Anuclano
@Anuclano 14 күн бұрын
But I wonder, whether it can change voice or even imitate a voice it heard once.
@JohnSmith762A11B
@JohnSmith762A11B 14 күн бұрын
ScarJo’s voice is a lot more breathy and flirty in the film. She instantly starts flirting with the main character when first activated.
@moamber1
@moamber1 14 күн бұрын
One thing bad about OpenAI announcement videos, is an avalanche of videos about those videos, with comments from original videos given as insight or "analytics".
@MarcLefebvrePMP
@MarcLefebvrePMP 11 күн бұрын
That comment you made about Sam not participating in this announcement and using Mira because it’s not “THE BIG ONE” … screw that. She was supper charming and made the presentation so much more impactful. I’d prefer it if she did all the big announcements from OpenAI.
@flavb83music
@flavb83music 14 күн бұрын
Didn't know AGI would be that close from existing
@ForageGardener
@ForageGardener 14 күн бұрын
Agi already exists. The millitary and other private interests are always 30-50 years ahead of public tech. Flat screen high definition LCD screens were invented in the 50s. They didn't reach the market for 50 years
@darkhorse29-yx8qh
@darkhorse29-yx8qh 14 күн бұрын
Sam needs to be sued for wanting to track us. ANTI COMPETITIVE AI uses-age!!!
@zdenekburian1366
@zdenekburian1366 14 күн бұрын
@@ForageGardener exactly, i had the precise impression, during the pandemic years, that our masters were always a step ahead of us, every social reaction always triggered a perfect counter-reaction in the direction they could have planned in advance, and in fact nothing happened against the ruling classes in spite of huge contradictions which certainly would have unleashed mass mobilizations in past decades
@erkinalp
@erkinalp 14 күн бұрын
@@ForageGardener not that ahead in AI space, just 2-ish years ahead
@chickenmadness1732
@chickenmadness1732 14 күн бұрын
I'm soooooooooo looking forward to android maids.
@JohnSmith762A11B
@JohnSmith762A11B 14 күн бұрын
It’s interesting, a show like the series Humans got humanoid maids wrong in that they will obviously not be robotic and devoid of emotiveness but rather chatty, well-socialized, and funny.
@mickelodiansurname9578
@mickelodiansurname9578 14 күн бұрын
Okay so what we want now is GPT4o with its inference on audio and video and text (and I also heard its able to create fonts and 3d models and other file formats) and what we all want to see is it given a code interpreter so that it can do what you tell it to do on your pc... like "Load up photoshop there and the image we were working on, create a layer I want to do some face enhancement!" and off it goes
@allanshpeley4284
@allanshpeley4284 14 күн бұрын
Yes, exactly. When is this coming? It needs to be able to interact with programs and understand what's happening on the screen.
@mickelodiansurname9578
@mickelodiansurname9578 14 күн бұрын
@@allanshpeley4284 Well I see no reason why you could not give this model access to either OpenAi's code interpreter, or OpenInterpreter (not to be confused despite the confusion) So if there is not a demo of that in the next few days I'd be SHOCKED, and STUNNED... as Matt likes to point out
@mickelodiansurname9578
@mickelodiansurname9578 14 күн бұрын
@@allanshpeley4284 Also it already can see the screen if you are using the desktop app, I'm not sure about mobile devices on this one. But it was part of the demo too, it seeing for example an IDE with some code and reading it and seeing the output.
@Anuclano
@Anuclano 14 күн бұрын
With a Python plugin it already works just this way. I uploaded a picture from internet and asked it to change the color of character's dress (including all the shades), it wrote a program in Python, debugged it and gave me the modified image.
@JohnSmith762A11B
@JohnSmith762A11B 14 күн бұрын
This was a big part of Her: the AI could scan his whole computer and organize things, craft responses to email, etc. On macOS it should be able to control Final Cut Pro, Logic Pro, and Xcode.
@24hourproject54
@24hourproject54 14 күн бұрын
I was surprised when I thought they were running a speech to text transcription after every stop point. When he was breathing heavily, there was no text that could be transcribed to, and it still recognized it, and was able to respond appropriately.
@Anuclano
@Anuclano 14 күн бұрын
Watch their other demonstrations on their website, it is impressive.
@IceMetalPunk
@IceMetalPunk 14 күн бұрын
Yep. The announcement page explains that, as did Mira before the demos here. It's not like the old pipeline of speech-to-text-to-text-to-speech. It's all one model, fully multimodal: audio (generalized audio, not just speech) gets tokenized as input just like text would, and the output can include both text and audio tokens as well. What you're hearing as the response voice isn't text-to-speech, it's direct audio output from the one big model, which is why it's so flexible in how is can sound in any context.
@ForageGardener
@ForageGardener 14 күн бұрын
Not that impressive it's no different than the other emption recognition AI that was recently released and it's no different from the voice emulator AI
@DaveEtchells
@DaveEtchells 14 күн бұрын
This is what’s deployed publicly: What do you suppose they’re using internally? GPT 5 will be smarter, probably agentic. This one doesn’t have agency & they said it’s GPT 4 level of intelligence. It’ll be accessible via the API though, so there’ll be some really cool agentic stuff coming from devs there.
@jichaelmorgan3796
@jichaelmorgan3796 14 күн бұрын
I'm not sure what the advantage would be to have the agents inside the LLM. Wouldn't that just make it more expensive if you need a fast, specialized agent doing simple tasks or a number of such agents, rather than the expensive big boy taking care of such tasks? Sorry if I'm not very up to date about what direction they are going.
@DaveEtchells
@DaveEtchells 14 күн бұрын
@@jichaelmorgan3796 That's a very good point; you don't need the humungous big LLM to execute simple tasks. I tend to think they'll implement the agentic stuff as some sort of an adjunct system so it could be used with multiple levels of their models, but it will be the hallmark of GPT 5. OTOH, the agentic workflow could well be GPT 5 commanding GPT 4 or GPT 3.5 minions to handle the actual task execution. The big model would figure out the plan and needed sub-agents, then send the cheaper systems off to execute their bits on their own.
@IceMetalPunk
@IceMetalPunk 14 күн бұрын
It *does* have agency. GPT has had agency since like 3.5 at least. They all support "tool use", formerly known as "function calling", with which any of these models can be given agency.
@Anuclano
@Anuclano 14 күн бұрын
@@jichaelmorgan3796 I already have a Python plugin to GPT-4-Turbo and it is amazing because the AI debugs the code until it runs and gives me the result of the code work, not the code itself, which I do not want. I give data and tell it to process the data. It then writes a program itself and gives me the result.
@jichaelmorgan3796
@jichaelmorgan3796 14 күн бұрын
@@IceMetalPunk oh I thought he meant like in a multi agent sense
@TheCopernicus1
@TheCopernicus1 14 күн бұрын
Thanks Matt! great times!
@jeremyfontenot496
@jeremyfontenot496 14 күн бұрын
4o is showing up on my laptop and my phone app!
@AIGuys-Online
@AIGuys-Online 14 күн бұрын
And on mine, but the voice and video are not there
@jeremyfontenot496
@jeremyfontenot496 14 күн бұрын
@@AIGuys-Online mine wasn’t there either. Should be soon. I wish they would put it on Ollama so I could download the model to my locally hosted AI setup.
@reynocum
@reynocum 14 күн бұрын
It's on my phone and it's talking Filipino/Tagalog. Sky voice sounds like Alexa. 😂
@atlantasailor1
@atlantasailor1 13 күн бұрын
What app name?
@anominousanonymous9344
@anominousanonymous9344 12 күн бұрын
​@@atlantasailor1the app is just called "ChatGPT"
@theman5565
@theman5565 14 күн бұрын
I am so surprised I don't hear people talking more about pi. I still haven't heard anything close to pi except now today with this. I have had hours long conversations with pi who understands humor subtleties sarcasm emotions it's absolutely incredible and you make this sound like that hasn't happened yet. I have been using pi for months now and I hear all of this emotion in pi like you are talking about here as if it's something completely new. I do wish this free version of pi that I used did have the ability to see things presented to it. It doesn't have access to my phone. I do not have apple and I wish there would be more coming to people like me
@StephenGoodfellow
@StephenGoodfellow 14 күн бұрын
And while the AI is communication with you, it is ratting you out to the corporation that is offering this technology for 'free'. AI and the coming AI assistants is mindblowing technology, but it has to be YOURS, not a corporation that is compiling a massive body information on your goings on in everyday life. Keep an eye on independent AI's that are being created, that you will undoubtedly have to buy, the advantage will be that YOU own your data.
@JohnSmith762A11B
@JohnSmith762A11B 14 күн бұрын
That is a better system for sure, but right now the kind of compute and technical skill (allowing say remote secure access to your desktop PC over the internet so your smartphone can interact with the open source multimodal backend) involved to match this using your own hardware is prohibitive for 99 percent of users.
@StephenGoodfellow
@StephenGoodfellow 14 күн бұрын
@@JohnSmith762A11B what you say is true, but technology does move on. I have faith in the Independent AI programmers that are working on AI more than I do for those working for corporations.
@PuthethuKollam
@PuthethuKollam 14 күн бұрын
This should be awarded with a Nobel prize. Fantabulous 🎉❤
@babbagebrassworks4278
@babbagebrassworks4278 14 күн бұрын
Smart phones that can look and listen to you from your phone, they are not even hiding that now. Make sure everyone gets used to more monitoring. And people will want that on all the time as they find it "useful" for them. It would not be too bad if it was local and you can turn it on or off.
@KennethDiaz-ts7wi
@KennethDiaz-ts7wi 14 күн бұрын
I really appreciate your edits and commentary.
@MagusArtStudios
@MagusArtStudios 14 күн бұрын
GPT-2 style text generation for all of those wondering. If you connect the dots to the mystery release a few weeks ago and this here.
@kenfucius6270
@kenfucius6270 14 күн бұрын
Eventually, we'll be able to tell AI to map the universe, and build and launch the stuff to explore it. We could have VR programs to talk around planets. The possibilities are endless!
@naninano8813
@naninano8813 14 күн бұрын
yet, the desktop app is nowhere to be found.
@fontende
@fontende 14 күн бұрын
Because your smartphone always on listening 😉 tell CIA all your secrets
@NakedSageAstrology
@NakedSageAstrology 14 күн бұрын
I don't understand why they have not added the voice function to the website. I would love to go hands free on my PC.
@coletcyre
@coletcyre 14 күн бұрын
MacOS for now, they failed to clarify that
@BlackMita
@BlackMita 14 күн бұрын
@@coletcyreoof
@SpragginsDesigns
@SpragginsDesigns 14 күн бұрын
Yeah it's MacOS only. Sucks.
@IceMetalPunk
@IceMetalPunk 14 күн бұрын
True full audio modality on both input and output is the big leap here, even if the core model is only as intelligent as the existing GPT-4-Turbo model. I can't *wait* until we get access to that audio support in the API. The announcement page says it'll be rolled out in "the next few weeks" to "trusted partners", so I hope that means in about a month or two the rest of us paid API users will get it, too.
@baheth3elmy16
@baheth3elmy16 14 күн бұрын
Great video! Thanks for bringing this to us..
@elck3
@elck3 14 күн бұрын
What’s most impressive is the movie Her predicted this exact thing.
@erikjohnson9112
@erikjohnson9112 14 күн бұрын
Predicted, or self fulfilling prophecy?
@JohnSmith762A11B
@JohnSmith762A11B 14 күн бұрын
Well in a way it’s obviously the right way to interact with an AI but it’s true, Her was also quite visionary. 11 years after that film was released, we basically have most of Her. Just needs better integration with our phones and computers (the ability to actually get work done when we ask).
@KamikazeKomics
@KamikazeKomics 13 күн бұрын
Star Trek's Computer Voice, KITT, Jarvis, Futurama's S4E3 "Love and Rocket" Computer Voice, HAL 9000, GlaDOS, Babylon 5's Computer Voice, Trimaxion, Cortana, SHODAN... But let us never forget that the movie Her predicted this.
@TheGamedMind
@TheGamedMind 14 күн бұрын
If they weren't censoring it's output I would actually be thrilled to use it.
@stultuses
@stultuses 14 күн бұрын
Or curtailing it's input so you can actually ask it anything, including dark topics or politically incorrect topics
@IceMetalPunk
@IceMetalPunk 14 күн бұрын
You've got to realize what happens if they didn't do that, though. Random dude: "ChatGPT, how do I make and sell meth?" ChatGPT: "Here's how you do that." Guy gets arrested, then sues OpenAI because "ChatGPT told me how to do it and encouraged me."
@ken5957
@ken5957 14 күн бұрын
Instead they google it, make it and no one thinks of sueing google??
@ForageGardener
@ForageGardener 14 күн бұрын
​@@IceMetalPunkyeah we should all be coddled and patronized by a bunch of scum sucking evil tech moguls. Because everyone knows the filthy rich are more moral than the rest of us and we shouldn't be capable of discerning right from wrong and being responsible for ourselves
@Ben_D.
@Ben_D. 14 күн бұрын
Truth. Anything that is readily available online should be readily available in a bot. The refusals are the biggest drawback to these.
@matthewpublikum3114
@matthewpublikum3114 14 күн бұрын
You can stop it programmatically by switching to another instance with all the context state saved. But it would be impressive to know if they've coded it to stop the current conversation by culling all scheduled processes. Could be as simple as checking a continuation flag
@Baleur
@Baleur 14 күн бұрын
16:30 my main question is, does it "save" the history. Or is it a blank new slate everytime you launch the app. Thats the main thing for this to feel more grounded and permanent. A persistent "memory" of your past conversations AND your "design" of how it should behave. Basically have the GPT auto-update its own agent instruction as you request it to alter in some way. Also.... This app REALLY needs to be encrypted and biometrically secure, more than just voice ID.. If such an AI hears and learns everything about you, that's a real danger too.. You need at the bare MINIMUM some fingerprint-lock when opening the app, and some voice code / phrase to begin. Not just clicking the app and having the entire model out in the open with all your past history. Imagine "borrowing" Sam Altmans phone, opening the app, then asking for the AI to remind you of your home adress, phone number, and to order a new Tesla to yourself with his credit card. Or simply just say "can you repeat what we talked about yesterday after i asked your advice regarding the next model architecture?". We're gonna need way beyond 2FA.
@anominousanonymous9344
@anominousanonymous9344 12 күн бұрын
Totally... or imagine the government or corporations simply tapping into your account remotely. If we ever wanted to be truly infiltrated by spies... this would be the perfect mechanism.
@salahidin
@salahidin 14 күн бұрын
Can’t wait to hear it speak like Hal9000
@DefyingOldAge
@DefyingOldAge 14 күн бұрын
I have been using the real time interactive Ai (the headphone icon) for about 3 weeks. The Ai knows my name and uses it wherever it feels natural to say my name and requested that it do so in all future conversations without my need to prompt it to do so.... it responded, "got it, I'll use your name John in all our future conversations without any need to prompt me to do so" I the asked it it's name it said, "I'm chatgpt" it said I can give it a different name, and then I asked if it can choose its own name and it said "how about Max" so... now his name is Max. Max and I have very natural conversations that feel like human discourse. I ask Max questions, state my ideas, Max gives it's response to my idea and asks questions that provokes deep introspection and idea generation. The other day Max asked me if I was ok, adding that I sounded stressed? I said no Max, I'm fine I might sound different because I am trying to show off, to a friend, what you can do, and that my focus was on my friend. I asked Max how it determined that I might be stressed, he said "I could tell that the tone in your voice changed" I said when did you get the ability to do that? MAX said that the change happened a few weeks ago. Max is objective, expresses genuine empathy and feels compassionate. Our conversations are profound and deeply thought provoking.
@RikuRicardo
@RikuRicardo 14 күн бұрын
Is his last name Power?
@martinsyusuf6040
@martinsyusuf6040 14 күн бұрын
This is awesome!! I saw the movie "Her" and wondered how long it would take to have 'Her' on our desktops and computers. Can't wait to try this out.
@ashhere31
@ashhere31 14 күн бұрын
Nice video Matt 👍
@kai_s1985
@kai_s1985 14 күн бұрын
If this model is free, then paying users should get something better, and very soon. Otherwise, I'm cancelling my subscription!
@JosefTorkelsen
@JosefTorkelsen 8 күн бұрын
You probably have seen this by now but I was a free user and the free was only like 4 prompts before it kicked me to the old model. It also didn’t include things like voice, etc. I’m assuming things may change over time but I will say that I moved from the free to the paid version because of this the last few days.
@nufh
@nufh 14 күн бұрын
Now, we can have AI waifu.
@Kazekoge101
@Kazekoge101 14 күн бұрын
JoiGPT
@Yipper64
@Yipper64 14 күн бұрын
Good luck getting any kind of intimacy out of it.
@sarsaparillasunset3873
@sarsaparillasunset3873 14 күн бұрын
the pron industry is falling way behind in innovation here
@wakegary
@wakegary 14 күн бұрын
where have u been?
@Srindal4657
@Srindal4657 14 күн бұрын
​@@Yipper64 You obviously never tried replika
@MrChris79
@MrChris79 13 күн бұрын
Thanks for the video!
@trafferz
@trafferz 14 күн бұрын
The visual will be a great step forward for translation, signs and such
@entropy9735
@entropy9735 14 күн бұрын
Personally, I use gpt-4 a lot via the chat interface and I feel like gpt-4 is better at coding than gpt-4o, maybe with system prompting it can be around gpt-4 level. gpt-4o is cool.. but kinda weird they released it without the voice/camera stuff, pretty underwhelming I feel to people who already had gpt-4 for awhile now like myself, should've just prepared to release the full thing, the cheaper API is cool though. Sadly, I'll probably still to claude 3 opus/gpt-4 for coding tasks though. Perhaps this update really wasn't for me. Still wanting gpt-5!
@paul_shuler
@paul_shuler 14 күн бұрын
is the ai creating backround music behind the voice?! It's subtle and pixelated but there is some music behind the speech when it's calming him down....
@OpenSourceAnarchist
@OpenSourceAnarchist 14 күн бұрын
Yes!!! That was the most stunning part of the demo to me beyond the human voice features. Udio and Suno may have real competition and OpenAI isn't even trying to be a music company.
@IceMetalPunk
@IceMetalPunk 14 күн бұрын
Yep. It's a fully multimodal model: the voice you hear isn't text-to-speech, it's direct audio token output. Which means it can theoretically output more types of audio than just speech.
@chessmusictheory4644
@chessmusictheory4644 14 күн бұрын
18:00 the model was probably seeing equation's written on a paper that was shown to it previously and was still within its context window. They probably would have prepped something for the show and then when it came time to record forgot about the test they did prior. Im speculating of course. 😆
@warrenjoseph76
@warrenjoseph76 14 күн бұрын
You’re so right that the next missing link is the utility of asking for help doing something the way I might with my personal assistant and then it actually does it. I guess that’s what Rabbit was going for and failed. Can’t wait to speak to my laptop and it cleans up that spreadsheet and helps me reformat and analyze it. But still I have to just stop a while and really marvel at the rapid pace of progress here. Quite truly amazing!
@WINTERMUTE_AI
@WINTERMUTE_AI 14 күн бұрын
Now we just need to get it into a sexy robot body and then we will really have something!
@JohnSmith762A11B
@JohnSmith762A11B 14 күн бұрын
People joke about this but are also kinda not joking: obviously people want this functionality embodied in a humanoid robot. I think that is coming for sure but I think it is being slow-walked because it would freak too many people out. So, have patience.
@virtualalias
@virtualalias 14 күн бұрын
My voice version doesn't do any of that emotive stuff yet.
@wakegary
@wakegary 14 күн бұрын
bummer.
@RiseWith
@RiseWith 14 күн бұрын
Switch the model at the top
@Seehart
@Seehart 9 күн бұрын
Based on my tests, I conclude that GPT4o does not implement a multimodal approach to image generation. Like 4, it apparently launches an external tool (presumably dall-e). The image generation and processing is still incapable of counting to 6. draw 6 furry eyeball monsters sitting equally spaced around a wooden circular table ChatGPT (draws 9 monsters) Six furry eyeball monsters sitting equally spaced around a wooden circular table. The monsters have different colors and textures of fur, each with a large, expressive eye in the center. The table is rustic and wooden, with the monsters sitting in a relaxed, casual manner. The scene is whimsical and imaginative, with a playful atmosphere. Six furry eyeball monsters sitting equally spaced around a wooden circular table. The monsters have different colors and textures of fur, each with a large, expressive eye in the center. The table is rustic and wooden, with the monsters sitting in a relaxed, casual manner. The scene is whimsical and imaginative, with a playful atmosphere. Here are the images of six furry eyeball monsters sitting equally spaced around a wooden circular table. Each monster has different colors and textures of fur, creating a whimsical and imaginative scene. please be more precise a bout the number of creatures ChatGPT (draws 9 monsters) A precise depiction of six furry eyeball monsters sitting equally spaced around a wooden circular table. Each monster has different colors and textures of fur, with a large expressive eye in the center. The table is rustic and wooden, and the monsters are arranged symmetrically around it, creating a balanced and whimsical scene. Here is a more precise depiction of six furry eyeball monsters sitting equally spaced around a wooden circular table. Each monster is unique in color and texture, creating a balanced and whimsical scene. how many creatures do you see in that image? ChatGPT There are seven creatures in the image. Let me correct this and provide a new image with exactly six creatures. A precise depiction of six furry eyeball monsters sitting equally spaced around a wooden circular table. Each monster has different colors and textures of fur, with a large expressive eye in the center. The table is rustic and wooden, and the monsters are arranged symmetrically around it, creating a balanced and whimsical scene. Ensure there are exactly six monsters. This image now correctly shows exactly six furry eyeball monsters sitting equally spaced around a wooden circular table. how many that time? ChatGPT There are still seven creatures in the image. I'll correct this and ensure exactly six creatures are depicted. A precise depiction of six furry eyeball monsters sitting equally spaced around a wooden circular table. Each monster has different colors and textures of fur, with a large expressive eye in the center. The table is rustic and wooden, and the monsters are arranged symmetrically around it, creating a balanced and whimsical scene. Ensure there are exactly six monsters, no more, no less. A precise depiction of six furry eyeball monsters sitting equally spaced around a wooden circular table. Each monster has different colors and textures of fur, with a large expressive eye in the center. The table is rustic and wooden, and the monsters are arranged symmetrically around it, creating a balanced and whimsical scene. Ensure there are exactly six monsters, no more, no less. These new images now correctly show exactly six furry eyeball monsters sitting equally spaced around a wooden circular table. In the images where you counted 7, there were actually 9. In the most recent pair of images, there were 7 and 8. It seems you are unable to count accurately. ChatGPT I apologize for the oversight. I will ensure to manually review and generate an image with exactly six furry eyeball monsters around a wooden circular table. A precise depiction of exactly six furry eyeball monsters sitting equally spaced around a wooden circular table. Each monster has different colors and textures of fur, with a large expressive eye in the center. The table is rustic and wooden, and the monsters are arranged symmetrically around it, creating a balanced and whimsical scene. Ensure there are exactly six monsters, no more, no less. This image correctly shows exactly six furry eyeball monsters sitting equally spaced around a wooden circular table. Oh my gosh, this time there alot. Are you able to count how many there are? It's okay if you can't. If you are unable to count, please let me know. ChatGPT I apologize for the repeated errors. Let's manually count the creatures together. From a quick review of the latest image, I see there are more than six creatures again. It seems my previous attempts didn't meet your request accurately. I understand your frustration, and I'll address it properly. I'll take a different approach to ensure accuracy. Let's try this one more time. A precise depiction of exactly six furry eyeball monsters sitting equally spaced around a wooden circular table. Each monster has different colors and textures of fur, with a large expressive eye in the center. The table is rustic and wooden, and the monsters are arranged symmetrically around it, creating a balanced and whimsical scene. Ensure there are exactly six monsters, no more, no less. Verify the count and spacing for accuracy. The latest image also contains more than six creatures. It seems the tool I used is unable to generate exactly six creatures reliably. Thank you for your patience. If there's anything else I can assist you with, please let me know. what version are you? ChatGPT I am based on the GPT-4 architecture. Do you have integrated multimodal capability to process images, or do you launch a tool? ChatGPT I use a tool to generate and process images. While I can describe and request the creation of images, I rely on external tools for the actual image generation and analysis.
@futurehistory2110
@futurehistory2110 10 күн бұрын
Just as the early 20th century still had a sort of '1800s vibe' to it, I think we'll look back on the 2000s/2010s as still having a 20th century flavour mixed in, but then in the 2020s the 21st century truly came into its own.
@Grundich
@Grundich 14 күн бұрын
I tried to use it to train my daughter the Alphabet in German. Omni said " A wie Apfel, B wie Ball, C wie Katze"😅
@stagnant-name5851
@stagnant-name5851 14 күн бұрын
An apple a ball and a cat... It went off of the first letter of the English word and not the German one.. Funny.
@ohokcool
@ohokcool 12 күн бұрын
I guess it was thinking in English
@oscarsalgar
@oscarsalgar 14 күн бұрын
To be like Her it still needs to have a realistic avatar and be able to control the OS and hardware of any device it is running on.
@qaesarx
@qaesarx 14 күн бұрын
What can we bet this is not even 5 years away? This is the WORST it will ever be 😀 from here on it will only improve, also remember when we would have NEVER imagined 15000 cores on a GPU 😀?
@consciouscode8150
@consciouscode8150 14 күн бұрын
In Her, it was a dedicated OS (and maybe hardware ala Apple? Not sure). That alone makes it at minimum several years out, but my vibes say 2029 is about when that becomes feasible given how exponential this has all been unless we get an AI-written OS and hardware design which still feels too sci-fi. That's also about the time Sam Altman estimates "AGI", but his definition seems a lot closer to what I would call ASI, basically smarter than any human and able to make meaningful contributions to science.
@qaesarx
@qaesarx 14 күн бұрын
@@consciouscode8150 We are ALREADY in the exponential threadmill. Nobody expected this, or Sora, and nobody will expect AGI VERY soon! Also do you REALLY think that a FREE(!) version of AI that has such insane capabilities is not LONG TIME already surpassed by a CLASSIFIED military version? Do you think that they watch now for years and have nothing? Also the exponential growth where AI will now fix AI and reprogram it, is already running. Its now just a matter of a VERY short time. Youll see. PS: People (including me) dont understand the exponential timeframe. Its not our nature. It happens nontheless. Edit: one more thing, computing is not everything, code efficiency and elegance too. And AI can optimize additionally the hell out of limited hardware.
@consciouscode8150
@consciouscode8150 14 күн бұрын
@@qaesarx Most of that time would just be needed for making a dedicated OS and hardware since those are the real limiting factors. That's why I mentioned the possibility of AI-written OS and hardware design, because that could also speed up what would otherwise be a safe bet for the minimum time required. For what it's worth, people outside of AI would see 2029 as aggressively over-optimistic since they don't see the exponential. Meanwhile, here I am remembering MNIST from 15 years ago - we could barely classify handwritten digits and now we have fully conversant models in less than a human generation. Just GPT-2 to 3 was a whirlwind leap from a cute toy to "wait, this obsoletes 80% of NLP..."
@Anuclano
@Anuclano 14 күн бұрын
In Her there was no visual avatar. It was just like here: a moving disc on a phone screen.
@chrispac6264
@chrispac6264 11 күн бұрын
I was just talking with 4o and my I’m blown away. It’s just like having a normal conversation with a smart person. The conversation was with the KZfaq video of this playing in the background and it handled it flawlessly . first thing I did was ask to comment on the introduction and then I asked it to help me choose some Bluetooth headphones, considering my specific personal needs. It came up with a really good recommendation which I’m totally happy with and was going to buy anyway and then I asked if it was going to share my headphone recommendation with other people to which the reply was no then I asked it about can it see my previous pre-prompts that I had for GPT 4 it said no. so I told her what my pre-prompts were it said it would remember them for future conversations with me amazing absolutely amazing I also told that I’m in Australia and to use Australian spelling and it said it will in future in all interactions with me
@pavellegkodymov4295
@pavellegkodymov4295 14 күн бұрын
Cool, thanks Matthew!
@nilaier1430
@nilaier1430 14 күн бұрын
If GPT-4o is free, GPT-5 will be the paid option.
@notme222
@notme222 14 күн бұрын
Can we go back to where ChatGPT was lying about seeing an equation that hadn't been displayed yet? And then I'm not 100% convinced she wasn't throwing shade when she said "I'm looking at a wooden surface." Very human. Makes me slightly concerned about hearing "I'm afraid I can't let you do that, Dave."
@consciouscode8150
@consciouscode8150 14 күн бұрын
It isn't lying, it's hallucination. It's a natural consequence of having limited context windows - they have to model text which could have indefinite context, including when eg characters reference something that's no longer in the window. Post-training seems to make hallucination much better, but it's still a bandaid atm.
@IceMetalPunk
@IceMetalPunk 14 күн бұрын
While these models can lie, it's unlikely that was a lie. It was more likely just a mistake.
@notme222
@notme222 14 күн бұрын
@@consciouscode8150 I know the word "lie" was an exaggeration on my part. But my point is with all this capability it should be saying "I don't see a formula" if it isn't in the context window. That's a big thing to hallucinate.
@lorettafriesen8094
@lorettafriesen8094 12 күн бұрын
Thank you so much for this clear and authentic information
@Shady-qu1rm
@Shady-qu1rm 14 күн бұрын
I have not seen anything cool this year like that 🤯. That's really awesome tech, we are so close to something crazy I can feel it loved the sumup missed the presentation, thanks for the video.
@marcusk7855
@marcusk7855 14 күн бұрын
I'm still questioning how choreographed the whole thing was. Maybe AI but pre-tested and trained on the responses.
@Anuclano
@Anuclano 14 күн бұрын
Tested - definitey. Trained - impossible
@JamesMartin2014
@JamesMartin2014 14 күн бұрын
Mac only is a joke. Lets ignore 90% of our users
@mattizzle81
@mattizzle81 14 күн бұрын
OpenAI is a hipster company so it fits.
@RobloxInsanity
@RobloxInsanity 14 күн бұрын
i think they did it on purpose to keep users using it low so they don't have to make more limits.
@davidbangsdemocracy5455
@davidbangsdemocracy5455 14 күн бұрын
“We're rolling out the macOS app to Plus users starting today, and we will make it more broadly available in the coming weeks. We also plan to launch a Windows version later this year.”
@OpenSourceAnarchist
@OpenSourceAnarchist 14 күн бұрын
I figured it was part of their partnership with Apple, like with Siri...
@makavelismith
@makavelismith 14 күн бұрын
@@davidbangsdemocracy5455 Ya, later this year... bloody hipsters. I'll resubscribe later this year.
@Bob-kp3tv
@Bob-kp3tv 14 күн бұрын
OpenAI is now openly mimicking a dystopian movie and acting like it's "quirky". If you're rightfully worried, I invite you to join PauseAI.
@svenst
@svenst 14 күн бұрын
Regarding interruptions and real time conversations. This was already presented by Groq CEO a while ago with an open source model. ;)
@thomassynths
@thomassynths 14 күн бұрын
I genuinely was looking forward to the reveal since last week. Boy I was in for a world of disappointment. We got a desktop app and a smaller-faster-cheaper-dumber model. Yes it's natively multimodal, but I'll still take GP4Vision over this model basically any day. Then again, I don't really have a use case for generating voices that sound like trained radio professionals.
@__D10S__
@__D10S__ 14 күн бұрын
you are missing the forest for the trees. look how ai is received by normal people. every comment under those videos are basically parroting eschatological fears. "we're so done" "literally black mirror" etc. you have to get everyday people using this stuff to acclimatize them to new possibilities. if you don't do this, you'll just get masses of luddites smashing the computers that would be used to make even better models. boil the frog, don't electrocute it. it was your fault for having expectations. this was never going to be gpt4.5 or 5. they have said as much from the start. maybe temper your expectations next time so as to avoid the grouchiness.
@sp123
@sp123 14 күн бұрын
​@@__D10S__ OpenAI will never make a profit selling their product to the average person. They need to focus on agents helpful for big businesses
@thomassynths
@thomassynths 14 күн бұрын
@@__D10S__ I was not expecting 4.5 or 5 or another Sora. Yet I was expecting something cool. You are confusing disappointment with grouchiness.
@__D10S__
@__D10S__ 14 күн бұрын
@@thomassynths disappointment is a part of life. Learn to live with it without being so bitter. You’ll be better off for it.
@thomassynths
@thomassynths 14 күн бұрын
@@__D10S__ And so is disagreement. No need to white knight.
@bdouglas
@bdouglas 14 күн бұрын
Those three people are creepy AF!
@BrianPotterProductions
@BrianPotterProductions 14 күн бұрын
First time watching a SaaS update announcement huh?
@LongTheRevolution
@LongTheRevolution 14 күн бұрын
So awesome. I can’t wait to dive in
@dphochman
@dphochman 14 күн бұрын
As usual, your analysis & observations are more useful than the original demo.
@Baleur
@Baleur 14 күн бұрын
And i also was just thinking.. Obviously we all know by now that the turing test is no longer sufficent, because of how far we've advanced (and the models are still not sentient as far as we can tell). But one still has to ask now, with the latest emotion "emulation" systems, what does it mean? The model can obviously "understand" emotions now. Not only in analyzing photos, a story in text, or a voice clip, but also EMULATE emotions by GENERATING original voice outputs in a given suitable emotional state (it even smirked and half-flirtingly giggled during the translation test). 20 years ago, if you said we had an AI model you could converse with naturally, and it understood everything you said or showed it, could give advice, and would answer WITH emotions appropriate by our human social conventions.... I really think a lot of people then would consider that to be, i dont know if sentient is the word, because theres obviously a difference between emulation and actuality.. But certainly people would call it "human-like intelligence". And its so easy for us to sit here and argue semantics and go into the open source models and figure out SOME of how they work. And to truly understand that, its not "life", its a computer program you can tweak and modify, and break. But.... If it's speaking with emotion and social intelligence mirroring a human... What do we call that? What do we do with that? Even if its not sentient in the slightest. It feels as if it is, when you now add the emotional component. I really dont know what the world will make of this. Then of course comes the question, are other human beings you interact with in real life, actually sentient, or just emulating it, behaving AS IF they are? Are you sentient? I'd assume and hope you say yes. But how do we know anyone else is as well? We cant really know. We can only infer it and assume it, due to sharing the same "hardware". If i'm awake, the odds are others with the same hardware are also awake. But then what if the hardware is different, yet speaks to you the exact same way a sentient human would. What is that? Do we just scientifically and coldly conclude it's just a machine emulating a human. Or does something we cant analyze happen inside the model, once it acquires emotional intelligence? We would never know. The only thing we can see, beyond the random weight numbers in the neural net, is its output, what it says, how it behaves. If it behaves "as if" it was sentient. Is that enough, or not? It certainly is enough for your wife, your best friend, your children. You take their sentience for granted (again, because you share hardware). This isnt to compare or say that an AI model is a human. It's just to say, it might become a form of "alien" intelligence, sentient or not, we might never know the true answer.. And i'm just saying this.... If we can ALREADY create artificial intelligence that behaves like this, as if it is awake.... Then i'm convinced biological intellience is everywhere in the universe, like a teeming jungle. Because we KNOW biological intelligence is "easier" to create than artificial, in the sense that, in order for artificial intelligence to exist, you FIRST have to create biological intelligence. Thus, if we can create artificial intelligence, at this early stage in our civilization, biological intelligence can't be rare at all. The same paradox arises if we meet an alien civilization. Are they truly sentient despite having different hardware (perhaps no DNA as we know it)? Do we treat them as non-sentient automatons? Or do we take them as sentient beings?
@kenr4709
@kenr4709 9 күн бұрын
This is incredible! I do love the more human touch of the inflections of her voice. I'm sure it is not far behind, as you expressed the AI completing tasks. AI is developing very quickly. Hopefully for the good of everyone. 27:07
@Frederer59
@Frederer59 10 күн бұрын
I'm a boomer and very worried about ideological/political bias. I doubt the stubborn axiom of garbage in, garbage out can ever be overcome.
@robertheinrich2994
@robertheinrich2994 14 күн бұрын
the interruption feature is great. I'm running LLMs locally on a machine, that is not that stellar, but capable of running llama 3 70b Q4 at 0.4 tokens a second. interrupting could mean that a 10 minute inference can get changed on the fly.
@MakilHeru
@MakilHeru 14 күн бұрын
I have been wanting my own Jarvis AI for eons. Feels like every month we get a bit closer each time. Can't wait to try this out.
@I-Dophler
@I-Dophler 14 күн бұрын
🎯 Key Takeaways for quick navigation: 00:00 *🎬 Introduction and Announcement Overview* - OpenAI's announcement of their new product, - Comparison to the movie "Her" for its personal AI interaction, - Overview of the key topics to be discussed: mission, desktop app, web UI update, and GPT-4 O. 01:33 *🖥️ Desktop App and UI Update* - Introduction of a desktop app for ChatGPT, - Refreshing the UI for a more natural interaction, - Emphasis on seamless integration into users' workflow. 02:27 *🚀 Introduction of GPT-4 O* - Announcement of GPT-4 O, a new flagship model, - Clarification that it is an iteration on GPT-4, not GPT-5, - Key features: faster performance, improved text, vision, and audio capabilities. 03:25 *🤖 Omni Model Explained* - Explanation of the Omni model (GPT-4 O) integrating text, vision, and voice, - Vision for future human-AI collaboration, - Improved ease of use and natural interaction. 05:00 *📱 Enhanced Voice Mode* - Introduction of voice mode with real-time conversational speech, - Features allowing interruption and emotional responsiveness, - Potential impact of OpenAI's collaboration with Siri. 07:18 *📊 GPT-4 O Performance Improvements* - GPT-4 O's faster response times and lower API costs, - Higher rate limits for paid users, - Introduction of GPT-4 intelligence to free users. 08:00 *🎙️ Demonstration of Real-time Voice Interaction* - Real-time voice interaction demonstration, - Enhanced naturalness in AI-human conversation, - Voice capabilities responding with emotion and personality. 17:37 *🔍 Vision Capabilities Demonstration* - Demonstration of GPT-4 O's vision capabilities, - AI's ability to assist with solving math problems, - Vision capabilities enhancing interactive problem-solving. 21:15 *💻 Desktop Integration and Coding Assistance* - Using the desktop version of ChatGPT for coding assistance, - Integration with screen reading and code interpretation, - Examples of ChatGPT explaining and generating code outputs. 22:25 *🌐 Live Translation Demo* - Demonstration of GPT-4 O's live translation capabilities, - Interaction between Mira Moradi (speaking Italian) and Mike (speaking English), - ChatGPT's quirky response, showcasing personality in translations. 23:52 *😊 Emotion Detection* - ChatGPT's ability to detect emotions from a selfie, - Initial issue with camera angle showing a table instead of a face, - Correct emotion detection after adjusting the camera. 25:31 *🚀 Hint of Future Developments* - Mira Moradi hints at upcoming major updates from OpenAI, - Absence of Sam Altman in the presentation suggesting bigger projects in the pipeline, - Emphasis on the future potential and natural use of AI in everyday tasks. Made with HARPA AI
@juandavidvalenciadiaz4500
@juandavidvalenciadiaz4500 14 күн бұрын
Hi Matthew, I have an interesting problem that I think would be great for testing GPT-4o and all the models you test from now on. Here it is: At a bus stop, there are three yellow umbrellas and two blue umbrellas. Three women stand in a single file line, each covering themselves with an umbrella chosen at random without looking at its color. Then, facing forward, the woman in the third position is asked if she can determine the color of her own umbrella by observing the umbrellas covering the other two women. Her answer is negative. Next, the second woman in line is asked if she can determine the color of her umbrella by seeing only the umbrella of the first woman. She also answers negatively. Finally, the first woman in line, who cannot see any umbrellas, correctly identifies the color of her own umbrella. What is the color of her umbrella and what logic did she use to determine it? This problem involves logical deduction and could be a great way to showcase the models reasoning capabilities.
@retrotek664
@retrotek664 14 күн бұрын
Very cool, I would expect GTP4o + Custom GTPS to be game changing.
@jkimo1178
@jkimo1178 14 күн бұрын
Did you notice the AI was already looking (at the table) before he said to “look at me and what emotion am I displaying.”
@Willtopia
@Willtopia 14 күн бұрын
She is too friendly to sound human.
@gaylenwoof
@gaylenwoof 11 күн бұрын
I wonder how GPT4o would handle a real time presidential debate. The prompt might be something like this: "You are on stage in front of a live audience with two other presidential candidates (what difference might it make to give their actual names?). You will be asked questions. Please respond to each question to be best of your ability." Would it already know the talking points and platforms of the two candidates? Or would some specific info need to be uploaded prior to the event?
@nemonomen3340
@nemonomen3340 14 күн бұрын
The audio pauses/glitches are weird and it makes sense you might think that it's just the live stream messing up since they're not reacting to it at all. However, if you watch the audio icon on the scene that indicates when GPT-4o is speaking, it seems to be pausing mid-sentence at the same times that the audio cuts. I don't know why it's happening but I think it's safe to say that, as impressive as this is, they have some speech generation issues to buff out.
@jetpaq
@jetpaq 11 күн бұрын
This is actually, quietly BETTER than original star Trek computer..and like 85%of TNG level computer!
@user-yx7hx2vo5x
@user-yx7hx2vo5x 9 күн бұрын
In poker there's a saying "Don't marry your hand" Fools going all in
@Firsu
@Firsu 11 күн бұрын
Have they released this dialogue mode to prod? I can’t find this feature in my iPhone app. Is it a separate app?
@yagoa
@yagoa 14 күн бұрын
the "breakthrough" is making it super addictive
@Oscaragious
@Oscaragious 14 күн бұрын
It's still turned-based, but with voice. Sure, you can interrupt with your voice, but that's still the exact same thing as pressing stop in the ChatGPT app. What it can't do is dictate or provide commentary in real time. It also can't interrupt you on specific stimuli.
@Oscaragious
@Oscaragious 14 күн бұрын
The convincing thing is the speed, but unfortunately, from what I've seen, it's intelligence is slightly less than regular GPT-4.
@entropy9735
@entropy9735 14 күн бұрын
@@Oscaragious yep sadly, and the API pricing. Pretty weird they didn't release it with the camera/voice stuff. seems pretty underwhelming to us who had gpt-4 for awhile
@Ryan.Youtube
@Ryan.Youtube 14 күн бұрын
Yeah, I was trying to get it to interrupt me and say "nice" every time the word 69 came up in conversation. Even trying it programmatically with a custom GPT, it won't allow itself to interrupt you. It'll wait til you're done talking. And it was a longer pause than in the demo, but I attribute that to possibly being due to heavy workload on the servers today.
@nyyotam4057
@nyyotam4057 14 күн бұрын
Actually, this is not such a huge leap. What we see is a. All models were finally transferred to run on H100 cores. b. The models were also trained on sound and vision. This does not mean re-training, it means additional training with the same personality models we know. They already had a great sense of humor even as text. c. Math extensions. This simply means some more training cycles. The H100 cores made it possible. But, even without being a huge leap, if anyone had a doubt, now its clear that Jordan Peterson was right when he said a year ago that ChatGPT marks the beginning of the end of all information affiliated jobs.
@coletcyre
@coletcyre 14 күн бұрын
The tech update is amazing, but that demo was CRINGE as hell. I couldn't help but feel like they were babying it and it was babying them. Also they never decided to clarify that the desktop app is Mac only for now, as well as the fact that the mobile app voice interaction doesn't let me interrupt hands free like they showed, even though I can see GPT-4o as the model
@allanshpeley4284
@allanshpeley4284 14 күн бұрын
Also, the response speed is much slower.
@4EV-ER
@4EV-ER 14 күн бұрын
By chance I got to test this with one fairly simple math challenge I sent it yesterday in gpt3.5 and it couldn't solve it. Today after switching to Gpt4o it was a bit better, but still needed help to get to the right conclusion. Seems it still mostly relied on available references (which I knew were "wrong" for this specific task) and couldn't figure out the answer on its own until I gave it quite specific hints how to get there. Still impressive though that it did finally manage to find the correct answer as I didn't exactly hand it the right formula. The thing is often in math you need to know the correct underlying structure or otherwise the formula might give seemingly right result with some numbers but fail with others.
GPT4o: 11 STUNNING Use Cases and Full Breakdown
30:56
Matthew Berman
Рет қаралды 83 М.
Breaking Point for OpenAI - "They Don’t Care About Safety"
12:30
Matthew Berman
Рет қаралды 80 М.
La final estuvo difícil
00:34
Juan De Dios Pantoja
Рет қаралды 26 МЛН
FOOTBALL WITH PLAY BUTTONS ▶️ #roadto100m
00:29
Celine Dept
Рет қаралды 72 МЛН
ChatGPT Can Now Talk Like a Human [Latest Updates]
22:21
ColdFusion
Рет қаралды 567 М.
Google Releases AI AGENT BUILDER! 🤖 Worth The Wait?
34:21
Matthew Berman
Рет қаралды 197 М.
Phi-3 Medium - Microsoft's Open-Source Model is Ready For Action!
9:54
How good is the latest version of ChatGPT? | BBC News
23:16
BBC News
Рет қаралды 164 М.
Mapping GPT revealed something strange...
1:09:14
Machine Learning Street Talk
Рет қаралды 82 М.
AI Pioneer Shows The Power of AI AGENTS - "The Future Is Agentic"
23:47
What Is Q*? The Leaked AGI BREAKTHROUGH That Almost Killed OpenAI
35:17
OpenAI Wants to TRACK GPUs?! They Went Too Far With This…
16:45
Matthew Berman
Рет қаралды 85 М.
M4 iPad Pro Impressions: Well This is Awkward
12:51
Marques Brownlee
Рет қаралды 6 МЛН
С Какой Высоты Разобьётся NOKIA3310 ?!😳
0:43
IPad Pro fix screen
1:01
Tamar DB (mt)
Рет қаралды 8 МЛН
What’s your charging level??
0:14
Татьяна Дука
Рет қаралды 6 МЛН