Microsoft's HUGE AI Updates: GPT5, Devin, AI Agents, Phi3 Vision

Рет қаралды 65,822

Күн бұрын

Highlights from Micrsoft Build 2024, fully explained. #microsoft #ainews #openai #ai #agi #singularity #gpt
Thanks to our sponsor Brilliant. Try Brilliant for free for a full 30 days: brilliant.org/AISearch . You’ll also get 20% off an annual premium subscription
Newsletter: aisearch.substack.com/
Find AI tools & jobs: ai-search.io/
0:00 Intro
0:57 Phi3 Vision
3:58 GPT-4o in Azure AI
4:55 GPT-4o realtime desktop assistant
6:56 Devin AI
9:27 Khan Academy
13:31 GPT5 and the next frontier
16:38 Sam Altman
20:22 Team Copilot
22:12 Copilot Agents
23:57 MS Fabric
26:11 Github Copilot extensions
27:52 Windows Recall
Here's my equipment, in case you're wondering:
GPU: RTX 4080 amzn.to/3OCOJ8e
Mic: Shure SM7B amzn.to/3DErjt1
Secondary mic: Maono PD400x amzn.to/3Klhwvu
Audio interface: Scarlett Solo amzn.to/3qELMeu
CPU: i9 11900K amzn.to/3KmYs0b
Mouse: Logi G502 amzn.to/44e7KCF
If you found this helpful, consider supporting me here. Hopefully I can turn this from a side-hustle into a full-time thing!
ko-fi.com/aisearch

Пікірлер: 158

@theAIsearch 23 күн бұрын

Thanks to our sponsor Brilliant. Try Brilliant for free for a full 30 days: brilliant.org/AISearch . You’ll also get 20% off an annual premium subscription

@hafacah 23 күн бұрын

I thought it was suspicious that the AI didn’t ask the man what size hiking boot he would need and just put a pair in his cart.

@eSKAone- 23 күн бұрын

Probably knew it already. But nice catch!

@WigganNuG 23 күн бұрын

@@eSKAone- its a personal AI; its knows bro's feet size! lmao. or it saw what size they were

@haukionkannel 21 күн бұрын

It has allready speed his shoe size so no need to ask again..

@harrykatsaros 19 күн бұрын

Staged demo, not live.

@ssreehari 18 күн бұрын

lol

@user-jh2yn6zo3c 23 күн бұрын

The thumbnail to click here with Nadella and Devin grinning together is SUPER OMINOUS !!!! Whoa DUDE!!!!! :)

@theAIsearch 23 күн бұрын

😃😃

@bakielbenshomriel6466 23 күн бұрын

Thank you for your summary, very informative.

@theAIsearch 23 күн бұрын

My pleasure!

@flyingfree333 23 күн бұрын

GPT-4o doesn't stand for omega, it stands for omni, because it's innately multi-modal.

@theAIsearch 23 күн бұрын

ugh i knew that 🤦‍♂️ did this late last night

@Sky-fk5tl 23 күн бұрын

Omni means multimodal?

@Legorreta.M.D 23 күн бұрын

@@Sky-fk5tl no. Omni means „of all things“.

@nomvonglismerced4311 23 күн бұрын

stuck on covid

@mohamedfofanah1628 23 күн бұрын

Omni doesn’t imply multimodal

@Zaharik1 20 күн бұрын

About Devin was interesting.

@Qaeser 21 күн бұрын

You saved me so much time going through Build, ty!

@theAIsearch 21 күн бұрын

no worries!

@Bmutch966 23 күн бұрын

I would use the recall. Sounds useful

@DjHazardous 23 күн бұрын

*I have been using co-pilot for idea suggestions and i will say ive notice an improved response time so this is very interesting updates i am concerned with the recall feature as like you mentioned privacy concerns.* Also how is that Channel you automated a while back been doing on KZfaq?

@theAIsearch 23 күн бұрын

They probably switched from GPT4 to 4o, which is why you're seeing some improvements. I didn't post anything on that channel since last year lol. It was mostly an experiment.

@nickfotopoulos5323 23 күн бұрын

The impact on society will be profound. We aren't even remotely prepared for the change that is coming.

@karmaindustrie 23 күн бұрын

We are prepared an the impact will prepare us further.

@kevinfrancis1583 23 күн бұрын

The change will be profound, but it will be a lot slower than these flashy demonstrations show. We will keep pace, adapt and CL control it. I remember when PCs appeares and the same things were said. Then the Internet. And we are still alive. Besides it is not the technology itself that is the problem - it is people. The worst thing built with computers so far is social media, followed by porn and what that is doing to abuse of women. What we need for everything is rapid legislation and controls before it gets too big.

@WigganNuG 23 күн бұрын

sure we are. We've had Siri/ Google / Alexa / Cortana for awhile now and people are very used to talking to voice assistants. The next logical step is that they are AI powered and more capable and human like. We'll all be power users of our PC's because our AI assistant is the power user for you. We'll all be mostly talking to our computers and phones in the next 5 years.

@karmaindustrie 23 күн бұрын

@@WigganNuG and the AI shall function as proper therapy, unprompted. By default reflecting any lack of (current/urgent or general) mental health, like empathy is supposed to do. Even just by tonality, so people feel recognized 'to their core' like never before, because normal people try to avoid empathy just for that reason... and their own fear of not knowing what to say if the conversation goes into 'THAT' direction, which the AI obviously doesn't have (the fear of THAT [way/guy])

@karmaindustrie 23 күн бұрын

@@WigganNuG AI will basically replace THAT guy... ALL of them (us). So all the THAT guys will appear normal or rather "the last will become the first" since AI has turned everything upside down and inside-out. Because therapy has no longer it's palliative component due to the fear of "not being in hero mode, justifying every financial demand" and will turn into curative real therapy, acknowledging the fact that every soul can heal fully. No need for suppression and deception and lametta.

@Drcraigbarton 23 күн бұрын

Windows recall + AI would be great. I can ask the AI to make up realistic images that made it look like I have been working while my real history (watching funny cat videos) has been deleted.

@erkanozdogan4765 20 күн бұрын

Thanks

@theAIsearch 20 күн бұрын

Welcome

@winkipinky 23 күн бұрын

How much storage will RECALL use up on my computer after 6 months? Will i run out of space??

@mixey01 22 күн бұрын

Woke up: A.I Going trough my day: A.I Went sleep A.I A.I Caramba 😅

@theAIsearch 22 күн бұрын

sounds like the future!

@infini.tesimo 23 күн бұрын

At most, I use AI to make sense of hours and hours of audio conversations with calls to summarize and potentially answer things I missed in meetings. Secondary use is making illustrations to get points across and thank god 4.o is out. Last would be nuanced deep search where I need a conversational type of answer where I can only ever get context in my ramblings as I brain dump into it.

@theAIsearch 23 күн бұрын

Great use cases. Thanks for sharing

@kevinfrancis1583 23 күн бұрын

Great examples. As yet AI is a great helper in smaller tasks for individuals. These are great uses.

@freecivweb4160 23 күн бұрын

Coming to a future near you: You: "Recall, give me that series I was watching on Netflix yesterday." Recall: "I can't do that, Dave. I'm afraid I can't access DRM."

@flyingfree333 23 күн бұрын

Password lock your computer and encrypt your HD and the AI's memory isn't an issue. But let's face it, most computers aren't secure and with or without AI if someone sits down at your computer they can get whatever they want.

@BillAnt 23 күн бұрын

Even if you have full HD encryption, if a malware/remote code execution gets in, it will siphon off you data unecrypted.

@WigganNuG 23 күн бұрын

not if you use face recognition and other bio-securities that have existed for years now.

@WigganNuG 23 күн бұрын

@@BillAnt Our antivirus software will be AI powered as well. Gotta think it though.

@BillAnt 22 күн бұрын

@@WigganNuG - Once a malware is running, it doesn't matter if you have it locked or not.

@tofolcano9639 21 күн бұрын

6:32 The AI didn't do that through the client's browser, he did that directly on the server in his http session probably. That's because as the guy on stage just explained, you can use the LLM services in your own website. They were displaying an imaginary website that sells shoes as an example and how you can talk to it and show them your own shoes to make you recommendations and buy them for you.

@thcoura 23 күн бұрын

The new surface keyboard is already out of stock from the pre order

@theAIsearch 23 күн бұрын

🤯

@nabi5864 23 күн бұрын

Yup

@kevinfrancis1583 23 күн бұрын

Damn...

@lomio7250 23 күн бұрын

About Windows Recall, I find it great. As long as you have nothing to hide, there is only benefits. But I'm sure most people fear for their privacy.

@theAIsearch 23 күн бұрын

As long as you have nothing to hide

@grahamvs 21 күн бұрын

If you have nothing to hide, then what's your usernames, passwords, credit card details, pin codes, etc? People that think they have "nothing to hide" are naive and don't realise how dangerous a lack of privacy really is. This new Recall will have access to more then people realise. The AI will know about any bank account you log into, as well as any sensitive work or documents on your computer. Just wait until someone figures out how to make malware to infect the AI... They will be able to capture your image through webcams, your voice, speech and writing patterns, meaning they can then easily make a fake AI version of you and ruin your life. When it comes to computers, nothing is 100% secure.

@elLooto 21 күн бұрын

As long as you have nothing to hide.... and the things that you did today dont become something you have to hide tomorrow... or next week... or next year... or ever in your life. Just think about people getting cancelled over a tweet they posted in 2011....

@Swelake 21 күн бұрын

I love these digital humans.

@nzenguemayombogolden2660 18 күн бұрын

I took a mandotory training on copilot for work. And every day my company send me link two generative IA training. I mean, they DON'T want to miss the train of progress 😂.

@theAIsearch 18 күн бұрын

that's nice. was it easy to learn?

@nzenguemayombogolden2660 18 күн бұрын

@theAIsearch yeah, it was easy to learn. It requires a more careful clearance labeling, meaning assigning the labels secret vs confidential etc to each file the laptop so that it does not accidentally reveal information (when you prompt, for example, write a report).

@devilgamingyt7308 23 күн бұрын

Can you plsss make a tutorial of downloading stable diffusion locally plssss

@WigganNuG 23 күн бұрын

just use GPT 4o to walk you through it; Im not EVEN KIDDING man!

@michellezhang820 23 күн бұрын

I am still using GPT3.5 more frequently

@NickDrinksWater 23 күн бұрын

gpt5 will be true ai, gpt6 will be sentient ai

@honkytonk4465 21 күн бұрын

I hope there will be no sentient ai.Sentient ai will no longer work for us

@NickDrinksWater 21 күн бұрын

@@honkytonk4465 Indeed, it will work with us

@eSKAone- 23 күн бұрын

Honestly how were they able to build all this in 2y. I more and more believe they have AGI internally already, as their strongest co-worker.

@eSKAone- 23 күн бұрын

Microsoft will rule the world.

@theAIsearch 23 күн бұрын

They have the most capital, the most compute, and some of the best talent in the world

@eSKAone- 23 күн бұрын

@@theAIsearchI guess, but the testing of all these features alone must be a ton of work. And you can't automate this task, not without reliable AGI at least.

@kevinfrancis1583 23 күн бұрын

200,000+ staff writes a lot of code. Especially if they use their own tools correctly.

@user-qo7lw1qr5x 23 күн бұрын

@@kevinfrancis1583 They have 1200+ employees. It's been said by a lot of the top guys that nobody knows how these AI work. Even the best researchers don't fully understand. If this model is almost 2 years old and limited by them, who knows what they are hiding.

@toerti9589 19 күн бұрын

Copilot a text that's only read by AI on the recipients side anyway. AI 2024.

@audiolivrobom 21 күн бұрын

People are talking about the Spanish bit of the demonstration. This is SO NOT a new feature. Since 3.5, GPT can do that flawlessly. It just jumps through languages easily.

@BlakeAveryProductions 23 күн бұрын

Fabric isn't new. Swear the license for free Power BI has been called Microsoft Fabric Free for at least the last 9 months

@user-gk7iq6if9q 23 күн бұрын

MS👍

@TheSirTerminator 23 күн бұрын

🤯

@beto8493 22 күн бұрын

Is this AI technology will be introduce in iPhone 16?

@theAIsearch 22 күн бұрын

possibly. apple is discussing a deal w openai

@honkytonk4465 21 күн бұрын

Yes!

@mohamadhasanzeinali3674 23 күн бұрын

you videos good, but i see too much ads

@pragmatica1032 23 күн бұрын

Recall is the worst idea Microsoft had since Clippy.

@geoffstow394 22 күн бұрын

why do I, as a 77 year old programmer, find this sinister?

@honkytonk4465 21 күн бұрын

Bc you're 77?

@firdousbhat123 23 күн бұрын

world flooding with AI tools

@shopbc5553 23 күн бұрын

Oh my god; if you think people are rude today; just wait for these accommodating AI models to normalize casual over-talk and interrupting Add this to the AI safety list: Train these things to maintain our social norms or improve them

@angryox3102 23 күн бұрын

I thought that I was the only one who was aggravated with the hosts interrupting GPTo livestream. It seemed so rude.

@Sky-fk5tl 23 күн бұрын

That's not gonna happen

@WigganNuG 23 күн бұрын

@@angryox3102 Its a computer dude.. GPT's feelings don't get hurt. They were actually showcasing this as FEATURE because before GPT would just ramble on because its verbosity is WAY too high (which you can tell it to be as brief as you want).

@AutisticCuriosity 23 күн бұрын

How many demos so far have been faked, do we trust these people?

@kevinfrancis1583 23 күн бұрын

I haves worked with Microsoft for decades and have been to many of these conferences. Microsoft doesn't fake demo's. But, there is always a big gap between a demo that is limited to work on a stage the real world. On the stage all sorts of complexities and limitations can be glossed over.

@WigganNuG 23 күн бұрын

Yea its fake. Makes sense; microsoft fakes AI powered computers that is really just Cortana but suckier and when we all buy these and find out its fake, Microsoft will just laugh and laugh and be like "GOTCHA SUCKERS"... . No one seems to think thing through anymore lmao.

@dcrespol 22 күн бұрын

@@kevinfrancis1583 Well the famous video about HoloLens 2 where surgeons are performing a surgery was too fake. However, the HoloLens 2 itself has great capabilities, but not that close to what that video was showing.

@Thenewvoice-pc5re 22 күн бұрын

Windows recall is the end of the road for windows. Why did they even think about it. There is no other use than spying on windows users which is really disgusting.

@mardiniwilldern 23 күн бұрын

Why your voice resembles MindYourDecision? 🤔

@honkytonk4465 21 күн бұрын

What is ai?Where are the funny cats?

@jonorgames6596 23 күн бұрын

Linux, here I come! :)

@angryox3102 23 күн бұрын

Not a fan of that recall feature. I’m headed there with you.

@roelzylstra 23 күн бұрын

This presentation is aimed at devs and the CTO is dumbing it down by talking about whales?? WTF?? As the AI chat you did shows, the increase can be either 3x or 33x ...completely useless and idiotic explanation by the CTO.

@simkjels 23 күн бұрын

I suspect they used the odd animal comparisons due to legal reasons.

@theAIsearch 23 күн бұрын

agree that the marine life analogy is not great. there are many species of sharks & whales. in fact, the largest shark is way bigger than the smallest whale

@kevinfrancis1583 23 күн бұрын

It's called not giving information away to competitors. They have to walk a fine line in these events vetween telling developers what their new stuff does and not giving too much away so the competition can build it too.

@simkjels 23 күн бұрын

Yes, that might also be the case. Although, there aren’t many competitors that are able to scale their platform to this extent - even if they wanted to.

@Huru_ 22 күн бұрын

lol

@asjsjsienxjsks673 23 күн бұрын

No, they won’t. These guys are trying to squeeze every last ounce of money. They can out of GPT because you’re we’re gonna start seeing massive diminishing returns.

@WigganNuG 23 күн бұрын

are you saying these AI models are not INCREDIBLY and UNDENIABLY useful? You're not trying to say that are you? lmao...

@asjsjsienxjsks673 22 күн бұрын

@@WigganNuG I’m saying we’re reaching diminishing returns

@WigganNuG 22 күн бұрын

@@asjsjsienxjsks673 Everyone will become power users of technology because they have an AI assistant that can understand exactly what you want these systems to do. The increase in the accuracy and how cheap its getting follows the curve of virtually every technological advancement; its get better, faster, cheaper over time. Compute efficiency has gotten incredibly faster with GPT 4o in a crazy short period of time. We may see a diminishing point in the pure analysis of compute efficiency (I honestly don't know), but the use cases that can be built around a contextual AI model that you can converse with using natural language and can perform virtually every operation on you computer for you is insane in its implications for productivity, gaming design (at EVERY level including in-game NPC to game design itself), movie production, combined use with advanced AR/XR/MR/VR technology. The possibilities are not diminishing anytime soon

@Charles-Darwin 23 күн бұрын

Let's face the facts, apple crapped their pants on this one.

@theAIsearch 23 күн бұрын

they have a lot of catching up to do

@Goku78041 23 күн бұрын

😂

@theAIsearch 23 күн бұрын

😃

@Huru_ 22 күн бұрын

What is Microsoft getting out of the Cognition deal exactly? Makes absolutely zero sense, they already have OpenAI aka the root.

@OMatheusSakai 23 күн бұрын

Good video really sexy voice!

@thcoura 23 күн бұрын

Hahahahahha

@karmaindustrie 23 күн бұрын

Whomst'd've?

@theAIsearch 23 күн бұрын

wow, thanks!

@IlllIlllIlllIlll 23 күн бұрын

Video too long sir 30min..

@WigganNuG 23 күн бұрын

listen at faster speeds or use chapters or scan ahead.

@thinktanium9789 23 күн бұрын

these dudes design open ai to be verbose and then interrupt it all the time

@theAIsearch 23 күн бұрын

lol

@Huru_ 22 күн бұрын

It's on purpose. It's to test its ability at switching tasks and how fast it does it.

@TheMrCougarful 23 күн бұрын

Sounds like MS is still doing MS. Apple is going to eat their lunch.

@fetus1686 23 күн бұрын

that GPT-4o spanish accent was god awful!, has to be fake!

@theAIsearch 23 күн бұрын

lol

@MacXpert74 23 күн бұрын

"Recall ...Recall" Don't fuck with your brain, pal. It ain't worth it!

@MacXpert74 23 күн бұрын

A friend of mine tried it and nearly got himself lobotomized!

@nomvonglismerced4311 23 күн бұрын

Does this whale have military protection...I have a feeling a harpoon might be targeting this whale release...for the future of humanity

@Legorreta.M.D 23 күн бұрын

Copilot‘s accent in Spanish makes my eardrums bleed. The voice never did Spanish sounds / words / fragments of words, etc. And it cannot pull the proper sounds from English. So it just has a horrible accent.

@theAIsearch 23 күн бұрын

lol perhaps because the user first spoke in english, so the AI used a more 'american' accent to accommodate. i might be overthinking though

@Legorreta.M.D 23 күн бұрын

@@theAIsearch the sounds, entonations, consonants and vowels are very different. Correct. Because the voice actor never did them because English doesn’t use them, copilot doesn’t have them in its bank to pull from. I imagine the same would happen for the French R and other sounds. But Microsoft loves having it speaking Spanish

@aceofmusics9029 23 күн бұрын

😠

@nemonomen3340 23 күн бұрын

🤡

@zerosum1290 22 күн бұрын

just use data not marine wildlife ffs.

@kuroallen6419 23 күн бұрын

You'll see soon AI vtubers too lmao 😂

@darkyuraptor3315 23 күн бұрын

That's actually already happening (kinda). There's a guy that made some decent framework on making an AI vtuber. He's still improving it, but it works. For info, search: Hilda AI Vtuber (there are others, but I believe the guy that made Hilda may be the best one)

@Kuukunen2 23 күн бұрын

Already exists, though

@Astrathegn 23 күн бұрын

This isn't anything new, intact I'd wager that a good portion of the people online are ai powered bots

@justintran3586 23 күн бұрын

Go and type "Neuro Sama". That's your answer

@kuroallen6419 23 күн бұрын

@@Kuukunen2 Oh I didn't know however I'm talking about gpt 4 omni like AI with a more humanlike interaction jajj. Although I can see some issues cuz of the limitations on the answers it can do but I hope 4o can surpass my imagination. 😅 Even having an AI vtuber companion in the live stream would be nice yk. 🙂