What are the use cases you want to see me building with Groq?

My first thought is how can we use this for scam baiting? We just need an elderly person's voice option to make the call and then prompt the AI to waste the scammers time talking about gift card activation codes.

This is one true gem of a video that focusses more on the use case. Thank you for breaking down the concepts really well and showing us demo of it's capabilities

Yes because we all want more cold calls from sales bots.

🎯 Key Takeaways for quick navigation: 00:32 *🧠 Introduction to Groq's LPU (Large Language Model Processing Unit)* - Introduction to Groq's LPU architecture designed specifically for AI inference. - Explanation of the need for LPU in large language model inference. - Comparison between LPU and other processing units like CPU and GPU. 05:37 *🔍 Comparison between CPU and GPU* - Description of CPU as the central processing unit and its limitations in parallel computing. - Explanation of GPU architecture, parallel computing power, and its expansion beyond gaming. - Illustration of the difference between CPU and GPU through a painting demonstration. 06:05 *🔄 Limitations of GPU in Large Language Model Inference* - Discussion on the limitations of GPU in handling large language model inference. - Explanation of the complexities in achieving sequential execution on GPU. - Overview of the latency issues and the need for complex control mechanisms. 09:47 *🚀 Groq's LPU Architecture and Performance Benefits* - Introduction to Groq's LPU architecture designed for sequential tasks and low latency. - Explanation of the simplified architecture and shared memory advantages. - Discussion on the predictability and performance gains achieved with Groq's LPU. 11:37 *🗣️ Applications of Fast Inference Speeds* - Exploration of potential applications such as real-time voice AI for natural conversations. - Discussion on the reduction of latency enabling smoother interactions. - Demonstration of real-time voice AI and its impact on user experience. 13:17 *🖼️ Utilization in Image and Video Processing* - Highlighting the effectiveness of Groq for real-time image and video processing. - Demonstration of image processing capabilities for various applications. - Discussion on unlocking consumer-facing use cases with fast inference speeds. 14:40 *🤖 Building Real-time Voice AI with Groq* - Discussion on building outbound sales agents using real-time voice AI. - Introduction to platforms like Vee for integrating voice AI into applications. - Demonstration of setting up a real-time voice AI assistant using Groq's model. 00:00 *📞 Setting Up Real-time Voice AI Cold Call Agent* - Setting up a real-time voice AI cold call agent using Groq technology. - Integration of voice AI capabilities into existing agent systems. - Configuring API calls and server URLs for seamless communication between systems. 19:18 *🛠️ Integrating Real-time Voice AI with Existing Agent Systems* - Demonstrates how to integrate real-time voice AI with existing agent systems. - Setting up agent tools for making phone calls and receiving transcriptions. - Configuring metadata and webhooks for seamless communication between platforms. 20:41 *📞 Configuring Call Functionality and AI Assistant* - Configuring call functionality within agent systems for real-time voice AI interaction. - Setting up dynamic message generation and personalized interactions. - Defining schemas, URLs, and metadata for effective communication between systems. Made with HARPA AI

This is really interesting. Thanks for the sharing Jason.

I wonder how many "Nigerian Prince" this thing could run in parallel? 🤔🤭

Loved this Jason!!! Thank you

You're incredible. Thanks for this Demo, Jason Sensei.

Thanks Jason for the good work.

These are amazing use cases!! Lowering the barriers of entry to do high quality business associated with big companies!! Thanks Jason

Thanks for this awesome content, first time on your page but this is great and simple to follow and understand!

Great share. Seriously grateful for creators like you!

So not quite there yet or reliable enough but getting closer. Thanks for these insights!

Another awesome video with great presentation and overview ,i give your video's example to many to make them understand how to educate viewer abour particular thing and tell about what,why,how and then implement things in easy way possible. Keep feeding us quality content buddy :-))

amazing stuff 💯

the thumbnail of this video is really cool, the text looks like it sticks out.

I loved your video!

Good stuff! Keep it up

Thank you for detailed, informative content 10/10

wow man this is incredible... holy molly!

Many thanks for never bothering to define what LPU is an actual acronym for.

Really great synopsis

Creating a UI questionnaire for non coder types to build applications to solve problems. Mostly business applications that might otherwise require a developer or consultant.

Its easy to see this will replace all callcenters very soon. I assume they originally developed this chip for the new Tesla Autopilot software, that is mainly AI/video based.

Awesome Video

Thanks, Jason for the great work!

17:17 That is so fast and seamless. Super cool.

Amazing!

good demo

Great explanation and example. Thank you very much.

Sick

WOW! Amazing tutorial. Top 3 I've watched ever! Keep up the great work! 🎉

Thank you.

I can't trust anything anymore! The demo in the end is very impressive This is so powerful but also scary, what the world will look like in 12 month, when all the communication are driven by AI?

Love this Jason, keep'em coming !!

Awesome job man

Excellent video! Keep up the good work.

great video

1:31 "I haven't do exercise at all for the past 3...or 6 months..." 😂

amazing video Jason

Can't wait to try this on some use cases I have in mind :D Great video as usual ;)

Can’t wait to watch this

Thank you for the background information reviews you provide.

How wonderful, this is bound to improve trust among people and all of our lives. This is the best thing that science has wrought since industrialized warfare. Thank you, technology.

Well done. It could be helpfull for custommer support actions

❤ great video, great explanation!

Amazing video Jason.

awesome@

This is amazing!

This is awesome. I've seen a bunch of Voice AIs and all of them have terrible latency issues as well as obvious AI voices. Using Groq to get the latency way down and custom voices with PlayHT solves both issues. Thanks for sharing!

Wow. Great information. Thank you for sharing!

The phone number thing is interesting... makes me fantasize about being able to have this as a replacement for the "leave a message after the beep" answering machines for your mobile if you don't get a call. A lot of people find leaving a message without having a conversation really awkward, so if you could instead connect to an AI assistant like this that actually talks to you, you could leave better messages, and the AI can summarize the conversation and leave you a txt message of the contents, or just leave their own summarized voice message.

God my manifestation skills went through the roof this time. Only 7 minutes from process start until this video magically materialized.

Helluva a channel you’re growing here big dawg! Keep up the good work!

Great video. Thanks for sharing

Really insightful video boss

This is why I subscribed!

They even added vocal fry to the woman’s voice for realism. * slow clap *

that intro was gold

Hesu, Jason The best channel You grew so much Since the first video I love this moment Where I am like, Opening the feed, Oh okay, Jason released a new video, "Well, it's probably _Good As Always_". ... Proceed to watch ... ABSOLUTE PERFECTION HANDS DOWN MAJESTIC INFORMATION BOILED DOWN LIKE A BOOSTED MONKEY ANIMAL YOU ARE NEVER HAVE I SEEN THINGS PUT IN THAT MANNER TOGETHER MUCH HARMONY STRONG BALANCE RESONANCE LEVEL? DEEeeeeee eeeeeeeeeee eeeeeP. From the Bottom of my heart, With Love & Respect Ivan

2:55 "In every frame 2 million pixels have to be generated" This guy broke down graphics in a way that made sense, for the first time in 20 years.

good job

hey great video - can you do a full walkthrough of relevanceai and how you set that agent up as its not possible to follow from your video as looks like you had some pre defined steps in there thanks or drop and drop a link to the code you used to build this? thanks

The Sales Agencies after watching this video: „Ah f*** this sh*t, let‘s learn some new skills“

As a non-dev, I am _so_ looking forward to tools like these.

Another amazing video!

Thank you for covering this, we are building AI Applications using groq. Fast, cheap, and reliable.

Awesome tutorial! The output seems to be conversation-aware. How can I train the voicebot so it will handle questions, and scripted answers the way I want it to? Would this be done in Groq? Your fitness caller did a great job and asked relevant questions to qualify you and give her an idea of where to go with the conversation...and the focus was on helping you and sales. Keep up the great work! I'm going to watch your video on how you built AI Agents for Research.

Great video, would be awesome if you could make one video of building a wrapper like this from scratch 😀

Thanks a lot. appreciate the details. Very helpful

yeah you’re gonna blow up bro 🎉 great video

Amazing video!!tysm

Brilliant video bravo 👍

I woke up to this video. My day just got 10x better 😄. I'm as a web dev, new to the field of AI LLMs. Just found Groq yesterday and tried with API access. but didn't understand what the heck is a LPU thing.but here we are! Thanks again!

This was really good. Thank you J! I have a use case for HR.

I'll have to try this. I managed to get very fast, close to realtime speech with the chatgpt api using a few queues and a local text to speech. The slowest part was the actual speech to text processing i believe. I was using whisper before they added all the new upgrades to the gpt api (this was when gpt3.5 just came out basically). It just processed two sentences to speech and put out the audio while it provessed the next sentences. The issue was that twilio made it very difficult to work with this since I needed to make it a stream and that required some realtime communication protocol that worked over phone, so i just stopped and had my own little chat assistant. Im a weeb. It was an anime girl ai assistant.

Awesome video, would recommend blurring out your whatsapp next time tho, just to make sure no pranksters mess with your friends.

I need one acting as my office assistant answering my phone calls.

Even if you are misleading with the idle cut times on the demo its impressive.

Hi Jason , great content , I just have one remark concerning the demo , the video is being cut it would be really nice if it was left intact just to have an idea of the latency , otherwise nice video

Hi Jason! I am impress about the content of the video. Do you know how much could cost a call for an Agent with that setup?

The highly-anticipated tool use (aka function calling) feature for Groq API was released last week!

This is awesome thanks 🙏

I loved the Crysis reference hahaha

Your videos are gold :-)

This workflow is insane for CRM.

As far as I know from the All in Podcast, “Groq” isn’t particularly made to be the LPU or language processing unit. It was build as a very parallel processor and had little use case until it was a perfect fit for LLMs. The brown skinned dude from the podcast owning a stake in the “Groq” company, also explained, that they didn’t have a compiler as in Nvidias Cuda, thus they build one in the last year. As the company was working on the idea for a while. It is more like the use case fits the product. LLMs definitely don’t exist long enough, that it was specifically made for it. So even as the LPU might be an adequate description right now: It rather looks like the chip picked up that profession, when growing up/maturing. Perfect timing interval for success: -Later and we would see another chip taking the spotlight, even if a little later. -earlier and the company might have bankrupted, if no use case were to be found

🤩🤩🤩

Synthflow is pretty cool too

Really interesting video, thank-you!

It will be something when ai can interrupt into a conversation correctly.

Great Work!!!

Great video, but just to clarify: GPU is Graphics Processing Unit not General Purpose Unit

Nice India will love this...

Great Video! Thank you! Ist IT possible only for WhatsApp to write with the customers?

This is amazing. Where can we get the code and stuff that you do your channel?

Interesting ai, gonna give it a whirl on monday with my turbo api keys

This makes what Vedal achieved with Neuro-sama even more impressive. He did all of that with pure code without any LLM or LPU

I can’t wait for this technology to get better. I need AI agents to for sales 😊