Using Your Own Data with Large Language Models (LLMs) aka Making JohnBot!

  Рет қаралды 21,470

John Savill's Technical Training

John Savill's Technical Training

Күн бұрын

In this video I walkthrough how to use your own data with Large Language Models (LLMs) like GPT by leveraging Azure AI Search and along the way I create JohnBot as a little example :-)
Useful associated videos:
📽️ Generative AI overview - • AI-900 - Learning Abou...
📽️ RAG, embedding and more - • RAG, semantic search, ...
🔎 Looking for content on a particular topic? Search the channel. If I have something it will be there!
▬▬▬▬▬▬ C H A P T E R S ⏰ ▬▬▬▬▬▬
00:00 - Introduction
00:26 - Why we need to use our own data
02:14 - Your source data
05:37 - Using Azure AI Search
08:19 - Integration and reading data
11:24 - Import and index
13:38 - What interval should be used?
16:18 - Viewing the index and indexer
18:11 - Chunking
24:51 - Other types of media beyond text
25:32 - IF YOU REMEMBER ONE THING :-)
29:43 - Keyword search is still useful so we need hybrid
32:41 - BM25 searching
34:15 - Hybrid search with RRF
41:27 - Orchestrator component
43:30 - Using the Playground and key settings such as memory
44:20 - Adding my data source
47:05 - Performing an interaction backed by my data (RAG)
50:20 - The response and references
55:12 - Summary
56:55 - Close
▬▬▬▬▬▬ K E Y L I N K S 🔗 ▬▬▬▬▬▬
► Whiteboard:
🔗 github.com/johnthebrit/Random...
▬▬▬▬▬▬ Want to learn more? 🚀 ▬▬▬▬▬▬
📖 Recommended Learning Path for Azure
🔗 learn.onboardtoazure.com
🥇 Certification Content Repository
🔗 github.com/johnthebrit/Certif...
📅 Weekly Azure Update
🔗 • Azure Infrastructure U...
☁ Azure Master Class
🔗 • Microsoft Azure Master...
⚙ DevOps Master Class
🔗 • DevOps Master Class
💻 PowerShell Master Class
🔗 • PowerShell Master Class
🎓 Certification Cram Videos
🔗 • Microsoft Certificatio...
🧠 Mentoring Content
🔗 • Virtual Mentoring
❔ Questions? Maybe I answered it in my FAQ
🔗 savilltech.com/faq
👕 Cure Childhood Cancer Charity T-Shirt Channel Store
🔗 johns-t-shirts-store.creator-...
👂 Enable the subtitles and from there you can translate to your native language via the auto-translate feature in settings! • KZfaq Captions and A... for a demo of using this feature.
SUBSCRIBE ✅ / @ntfaqguy
#copilot #microsoft #azure #johnsavillstechnicaltraining

Пікірлер: 59
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
Hey everyone, creating the JohnBot 4000 or just how to use YOUR data with generative AI :-D ! Please make sure to read the description for the chapters and key information about this video and others. ⚠ P L E A S E N O T E ⚠ 🔎 If you are looking for content on a particular topic search the channel. If I have something it will be there! 🕰 I don't discuss future content nor take requests for future content so please don't ask 😇 🤔 Due to the channel growth and number of people wanting help I no longer can answer or even read questions and they will just stay in the moderation queue never to be seen so please post questions to other sites like Reddit, Microsoft Community Hub etc. 👂 Translate the captions to your native language via the auto-translate feature in settings! kzfaq.info/get/bejne/rJuSaJZetc2pnX0.html for a demo of using this feature. Thanks for watching! 🤙
@joefitzgerald1664
@joefitzgerald1664 7 ай бұрын
THE MOST significant video you will watch this year regarding Azure AI! This video has profoundly changed what I can bring to my customers!
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
Wow, thanks!
@RaptorTila
@RaptorTila 7 ай бұрын
I just finished this video, and i have to agree with others... the level of detail was perfect, and it gave me such a better understanding of the LLM Chatbots. It even connected a ton of dots for me with how regular search engines are able to do what they do so quickly. Best video i have seen on this topic, amazing work John... I THANK you soo much for all you do.
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
That’s awesome, glad it was useful.
@sarthaks
@sarthaks 7 ай бұрын
Super super useful.. Thanks! John for this great insight to a very niche technology
@Dikimkd
@Dikimkd 7 ай бұрын
This is one of the best, if not THE BEST video on all youtube. I enjoyed this a lot, and am planning to watch it again tomorrow. THANK YOU for this!
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
Wow, thank you! Glad you enjoyed it! I had a blast researching and creating it.
@GrowWithAgencio
@GrowWithAgencio 7 ай бұрын
Thanks for the video John.
@Ajmal_Yazdani
@Ajmal_Yazdani 7 ай бұрын
Finally, a video from you Sir. Appreciate and Thanks!!!
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
My pleasure!
@georgevetolavman
@georgevetolavman 7 ай бұрын
Really great content! Thank you for the huge amount of time you put into making these high quality walkthroughs.
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
Thank you, appreciate the kind note.
@davidel6282
@davidel6282 6 ай бұрын
Clear and well thought true content, thank you for the great infomation! Definitly giving me the classic era of eli the computer guy vibes , you are the modern equivilant :)
@RaptorTila
@RaptorTila 7 ай бұрын
i was literally starting to plan this exact same thing over the weekend with a different show. Perfect timing, thank you!
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
Have fun!
@root_is_god
@root_is_god 7 ай бұрын
Awesome video. Thanks so much for breaking down such a new topic from beginning to end like this. I'm planning to watch more and more of you your previous content, so thanks for all the time and effort you have put into this treasure trove!
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
Glad you enjoyed it!
@LenBautista
@LenBautista 7 ай бұрын
Thanks again John for another fantastic video! Your explanations are clear and insightful. Really appreciated the learning experience!
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
My pleasure!
@PrinceJohn84
@PrinceJohn84 7 ай бұрын
Absolutely superb. The work that you've put into producing this is mind blowing 💪👍
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
Thanks a ton!
@cnchandroo
@cnchandroo 7 ай бұрын
Thanks for the wonderful video, John and it is very informative.
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
Glad you enjoyed it
@Bubu020174
@Bubu020174 7 ай бұрын
This lesson is 💎
@trevorharris627
@trevorharris627 7 ай бұрын
That is awesome to see these various AI technologies working together! The responses are just amazing. We currently have a ton of PDFs in various private SharePoint sites (that get updated routinely) and hope to someday be able to use a chatbot to respond based on that content.
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
Sounds great!
@filipkindt5463
@filipkindt5463 7 ай бұрын
Thanks John for the great video!
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
You are welcome!
@1979benmitchell
@1979benmitchell 7 ай бұрын
Perfect timing! I just got access to Azure OpenAI 😁
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
Perfect!
@dhacloudtech1199
@dhacloudtech1199 7 ай бұрын
Thank you John! You do have amazing talent to explain everything!! Finally all AI fuzz started to make sense. When we (the everyday John's video addicts since 2019 and earlier) are going to see JohnBot 4000 to come online so we can crack allthings Azure in realtime :) ? I have a gigantic onenote referencing your videos, I have been trying to do the task of the JohnBot 4000 in my own head, and it is about to burst :D. We all do need a gurdian JohnBot 4000 to save us! A Merry Christmas and a Happy New Year!
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
lol, no JohnBot 4000 plans for public, I think that would be terrifying ;-) Merry Christmas 🎅
@alesvondra6614
@alesvondra6614 6 ай бұрын
This is really great. It's so much easier to get the information I need from your video than piece it together from documentation or other means. Level of detail is perfect. I work in AI platform team for major corporation and I'm definitely going to push for Azure solutions more, compared to AWS or Google
@NTFAQGuy
@NTFAQGuy 6 ай бұрын
Great to hear! Glad I could help.
@alexgraham3529
@alexgraham3529 7 ай бұрын
Again, great detail on the "Behind the Scenes" effort of LLMs. Makes sense after all the various learning I've done to then see this, and I understand what your talking about 😅.
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
Glad it was helpful!
@joergmayer3741
@joergmayer3741 7 ай бұрын
Thx John - great content. Best from Germany
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
Thanks for watching!
@dasm4039
@dasm4039 7 ай бұрын
Awesome! THANK YOU !!!
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
You're welcome!
@chaosgaming637
@chaosgaming637 5 ай бұрын
Thank you so much!
@NTFAQGuy
@NTFAQGuy 5 ай бұрын
You're welcome!
@vinayashastry6156
@vinayashastry6156 5 ай бұрын
Awesome.
@amglover4361
@amglover4361 6 ай бұрын
I'm beginning to think you're actually AI yourself, like Data from Star Trek only with better skin 🤭 I mean, how can one person know so much about so much 😋 Seriously though, thanks for this
@NTFAQGuy
@NTFAQGuy 6 ай бұрын
As an AI model I cannot respond to this type of question.
@Daniel-Six
@Daniel-Six 5 ай бұрын
Great presentation... except for the periodic intrusion of this giant tree limb onto the screen. Oh wait... that's your right arm! 😂 Seriously, good stuff... I learned a lot from this.
@NTFAQGuy
@NTFAQGuy 5 ай бұрын
ROFL
@Fallyn2911
@Fallyn2911 7 ай бұрын
We are going through this now at work. Creating a bot and locking down bing Chat n co pilot.
@metnet666
@metnet666 3 ай бұрын
Hi John. Great video! About 45 minutes in you mention that using this implementation will mean you don't get hallucinations - is that definitely the case?
@NTFAQGuy
@NTFAQGuy 3 ай бұрын
Always a chance but greatly reduces probability
@metnet666
@metnet666 3 ай бұрын
@@NTFAQGuy thanks for the speedy reply!
@Martinlay9
@Martinlay9 7 ай бұрын
nice vidoe John, first comment boys 😎😎
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
Technically you were second ROFL :-)
@Martinlay9
@Martinlay9 7 ай бұрын
@@NTFAQGuy LOL :-)
@AzureCloudCowboy
@AzureCloudCowboy 7 ай бұрын
Hey John .
@NTFAQGuy
@NTFAQGuy 7 ай бұрын
Hey!
@user-no1rb5cr5i
@user-no1rb5cr5i 5 ай бұрын
if chatgpt + can read pdf and trian from external sources then why would i need to make my own LLM model?
@NTFAQGuy
@NTFAQGuy 5 ай бұрын
You are not making your own LLM model.
[1hr Talk] Intro to Large Language Models
59:48
Andrej Karpathy
Рет қаралды 2 МЛН
Using the Well-Architected Framework
34:39
John Savill's Technical Training
Рет қаралды 36 М.
Stay on your way 🛤️✨
00:34
A4
Рет қаралды 24 МЛН
ВОДА В СОЛО
00:20
⚡️КАН АНДРЕЙ⚡️
Рет қаралды 32 МЛН
Fast and Furious: New Zealand 🚗
00:29
How Ridiculous
Рет қаралды 43 МЛН
Elon Musk Drops New Tesla Bot 2.0 Optimus Secrets
57:11
Brighter with Herbert
Рет қаралды 4,2 М.
RAG, semantic search, embedding, vector... Find out what the terms used with Generative AI mean!
29:04
How to Build LLMs on Your Company’s Data While on a Budget
40:37
What Makes Large Language Models Expensive?
19:20
IBM Technology
Рет қаралды 65 М.
Trusting Your Co-Pilot
23:20
John Savill's Technical Training
Рет қаралды 12 М.
AI-900 - Learning About Generative AI
59:47
John Savill's Technical Training
Рет қаралды 51 М.
What are AI Agents?
12:29
IBM Technology
Рет қаралды 107 М.
PASSKEYS - What they are, why we want them and how to use them!
1:10:42
John Savill's Technical Training
Рет қаралды 32 М.
Stay on your way 🛤️✨
00:34
A4
Рет қаралды 24 МЛН