What is RAG? (Retrieval Augmented Generation)

Рет қаралды 67,494

3 ай бұрын

How do you create an LLM that uses your own internal content?
You can imagine a patient visiting your website and asking a chatbot: “How do I prepare for my knee surgery?”
And instead of getting a generic answer from just ChatGPT, the patient receives an answer that retrieves information from your own internal documents.
The way you can do this is with a Retrieval Augmented Generation (RAG) architecture.
It’s not as complex as it sounds and I’m breaking down how this very popular solution works in today’s edition of #CodetoCare, my video series on AI & ML.
My next video will be on a use case of AI in healthcare - what do you want to hear about from me?
#AI #artificialintelligence #LLM #genai
Check out my LinkedIn: www.linkedin.com/in/donwoodlock/
---
ABOUT INTERSYSTEMS
Established in 1978, InterSystems Corporation is the leading provider of data technology for extremely critical data in healthcare, finance, and logistics. It’s cloud-first data platforms solve interoperability, speed, and scalability problems for large organizations around the globe.
InterSystems Corporation is ranked by Gartner, KLAs, Forrester and other industry analysts as the global leader in Data Access and Interoperability. InterSystems is the global market leader in Healthcare and Financial Services.
Website: www.intersystems.com/
KZfaq: www.youtube.com/@InterSystemsCorp
LinkedIn: www.linkedin.com/company/intersystems/
Twitter: InterSystems

Пікірлер: 135

@dwoodlock 29 күн бұрын

Since this video turned out to be so successful and several people requested for me to do a deep dive / demo, here it is! Looking forward to reading your comments and hope you enjoy this one too. kzfaq.info/get/bejne/hp6kgs2avquqoYk.html

@hussamcheema 2 ай бұрын

One of the best explanation of RAG on KZfaq. Thanks Don.

@NicolaiDufva Ай бұрын

I agree. Most other explanations are either way too detailed with live coding that muddles the information or way too high-level talking about how the LLM retrieves the additional data (which it doesn't! it is given to it via the prompt!)

@CodeVeda 2 ай бұрын

Finally someone is explaining with an real time example. Otherwise everyone else takes an example of fruits (apple, oranges etc) or movie names etc.

@endourology Күн бұрын

I finally understood what RAG is, including the vector part. Great!

@christopherhunt-walker6294 21 күн бұрын

Wow he has explained this really clearly. This is the missing link for me between LLMs and making them actually useful for my projects. Thank you!

@eahmedshendy 3 ай бұрын

Not confusing at all, just simple and get to the point explanation, thank you.

@gt6808a 3 күн бұрын

This has been the most helpful video I've found to help me understand how RAG works. Thank you so much for your wonderful explanation!

@califfa2419 5 күн бұрын

what a great explanation of RAG! Thank you

@user-ts2sj2dg8t 3 ай бұрын

Thank you. You are the first to explain RAG well. I have hear about a lot without understanding what does it mean.

@mattius459 28 күн бұрын

Great, thank you.

@latentspaced Ай бұрын

Appreciate you and your content. I'm glad I found you again

@mzimmerman1988 9 күн бұрын

well done! thanks.

@BAZ82 2 ай бұрын

I found your video to be the most accessible and informative introduction to RAG, especially for those new to this topic.

@arjbaid2024 3 ай бұрын

Wonderful explanation of this topic. Thank you!

@easybachha 2 ай бұрын

Excellent explanation. Exactly what I was looking for! Thank you, Don!

@JamesNguyen-lt5bc 12 күн бұрын

awesome explanation. Thank you

@herculesgixxer 2 ай бұрын

loved your explanation, thank you

@joeytribbiani735 Ай бұрын

the best explanation of rag that've found thank you a lot

@MrNewAmerican 3 ай бұрын

This is probably the best tutorial I have watched. Period. What an amazing teacher!

@abhilpnYT 2 ай бұрын

Well explained ThankYou ❤

@MuthukumaranPanchalingapuramKo Ай бұрын

Best content on RAG!! Thank you!

@vinayakminde8317 3 ай бұрын

By far this is the most simple explaination for RAG I have came across. Amazing. Looking forward to next videos in series.

@MateoGarcia-rt7xt 11 күн бұрын

Thanks for this great explanation, Don!

@bhaskarmazumdar9478 28 күн бұрын

This is an excellent explanation of the concept. Thank you Don

@Ak_Seeker 3 ай бұрын

Awesome, thanks for the wonderful explanation in simple language

@achen94 2 ай бұрын

Amazing video. Thanks for the great explanation!

@ciropaiva1519 2 ай бұрын

Incredible Video! Thank you very much!

@johnny1966m 3 ай бұрын

Thank you very much for this video. Now is understand what my colleagues do in work with system documentation handling with use of LLM.:)

@AshisRaj 2 ай бұрын

Excellent explanation Mr. Author

@govindarajram8553 16 күн бұрын

Just I watched from youtube suggestions and you me good explanations on Retrieval augmented generation closure to my use case. Thank you

@nadellaella6416 27 күн бұрын

Bestt explanation! Thank youu Mr.Don!

@EGlobalKnowledge 3 ай бұрын

Nice explanation, Thank you

@dannysuarez6265 2 ай бұрын

Thank you for your great explanation sir!

@rafa_lopes 2 ай бұрын

It was one of the most didactic explanations about RAG. Thank you, @Don Woodlock.

@shamimibneshahid706 Ай бұрын

Clearly explained!

@itayregev4691 2 ай бұрын

Thank you Don

@Arunkumar-234. Ай бұрын

Great explanation! Thank you very much :)

@bryanbimantaka 2 ай бұрын

WOW! The simplest yet the best explanation! It's easy to understand for a beginner like me. THANK YOU!

@zandanshah Ай бұрын

Good content, please share more.

@MrFrubez 2 ай бұрын

Such a great explanation of RAG. It really helped me grasp the power of it.

@rahulkunal Ай бұрын

Thanks for such a simple explanation of the RAG Architecture Concepts.

@tatuldanielyan9943 7 күн бұрын

Thank you

@anoopaji1469 3 ай бұрын

Very informative and simple

@IhorVasutyn 2 ай бұрын

Very intuitive

@EstevaoFloripa Ай бұрын

Thanks a lot! Great and simples explanation!

@MichaelRuddock 2 ай бұрын

Thank you for sharing your knowledge with us, great explanation.

@longship44 Ай бұрын

This is one of the best explanations of large language Models and the value of utilizing RAG I have seen. Don, you are an outstanding communicator. Thank you for taking the time to put this together.

@kingofartsofficial4431 3 ай бұрын

Very Good Explanation Sir

@chesaku Ай бұрын

Wow.. Job well done. Great and simplistic explanation for such complex topic.

@789juggernaut 2 ай бұрын

Excellent video, really appreciate it.

@Themojii 18 күн бұрын

Great explanation of RAG. I subscribed to your channel after watching this. Thank you Don for the great content.

@narendraparmar1631 Ай бұрын

Thanks Don , that's informative

@screenwatcher6224 2 ай бұрын

This is SOOOO GOOD

@bigplumppenguin 2 ай бұрын

Very good introduction!!!

@jasonkey7063 2 ай бұрын

Great explanation. I believe this has a big market for developers in small towns. Such an easy product to create and sell.

@stephenlii1744 2 ай бұрын

it’s a pretty good explanation,thanks Don

@Deep185 3 ай бұрын

Thank you!

@TournamentPoker 3 ай бұрын

Great tutorial!

@aryankushwaha9306 Ай бұрын

one of the best explanation i ever found. Now I finally understand what RAG is and thank you so much Mr. Don

@DavidBennell 24 күн бұрын

Great explanation, I have seen a lot of these and people normally go into far too much detail and muddy the water, or are far too abstract, fast and loose, or just get it wrong. I think this is a great level to cover this topic at.

@itsAlabi 2 ай бұрын

This is really clear, this will customize the output based on the environment of the user not just on open source data.

@vaidyanathtdakshinamurthy8732 5 күн бұрын

Hello Don Sir, thanks for this explanation. You're a blessed master craftsman. Simple and precise description and to the point.

@travelchimps6637 Ай бұрын

9:20 not at all confusing, makes perfecf sense the way u exolained it thank you!!!

@m.abdullahfiaz9635 Ай бұрын

Thanks Prof. Don Woodlock you have explained exactly the same as I need to understand about my current project every concept maps to the practical part of project. Please deliver your knowledge more about advance and complex topics.👍

@fire17102 2 ай бұрын

Would love it if you could showcase a working rag example with live changing data. For example item price change, or policy update. Does it require to manually manage chunks and embedding references or are there better existing solutions? I think this really differentiates between fun-todo and actual production systems and applications. Thanks and all the best! Awesome video ❤

@_alphahowler Ай бұрын

I would second that request with a real world example where information changes, i.e. some information is outdated Nd some new information is added without compromising the quality of the system.

@steffenmuller2888 2 ай бұрын

I was looking for a general explanation to the RAG topic and you provide it very well! Now, I understand that the quality of RAG systems strongly depend on the information retrieval from the vector database. I will try to implement a RAG system on my own to learn something about it. Thank you very much!

@PR03 2 ай бұрын

great session dear Don. It was very complete, to the point and simply more advanced than other popular videos but of course in simple words. Thank you so much sir. ❤❤

@coopernelson6947 Ай бұрын

Great video. I feel like this is the first time I'm learning stuff that is at the cutting edge. This video was posted 2 months ago, very exciting times

@gtarptv_ 15 күн бұрын

Same here I had no idea that RAG WAS BIG DEAL. I'VE BEEN READING STUFF ON REDDIT WORK PEOPLE TALKING ABOUT THE RAG THIS AND THAT

@dharmakelleherauthor 3 күн бұрын

Thank you so much! This is a great, easy-to-follow explanation. Coincidentally, I'm having knee surgery tomorrow. LOL.

@ClayBellBrews 2 ай бұрын

Great work; would really love to see you dig in on tokens and how they work as well.

@FirstNameLastName-fv4eu 24 күн бұрын

God save that patient on his/ her Knee Surgery !!

@CollaborationSimplified 2 ай бұрын

This was great, thank you! I believe this process is what Copilot for Microsoft 365 uses and it is referred to as ‘grounding’. Very helpful 👍

@MagusArtStudios 2 ай бұрын

I've been doing RAG and not even knowing the definition. Was glad to see I wasn't doing it wrong by injecting it into the end of the prompt.

@peterbedford2610 2 ай бұрын

Sounds like it is optimizing or creating a more efficient prompt session? I guess "augmentation" is a fairly good description. Thank you. I enjoy your teaching style.

@inaccessiblecardinal9352 3 ай бұрын

Doing RAG stuff right now for work. Just scratching the surface, but very interesting stuff so far. We have a few clients on the horizon who really just need text classification, and the vanilla results from the vector DB might actually be good enough for them. Interesting territory coming fast.

@dwoodlock 3 ай бұрын

yes - I have found that pretty small LLMs (like BERT) do just fine for text classification.

@MadHolms 2 ай бұрын

great explanation, thx, but is only theory, can you please show a sample system where all of the above happens? thx!

@joannaw3842 3 ай бұрын

Thank you very much, finally someone has explained it in an accessible way. My question, as a tester, are there any weaknesses in such a solution that need to be taken into account when working with such systems?

@dwoodlock 3 ай бұрын

Good question. There are two key points of failure that you want to think about from a testing point of view. Part 1 is whether the system is pulling the right documents to use as context. And Part 2 is whether the LLM, given the right documents, is giving a good answer to the question. Maybe teasing those two apart and testing them separately would be a good strategy.

@geoiowa Ай бұрын

Great explanation of RAG! What tool do you use for the drawing? Thanks

@dwoodlock 20 күн бұрын

It's a Revolution Lightboard.

@morespinach9832 2 ай бұрын

The revelation for me is that “our own data” is in fact added as a prompt before the prompt. And not after the LLM has responded. Is this correct? Secondly any vector database recommendations for storing our own very unstructured PDF documents? Do we need specialized stuff like Pinecone (which sadly is only hosted saas) or would Neo4J type stuff work too… or elastic search?

@cerberus1321 Ай бұрын

Great video, thanks. I'm tasked with prototyping a product utilizing these methodologies for a client this quarter. I've not done it before so this is very helpful. Is langchain a tool that can handle this entire process? How much context can you provide an LLM without restricting it? Also, how do we actually bottle the raw database query results for summarization, assuming not all questions will relate to qualitative data?

@dwoodlock 20 күн бұрын

Yes - langchain can be a great help. I mostly didn't use it for this video because I wanted to explain the underlying concepts.

@theindubitable 2 ай бұрын

I have a problem with the model not changing context. It fills the the token cap and then when I ask another question it wont update the chunks everytime. How can I solve this? Maybe prompting.

@imranideas Ай бұрын

Hi, I have passed on the content of a pdf file to the llm and it does come up with a relevant response however the response is still generic in nature from the content i provided, what i need is a crisp to the point response like steps required to activate a sim card.. can you help me achieve the same

@oryxchannel 3 ай бұрын

Pinecone vector DB has done some revolutionizing of its website- driving costs down with a new tech. It may affect how info is retrieved.

@dwoodlock 3 ай бұрын

Yes - pinecone is a leader in this area.

@hebol 2 ай бұрын

Just found you and your great content. Have to ask do you mirror-write…or thinking about it do you just mirror the video .-)

@dwoodlock 2 ай бұрын

No I don't mirror right - that would be way too complicated! I'm speaking behind a glass a writing on it naturally and it reverses everything. That's why I don't wear my Nirvana T-shirt when filming.

@hebol 2 ай бұрын

@@dwoodlockit wouldn’t be impossible. I had a lecturer she wrote with both hands interchangeable. You absolutely have the uniqeness (if that is a word…I’m Swedish) But you mirror the video so that we can se the text or? You are right-handed aren’t you…it looks like you are left handed….but regardless..I love your content. The best of lecturers theroretical and practical!

@lxn7404 18 күн бұрын

I wonder what is the role of LLM in creating a vector, it looks like simple indexation

@seva723 3 ай бұрын

soooooo lit

@didyouknowtriviayt 2 ай бұрын

I built a system like this last year with openai, pinecone and python

@DhavalPatel12 Ай бұрын

Thanks for explaining in detail and relevant example. Why not just train LLM with your data in the first place ? That would simplify the architecture.

@dwoodlock 20 күн бұрын

Yes - it would. But you may not have enough text to teach it all the intricacies of the English language and the original training is very very expensive and computational expensive. So it's better to start with a model that somebody has trained first and then fine-tune it or feed in context like I described.

@JohnTurner313 3 ай бұрын

Very clear and helpful. The question I have: if I create a RAG using my own content (eg: contents of my cloud drive), how do I prevent that data content, which may include PII, HIPAA and other protected information, from being used by the AI provider like OpenAI? Anything I send to a 3P AI LLM will be used by them for training their own model, which in turn leads to high risk leakages to other people who aren't me. It seems like the only way to do this is to have a restricted, private LLM running locally on my laptop or home network.

@dwoodlock 3 ай бұрын

You need an agreement with these cloud services providers that enabled you to send PHI to them. Some offer this as one of their services. If you don't have that agreement, you cannot do it (in most countries). It is also an option to run a model on-prem and there are decent open source LLMs that you can use for certain use cases.

@morespinach9832 2 ай бұрын

@@dwoodlockwhich ones can be self hosted - BERT, RoBERTa? Which ones are good I mean. Also - do we have to keep these models up to date on Prem by downloading them again in the future as new versions of them emerge?

@joemiller9856 Ай бұрын

Don , Can RAG be used to protect private company sensitive (trade secrets, etc. ) data by essentially translating this private data to numerical information (vectors) while using publicly available LLM? I suppose the responses from these prompts may also potentially expose sensitive information as well??

@dwoodlock 20 күн бұрын

Even though the RAG approaches turns words, sentences, and paragraphs into numbers, that doesn't mean that they are private, in other words you can call the tokenizer in reverse. So you need to treat these in the same way when considering whether to send them to a cloud LLM service.

@michaelcharlesthearchangel Ай бұрын

RAG // RSI from the Matrix

@pritampatil6056 3 ай бұрын

Father of AI for a reason!!

@djl3009 2 ай бұрын

I guess it doesn't hurt to have a likeness to Geoffrey Hinton if you are an AI practitioner :)

@dwoodlock 20 күн бұрын

Ha.

@JamesSpellos 2 ай бұрын

So is a GPT that people can easily build essentially an architecture that uses a RAG approach, and if so, does it create a vector database from the documents the user uploads?

@dwoodlock 20 күн бұрын

Yes basically. And it also allows the user to put in custom instructions for their GPT.

@JamesSpellos 20 күн бұрын

@@dwoodlock Thank you for the confirmation & clarification. Appreciate it.

@worldof_AG 2 ай бұрын

Please create a video of an entire project to create a chatbot using RAG

@dwoodlock 20 күн бұрын

I have one now: kzfaq.info/get/bejne/hp6kgs2avquqoYk.html

@worldof_AG 20 күн бұрын

@@dwoodlock thanks

@ramsescoraspe 3 ай бұрын

What about if the "content" is a relational database?

@dwoodlock 3 ай бұрын

Relational data is a fine source for this as well. Generally speaking you would 'textify' that data from the relational database to make it part of the prompt. For example when we use this approach with patient medical records, we create a text version of the medical record (which contains structured fields in a relational database) and use that text as part of the RAG model. You don't have to turn everything into complete sentences, but some textual form gives the LLMs the best chance of understanding structured data.

@serdalaslantas 2 ай бұрын

Hi, I have a problem with my chatbot. It doesn’t have a memory and doesn’t remember my previous conversations! How do I solve this issue? Does RAG system solve this problem? Thanks for your answer.

@KrungThaiBank 24 күн бұрын

Can save question and answer for next question

@dwoodlock 20 күн бұрын

yes - I didn't demonstrate this but RAG systems also summarize the prior conversation (or the last few questions) and send that as context. So if you ask "Do you have parking?" and then "How much does it cost?", it knows that you are referring to parking vs. your knee surgery for example.

@NISHANTSUTAR-fi9xe 23 күн бұрын

If I don’t have any relative data in my document then how to avoid giving respond to that question instead of giving random answer unrelated answer

@dwoodlock 20 күн бұрын

Just add that to the prompt. "If you are not finding any relevant information in the context that I provided, please don't answer the question". That sort of thing.

@asapfilms2519 2 ай бұрын

All human beings a large language models themselves. :)

@dwoodlock 20 күн бұрын

I guess so.

@nking99t 9 күн бұрын

one sentence summary: the data input(your own content) for gpt

@herotube789 3 ай бұрын

is what's called data embedding ?

@dwoodlock 3 ай бұрын

Yes - embedding is a key foundation that makes this work. Embedding is basically take the 'essence' of a paragraph of text and turning into a string of numbers. ML models really just work on numbers so this is clever process to do that.