What is RAG? (Retrieval Augmented Generation)

Рет қаралды 80,745

4 ай бұрын

How do you create an LLM that uses your own internal content?
You can imagine a patient visiting your website and asking a chatbot: “How do I prepare for my knee surgery?”
And instead of getting a generic answer from just ChatGPT, the patient receives an answer that retrieves information from your own internal documents.
The way you can do this is with a Retrieval Augmented Generation (RAG) architecture.
It’s not as complex as it sounds and I’m breaking down how this very popular solution works in today’s edition of #CodetoCare, my video series on AI & ML.
My next video will be on a use case of AI in healthcare - what do you want to hear about from me?
#AI #artificialintelligence #LLM #genai
Check out my LinkedIn: / donwoodlock
---
ABOUT INTERSYSTEMS
Established in 1978, InterSystems Corporation is the leading provider of data technology for extremely critical data in healthcare, finance, and logistics. It’s cloud-first data platforms solve interoperability, speed, and scalability problems for large organizations around the globe.
InterSystems Corporation is ranked by Gartner, KLAs, Forrester and other industry analysts as the global leader in Data Access and Interoperability. InterSystems is the global market leader in Healthcare and Financial Services.
Website: www.intersystems.com/
KZfaq: / @intersystemscorp
LinkedIn: / intersystems
Twitter: / intersystems

Пікірлер: 146

@dwoodlock Ай бұрын

Since this video turned out to be so successful and several people requested for me to do a deep dive / demo, here it is! Looking forward to reading your comments and hope you enjoy this one too. kzfaq.info/get/bejne/hp6kgs2avquqoYk.html

@CodeVeda 3 ай бұрын

Finally someone is explaining with an real time example. Otherwise everyone else takes an example of fruits (apple, oranges etc) or movie names etc.

@hussamcheema 3 ай бұрын

One of the best explanation of RAG on KZfaq. Thanks Don.

@NicolaiDufva 2 ай бұрын

I agree. Most other explanations are either way too detailed with live coding that muddles the information or way too high-level talking about how the LLM retrieves the additional data (which it doesn't! it is given to it via the prompt!)

@eahmedshendy 3 ай бұрын

Not confusing at all, just simple and get to the point explanation, thank you.

@longship44 Ай бұрын

This is one of the best explanations of large language Models and the value of utilizing RAG I have seen. Don, you are an outstanding communicator. Thank you for taking the time to put this together.

@christopherhunt-walker6294 Ай бұрын

Wow he has explained this really clearly. This is the missing link for me between LLMs and making them actually useful for my projects. Thank you!

@BAZ82 3 ай бұрын

I found your video to be the most accessible and informative introduction to RAG, especially for those new to this topic.

@MrNewAmerican 3 ай бұрын

This is probably the best tutorial I have watched. Period. What an amazing teacher!

@user-ts2sj2dg8t 3 ай бұрын

Thank you. You are the first to explain RAG well. I have hear about a lot without understanding what does it mean.

@latentspaced 2 ай бұрын

Appreciate you and your content. I'm glad I found you again

@computingcoding799 14 күн бұрын

Awesome video! It helped explain the concept a great deal. well done👍

@travelchimps6637 Ай бұрын

9:20 not at all confusing, makes perfecf sense the way u exolained it thank you!!!

@arjbaid2024 3 ай бұрын

Wonderful explanation of this topic. Thank you!

@coopernelson6947 Ай бұрын

Great video. I feel like this is the first time I'm learning stuff that is at the cutting edge. This video was posted 2 months ago, very exciting times

@gtarptv_ Ай бұрын

Same here I had no idea that RAG WAS BIG DEAL. I'VE BEEN READING STUFF ON REDDIT WORK PEOPLE TALKING ABOUT THE RAG THIS AND THAT

@FirstNameLastName-fv4eu Ай бұрын

God save that patient on his/ her Knee Surgery !!

@herculesgixxer 2 ай бұрын

loved your explanation, thank you

@johnny1966m 3 ай бұрын

Thank you very much for this video. Now is understand what my colleagues do in work with system documentation handling with use of LLM.:)

@easybachha 3 ай бұрын

Excellent explanation. Exactly what I was looking for! Thank you, Don!

@srleb3462 2 күн бұрын

Thanks fir great explanation

@m.abdullahfiaz9635 Ай бұрын

Thanks Prof. Don Woodlock you have explained exactly the same as I need to understand about my current project every concept maps to the practical part of project. Please deliver your knowledge more about advance and complex topics.👍

@mzimmerman1988 26 күн бұрын

well done! thanks.

@ciropaiva1519 3 ай бұрын

Incredible Video! Thank you very much!

@JamesNguyen-lt5bc 29 күн бұрын

awesome explanation. Thank you

@endourology 18 күн бұрын

I finally understood what RAG is, including the vector part. Great!

@achen94 3 ай бұрын

Amazing video. Thanks for the great explanation!

@EGlobalKnowledge 3 ай бұрын

Nice explanation, Thank you

@bhaskarmazumdar9478 Ай бұрын

This is an excellent explanation of the concept. Thank you Don

@aryankushwaha9306 Ай бұрын

one of the best explanation i ever found. Now I finally understand what RAG is and thank you so much Mr. Don

@annadehek6533 9 күн бұрын

such a good explanation, thank you so much!!

@vinayakminde8317 3 ай бұрын

By far this is the most simple explaination for RAG I have came across. Amazing. Looking forward to next videos in series.

@MuthukumaranPanchalingapuramKo Ай бұрын

Best content on RAG!! Thank you!

@MichaelRuddock 3 ай бұрын

Thank you for sharing your knowledge with us, great explanation.

@Ak_Seeker 3 ай бұрын

Awesome, thanks for the wonderful explanation in simple language

@abhilpnYT 3 ай бұрын

Well explained ThankYou ❤

@anoopaji1469 3 ай бұрын

Very informative and simple

@joeytribbiani735 2 ай бұрын

the best explanation of rag that've found thank you a lot

@ShikhaSheth-pk1us 4 күн бұрын

Real good one!

@dannysuarez6265 3 ай бұрын

Thank you for your great explanation sir!

@jasonkey7063 2 ай бұрын

Great explanation. I believe this has a big market for developers in small towns. Such an easy product to create and sell.

@DavidBennell Ай бұрын

Great explanation, I have seen a lot of these and people normally go into far too much detail and muddy the water, or are far too abstract, fast and loose, or just get it wrong. I think this is a great level to cover this topic at.

@rajmeets9303 16 күн бұрын

Wow! Wonderful session. I loved the simplicity of explaining RAG. Thanks a lot Don.

@789juggernaut 3 ай бұрын

Excellent video, really appreciate it.

@kingofartsofficial4431 3 ай бұрын

Very Good Explanation Sir

@bigplumppenguin 3 ай бұрын

Very good introduction!!!

@nadellaella6416 Ай бұрын

Bestt explanation! Thank youu Mr.Don!

@MateoGarcia-rt7xt 27 күн бұрын

Thanks for this great explanation, Don!

@rahulkunal 2 ай бұрын

Thanks for such a simple explanation of the RAG Architecture Concepts.

@TournamentPoker 3 ай бұрын

Great tutorial!

@califfa2419 22 күн бұрын

what a great explanation of RAG! Thank you

@chesaku Ай бұрын

Wow.. Job well done. Great and simplistic explanation for such complex topic.

@CollaborationSimplified 2 ай бұрын

This was great, thank you! I believe this process is what Copilot for Microsoft 365 uses and it is referred to as ‘grounding’. Very helpful 👍

@zandanshah 2 ай бұрын

Good content, please share more.

@nexai_official 7 күн бұрын

Thank you Don! The explanation was delightful

@MrFrubez 2 ай бұрын

Such a great explanation of RAG. It really helped me grasp the power of it.

@bryanbimantaka 3 ай бұрын

WOW! The simplest yet the best explanation! It's easy to understand for a beginner like me. THANK YOU!

@EstevaoFloripa 2 ай бұрын

Thanks a lot! Great and simples explanation!

@AshisRaj 2 ай бұрын

Excellent explanation Mr. Author

@vaidyanathtdakshinamurthy8732 22 күн бұрын

Hello Don Sir, thanks for this explanation. You're a blessed master craftsman. Simple and precise description and to the point.

@narendraparmar1631 2 ай бұрын

Thanks Don , that's informative

@Themojii Ай бұрын

Great explanation of RAG. I subscribed to your channel after watching this. Thank you Don for the great content.

@IhorVasutyn 2 ай бұрын

Very intuitive

@govindarajram8553 Ай бұрын

Just I watched from youtube suggestions and you me good explanations on Retrieval augmented generation closure to my use case. Thank you

@SantK1208 4 күн бұрын

Awesome , Thanks ❤

@gt6808a 20 күн бұрын

This has been the most helpful video I've found to help me understand how RAG works. Thank you so much for your wonderful explanation!

@rafa_lopes 3 ай бұрын

It was one of the most didactic explanations about RAG. Thank you, @Don Woodlock.

@davutengin 6 күн бұрын

Best RAG explanation I think. Thanks.

@shamimibneshahid706 2 ай бұрын

Clearly explained!

@stephenlii1744 2 ай бұрын

it’s a pretty good explanation,thanks Don

@Arunkumar-234. 2 ай бұрын

Great explanation! Thank you very much :)

@itsAlabi 2 ай бұрын

This is really clear, this will customize the output based on the environment of the user not just on open source data.

@screenwatcher6224 2 ай бұрын

This is SOOOO GOOD

@itayregev4691 3 ай бұрын

Thank you Don

@steffenmuller2888 2 ай бұрын

I was looking for a general explanation to the RAG topic and you provide it very well! Now, I understand that the quality of RAG systems strongly depend on the information retrieval from the vector database. I will try to implement a RAG system on my own to learn something about it. Thank you very much!

@MagusArtStudios 3 ай бұрын

I've been doing RAG and not even knowing the definition. Was glad to see I wasn't doing it wrong by injecting it into the end of the prompt.

@mattius459 Ай бұрын

Great, thank you.

@PR03 3 ай бұрын

great session dear Don. It was very complete, to the point and simply more advanced than other popular videos but of course in simple words. Thank you so much sir. ❤❤

@Tessi42 10 күн бұрын

Thank you very much for this great presentation. Tomorrow I will use this video to describe in a few minutes to the decision-makers in my company what this RAG means. Many simply do not yet understand the simplicity behind the pattern and therefore the possibilities I find it difficult to present it in such simplicity Thank you very much🙂

@inaccessiblecardinal9352 4 ай бұрын

Doing RAG stuff right now for work. Just scratching the surface, but very interesting stuff so far. We have a few clients on the horizon who really just need text classification, and the vanilla results from the vector DB might actually be good enough for them. Interesting territory coming fast.

@dwoodlock 4 ай бұрын

yes - I have found that pretty small LLMs (like BERT) do just fine for text classification.

@ClayBellBrews 2 ай бұрын

Great work; would really love to see you dig in on tokens and how they work as well.

@dharmakelleherauthor 20 күн бұрын

Thank you so much! This is a great, easy-to-follow explanation. Coincidentally, I'm having knee surgery tomorrow. LOL.

@peterbedford2610 3 ай бұрын

Sounds like it is optimizing or creating a more efficient prompt session? I guess "augmentation" is a fairly good description. Thank you. I enjoy your teaching style.

@tatuldanielyan9943 24 күн бұрын

Thank you

@Deep185 4 ай бұрын

Thank you!

@fire17102 2 ай бұрын

Would love it if you could showcase a working rag example with live changing data. For example item price change, or policy update. Does it require to manually manage chunks and embedding references or are there better existing solutions? I think this really differentiates between fun-todo and actual production systems and applications. Thanks and all the best! Awesome video ❤

@_alphahowler 2 ай бұрын

I would second that request with a real world example where information changes, i.e. some information is outdated Nd some new information is added without compromising the quality of the system.

@adeniyiajani7617 16 күн бұрын

I like the video which software did you use. Well done sir

@morespinach9832 3 ай бұрын

The revelation for me is that “our own data” is in fact added as a prompt before the prompt. And not after the LLM has responded. Is this correct? Secondly any vector database recommendations for storing our own very unstructured PDF documents? Do we need specialized stuff like Pinecone (which sadly is only hosted saas) or would Neo4J type stuff work too… or elastic search?

@joannaw3842 3 ай бұрын

Thank you very much, finally someone has explained it in an accessible way. My question, as a tester, are there any weaknesses in such a solution that need to be taken into account when working with such systems?

@dwoodlock 3 ай бұрын

Good question. There are two key points of failure that you want to think about from a testing point of view. Part 1 is whether the system is pulling the right documents to use as context. And Part 2 is whether the LLM, given the right documents, is giving a good answer to the question. Maybe teasing those two apart and testing them separately would be a good strategy.

@geoiowa Ай бұрын

Great explanation of RAG! What tool do you use for the drawing? Thanks

@dwoodlock Ай бұрын

It's a Revolution Lightboard.

@MadHolms 2 ай бұрын

great explanation, thx, but is only theory, can you please show a sample system where all of the above happens? thx!

@cerberus1321 Ай бұрын

Great video, thanks. I'm tasked with prototyping a product utilizing these methodologies for a client this quarter. I've not done it before so this is very helpful. Is langchain a tool that can handle this entire process? How much context can you provide an LLM without restricting it? Also, how do we actually bottle the raw database query results for summarization, assuming not all questions will relate to qualitative data?

@dwoodlock Ай бұрын

Yes - langchain can be a great help. I mostly didn't use it for this video because I wanted to explain the underlying concepts.

@theindubitable 2 ай бұрын

I have a problem with the model not changing context. It fills the the token cap and then when I ask another question it wont update the chunks everytime. How can I solve this? Maybe prompting.

@lxn7404 Ай бұрын

I wonder what is the role of LLM in creating a vector, it looks like simple indexation

@imranideas Ай бұрын

Hi, I have passed on the content of a pdf file to the llm and it does come up with a relevant response however the response is still generic in nature from the content i provided, what i need is a crisp to the point response like steps required to activate a sim card.. can you help me achieve the same

@DhavalPatel12 Ай бұрын

Thanks for explaining in detail and relevant example. Why not just train LLM with your data in the first place ? That would simplify the architecture.

@dwoodlock Ай бұрын

Yes - it would. But you may not have enough text to teach it all the intricacies of the English language and the original training is very very expensive and computational expensive. So it's better to start with a model that somebody has trained first and then fine-tune it or feed in context like I described.

@oryxchannel 4 ай бұрын

Pinecone vector DB has done some revolutionizing of its website- driving costs down with a new tech. It may affect how info is retrieved.

@dwoodlock 4 ай бұрын

Yes - pinecone is a leader in this area.

@JohnTurner313 3 ай бұрын

Very clear and helpful. The question I have: if I create a RAG using my own content (eg: contents of my cloud drive), how do I prevent that data content, which may include PII, HIPAA and other protected information, from being used by the AI provider like OpenAI? Anything I send to a 3P AI LLM will be used by them for training their own model, which in turn leads to high risk leakages to other people who aren't me. It seems like the only way to do this is to have a restricted, private LLM running locally on my laptop or home network.

@dwoodlock 3 ай бұрын

You need an agreement with these cloud services providers that enabled you to send PHI to them. Some offer this as one of their services. If you don't have that agreement, you cannot do it (in most countries). It is also an option to run a model on-prem and there are decent open source LLMs that you can use for certain use cases.

@morespinach9832 3 ай бұрын

@@dwoodlockwhich ones can be self hosted - BERT, RoBERTa? Which ones are good I mean. Also - do we have to keep these models up to date on Prem by downloading them again in the future as new versions of them emerge?

@hebol 3 ай бұрын

Just found you and your great content. Have to ask do you mirror-write…or thinking about it do you just mirror the video .-)

@dwoodlock 3 ай бұрын

No I don't mirror right - that would be way too complicated! I'm speaking behind a glass a writing on it naturally and it reverses everything. That's why I don't wear my Nirvana T-shirt when filming.

@hebol 3 ай бұрын

@@dwoodlockit wouldn’t be impossible. I had a lecturer she wrote with both hands interchangeable. You absolutely have the uniqeness (if that is a word…I’m Swedish) But you mirror the video so that we can se the text or? You are right-handed aren’t you…it looks like you are left handed….but regardless..I love your content. The best of lecturers theroretical and practical!

@joemiller9856 2 ай бұрын

Don , Can RAG be used to protect private company sensitive (trade secrets, etc. ) data by essentially translating this private data to numerical information (vectors) while using publicly available LLM? I suppose the responses from these prompts may also potentially expose sensitive information as well??

@dwoodlock Ай бұрын

Even though the RAG approaches turns words, sentences, and paragraphs into numbers, that doesn't mean that they are private, in other words you can call the tokenizer in reverse. So you need to treat these in the same way when considering whether to send them to a cloud LLM service.

@didyouknowtriviayt 3 ай бұрын

I built a system like this last year with openai, pinecone and python

@JamesSpellos 3 ай бұрын

So is a GPT that people can easily build essentially an architecture that uses a RAG approach, and if so, does it create a vector database from the documents the user uploads?

@dwoodlock Ай бұрын

Yes basically. And it also allows the user to put in custom instructions for their GPT.

@JamesSpellos Ай бұрын

@@dwoodlock Thank you for the confirmation & clarification. Appreciate it.