GraphRAG: The Most Incredible RAG Strategy Revealed

  Рет қаралды 26,976

Mervin Praison

Mervin Praison

Күн бұрын

🎥 Welcome to our channel! Today, we dive into the revolutionary Graph RAG from Microsoft, an advanced retrieval-augmented generation system that enhances AI responses by providing relevant context. GraphRAG: The Most Incredible RAG Strategy Revealed
📌 In this video, you will learn:
What is RAG (Retrieval-Augmented Generation)?
Differences between Basic RAG and Graph RAG
How to implement Graph RAG in your application
Step-by-step guide on setting up Graph RAG
Advantages of using Graph RAG over traditional methods
🔍 Key Features:
Entity Extraction
Hierarchy Extraction
Graph Embedding
Community Summarization
Topic Detection
🔧 Setup Steps:
Install the Graph RAG package
Configure API keys and settings
Initialize your project
Upload and process data
Run queries to extract high-quality answers
🔗 Useful Links:
Graph RAG Documentation
GitHub Repository
Subscribe for More AI Content
🔗 Useful Links:
Patreon: / mervinpraison
Ko-fi: ko-fi.com/mervinpraison
Discord: / discord
Twitter / X : / mervinpraison
Sponsor a Video or Do a Demo of Your Product: mer.vin/contact/
GPU for 50% of it's cost: bit.ly/mervin-praison Coupon: MervinPraison (50% Discount)
Code: mer.vin/2024/07/graphrag-code/
📅 Timestamps:
0:00 Introduction to Graph RAG
1:00 Basics of RAG
1:58 Understanding Graph RAG
3:00 Setting Up Graph RAG
5:01 Integrating Graph RAG with Your Application
7:30 Running Queries and Extracting Data
9:00 Global vs. Local Search
10:27 Conclusion and Next Steps

Пікірлер: 82
@henkhbit5748
@henkhbit5748 20 күн бұрын
Great video👍 just saw today about graphrag. You're one of the first covering this. Looking forward for the next video. Graph visualization would be nice 2. Thanks.
@adapt_it
@adapt_it 21 күн бұрын
This content is really amazing! Thank you!
@oussamaoucouc6134
@oussamaoucouc6134 21 күн бұрын
You are the man , thanks again for your videos, we apreciate that
@ShishirKumar07
@ShishirKumar07 20 күн бұрын
This is great video! Thank you Mervin.
@HassanAllaham
@HassanAllaham 20 күн бұрын
This is a powerful video on a powerful tech ... waiting to see what you will do with it ...thanks for the good content 🌹🌹🌹
@agentDueDiligence
@agentDueDiligence 21 күн бұрын
Thank you Mervin!
@MrBiscuit696
@MrBiscuit696 20 күн бұрын
Great video! Gonna try this now
@shawnkratos1347
@shawnkratos1347 20 күн бұрын
Waiting on ur next video. Please cover setting this up with ollama and openwebui
@kylelau1329
@kylelau1329 17 күн бұрын
I can't make it work in this stage
@dhanasekar2113
@dhanasekar2113 19 күн бұрын
Wonderful work..
@HerroEverynyan
@HerroEverynyan 21 күн бұрын
Thank you for the introduction so soon after the announcement! I'd be really curious to see how it compares with classic RAG on a large text where we ask for specific data, such as the taxes you'd have to pay on dividends according to the fiscal code.
@yuzual9506
@yuzual9506 20 күн бұрын
thx a lot for your work !
@theindianrover2007
@theindianrover2007 21 күн бұрын
Really like your videos
@dogbreath226
@dogbreath226 18 күн бұрын
Excellent intro. I've been looking forward to seeing what MS did with this research
@MrTommyorgryte
@MrTommyorgryte 19 күн бұрын
Thanks! Great presentation as always! Can you do this using Ollama?
@PriNovaFX
@PriNovaFX 20 күн бұрын
Thank you, Mervin for your video and bringing this into my attention. Amazing to see that you are using Cody. What do you think, could GraphRag bring benefits to code search too?
@Jacobstalin
@Jacobstalin 21 күн бұрын
Amazing content sir. This concept much much needed in current time where native RAG lacks at some point. I just wanted to ask how did you create Graph visualisation at starting? [2:57]
@ysy69
@ysy69 21 күн бұрын
powerful!
@IdPreferNot1
@IdPreferNot1 21 күн бұрын
Knowledge graphs are the future... a definite component to give structure to RAG, reasoning, agentic behavior etc. That why i think LangGraph and LLamaIndex are 2 frameworks to keep up to date with.
@awakenwithoutcoffee
@awakenwithoutcoffee 20 күн бұрын
I agree but how does LangGraph relate to graphRAG?
@KumR
@KumR 20 күн бұрын
Thanks MP. Can you pl extend this to read csv, pdf, docx and add UI using streamlit too?
@brandonvelasquez3530
@brandonvelasquez3530 15 күн бұрын
i believe it can inherently read CSV since that is basically just raw text in a specific format. I am curious about pdf and docx still
@elbosanacHD
@elbosanacHD 21 күн бұрын
Awesome video ! Do you know how does it compare with RAPTOR performance wise ?
@MidSeasonGroup
@MidSeasonGroup 15 күн бұрын
Hi Melvin, how could this be used to optimize responses with the latest best practices and updates about a rust framework like dioxus? Many of these models are outdated and hence present a challenge.
@gauravmodi12
@gauravmodi12 21 күн бұрын
How we can see the knowledge graph on UI on Neo4j?
@106rutvik
@106rutvik 9 күн бұрын
Hi currently we are using Pinecone Vector based DB. Can we shift to using graphrag? How it is different from vector DB? And when should we use it? Or how can we utilizes both vector DB and graph db to make outputs better?
@carlshod9024
@carlshod9024 21 күн бұрын
Hi! Have you try LLamaIndex Graph Rag? What are the main difference between them? Very interesting video bro
@andrewandreas5795
@andrewandreas5795 20 күн бұрын
Does it work with the Claude models?
@figs3284
@figs3284 21 күн бұрын
Are there any ways in which you can use graphrag for coding tasks or code generation, etc? I know that wasn't their main focus with this, but I wonder if it's possible with this system.
20 күн бұрын
thanks
@DEEPANMN
@DEEPANMN 17 күн бұрын
Is it possible to add networkx graph into this instead of LLM generated graph! I have a readymade graph on the private dataset?
@KiwiAndCurry
@KiwiAndCurry 20 күн бұрын
Anyone know the rough token cost for creating the relationships / user query? seems that it would likely be ~5x the cost of setting up a standard RAG.
@studiophantomanimation
@studiophantomanimation 21 күн бұрын
Can it work with Claude 3.5 sonnet?
@ahmedbeji4248
@ahmedbeji4248 20 күн бұрын
thank you, this is actually really exciting but is there a way to use sentence transformer embedders instead of openai or azure ? its better in my experience to use a custom embedding model trained on my data , the whole system is amazing but if its kept general it will still underperform custom systems tailored for the data If we can customise the chunking ( not token based we can actually maybe either have the chunks ready ( usually i do regex ) and use a custom transformer model ( kinda similar how u can do it in Haystack or llamaindex ) this can be really amazing
@awakenwithoutcoffee
@awakenwithoutcoffee 20 күн бұрын
quite amazing isn't it. From the MS presentation it looked promising but the results took 10x more Tokens + 10x longer to generate (70s for 1 answer). How would we tackle this issue, maybe Groq inferencing could reduce the compute time ? Also: can you elaborate more on local vs global search and when to use which ? for the most accurate response maybe we should combine the two into a final answer (?). Exciting indeed, would love to see more benchmarks. 🙏
@positivevibe142
@positivevibe142 21 күн бұрын
Any Local version of this, like private, without API?
@deepanshjha6353
@deepanshjha6353 21 күн бұрын
First Blood 🙌
@svenandreas5947
@svenandreas5947 20 күн бұрын
I wait for the ollama example .... still not sure if i got the definition of community content ..... but awesome video
@ahmadchamseddine6891
@ahmadchamseddine6891 20 күн бұрын
no ollama support
@binaryfaith
@binaryfaith 20 күн бұрын
Can you do this demo with tabular data?
@arunn2413
@arunn2413 20 күн бұрын
What are the use cases for the text genration and embedding models? Embedding model: Indexing Text Generation:gpt-4o Summarization I think text generation is also used here for indexing, does that not involve much cost than naive RAG?
@user-zv8hn5qe9y
@user-zv8hn5qe9y 19 күн бұрын
I just want to know the graphrag will extract the ner and relationship,but the original content will embed to the graphrag?hope some can reply me ❤❤
@106rutvik
@106rutvik 9 күн бұрын
also can you tell for what exact purpose GPT was used here? and how many tokens were you charged for?
@sharankumar31
@sharankumar31 19 күн бұрын
Hi bro kindly could you make a video on, how can i integrate this GraphRAG on phidata, crewai etc... it would be worth it...
@ThomasConover
@ThomasConover 15 күн бұрын
5:47 Can I use this with Claude api?
@lucface
@lucface 21 күн бұрын
How does it fair with CrewAI?
@theindianrover2007
@theindianrover2007 21 күн бұрын
@rockypunk91
@rockypunk91 7 күн бұрын
If you index different documents at different point of time. We end up with multiple artifacts in the output folder. How should one do a search over all outputs. Like a production level application
@leosong-lq4dl
@leosong-lq4dl 3 күн бұрын
merge script
@jacobriedel5326
@jacobriedel5326 21 күн бұрын
Does anyone know a great open source library for a chatbot that is comparable to production chatbots. A lot of enterprise level chatbots are totally lacking in the Gen AI / LLM capabilities but it would be create if developers like us could enhance a base chatbot with our own RAG techniques like GraphRAG
@dinoscheidt
@dinoscheidt 21 күн бұрын
Uhm… a chat window is simply a text field and text above it. That is so simple to do with a few lines of html that this would be a very small open source project 😅
@anandakrishnankb9172
@anandakrishnankb9172 15 күн бұрын
How can we see the graph?
@dolife8048
@dolife8048 20 күн бұрын
How can this be used practically inside of obsidian, where many people already have a huge database on their own fields of interest? Can you create a tutorial how to implement this in obsidian?
@evertonlimaaleixo1084
@evertonlimaaleixo1084 20 күн бұрын
Congrats! How much cost this process of graph generation using gpt-4o? As I understood, for each chunk you make one request to extract the relation, all right?
@1509skate
@1509skate 19 күн бұрын
I just spent 38$ on a 300 page document with GPT-4o....... Wasnt even a relevant document, just a first test 😥
@1509skate
@1509skate 19 күн бұрын
Just did a single Prompt against this, costet another 2.38$
@evertonlimaaleixo1084
@evertonlimaaleixo1084 19 күн бұрын
@@1509skate omg!
@artur50
@artur50 21 күн бұрын
Can it be local?
@loicbaconnier9150
@loicbaconnier9150 20 күн бұрын
all links reference missing 😊
@shray5801
@shray5801 20 күн бұрын
The question here is , would this not end up in having an issue with context length?
@unclecode
@unclecode 21 күн бұрын
Great content! Thanks. Knowledge Graphs are superior to flat RAG systems, enabling complex queries that explore relationships between entities. They allow for more challenging questions that require connecting information, like analyzing Scrooge's actions in context. Knowledge Graphs provide structured relationships, not just text chunks, leading to more insightful answers. This approach is effective for Q&A assistants, as users seek more than just facts. Combining Knowledge Graphs with vector data is ideal. To present the real difference, instead of asking a factual question like "Who is Scrooge?", please try "what part of the story shows Scrooge doing wrong?" This requires an argument and connections between facts. Or ask, "Who is Scrooge and what is the most important thing we understand from his reaction in the story?" Such questions need to retrieve and connect information and facts.
@agentred8732
@agentred8732 20 күн бұрын
Your comment is as valuable as this very valuable video. A big thank you to you and to Mervin for providing such great insights into RAG and GraphRAG!
@artur50
@artur50 18 күн бұрын
anyone checked Ollama?
@d4rkg
@d4rkg 20 күн бұрын
Nice video, but next time try to give a more popular source for retrieving the info, the poor gpt might probably not have any clue about such an unknown book as the one you used...
@iham1313
@iham1313 20 күн бұрын
most common text form is pdf. not txt, not markdown. so how does it deal with REAL documents?
@ULTR4_DEV
@ULTR4_DEV 15 күн бұрын
Pdf is not a textformat
@MuhammadZubair-n7d
@MuhammadZubair-n7d 16 күн бұрын
Difference between local and global search is not evident through the example. I think it's assumed that the person watching the video already knows it very well.
@alew3tube
@alew3tube 21 күн бұрын
anybody got ollama running with graphrag?
@alew3tube
@alew3tube 20 күн бұрын
Ollama still doesn't support OpenAI API embeddings format, but the LLM part worked. Might need some patching to use 100% local.
@xmagcx1
@xmagcx1 21 күн бұрын
github?
@dfwblah
@dfwblah 21 күн бұрын
Unclear that the results are any better based on what you showed.
@micbab-vg2mu
@micbab-vg2mu 20 күн бұрын
Interesting - current RAGs are not good enough for me - maybe this method will be more accurate.
@john_blues
@john_blues 19 күн бұрын
Please when you do these , evaluate the response for correctness. That fact that it gives 'something' is not nearly sufficient.
@lesptitsoiseaux
@lesptitsoiseaux 20 күн бұрын
I came for the 3d graph I left empty handed.
@armikatollo4449
@armikatollo4449 14 күн бұрын
respect bro good content. thanks
GraphRAG Advanced: Avoid Overspending with These Tips
12:41
Mervin Praison
Рет қаралды 6 М.
Graph RAG: Improving RAG with Knowledge Graphs
15:58
Prompt Engineering
Рет қаралды 35 М.
ОСКАР vs БАДАБУМЧИК БОЙ!  УВЕЗЛИ на СКОРОЙ!
13:45
Бадабумчик
Рет қаралды 6 МЛН
Cat Corn?! 🙀 #cat #cute #catlover
00:54
Stocat
Рет қаралды 16 МЛН
Русалка
01:00
История одного вокалиста
Рет қаралды 7 МЛН
GraphRAG: LLM-Derived Knowledge Graphs for RAG
15:40
Alex Chao
Рет қаралды 95 М.
Why Agent Frameworks Will Fail (and what to use instead)
19:21
Dave Ebbelaar
Рет қаралды 25 М.
Fixing RAG with GraphRAG
15:04
Vivek Haldar
Рет қаралды 6 М.
The moment we stopped understanding AI [AlexNet]
17:38
Welch Labs
Рет қаралды 748 М.
Microsoft GraphRAG Alternative and 10x Cheaper?
11:05
Mervin Praison
Рет қаралды 1,9 М.
I wish every AI Engineer could watch this.
33:49
1littlecoder
Рет қаралды 71 М.
Claude 3.5 Deep Dive: This new AI destroys GPT
36:28
AI Search
Рет қаралды 531 М.
Generative AI in a Nutshell - how to survive and thrive in the age of AI
17:57
CAA Conversion kit at ZAHAL 🎯
0:14
Zahal Youtube
Рет қаралды 34 МЛН
Жду в тг: @kedrovaalyona
0:59
Кедрова Алёна
Рет қаралды 2 МЛН
МУЖЧИНА И ТОПОР
0:22
В ТРЕНДЕ
Рет қаралды 8 МЛН