No video

Augmented Language Models (LLM Bootcamp)

  Рет қаралды 36,298

The Full Stack

The Full Stack

Күн бұрын

New course announcement ✨
We're teaching an in-person LLM bootcamp in the SF Bay Area on November 14, 2023. Come join us if you want to see the most up-to-date materials building LLM-powered products and learn in a hands-on environment.
www.scale.byth...
Hope to see some of you there!
--------------------------------------------------------------------------------------------- In this video, Josh walks through the patterns for augmenting language models with external context: retrieval augmentation, chaining, and tool use.
Download slides from the bootcamp website here: fullstackdeepl...
Intro and outro music made with Riffusion: github.com/rif...
Watch the rest of the LLM Bootcamp videos here: • LLM Bootcamp - Spring ...
0:00:00 Why augmented LMs?
0:06:40 Why retrieval augmentation?
0:08:25 Traditional information retrieval
0:13:05 Embeddings for retrieval
0:22:15 Embedding relevance and indexes
0:28:42 Embedding databases
0:38:50 Beyond naive embeddings
0:41:10 Patterns & case studies
0:46:16 What are chains and why do we need them?
0:52:50 LangChain
0:54:55 Tool use
0:59:17 Plugins
1:02:38 Recommendations for tool use
1:04:07 Recap & conclusions

Пікірлер: 17
@ayanghosh8226
@ayanghosh8226 Жыл бұрын
Love the logical sequence of presenting the complications in advanced LLM applications. One of the best resources on the web, if one wants a solid mental map of how and when to augment LLMs.
@HarendraSingh-xw6hv
@HarendraSingh-xw6hv Жыл бұрын
💯
@loic7572
@loic7572 Жыл бұрын
This is the best bootcamp I've ever watched. I only wish I had known about the KZfaq channel before.
@l501l501l
@l501l501l Жыл бұрын
Second that!
@jeromeeusebius
@jeromeeusebius 10 ай бұрын
Great resource for understanding RAG and the various ways to improve reliability and accuracy of LLM's. Thanks for sharing.
@robertcormia7970
@robertcormia7970 Жыл бұрын
Another fantastic video (webinar) helping to build on foundational knowledge of LLMs. Clear explainations of chains, tools, APIs, and "process". Can't wait to watch the next one (LLMOPs)
@RohanKumar-vx5sb
@RohanKumar-vx5sb Жыл бұрын
u’re the best. this has been the singular most useful and up to date analysis of LLM advancements
@saratbhargavachinni5544
@saratbhargavachinni5544 Жыл бұрын
Great talk! Thanks for sharing
@za_daleko
@za_daleko 10 ай бұрын
Thanx for this knowledge. Greetings from Poland.
Жыл бұрын
Awesome! Thanks Josh for the presentation!
@lukeliem9216
@lukeliem9216 Жыл бұрын
This talk is very informative about building LLM-based apps with proprietary datasets.
@fudanjx
@fudanjx Жыл бұрын
Quick Summary: Introduction: Language models are powerful but lack knowledge of the world. We can augment them by providing relevant context and data. Witnesses: - Retrieval: Searching a corpus and providing relevant documents as context. - Chains: Using one language model to develop context for another. - Tools: Giving models access to APIs and external data. Testimonies: Retrieval: - Simplest way is adding relevant facts to context window. - As corpus scales, treat it as an information retrieval problem. - Embeddings and vector databases can improve retrieval. Chains: - Use one language model to develop context for another. - Can help encode complex reasoning and get around token limits. - Tools like Langchain provide examples of chain patterns. Tools: - Give models access to APIs and external data. - Chains involve manually designing tool use. - Plugins let models decide when to use tools. Key Takeaways: - Start with rules and heuristics to provide context. - As knowledge base scales, think about information retrieval. - Chains can help with complex reasoning and token limits. - Tools give models access to external knowledge. Conclusion: Augmenting language models with relevant context and data can significantly improve their capabilities. There are a variety of techniques to provide that augmentation, each with trade-offs around flexibility, reliability, and complexity.
@user-cq5ue1cj3n
@user-cq5ue1cj3n Жыл бұрын
great. I had to listen at a 0,75 speed, not to miss anything.
@deeplearningpartnership
@deeplearningpartnership Жыл бұрын
Cool
@domlahaix
@domlahaix Жыл бұрын
Crocodile, Ball.... unless you're working for Lacoste 😀
@SavanVyas91
@SavanVyas91 Жыл бұрын
What’s his name where can I find him?
@kennethcarvalho3684
@kennethcarvalho3684 9 ай бұрын
isnt this a search like google
Embeddings: What they are and why they matter
38:38
Simon Willison
Рет қаралды 22 М.
UX for Language User Interfaces (LLM Bootcamp)
50:48
The Full Stack
Рет қаралды 14 М.
Алексей Щербаков разнес ВДВшников
00:47
Smart Sigma Kid #funny #sigma #memes
00:26
CRAZY GREAPA
Рет қаралды 19 МЛН
👨‍🔧📐
00:43
Kan Andrey
Рет қаралды 10 МЛН
Learn to Spell: Prompt Engineering (LLM Bootcamp)
51:32
The Full Stack
Рет қаралды 27 М.
Fine-tune Multi-modal LLaVA Vision and Language Models
51:06
Trelis Research
Рет қаралды 20 М.
LLMOps (LLM Bootcamp)
49:11
The Full Stack
Рет қаралды 89 М.
What's Next? (LLM Bootcamp)
1:00:09
The Full Stack
Рет қаралды 10 М.
Large Language Models in Five Formulas
58:02
Sasha Rush 🤗
Рет қаралды 34 М.
Large Language Models (LLMs) - Everything You NEED To Know
25:20
Matthew Berman
Рет қаралды 77 М.
Reza Shabani - How Replit Trained Their Own LLMs (LLM Bootcamp)
32:15
The Full Stack
Рет қаралды 10 М.
Алексей Щербаков разнес ВДВшников
00:47