Evaluating LLM-based Applications
Рет қаралды 23,255
Жыл бұрынEvaluating LLM-based applications can feel like more of an art than a science. In this workshop, we'll give a hands-on introduction to evaluating language models. You'll come away with knowledge and tools you can use to evaluate your own applications, and answers to questions like:
- Where do I get evaluation data from, anyway?
- Is it possible to evaluate generative models in an automated way?
- What metrics can I use?
- What's the role of human evaluation?
Talk by: Josh Tobin
Here’s more to explore:
LLM Compact Guide: dbricks.co/43WuQyb Big Book of MLOps: dbricks.co/3r0Pqiz
Connect with us: Website: databricks.com
Twitter: / databricks
LinkedIn: / databricks
Instagram: / databricksinc
Facebook: / databricksinc
@AnandShah-ds 8 ай бұрын
Evaluations aside, I really enjoyed the presentation. I was hooked. Great story-telling skills Josh. Thanks for sharing your experience. We count on volunteers like you to spread knowledge.
@vaishnavipatil3319 Жыл бұрын
Thank you for clearing this concepts. Would like to see more videos from you on evaluation frameworks, methods.
@ndamulelosbg8887 5 ай бұрын
This is an exellent coverage of the challenging task of llm evaluatuon
@asfandiyar5829 11 ай бұрын
Just what I was after. Thanks
@PJ-hi1gz Ай бұрын
Great talk, thanks for sharing
@ndamulelosbg8887 5 ай бұрын
"Your opininon on LLMs does not matter" - I found this to be a great quote
@bharath_v 8 ай бұрын
Good One!
@manishsharma2211 11 ай бұрын
Good work
@SpartanPanda 10 ай бұрын
Great storyline
@threevia.travel 6 ай бұрын
Very generic, expected something more tangible! Sounds common sense which might work or might not work
Databricks
Рет қаралды 2,8 М.
Fabiosa Animated
Рет қаралды 10 МЛН
MLOps.community
Рет қаралды 4,6 М.
Databricks
Рет қаралды 32 М.
Brother-live_mob
Рет қаралды 691 М.
Aman Soni Official
Рет қаралды 8 МЛН