Jason Lopatecki is CEO and Co-Founder of Arize AI.
In this keynote, he outlines a vision for LLM monitoring and observability and covers everything from LLM traces and spans to LLM evals, prompt testing and iteration, RAG search and retrieval, and fine-tuning. He covers the wide array of LLM use cases - like chatbots, structured data extraction, summarization, Q&A assistants, web scraping, code generation, and tagging and labeling - before outlining supported LLM span types. He then previews an exciting launch around LLM evals.
This talk was originally delivered at “From Toy To Production: Building LLM-Powered Systems that Work in the Real World,” an event in New York City dedicated to scaling LLM-powered systems from experimental stages to real-world production environments.
Get updates from Arize on future events: arize.com/comm...
Learn more about LLMOps best practices in our course covering LLM evaluation, guardrails, building your own chatbot, chains and agents, and more: arize.com/blog...