Building Multi-Modal Search with Vector Databases

  Рет қаралды 16,237

DeepLearningAI

DeepLearningAI

8 ай бұрын

This workshop is all about leveraging the power of lightning fast vector search implemented using vector databases like Weaviate in conjunction with multimodal embedding models to power at-scale, production ready applications capable of understanding and searching text, images, audio and video data.
What the attendees will take away from the workshop:
How machine learning models can embed multimodal data
How vector databases like Weaviate enable real time semantic search
How vector database can be used to scale the use of these models to billion scale
Code implementations of performing any-to-any modality search (for example audio-to-image or image-to-text searches)
Applications enabled by at scale multimodal search and retrieval
This event is inspired by DeepLearning.AI’s GenAI short courses, created in collaboration with AI companies across the globe. Our courses help you learn new skills, tools, and concepts efficiently within 1 hour.
About Weaviate
Weaviate is an open-source vector database. It allows you to store data objects and vector embeddings from your favorite ML-models, and scale seamlessly into billions of data objects.
Speakers:
Sebastian Witalec, Head of DevRel at Weaviate
/ sebawita
Zain Hasan, Developer Advocate at Weaviate
/ zainhas
Here are the slides covered in the presentation:
docs.google.com/presentation/...

Пікірлер: 11
@glauberss2007
@glauberss2007 7 ай бұрын
Thanks to share it... amazing workshop!!
@BrikeshKumar987
@BrikeshKumar987 8 ай бұрын
@Sebastian, Great presenation. Thank you!! One quick question. I didn't see you making any calls to the OpenAI API giving the question and context obtained from the vector searhc. Does Weaviate API abstract that away and make the call to API for you?
@sebastianwitalec7689
@sebastianwitalec7689 8 ай бұрын
Thank you @BrikeshKumar987. Yes, you are correct. Weaviate calls OpenAI API for you (this is why I added get "X-OpenAI-Api-Key" at the beginning) this happens both when you insert (or modify) data, and when you query. This way you don't think about the code to vectorize your data, as that is all done for you. Please note, you will still be charged by OpenAI for any API calls ;)
@rb8844
@rb8844 8 ай бұрын
A question from @Sebastian and @Zain : Can we use this methodology to perform keywords based classification task? For instance, I want to find whether a paragraph of text contains a keyword or not? Can I implement it at a large scale i.e., to perform same keywords based classification for tens of thousands of records?
@sebastianwitalec7689
@sebastianwitalec7689 7 ай бұрын
Hi @rb8844, yes you can use this methodology to search across text paragraphs. And yes you can use it to search across tens of thousands, or even tens or hundreds of millions of records. Tbh. you shouldn't limit yourself to just a keyword search. With vector search (which utilises ML models) or hybrid search (which uses vector and keyword search), you can achieve even more.
@user-no4ck2kj8f
@user-no4ck2kj8f 7 ай бұрын
can we search images or audio or videos using Weaviate?
@Jirayu.Kaewprateep
@Jirayu.Kaewprateep 8 ай бұрын
🥺💬 Thank you. Vector database and how to build model parameters is interesting as I understand models in a Programming language with data field properties and references are different from the vector database. He examines how the vector database works as an object but can contain multiple object property and that allows to use in various fields. 🥺💬 It can contain subscribed or registered objects. 🥺💬 Ass see there are references ID with different fields property I experience when working with IVR or Database this is not a new thing but this way you explain help a lot about understanding but normal users are not programming of vector database but they retrieved and setattr() as the quesiton about experiences. 👤💬 IVR is Interactive voice response and speech engine. 🥺💬 You can combine of traditional search with vector search that are built in different way for user experience. 🥺💬 It can be subscribed objects then it is always up to date. 🥺💬 Thank you.
@zouhirelmezraoui1336
@zouhirelmezraoui1336 8 ай бұрын
💖👆💖🎓🎓🎓👉👆👈
@nazmussakib19061
@nazmussakib19061 3 ай бұрын
Can we search by multiple modality instance at the same time? Like I have given picture of a white cat. And also I want to say "I want a similar but ginger/orange colored cat". Will it be possible? For simplicity lets assume my rag database actually contains a ginger colored cat instance
@fintech1378
@fintech1378 8 ай бұрын
how bout creating video instead of images? can we do it with a series of images?
@sebastianwitalec7689
@sebastianwitalec7689 7 ай бұрын
Yes, you should be able to retrieve multiple images from the database and send it to a service that could turn them into a video 🤔
HOW DID HE WIN? 😱
00:33
Topper Guild
Рет қаралды 42 МЛН
NERF WAR HEAVY: Drone Battle!
00:30
MacDannyGun
Рет қаралды 56 МЛН
ОСКАР ИСПОРТИЛ ДЖОНИ ЖИЗНЬ 😢 @lenta_com
01:01
How to build Multimodal Retrieval-Augmented Generation (RAG) with Gemini
34:22
Google for Developers
Рет қаралды 40 М.
OpenAI Embeddings and Vector Databases Crash Course
18:41
Adrian Twarog
Рет қаралды 419 М.
Learn How to Build Multimodal Search and RAG
23:15
DeepLearningAI
Рет қаралды 3,5 М.
Vector Search Isn’t Enough | BRKFP301H
44:21
Microsoft Developer
Рет қаралды 23 М.
GraphRAG: Knowledge Graphs for AI Applications with Kirk Marple - 681
46:53
The TWIML AI Podcast with Sam Charrington
Рет қаралды 3,7 М.
Why are vector databases so FAST?
44:59
Underfitted
Рет қаралды 14 М.
Vector Search and Embeddings
34:43
Google Cloud
Рет қаралды 7 М.
RAG But Better: Rerankers with Cohere AI
23:43
James Briggs
Рет қаралды 54 М.
Vector Search: Powering the Next Generation of Applications
38:15
How Many Balloons Does It Take To Fly?
0:18
MrBeast
Рет қаралды 83 МЛН
DESAFIO IMPOSSÍVEL #trending
0:16
O Mundo da Ágata
Рет қаралды 15 МЛН
ЧТО НАМ ПОПАЛОСЬ?😜😜😜
0:12
Chapitosiki
Рет қаралды 1,4 МЛН
ПОХОДУ ОН БУДЕТ СИДЕТЬ ДОМА ДО СТАРОСТИ
0:18
ПОХОДУ ОН БУДЕТ СИДЕТЬ ДОМА ДО СТАРОСТИ
0:18