Using Vector Databases for Multimodal Embeddings and Search - Zain Hasan - NDC London 2024

  Рет қаралды 1,636

NDC Conferences

NDC Conferences

Ай бұрын

This talk was recorded at NDC London in London, England. #ndclondon #ndcconferences #developer #softwaredeveloper
Attend the next NDC conference near you:
ndcconferences.com
ndclondon.com/
Subscribe to our KZbin channel and learn every day:
/ ‪@NDC‬
Follow our Social Media!
/ ndcconferences
/ ndc_conferences
/ ndc_conferences
#machinelearning #database #bigdata
Many real-world problems are inherently multimodal, from the communicative modalities humans use such as spoken language and gestures to the force, proprioception, and visual sensors ubiquitous in robotics. In order for machine learning models to address these problems and interact more naturally and wholistically with the world around them and ultimately be more general and powerful reasoning engines we need them to understand data across all of its corresponding image, video, text, audio, and tactile representations.
In this talk, Zain Hasan will discuss how we can use open-source multimodal models (such as github.com/facebookresearch/I..., that can see, hear, read, and feel data(!), to perform cross-modal search(searching audio with images, videos with text etc.) at the billion-object scale with the help of open source vector databases. I will also demonstrate, with live code demos and large-scale datasets, how being able to perform this cross-modal retrieval in real-time can help users add natural search interfaces to their apps. This talk will revolve around how we scaled the usage of multimodal embedding models in production and how you can add cross-modal search into your apps.

Пікірлер: 1
@s.m.mustafaakailvi2915
@s.m.mustafaakailvi2915 Ай бұрын
This is it. This is the future and I've been searching & experimenting for MONTHS and this is literally the FIRST instance I have found of this type of implementation of Multi-Modality!
The Future of Cookies - Anders Abel - NDC London 2024
43:52
NDC Conferences
Рет қаралды 1,9 М.
Common mistakes in EF Core - Jernej Kavka - NDC London 2024
1:05:04
NDC Conferences
Рет қаралды 5 М.
DELETE TOXICITY = 5 LEGENDARY STARR DROPS!
02:20
Brawl Stars
Рет қаралды 16 МЛН
Sprinting with More and More Money
00:29
MrBeast
Рет қаралды 175 МЛН
$10,000 Every Day You Survive In The Wilderness
26:44
MrBeast
Рет қаралды 132 МЛН
Super gymnastics 😍🫣
00:15
Lexa_Merin
Рет қаралды 89 МЛН
TDD Revisited - Ian Cooper - NDC Porto 2023
1:13:26
NDC Conferences
Рет қаралды 12 М.
How to build Multimodal Retrieval-Augmented Generation (RAG) with Gemini
34:22
Google for Developers
Рет қаралды 30 М.
An Introduction to Residuality Theory - Barry O'Reilly - NDC London 2024
54:15
RAG, semantic search, embedding, vector... Find out what the terms used with Generative AI mean!
29:04
What Is an AI Anyway? | Mustafa Suleyman | TED
22:02
TED
Рет қаралды 1,1 МЛН
It’s time to rebuild DevOps. - Paul Stack - NDC London 2024
1:07:04
NDC Conferences
Рет қаралды 3,7 М.
Урна с айфонами!
0:30
По ту сторону Гугла
Рет қаралды 6 МЛН
Непробиваемый телевизор 🤯
0:23
FATA MORGANA
Рет қаралды 399 М.
Main filter..
0:15
CikoYt
Рет қаралды 4,2 МЛН
МОЩНЕЕ ТВОЕГО ПК - iPad Pro M4 (feat. Brickspacer)
28:01
ЗЕ МАККЕРС
Рет қаралды 73 М.