Hybrid Search RAG With Langchain And Pinecone Vector DB

Hybrid search typically refers to a search approach that combines multiple search methodologies or technologies to provide more comprehensive and accurate results. In the context of information retrieval, hybrid search often involves blending traditional keyword-based searching with more advanced techniques such as natural language processing (NLP), semantic search, and machine learning.
Check out my Udemy Courses
For these 4 days please find all my udemy courses in 399rs INR, check it out if you need it.
Complete Machine Learning,NLP Bootcamp MLOPS & Deployment: bit.ly/4fealDs
Complete Generative AI Course With Langchain and Huggingface: bit.ly/3WlxJqZ
Building Gen AI App 12+ Hands-on Projects with Gemini Pro: bit.ly/4f6APGX

[@shyamshanks7621]

Wow! Just when I wanted to implement hybrid search in a RAG at work, you launch this video! 😃😍

[@user-uq9rp2xy1p]

man you are great just great i was in search of this technique and you just gave me something valuable

[@prasannakarthik7721]

Course price -399. Value - Infinity. Thank you for all your teachings Krish! You're amazing!

[@user-yg2qv4kf4r]

A lot of improvement in your teaching. Keep it up.

[@vedkerkar4593]

00:02 Implementing Hybrid Search RAG with Langchain and Pinecone Vector DB 02:17 Converting text to vector and performing vector search 08:11 Hybrid search combines semantic and synthetic techniques 10:45 Documents are converted into sparse and dense vectors for storage in Vector DB. 15:19 Reciprocal rank Fusion in hybrid search 17:37 Calculating final score based on semantic search and keyword search. 22:02 Understanding the concept of hybrid search 24:06 Hybrid search supports keyword, semantic, and graph knowledge search 27:59 Initializing and creating Pinecone hybrid search retriever 30:06 Creating an index with Langchain and Pinecone Vector DB 34:06 Setting up hybrid search with Langchain and Pinecone Vector DB 36:06 Introduction to using HF token and Pinecone vector DB 40:24 Demo of adding text to Index and retrieving results 42:24 Hybrid search with Langchain and Pinecone Vector DB

[@ahmadwaheed8003]

Krish please add some data visualization related stuff in the ml dl NLP course.

[@mrinalsacademy1157]

Why

[@shivamthaman7081]

Yes please

[@vinaykumarreddy-w1b]

Hi Krish, the content that you provide us is amazing and helpful for many who wanted to step into data science I have a request for you to make a video on LLM based structured data analysis Q&A application

[@AjayVerma-xi2us]

Wow I watch all videos and learn a lot

[@muhammadadilnaeem]

Hell of Tutorial about Hybrid Search and Pinecone Vector Database

[@harshgarg5893]

Hi Krish, >> You are awesome! I’m a Salesforce developer and didn’t know much about data science. I’ve unintentionally watched all your videos since KZbin kept recommending them. I’ve learned a lot from you, both technically and in terms of your thought process. >> Inspired by your content and research papers, I’ve started building a RAG multi-agent system from LangGraph for support systems (Salesforce, Google, etc.). Can you guide me on fine-tuning data? Your videos on fine-tuning were helpful but not advanced enough for production-level design. Small request: Could you start a channel for engineers to build production-level RAG systems and pipelines? Cheers, Hrsh

[@avinashsoftwaresolutions3637]

hello krish sir i want to know what all courses should i take to job ready skills in industry from your udemy courses

[@kaustuvchakraborty7372]

I am a big fan of you... watch all most of all videos here and also doing two courses from udemy...I have two specific requests 1. Could you please share the name of the software that you use for screen writing during the theory explanation 2. Could you please highlight how this hybrid search helps in a enterprise set up

[@frag_it]

I am loving these tutorials I would like to see you do in depth on using vllm as an api point for serving llm using azure kubernates cluster it would be soo useful to the community as we can then use quantized models of llama3 70b with very cheap gpu to help serve applications. I would be just amazing for the community then you can use that to help make agents with lang graph tutorials bro I would love it

[@krishnachaitanya4517]

Thanks for the fantastic LLM projects...

[@ArnavModanwal-x9c]

Your videos are the best!

[@shotbotop3790]

Hi sir , great video and does give you a fundamental idea of hybrid search and PineconeDB . can you please provide the code or link to the colab notebook to have a practical run through . Thanks.

[@satvicgupta9338]

can you please make a video on modular rag and please make some industry grade projects related to gen ai , thank you so much sir for your wonderful contribution !!

[@KumR]

Welcome back to YT.. Can you please do some detailed sessions on Graph RAG ? Also for PineCone better to create index using code.

[@yashrajmotwani118]

Amazing tutorials

[@ravijlade4851]

why is it simply listing the sentences provided and not returning say Paris when asked which city was recently visited?

[@VijayKumar-nz6ij]

Hlo sir Could you share text summarisation with N-grams using deep learning back end code 😢

[@avinashsoftwaresolutions3637]

hello krish sir i want to know what all courses should i take to job ready skills in industry from your udemy courses help me with this sir plsssss

[@ayushjhabak2851]

amazing ,would be great if you can create same for pinecone + langchain with javascript !

[@mohamedhussain1113]

It seems all respond are same in last , please do some research and figure out the issue, how to get precise answer

[@awakenwithoutcoffee]

Krish, could you make a video on meta-data creation for filtering ? we could make a meta-data hierarchy of parent grandchildren but Im unsure which models to use.

[@TonyAkalonu001]

Thank you for the good work Krish

[@yashnarvariya4725]

Hello sir,i want to access your tutorial of Air quality index which comes with membership,so if i took the 59/ months membership can I access that course. And what level of Python is necessary for this? Please reply

[@elenaromanova2841]

Thank you for this channel ❤

[@Rits1804-l4r]

sir can you please upload more video on finetuning LLM as mostly this skill is required in many companies , Even if you upload a course on udemy we' ll defiantly buy it as no other youtuber covered this topic nicely the way you are, I have already seen your finetuning playlist , we want more please sir

[@IrtazaAslam-n9p]

Hi Krish, Please start every project with creating the environment it is a huge problem sometimes if there's an error.

[@shnzomar7001]

Can anyone help me, if same technique can be done on recommendation system, and I have large data, how I’m gonna proceed after adding it to retrieval. I mean large data can’t be sentences, where I can add it in retrieval separately…

[@Newsaboutall-z2u]

You provide me full explications how to use Rag I feel proud of continue to learn your courses. I had some issues, can we do a hybrid search using TiDB serverless ??

[@adityapatil377]

Thank you for the amazing video krish. Can you please upload the video related to Neo4j database and graph search

[@vitalikbutarin6580]

Hi krish, I am following your content froom past 3 years but in the udemy courses I felt like the way o simplicity is missing. If possible please try to keep things simple as muh as you can. All your content is very good and relevant to the industry

[@gowrinagh896]

I would strongly request you to cover graph rag, because there's lot of positive buzz and high accuracy on it

[@awakenwithoutcoffee]

too expensive and difficult to implement but maybe the coming months some new tech releases that makes it more usable. Also no implementation with existing AI frameworks.

[@RohithChandra.Kae21b054]

What is the use of doing a syntatic search? Semantic search itself covers everything right?

What is the accuracy and processing speed when comparing to traditional rag architecture wrt hybrid? cause to utilize this hybrid method, we need to use Pinecone which is a paid VectorDB unlike FAISS, ChromaDB. So we have to consider that aspect also whether its worth investing in this new method.

[@aryapulkit8886]

What are the Usecases for hybrid Search Rag ? when to use semantic search and when to switch to hybrid ?

[@divyaraj-rana]

Hi Krish! Excited to dive into this video. You are helping everyone to shift the mindset of developing and getting started with new AI stack! Your content is simply great with a proper crisp (like CRISP-DM in data mining space) explanation and hands-on approach. Also do look out about Weaviate (a new vector DB for building enterprise gen AI applications).

[@krishnaik06]

Sure

[@awakenwithoutcoffee]

I don't think weaviate works on windows ?

[@KomalSaiAnuragPasumarthy]

Krish Sir Do Video about Hierarchical Tree-based Indexing of Multiple Textbook based RAG application

[@neil007sal]

At last when you gave inputs like First, last , Recent.. Output was Same for all 3 inputs. Can you explain on this?

[@rishiraj2548]

Good morning 🙏🏻😎

[@ishaanpanchal1549]

Please make one video using Neo4j or AWS Neptune, converting unstructured data like pdf, etc. to graph and then doing Graph RAG

[@ganeshvenkataramanan3938]

Wonderful, can you please share the sample code that you used here. Thanks

[@priyankapandey707]

sir i m looking time series projects related to supply chain industry , could you pls help me that regarding ??

[@manavgora]

I missed the courses at low price, can you give the discount again?/

[@matt.lehodey]

are you able to do this on Langflow?

[@shivprasadroul5316]

Hi sir, could you please provide any coupon code for the same.....

[@Anas-zw7vq]

THANKS IT WORKS

[@KannetiAdi]

Krish can you please make a video on Raptor(Trie based) index for rag - long context llm's

[@RamaChandran-fc3hp]

Hello sir how are you. I also saw generative ai using hugging face and langchain course on your udemy platform. I think you also created the playlist regarding hugging face and langchain in your KZbin channel. Is there any possibilities that you explain that topic in your KZbin channel.

[@HarshilVagadiya]

sir can we do a similarity search on specific pincone index?

[@vivekneshti]

What text editor software/app did you use this?

[@pavanm361]

Make videos on Microsoft Copilot Studio

[@premmanu6557]

You vids have helped me a lot. I was able to complete a text to SQL project for my team, i had a chance to learn more about prompt engineering. How would you build a solution to analyze LOG files from different applications? Could I use RAG, knowledge graph to create an application that looks at log files and can find the errors. Thank you

[@srivenuguntla3375]

Hello Prem, Can you please share details on how you implemented this TEXT to SQL RAG project?

[@anveek2532]

Sir can I do gen ai course without any basic knowledge of data science.

[@afnankhan1278]

where to find code?

[@gauravfamily2209]

Please explain Agentic RAG Arch.

[@DPSharma-yd5mm]

krish this will be part of your langchain playlist ?? \

[@Jagpal.S]

Hi Krish.. need some urgent help please in an AI Project. I have a big project coming to my company on AI-Native GPU Cloud Platform from an international client whch requires end to end developing a solution on AI-Native GPU Cloud Platform, Testing and deploying in one of the multionational Privatly owned bank. Could you please help me with good connect who has required skill and would be intesterested ?

[@impbitsforsscexams3202]

Hi sir

[@Vir-se2kb]

Hi Kris, you used to post all the new tech trends to get more like & subscriptions. But please explain what/why the library/class you are using. And more importantly why you have written the specific line of code. That will really help. Simply just copy & pasting codes with minimal explanation will not help us. Please work on this review.

[@aravindraamasamy9453]

can you attach the code for this. Thanks for the video

[@mdchandan6441]

Sir ml and GenAi course Hindi ma upload koro

[@MuhammadArif-pc1dc]

Krish please add generative ai course to personal plan on Udemy🙏

[@krishnaik06]

already it is available :)