Groq LLM and Langchain Streaming || Faster LLM RAG Inference

[@buzzlightyear9202]

Great video!! thank you so much!!

[@hiranga]

Great vid - keep up the great work!!💪🏾💪🏾💪🏾💪🏾💪🏾

[@yazanrisheh5127]

why u using mmr and not similarity search?

[@AIwithTarun]

I personally feel it fetched better results, also it's been mentioned in few articles. To be more precise MMR is a method designed to enhance the diversity of retrieved items in response to a query, avoiding redundancy. Rather than focusing solely on retrieving the most relevant items, MMR achieves a balance between relevance and diversity.

[@ASathwik]

does this support larger files like 1000 pages or 2000 pages ?

[@AIwithTarun]

We can use Compression filter for the retrievers and lessen the inference time. Tho, I believe it will take less than 20-25 sec to generate the entire response.