Evaluating RAG Performance with Vector Databases | BLEU, ROUGE, and RAGAS

[@kokrhuiong3203]

may I get the code for the evaluation using llama index? The github repo you shared looks like it only has the code for using langchain

[@maryamashraf6370]

Hey, thanks for the session, it was so helpful. You mentioned at the end that some of the most useful articles you've learnt from came out just that week. Could you point me in the direction of where you usually learn from? Allot of the time when I'm trying to find learn about RAG more in-depth now, I find a hard time locating papers or articles that are actually useful. Are there any specific journals or rag-pioneering groups you look to for latest developments in the field?

[@KxSystems]

Hi @maryamashraf6370 not a specific journal no. What was helpful for me was signing up to Medium Daily Digest with various relevant tags selected so that I am notified of the latest articles. Also, by following a lot of the leading voices in the space on LinkedIn and KZbin - for example leaders in the LlamaIndex/Langchain space, top AI advocates and voices ( can find these by doing a search on LinkedIn).

[@AhmedM.Hussein]

Is the material avaialble?

[@KxSystems]

github.com/KxSystems/kdbai-samples/blob/main/retrieval_augmented_generation/retrieval_augmented_generation_evaluation.ipynb