LLM Evaluation With MLFLOW And Dagshub For Generative AI Application

[@krishnaik06]

Subscribe if you want to become a Data Scientist :)

[@jaisingh1292]

Hi Krish can you please take a look at dvc and mlflow and can they be combined and used for gen ai , the demand for LLMops is increasing. For cloud its fine but industries want on prem solution as well it would be great if you can make any video on the same

[@DarkShadow-bq5yb]

can you create video for Data engineering using LLMs

[@HimanshuGupta-ps3ib]

Great video Krish! Watching your content from USA.

[@YorkYongYeo]

thanks for sharing this! just what i needed for reference. Liked and looking forward to the one for RAG evaluation

[@surbhirohilla5139]

You deserve more appreciation for this

[@2dapoint424]

Krish, @10:15 in VS code what is that cat like icon on top right next to the run button?

[@adityarajshukla9422]

copilot

[@pratiksitapara8962]

Great video on Evals! Thanks! But It would be great to see or if you could make a video on Evaluating RAG on Traditional metrics? What insights we can get by using traditional evals or automatic evals? What is the current SOTA methods for RAG Evals!?

[@prayagbrahmbhatt6375]

Need a video explanation on promptfoo, an opensource LLM evaluation library.

[@shriharinair1999]

can you from now on focus more on non paid apis?

[@rickyS-D76]

Is it possible to do RAG evaluation with Mlflow? Can you please make a video on RAGAS or any other good RAG evaluation tool... thanks

[@harikrishnank913]

Could you share open source evaluation strategies without relying upon openai

[@arpitqw1]

what is the use of daghub ?, same once can see in local tracking server.

[@adityamaurya9521]

Can we do this with Mistral API keys ?

[@anubhavsarkar5745]

Very Helpful Video Krish. Can you please show us the same LLM Model Evaluation using MLFlow, but using HuggingFace LLMs instead of OpenAI ? I am facing a lot of issues in adding payment method to the OpenAI platform.

[@SantoshYadav-f4r4s]

Hi Krish ! This is excellent video, will you be able to make a video on Azure AI Prompt flow, please?

[@pavanpraneeth4659]

Awesome please in future show how to integrate this with aws bedrock please

[@ashishdayal172]

sounds like tensorflow hub

[@sourabhsomdeve1373]

Nice

[@RishiRajxtrim]

Good evening

[@GiovanneAfonso]

Incredible content, thank you +1sub

[@ridj41]

Krish honestly the content has become a bit uninteresting tbh from the past few videos. Would love if you try out some new kind of projects, some advanced ones to use in our resumes using GenAi

[@krishnaik06]

brother this is really important. I usually make all the videos based on the job market :)

[@TheNiyatiSrivastavaChannel]

Is anyone facing error: mlflow.exceptions.MlflowException: API request to endpoint /api/2.0/mlflow/runs/create failed with error code 403 != 200. Response body: '' I have tried everything I knew but this autentication error is not going