MLOps Chat: How Should We Test ML Models? with Data Scientist Jeremy Jordan

[@firstpersonviews1996]

Interesting interview, thank you for maintaining such great channel!

[@rajputjay9856]

Thanks for wonderful talk and knowledge chats

[@eleonoracortese6967]

Thank you for your tutorials!

[@dvcorg8370]

Glad you like them!

[@venkateshvenkataramani2386]

Wonderful content! Keep up the good work!

[@dvcorg8370]

Thank you! Will do!

[@rajangupta5432]

Hi elle, from Tester perspective can you make some videos where you can cover what are the steps a tester do when ML developer deploy a model and hand it over to QA for verification. Please

[@nilanshrajput791]

I cannot find the Apple library "Checklist" for testing for NLP models that he mentioned, can anyone provide relevant links for it.

[@dvcorg8370]

Is this what you're looking for? github.com/marcotcr/checklist

[@dvcorg8370]

@@nilanshrajput791 that's kinda funny :)

[@dvcorg8370]

@@nilanshrajput791 that's awesome timing. Keep us posted on how your test suite goes!

[@ndamulelosbg8887]

Interesting insights!

[@mohitsinghpawar5682]

Thanks for this video 🔥 . One question does CML supports flask with rest API .. like can it run APIs too on GitHub actions? Thanks

[@mohitsinghpawar5682]

Either in CML or in DVC

[@dvcorg8370]

@@mohitsinghpawar5682 Hi Mohit, indirectly, yes! So your flask app needs to be hosted on a machine that will be persistently on (if you want to use the API). But your GitHub Actions runner will turn off after the workflow is done. So you could use your GitHub Actions runner to deploy the flask app to another machine (maybe Heroku could help here?)

[@mohitsinghpawar5682]

Thanks a lot 😊 ..Is there any docs or example for such ? Thanks

[@dvcorg8370]

@@mohitsinghpawar5682 We don't have any ourselves, but these docs from other authors look helpful: blog.siliconvalve.com/2019/03/22/use-github-actions-to-deploy-a-python-flask-web-app-to-azure-app-service-on-linux/ medium.com/swlh/get-started-with-ci-cd-using-github-actions-ca32d34b2943 www.clouddev.engineering/how-to-deploy-a-python-api-with-github-actions-cicd/

[@mohitsinghpawar5682]

@@dvcorg8370 thanks a lot❤️

[@patriciarodrigues9132]

Can we have more videos of using CI CD pipelines along with dvc to do a deployment perhaps using something like django

[@dvcorg8370]

Noted, Patricia! Deploying an app that you can interact with is a compelling use case, particularly because it can help you understand the behavior of your deployed model in a way that visuals & tables alone can't.