Migrating from OpenAI models to Hugging Face models

In this video, we'll be discussing the seamless migration of your applications from OpenAI models to Hugging Face's open-source alternatives. We'll cover the step-by-step process of deploying a Llama3 8B model on a Google Cloud Inference Endpoint and invoking it with the OpenAI client library. Additionally, we'll deploy a Zephyr 7B model on Amazon SageMaker and demonstrate how easily it can be integrated with the OpenAI Messages API. By the end of this video, you'll be equipped with the knowledge to unlock the full potential of open-source models, all without rewriting your existing code!
This video is perfect for data scientists, machine learning engineers, and developers looking to explore the benefits of open-source models and expand their ML engineering toolkit.
#OpenAI #HuggingFace #MLEngineering
⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos. Follow me on Medium at / julsimon or Substack at julsimon.substack.com. ⭐️⭐️⭐️
Notebooks
* gitlab.com/juliensimon/huggin...
* gitlab.com/juliensimon/huggin...
Blog: huggingface.co/blog/tgi-messa...

[@satsanthony4452]

Thanks Julien for the two demos. Good options for developers.

[@juliensimonfr]

Agreed :)

[@yacinezahidi7206]

Thank you Julien ! Do this work with Vision Language Models as well ?

[@juliensimonfr]

Never tried it, sorry. Ask at discuss.huggingface.co :)