LLMs deployment. Hugging Face Text Generation Inference and alternatives

Speaker: Grzegorz Jurdziński
deepsense.ai helps companies implement AI-powered solutions, with the main focus on AI Guidance and AI Implementation Services.
Our commitment and know-how have been appreciated by global clients including Nielsen, L’Oréal, Intel, Nvidia, United Nations, BNP Paribas, Santander, Hitachi and Brainly.
Wherever you are on your AI journey, we can guide you and help implement projects in Generative AI, Natural Language Processing, Computer Vision, Predictive Analytics, MLOps and Data Engineering. We also deliver training programs to support companies in building AI capabilities in-house.
#llms #largelanguagemodels #artificialintelligence

[@bg-mq5hz]

Nicely explained. Thank you.

[@prashiltumbade9130]

Great overview!!! Another alternative to consider would be Nvidia Triton Inference Server

[@achmedzhanov_nail]

ollama is good alternative

[@mateuszwozny363]

Nice work. I was wondering if Ollama could be another alternative for TGI?

[@DoomsdayDatabase]

Watching after a few months 🥲Hopefully not that different now