Hands-on: Spring AI with Ollama and Microsoft Phi-3 🚀 🦙 | Run LLMs locally and connect from Java

[@mudassarh4268]

You are a key contributor in the java space, pls continuing doing awesome work. Requesting you to extend this video with some sample trained data. Data that could be fed to this llm eg we can store in our repository like top destination as per the time of the year / events/ weather etc,

[@TechPrimers]

Thanks for the kind words Mudassarh. Yes sure i will make those soon like i showed in the RAG architecture

[@ramkarlapudi662]

Thank you , I am looking forward to learning more from your channel, much appreciated, keep going, we java lovers are with you :)

[@TechPrimers]

Awesome, thank you!

[@cris_12535]

sir ,We want project like which use iot device and SLM (full stack application using react,spring,mysql)

[@shivprakashy]

Informative as usual, I think python & its framework would be more suitable for AI content at least for quick PoC. Definitely this video will help Java fans😊

[@TechPrimers]

Ya shiv, will do python soon

[@janakiramireddikoki7084]

Thanks for the another great video as usual. Yes if possible please make video on azure openAI which is one of trending AI interface.

[@TechPrimers]

Sure janakiram

[@rajeshbongurala8491]

Gr8 info buddy for beginners. I want to use microsoft azure openai with custom data and rag too. Also need a custom chatbotot (own). Can you help me with desing? How to build my app in python, call 3rd party api, how to use RAG, how to expose API to custom chatbot etc ?

[@rajkumaraddu]

thank you Ajay. you made my day.. one query, is it possible to upload a resume file and get the required details like, name, contact, skills etc..

[@TechPrimers]

I haven’t tried that yet Raj. Will try it out. Thank you

[@rajkumaraddu]

@@TechPrimers thank you so much.. I too trying the same.. Please let us know if you done with it. Thank you

[@manojBadam]

Thanks for the video, few things are unclear from the demo, does the Spring AI talk to your local ollama ? What happens if ollama is not installed or running that model at that point of time ?

[@TechPrimers]

Hi manoj, yes it connects to the local ollama. You will receive connection refused error or 404 error if ollama is down

[@liqwis9598]

Good one , but imagine my backend is supporting a application, and my offline running ai model is as connected to my backend springboot, now how can I train the offline running ai model about the application and create a chat bot which gives response to the request only about the trained data i.e the application

[@TechPrimers]

Great question. Take a look at my video on RAG architecture on how it can solve the dynamic data source updates in the LLM model. I will make a video on that soon with handson

[@liqwis9598]

@@TechPrimers waiting for it and if possible try creating a scenario which I explained

[@prasadpardeshi587]

pls create video using open ai

[@rishiraj2548]

👍👍

[@JaNaMSoNi]

😅

[@TechPrimers]

Lets Go!