Real time RAG App using Llama 3.2 and Open Source Stack on CPU

[@AbhijeetSingh-ku4bz]

This is great bro. I have been trying to build this for over 2 months and just could progress. This is awesome

[@AIAnytime]

Glad to hear that...

[@pedrointeraminense4890]

I create the Embbedings, but it generates an error in the "chat with document”, when I ask the question it generates this error: "An error occurred while processing your request: [WinError 10061]". Can anyone help?

[@avinashnair5064]

how can we add convesational memeory buffer i need to have context in my chat who can we do that?

[@ritikkumar30]

I have same problem of storing context for each session

[@areefa6268]

Hey such a great tutorial. This project is a go to for handson RAG. Thanks. Can you please make a video for hosting these streamlit projects also running llm through ollama. Curious fto know this how you host the llm behind and the proj.

[@educationdelightenglish3819]

Boss you are a GENIUS! thanks buddy !

[@AIAnytime]

You're welcome!

[@kareemyoussef2304]

What about bulk processing the pdfs

[@avinashnair5064]

What is i need to retrive the image from the documents not generation just the images from the pdf with context similarity?

[@manikumar-vr3kp]

why did u show its perfomance and accuracy

[@parwindersingh2302]

Brilliant bro..better than the so called experts..end to end flow awesome..can we do it for json messages also instead of pdfs. If yes what would be the changes

[@muhammedaslama9908]

If Qdrant is currently running locally, what steps should we take when deploying the application?

[@AIAnytime]

You can deploy the same qdrant on any VM via docker command or within a container instance services.

[@IsmailIfakir]

is there is a multimodal llm can fine-tuning for sentiment analysis from text, image, video and audio ?

[@MrRobots100]

Can we host this online, to have an API which can react with a client. Can the hugging face 16GB CPU host this with fast interference ? If not, how can I host it on my local device to have an API.

[@maheswarib199]

Can anybody tell how different domain of dataset interoperate ?

[@maheswarib199]

Can use hnsw for vector db and train using different domain dataset agriculture legal health for single qa project

[@RedCloudServices]

but multimodal should mean you can use a Vision LLM to read each PDF page as an image not use traditional vector based RAG - can you make a video using Vision LLM with this PDF?

[@mahomaesdios11]

This is great content! Awesome! Could I ask you to record a video using Open WebUI with ollama for example? I think WebUI is top-notch.

[@AIAnytime]

I already have a lot of videos on that

[@deekshitht786]

you are awesome 😍

[@rahulhalappa3927]

does it process images within pdf ?

[@light_70]

Great Video

[@artur50]

great! might be an option to add an option for 'semantic search'

[@AIAnytime]

Definitely!

[@BetterProgrammer-p5k]

An error occurred while processing your request: [WinError 10061] No connection could be made because the target machine actively refused it can someone help me with the above error

[@sifu1077]

I have the same problem. I think it's firewall related, but I can't figure it out.

[@pedrointeraminense4890]

Is this problem when you get to Chat? Were you able to solve this problem?

[@mohsenghafari7652]

Thanks, dear. Is it support Persian pdfs and language?

[@KINGOFCODES]

Nice....Make End to End Project on TAG....Tabular Augmented Retrieval .....Thanks

[@AIAnytime]

I'll add it to my list.

[@hardiksharma9817]

how to stop hallucinations in chatbot

[@muhammedajmalg6426]

thanks for sharing

[@AIAnytime]

My pleasure

[@stevencheney4159]

Great video - tons of useful information here so thank you! Are you able to create embeddings for document types other than PDFs easily? For example, I have a lot of documentation that is stored with Markdown. I could probably export them to a PDF but I'm curious if I could parse them directly.

[@AIAnytime]

Yes you can!

[@SonGoku-pc7jl]

thanks for all for all for all! sorry for this but, you can make this with mymupd4llm and 3.2 11b with vision please? with next plase!, I all trys conection next with fastapi etc fail :P :(

[@saimanikantak-ti2td]

Could you please share the discord link

[@theindianrover2007]

Awsm

[@SnehaRoy-xf3zv]

❤

[@ROKKor-hs8tg]

I want rag pdf without ollama or key Llama3.2,chfma,faisscpu,oll freeeeeeee

[@rraviteja]

Bro can you please make a video using complete cloud because some people like me don't have good laptop

[@AIAnytime]

Already there. Watch my End to end RAG videos using AWS and Azure in RAG Playlist.

[@mangaanime7727]

Hello Sir, Do you provide one on one courses online?

[@AIAnytime]

No

[@mohamedfouad1309]

whats your discord?