LangChain on Microsoft Azure - ChatBot with Azure Web Service & Azure Cognitive Search

[@balh2325]

This was really great, seriously the best tutorial I've seen on Azure integration with LangChain! Just wanted to add some dependencies I needed to integrated on my end as of the date I post this comment that I needed to install on top of the requirements.txt. Some potential additional dependencies people might need to add are: pip install unstructured pip install unstructured[pdf] # if you want to upload PDF files pip install tiktoken pip install azure-search pip install openai pip install azure-search-documents==11.4.0b8 pip install azure-identity Also, if you're building your docker container from an M1 Mac you may need to transpile your container using --platform=linux/amd64, so my command for build looked more like: docker buildx build --platform=linux/amd64 -t . I was running into issues with my app service but after building my docker container like this on my M1 mac it appeared to fix it. Thanks once again for this great tutorial!

[@codingcrashcourses8533]

Thank you. I pinned your comment

[@uhtexercises]

Awesome walkthrough. These cloud service UIs are so convoluted and overwhelming when just getting started. This video really puts together all pieces of the puzzle. Thank you for sharing

[@AliendaroN]

Man this is brilliant. One of the few creators who go beyond Notebooks.

[@Namrata766]

Thanks for uploading this. It is one of the best, simplest and working solutions available online. I created my first AI application after learning from this video. Please keep up the good work. And once again, thanks a ton. 😊

[@codingcrashcourses8533]

Thank you

[@softvision3000]

Thank you for this great tutorial! The most I learned was during fixing all the errors you luckily kept in the video. Please keep it that way, as barely all goes smooth from beginning. Due to the new API version of OpenAI, i faced even more issues, but could finally make it run.

[@codingcrashcourses8533]

The langchain Team currently works on integrating openai 1.0. Will work Soon hopefully

[@crisgath3512]

Always elevating your content level. Thanks!

[@Leonid.Shamis]

Very educational and informative content, thank you very much!

[@syedhaideralizaidi1828]

This is so helpful. Please do more of videos covering azure services with LLM-powered Applications.

[@codingcrashcourses8533]

thanks. Thought of something like tracking changes in a blogstorage and trigger building a new index with azure functions. I am also still experimenting with this, since there are few best practices :)

[@prasenjitgiri919]

this is a magnificent tutorial, ty!

[@paragdave76]

Excellent video, nicely explained. Thank You! Pls share if you have video for leveraging Azure COSMOS DB as a Vector store.

[@shashanksagar4878]

Amazing video, along with the retrieved answer, how do I allow the user to print the relevant document as reference from the blob storage.

[@toanda76]

How to load the PDF files on the blob? If the directory on the blob have multi file types as pdf, txt, csv,... How to load it? thanks.

[@codingcrashcourses8533]

Azure has a very good Python SDK, which allows you to do that easily. If you have different files, you have to use different Loaders. You can use a Factory Pattern to select the correct loader, based on the file ending

[@ArielChatbot]

Do you have an idea how to delete these files? You just have to delete them from the blob, or how do you delete them from the cognitive search index?

[@codingcrashcourses8533]

You could use Azure Functions which are triggered by an Event in your Blob Storage. That function then triggers the indexing logic in ACS.

[@sung3898]

Thank you for the great content. Quick question. Why did you upload your data to Azure blob instead of just loading the txt file using TextLoader?

[@codingcrashcourses8533]

Just to integrate more azure features. If you have an app in production, your data will probably not live in a persons PC:)

[@fealgu100]

Does anyone know if running the docker builds will eat all the computer space? Using docker desktop

[@codingcrashcourses8533]

What you mean? You ask what to do If that happens or you want to know what to do against it?

[@TheVinaysuneja]

Very good video !!

[@prateeklath]

Hi, i need 1 small help, i am able to load container, but what about if i have to load a directory under a container, not entire container.

[@codingcrashcourses8533]

Can you be a little bit more specific, with an example?

[@prateeklath]

@codingcrashcourses8533 yes. I want to load documents from container/myfolder directory for chunking. The example shows only for container. But when i m trying to put slash after container it is showing me error

[@codingcrashcourses8533]

@@prateeklath what error? path not found? Make sure you are accessing the correct path. You can maybe try use the docker exec command to debug this: stackoverflow.com/questions/30172605/how-do-i-get-into-a-docker-containers-shell

[@prateeklath]

@codingcrashcourses8533 yes invalid resource uri. I will be trying azur bobclient service to test. I have to add multiple files from directory under container for chunking

[@prateeklath]

@codingcrashcourses8533 i resolved the problem by passing myfolder/filename in blob name parameter

[@brunomottini88]

Excelente video papa

[@SaddamBinSyed]

You got new subscriber.

[@paulatreides7547]

I tried but I could not get this to run, when attempting to create the index I get the following errors: dimensions is not a known attribute of class and will be ignored azure.core.exceptions.HttpResponseError: (InvalidRequestParameter) The request is invalid. Details: definition : The vector field 'content_vector' must have the property 'dimensions' set. Code: InvalidRequestParameter Message: The request is invalid. Details: definition : The vector field 'content_vector' must have the property 'dimensions' set. Exception Details: (InvalidField) The vector field 'content_vector' must have the property 'dimensions' set. Parameters: definition

[@codingcrashcourses8533]

99% the wrong version of azure-cognitive-search. Which one do you use?

[@paulatreides7547]

Thanks, I changed the version and now it runs but I'm working through another error. I can create the indexes and store the documents. When I try to run the application the streamlit service starts and I can input a question then it crashes. I'm getting the following error: raise Exception(f"Error in search request: {response}") Exception: Error in search request:

[@eriklindquist5025]

What version did you change it to and how?

[@eriklindquist5025]

I have a similar error but it is related to failing to make a connection and I am using azure-search-documents 11.4.0b8 azure.core.exceptions.ServiceRequestError: : Failed to establish a new connection: [Errno 11001] getaddrinfo failed

[@codingcrashcourses8533]

@@eriklindquist5025 for me that looks like an DNS misconfiguration, not something related to the package

[@naraPradeepkumar]

Hi is there any option to download the output file

[@codingcrashcourses8533]

can you say what exact part of the video you relate to and what you want to download? then I may help you :)

[@LURASASA]

Thank you for this excellent video! I followed your instructions and created the vector store in a Search service, pushed the Docker image to a container registry, and created the App service. However, I encountered some issues when I tried to run it. The Log stream showed this error message: “Container appXXX didn’t respond to HTTP pings on port: 80”. I have tried various solutions, such as changing the python-lite versions, adding EXPOSE 80 to Dockerfile, adding WEBSITES_PORT 80 to the app service, and so on, but none of them worked. I also got this error from Azure diagnostics: “The error message indicates that the container is unable to start due to an exec format error…exec /usr/local/bin/streamlit: exec format error”. I am really stuck and frustrated. Could you please give me some advice on how to fix this problem? I would really appreciate your help.

[@codingcrashcourses8533]

Does the App run on 0.0.0.0? Thats is needed for a Container. Otherwise it is only accessible from inside the container. EXPOSE does not have any effect by the way.

[@LURASASA]

The Docker image built on my macOS M1 wasn't compatible with Azure Linux environment. Forced Docker to build the image for AMD64 and it was solved. Hope it helps.

[@HushingDonner]

Nice step by step tutorial. Now, how do I add custom metadata to cognitive search as custom fields and make it part of vector_store.add_documents() method?

[@codingcrashcourses8533]

add_documents takes list of Documents. These contain a metadata field which you can update as you wish. Take a look at it´s implementation, it´s one of the core classes of langchain. [ Document { pageContent: "Hello world", metadata: { id: 2 } }

[@NandaKishoreBellamMuralidhar]

hi, thank you very much for such a beautiful content. does any of the steps mentioned requires payment?

[@codingcrashcourses8533]

The Image registry costs a few bucks, but you can also deploy the app as Code instead of a container

[@mEuclide]

Hi. Thank you for this interesting video. Why don't you use Azure OpenAI?

[@codingcrashcourses8533]

Its currently not available for everybody. I am at least not allowed to create a Ressource.

[@nicolaslee5722]

I'm using azure open ai, would there be Any modification to the files

[@saurabhjain507]

Please make more videos on Azure OpenAI. Thank you for the video

[@codingcrashcourses8533]

I will probably make a full course on that for Udemy with event driven document updates, blobstorage, ACS and more :)

[@saurabhjain507]

I am going to enroll in that course for sure!

[@flashops8062]

Can you give me udemy course name

[@SudaneseDevelopers]

many thanks, could you explain by example how I can create data source, skillset, index and indexer on Azure AI Search :) pllllllllllllllllz 🤗

[@codingcrashcourses8533]

Currently no plans to do that, sorry! I don´t like ACS at all :/

[@IsraelCisnerosMalacara]

That was great! I just got an error on the live app, everytime I search says MissingSchema: Invalid URL on File "/usr/local/lib/python3.11/site-packages/requests/models.py", line 439, in prepare_url raise MissingSchema(

[@codingcrashcourses8533]

Did you enter your own URL? Please check if you made any mistakes. My guess would be that the format is wrong