Azure OpenAI 101: Powering ChatGPT with your Data - A Deep Dive

[@duanerobinson9013]

Awesome video! Low key, sober, and packed with information.

[@yazardari4237]

Excellent video, exhaustive and comprehensive as always

[@abdulzedan]

Appreciate the kind words, thank you!

[@chandrachoodR]

Really fantastic video on using the Azure openai to create smart apps and services , thanks for

[@maxtriplex7397]

Been waiting for this video! Thanks a lot!

[@abdulzedan]

Glad you found it helpful!

[@FlameOfAnor9]

Thanks Abdul. Great work!

[@abdulzedan]

Thank you! I’m glad you enjoyed it ☺️

[@rmehdi5871]

Great video, Abdul! In you scheme at 8:36, do you know a format of the information exchange between ACS and ChatGPT, namely between 1. User prompt/question and ACS; 2. From ACS to ChatGPT ("augmented prompt"?); and 3. Answer provided from ChatGPT? Are those JSON structures or in a different format? How to find and view those communication exchanges in the system? Thanks!

[@abdulzedan]

Thank you! Not sure I get your question, I would reach out to Azure Support for clarity on this :)

[@parkerrex]

Finally someone I can understand 😂

[@ahmedt3069]

Thank you abdul great work

[@abdulzedan]

Thank you! I am glad you found it useful

[@Shoaibkhan-oj3oe]

is there any way to create an API for this same bot and use it in a custom website?

[@czarahlvic4290]

Hi I just followed your video and experiencing this "The requested information is not found in the retrieved data. Please try another query or topic." kindly help

[@abdulzedan]

This happens when the "retrieval" part of the RAG in Cog Search isn't fully optimized/configured. If you enable semantic search/vector search (now supported with Cognitive Search), this should go away. Sometimes, asking the question in a different way would also alleviate the issue you have!

[@RobertoCarlosSanchez-g7u]

Is there a way to integrate the power of web app like Rest API for my app? 🤔

[@abdulzedan]

That's precisely what we're doing in this demonstration. By deploying into the web app, it is already leveraging the API's behind the scenes :)

[@RobertoCarlosSanchez-g7u]

@@abdulzedan Thanks for responding, what I was referring to is if there is any point where I can make calls from my application for the same chat, receiving responses about my own data including the references

[@CrispinCourtenay]

Curious, could you connect Kafka, Red Panda etc. to Azure Blob and then have ACS in a near real time streaming pipeline?

[@parkerrex]

That’s what I’m Looking for. Any luck ?

[@aliakseitsyuliou5681]

Nice video. But I still have no clue how should we resolve the problem with stateless data? Any tips? Upload the data set to the current session it's not a point at all. Just to play for fun(IMHO).

[@abdulzedan]

Thank you for sharing your thoughts. In the video, this is why we're deploying what we're doing in the playground, to an Azure Web App. This way, it is no longer "stateless" and you can leverage it on an ongoing basis. Hope this helps :)

[@aliakseitsyuliou5681]

@@abdulzedan thank you for the fast response. I'll check this possibility!

[@AshPrasad-fz7mr]

Assuming we feed a csv of last month's sales data, can it answer, 'give me the top sellers?'

[@abdulzedan]

No, the supported formats can be found here: learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data#data-formats-and-file-types

[@andypejman]

Thank you, so in your example, what happens if you ask GPT something that it doesn't have the answer to from your own dataset? Does it try to make something up or does it just tell you it doesn't have the answer? Or is this something you have to prompt it so that it is trained in a certain way?

[@abdulzedan]

Thank you for the comment! If you head to 25:52 in the video, I make a note of the "Limit responses to your data content" option. If this is selected, then the model will tell you it cannot retrieve/have the answer you are looking for. Additionally, in the system message, you can further augment the limit your responses to your data content by adding a system message that states how you would like the model to respond in situations where it doesn't know the answer. Hope this helps :)

[@dannyparkins]

@@abdulzedan I thought there is a "Temperature" setting that kind of determines how "creative" the model is allowed to be.

[@abdulzedan]

This is also true here, in the right of the chat playground, under configuration, you will see the option "parameters". Here you can adjust the temperature value of the model!@@dannyparkins

[@COLD17]

So how about you show how the indexes are created instead of just clicking through the portal of a finished setup?

[@syedbabarali1]

Nice tutorial @Abdul Zedan.. I also did the same thing but I have stuck on a 'Authentication Not Configured' error while trying to run my app on 'Azure App Service' from Chatplayground. Could you please guide me on how to skip or bypass this page

[@abdulzedan]

Thanks Babar! This can be due to invalid/missing permissions. Please visit: learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data#important-considerations and configure the identity provider in the app!

[@syedbabarali1]

@@abdulzedan Thank your problem resolved

[@haodeng9639]

The cost lots of token. I will think twice deploy any openai apps

[@dereksantossidi6850]

Sounds very expensive.

[@simmo2337]

promo sm 👇