Bring Your Own Data Into Azure OpenAI

Join me as we delve into bringing your own data into Azure Open AI; in this video, we will get the Azure Microsoft Learn library into our Azure storage account and use Cognitive Search with Azure Open AI to query against.
Feel free to comment! I am planning on this being the first of many videos!
What do you use Azure Open AI for?
What do you want to see or learn that I could do a video or blog post on?
References
* Bring Your Data to Life with Azure OpenAI - luke.geek.nz/a...
* Azure OpenAI Service models - learn.microsof...
* Quickstart: Chat with Azure OpenAI models using your own data - learn.microsof...
* Tokenizer - platform.opena...
#Azure #openai #AzureOpenAI #cognitivesearch

[@tiagoteixeira2139]

Amazing video Luke, all the steps very well explained! You should do one about vector search!

[@lukemurraynz]

Great suggustion, will see if I can put something together. Thanks for the comment.

[@JorgeGil-qf6zy]

Great video Luke, do you know by chance if this type of approach will support uploading hundreds or thousands of pdfs? and can those be uploaded programmatically

[@lukemurraynz]

Theoretically yes, as the data is just stored in a Storage Account, you could have something like PowerShell, Logic Apps etc have data automatically get added to the Storage Account, then have a schedule for the Indexer to run, every few days etc to keep the index up to date.

[@shanthababu]

Excellent Luke. This is really very useful to understand Azure Open AI. Thanks for sharing. Can you please show the code built by the web app, which was constructed from chat playground (Deploy to web App)

[@lukemurraynz]

Hey! Sorry I only saw the comments, the code for the WebApp is deployed and packaged directly by Azure. You could deploy the WebApp and FTP into the site and grab the datafrom there.

[@louisamakye8561]

great video Luke

[@lukemurraynz]

Glad you enjoyed it! Alot has changed with AI Studio etc, since this video was released! But the fundementals remain the same. Let me know if theres anything specific you want to learn about!

[@JukkaPekkaKeisala]

Thank you for the walkthrough. What is the running cost per month on the setup you created?

[@lukemurraynz]

Barely anything in my demo environment, to be honest - mainly due to creating it for the demo and wiping it around, and I have scripts that delete my own resources away each week if I don't need them (luke.geek.nz/azure/Cleanup-your-unwanted-Azure-resources-on-a-schedule/). But in terms of pricing up the solution, it can depend, ie: * Azure AI Search (previously Cognitive Search) - azure.microsoft.com/pricing/details/search/?WT.mc_id=AZ-MVP-5004796 - is priced at storage, the number of indexes and scale units. Standard S1 SKU: $528.45 NZD (mainly due to the storage size) * Azure Storage Account - azure.microsoft.com/pricing/details/storage/blobs/?WT.mc_id=AZ-MVP-5004796#pricing - using Blob Storage (and 6 GB of file size from the markdown files): Premium Storage $2-3 NZD * Azure Open AI - azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/?WT.mc_id=AZ-MVP-5004796 This really depends on the number of prompts (1000 tokens) you give it and whether the competition comes back. You can get a general indication by using the OpenA tokenizer: platform.openai.com/tokenizer/. For my demo, it would have been under a few dollars for my test prompts, but the cost would vary on the data and prompts you are delivering. This is a service, that I recommend starting off slow and monitor and build. * Azure App Service - azure.microsoft.com/pricing/details/app-service/windows/?WT.mc_id=AZ-MVP-5004796#pricing Standard S1 tier: $149.964 NZD Total estimate: $681.45 NZD, if I would have run it for an entire month, most of the cost is your AI Search, App Service and Azure Open AI instance (depending on usage).

[@Willisboyz192]

Not sure if anyone on here can answer this, but if I wanted to bring multiple data sources in, i.e, azure sql tables and pdf's that are contained in azure blob storage is it possible to have openai use both data sources even though we can have only 1 index being used at at time? Note I want to mention that this data is not relatable, so I can not consolidate an index between them.

[@lukemurraynz]

Hi, potentially, I would need to look into this - at a guess, you would have to use something like Semantic Kernel to do it, ie Stepwise planner, to do it. learn.microsoft.com/en-us/semantic-kernel/overview/

[@lukemurraynz]

"Can I search across multiple indexes? No, a query is always scoped to a single index." Reference: learn.microsoft.com/azure/search/search-faq-frequently-asked-questions?WT.mc_id=AZ-MVP-5004796#can-i-search-across-multiple-indexes- You would need to modify the code to search all indexes, then cache it: github.com/Azure-Samples/azure-search-openai-demo/issues/380

[@AbhiShek-my5kk]

How to get the openai.api_key ?.Thanks in advance

[@lukemurraynz]

You can grab the keys from the Azure Open AI resource, in the Azure Portal, under Keys and Endpoints.