It was an honor to have Massimo present to our attendees! Feel free to reach out to me, if there are any other specific Azure related technologies you may want covered.
@iamchinmayapadhiАй бұрын
Hi Richard , Awesome demo. It helped me a lot in setting up AKS. What is the monthly costs of running the demo setup in azure ?
@lukemurraynzАй бұрын
Hi, this is a 'it depends'. On the node pool sizes, and your SKU. You can run the AKS Free Tier, which you only pay for resources (ie the underlying VMs), so they will cost while they are running. See: * AKS Pricing tier comparison: azure.microsoft.com/pricing/details/kubernetes-service/?WT.mc_id=AZ-MVP-5004796#pricing * AKS Pricing Calculator: azure.microsoft.com/pricing/calculator/?service=kubernetes-service&WT.mc_id=AZ-MVP-5004796
@PixelRobotsАй бұрын
@@lukemurraynzI would also add that you can stop and start the cluster to save costs too. If you use nodes with support ephemeral disk then you don't even pay for storage. You just pay for load balancer, IP address, and vnet etc whilst the cluster is off.
@HoussemDellai2 ай бұрын
Thank you Luke for having me :)
@lukemurraynz2 ай бұрын
Our pleasure!
@JorgeGil-qf6zy4 ай бұрын
Great video Luke, do you know by chance if this type of approach will support uploading hundreds or thousands of pdfs? and can those be uploaded programmatically
@lukemurraynz3 ай бұрын
Theoretically yes, as the data is just stored in a Storage Account, you could have something like PowerShell, Logic Apps etc have data automatically get added to the Storage Account, then have a schedule for the Indexer to run, every few days etc to keep the index up to date.
@tiagoteixeira21395 ай бұрын
Amazing video Luke, all the steps very well explained! You should do one about vector search!
@lukemurraynz5 ай бұрын
Great suggustion, will see if I can put something together. Thanks for the comment.
@AbhiShek-my5kk6 ай бұрын
How to get the openai.api_key ?.Thanks in advance
@lukemurraynz6 ай бұрын
You can grab the keys from the Azure Open AI resource, in the Azure Portal, under Keys and Endpoints.
@louisamakye85616 ай бұрын
great video Luke
@lukemurraynz6 ай бұрын
Glad you enjoyed it! Alot has changed with AI Studio etc, since this video was released! But the fundementals remain the same. Let me know if theres anything specific you want to learn about!
@JukkaPekkaKeisala8 ай бұрын
Thank you for the walkthrough. What is the running cost per month on the setup you created?
@lukemurraynz8 ай бұрын
Barely anything in my demo environment, to be honest - mainly due to creating it for the demo and wiping it around, and I have scripts that delete my own resources away each week if I don't need them (luke.geek.nz/azure/Cleanup-your-unwanted-Azure-resources-on-a-schedule/). But in terms of pricing up the solution, it can depend, ie: * Azure AI Search (previously Cognitive Search) - azure.microsoft.com/pricing/details/search/?WT.mc_id=AZ-MVP-5004796 - is priced at storage, the number of indexes and scale units. Standard S1 SKU: $528.45 NZD (mainly due to the storage size) * Azure Storage Account - azure.microsoft.com/pricing/details/storage/blobs/?WT.mc_id=AZ-MVP-5004796#pricing - using Blob Storage (and 6 GB of file size from the markdown files): Premium Storage $2-3 NZD * Azure Open AI - azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/?WT.mc_id=AZ-MVP-5004796 This really depends on the number of prompts (1000 tokens) you give it and whether the competition comes back. You can get a general indication by using the OpenA tokenizer: platform.openai.com/tokenizer/. For my demo, it would have been under a few dollars for my test prompts, but the cost would vary on the data and prompts you are delivering. This is a service, that I recommend starting off slow and monitor and build. * Azure App Service - azure.microsoft.com/pricing/details/app-service/windows/?WT.mc_id=AZ-MVP-5004796#pricing Standard S1 tier: $149.964 NZD Total estimate: $681.45 NZD, if I would have run it for an entire month, most of the cost is your AI Search, App Service and Azure Open AI instance (depending on usage).
@lukemurraynz8 ай бұрын
The NZ North Region Partner Playbook can be downloaded from aka.ms/nzplaybook
@Willisboyz1929 ай бұрын
Not sure if anyone on here can answer this, but if I wanted to bring multiple data sources in, i.e, azure sql tables and pdf's that are contained in azure blob storage is it possible to have openai use both data sources even though we can have only 1 index being used at at time? Note I want to mention that this data is not relatable, so I can not consolidate an index between them.
@lukemurraynz8 ай бұрын
Hi, potentially, I would need to look into this - at a guess, you would have to use something like Semantic Kernel to do it, ie Stepwise planner, to do it. learn.microsoft.com/en-us/semantic-kernel/overview/
@lukemurraynz8 ай бұрын
"Can I search across multiple indexes? No, a query is always scoped to a single index." Reference: learn.microsoft.com/azure/search/search-faq-frequently-asked-questions?WT.mc_id=AZ-MVP-5004796#can-i-search-across-multiple-indexes- You would need to modify the code to search all indexes, then cache it: github.com/Azure-Samples/azure-search-openai-demo/issues/380
@shanthababu9 ай бұрын
Excellent Luke. This is really very useful to understand Azure Open AI. Thanks for sharing. Can you please show the code built by the web app, which was constructed from chat playground (Deploy to web App)
@lukemurraynz8 ай бұрын
Hey! Sorry I only saw the comments, the code for the WebApp is deployed and packaged directly by Azure. You could deploy the WebApp and FTP into the site and grab the datafrom there.