Hidden Tags in Microsoft Azure
21:28
Bring Your Own Data Into Azure OpenAI
1:27:37
Azure Resource Mover - Demo (Silent)
16:07
Microsoft Azure - Overview
28:16
2 жыл бұрын
Пікірлер
@ashisharya65
@ashisharya65 Ай бұрын
Great video Luke 👏👏
@lukemurraynz
@lukemurraynz Ай бұрын
It was an honor to have Massimo present to our attendees! Feel free to reach out to me, if there are any other specific Azure related technologies you may want covered.
@iamchinmayapadhi
@iamchinmayapadhi Ай бұрын
Hi Richard , Awesome demo. It helped me a lot in setting up AKS. What is the monthly costs of running the demo setup in azure ?
@lukemurraynz
@lukemurraynz Ай бұрын
Hi, this is a 'it depends'. On the node pool sizes, and your SKU. You can run the AKS Free Tier, which you only pay for resources (ie the underlying VMs), so they will cost while they are running. See: * AKS Pricing tier comparison: azure.microsoft.com/pricing/details/kubernetes-service/?WT.mc_id=AZ-MVP-5004796#pricing * AKS Pricing Calculator: azure.microsoft.com/pricing/calculator/?service=kubernetes-service&WT.mc_id=AZ-MVP-5004796
@PixelRobots
@PixelRobots Ай бұрын
​@@lukemurraynzI would also add that you can stop and start the cluster to save costs too. If you use nodes with support ephemeral disk then you don't even pay for storage. You just pay for load balancer, IP address, and vnet etc whilst the cluster is off.
@HoussemDellai
@HoussemDellai 2 ай бұрын
Thank you Luke for having me :)
@lukemurraynz
@lukemurraynz 2 ай бұрын
Our pleasure!
@JorgeGil-qf6zy
@JorgeGil-qf6zy 4 ай бұрын
Great video Luke, do you know by chance if this type of approach will support uploading hundreds or thousands of pdfs? and can those be uploaded programmatically
@lukemurraynz
@lukemurraynz 3 ай бұрын
Theoretically yes, as the data is just stored in a Storage Account, you could have something like PowerShell, Logic Apps etc have data automatically get added to the Storage Account, then have a schedule for the Indexer to run, every few days etc to keep the index up to date.
@tiagoteixeira2139
@tiagoteixeira2139 5 ай бұрын
Amazing video Luke, all the steps very well explained! You should do one about vector search!
@lukemurraynz
@lukemurraynz 5 ай бұрын
Great suggustion, will see if I can put something together. Thanks for the comment.
@AbhiShek-my5kk
@AbhiShek-my5kk 6 ай бұрын
How to get the openai.api_key ?.Thanks in advance
@lukemurraynz
@lukemurraynz 6 ай бұрын
You can grab the keys from the Azure Open AI resource, in the Azure Portal, under Keys and Endpoints.
@louisamakye8561
@louisamakye8561 6 ай бұрын
great video Luke
@lukemurraynz
@lukemurraynz 6 ай бұрын
Glad you enjoyed it! Alot has changed with AI Studio etc, since this video was released! But the fundementals remain the same. Let me know if theres anything specific you want to learn about!
@JukkaPekkaKeisala
@JukkaPekkaKeisala 8 ай бұрын
Thank you for the walkthrough. What is the running cost per month on the setup you created?
@lukemurraynz
@lukemurraynz 8 ай бұрын
Barely anything in my demo environment, to be honest - mainly due to creating it for the demo and wiping it around, and I have scripts that delete my own resources away each week if I don't need them (luke.geek.nz/azure/Cleanup-your-unwanted-Azure-resources-on-a-schedule/). But in terms of pricing up the solution, it can depend, ie: * Azure AI Search (previously Cognitive Search) - azure.microsoft.com/pricing/details/search/?WT.mc_id=AZ-MVP-5004796 - is priced at storage, the number of indexes and scale units. Standard S1 SKU: $528.45 NZD (mainly due to the storage size) * Azure Storage Account - azure.microsoft.com/pricing/details/storage/blobs/?WT.mc_id=AZ-MVP-5004796#pricing - using Blob Storage (and 6 GB of file size from the markdown files): Premium Storage $2-3 NZD * Azure Open AI - azure.microsoft.com/en-us/pricing/details/cognitive-services/openai-service/?WT.mc_id=AZ-MVP-5004796 This really depends on the number of prompts (1000 tokens) you give it and whether the competition comes back. You can get a general indication by using the OpenA tokenizer: platform.openai.com/tokenizer/. For my demo, it would have been under a few dollars for my test prompts, but the cost would vary on the data and prompts you are delivering. This is a service, that I recommend starting off slow and monitor and build. * Azure App Service - azure.microsoft.com/pricing/details/app-service/windows/?WT.mc_id=AZ-MVP-5004796#pricing Standard S1 tier: $149.964 NZD Total estimate: $681.45 NZD, if I would have run it for an entire month, most of the cost is your AI Search, App Service and Azure Open AI instance (depending on usage).
@lukemurraynz
@lukemurraynz 8 ай бұрын
The NZ North Region Partner Playbook can be downloaded from aka.ms/nzplaybook
@Willisboyz192
@Willisboyz192 9 ай бұрын
Not sure if anyone on here can answer this, but if I wanted to bring multiple data sources in, i.e, azure sql tables and pdf's that are contained in azure blob storage is it possible to have openai use both data sources even though we can have only 1 index being used at at time? Note I want to mention that this data is not relatable, so I can not consolidate an index between them.
@lukemurraynz
@lukemurraynz 8 ай бұрын
Hi, potentially, I would need to look into this - at a guess, you would have to use something like Semantic Kernel to do it, ie Stepwise planner, to do it. learn.microsoft.com/en-us/semantic-kernel/overview/
@lukemurraynz
@lukemurraynz 8 ай бұрын
"Can I search across multiple indexes? No, a query is always scoped to a single index." Reference: learn.microsoft.com/azure/search/search-faq-frequently-asked-questions?WT.mc_id=AZ-MVP-5004796#can-i-search-across-multiple-indexes- You would need to modify the code to search all indexes, then cache it: github.com/Azure-Samples/azure-search-openai-demo/issues/380
@shanthababu
@shanthababu 9 ай бұрын
Excellent Luke. This is really very useful to understand Azure Open AI. Thanks for sharing. Can you please show the code built by the web app, which was constructed from chat playground (Deploy to web App)
@lukemurraynz
@lukemurraynz 8 ай бұрын
Hey! Sorry I only saw the comments, the code for the WebApp is deployed and packaged directly by Azure. You could deploy the WebApp and FTP into the site and grab the datafrom there.