AZURE FUNCTION ⚡ - Integrate with Azure Queue Storage | Getting Started With ASP.NET Core Series

[@swamysivakumarYalamati]

Thanks

[@RahulNath]

Thank you for the 'Super Thanks' - This is a first time for me getting this 😀 The full Azure series is here bit.ly/azure-series

[@TommiLipponen]

Dear Rahul, your videos are pure gold.

[@RahulNath]

Thank you Finn!

[@dsfgato]

Great content, mate.. pretty good english pronunciation as well. Thanks and congratz!!

[@RahulNath]

Thanks! 😃

[@chaosknight3175]

Learning AF right now, this is the juice. Thank you sir!

[@RahulNath]

Great to hear that Arrak! Also check out how you can use DI in Azure Functions here www.rahulpnath.com/blog/dependency-injection-in-azure-functions/ And you can call me Rahul 🙂

[@chaosknight3175]

@@RahulNath Wow, you save my time brother. Can't thank you enough. You have such a hight quality videos. Keep it up! Bless you.

[@RahulNath]

@@chaosknight3175 Happy to hear that and glad it helped!

[@PraveenKumar-ft2kr]

Thank you brother.. Fully understood :)

[@RahulNath]

Great to hear that Praveen!

Great video. Pace is excellent and major angles are covered.

[@RahulNath]

Glad you liked it Tom!

[@radhikaagrawal5519]

Amazing Content. Keep up the good work😊

[@raj8844]

Highly underated channel... Keep up the good work Rahul

[@RahulNath]

Thank you Rajesh for your kind words! 😀

[@nageshandani]

I can relate your explanation to Scott Hanselman. What a wonderful learning from your channel.

[@RahulNath]

Wow thank you for your kind words Nagesh. Scott's been a huge motivation for me throughout my tech journey!

[@anjanchidige]

outstanding 👍

[@RahulNath]

Thanks again Anjan!

[@DeepakShaw]

Thanks very detailed demo and excellent explanation. Are you planning some demo on Azure Table storage with EF Core?

[@RahulNath]

Thank you and great suggestion! Added to my list.

[@charliechaplin1941]

Great brother.. sharp and precise..

[@RahulNath]

Thank you 🙂

[@serguei5000]

Love your videos! Thank you for the great work sir.

[@RahulNath]

Glad you like them!

[@jruthes]

Thanks Rahul, you are the amazing. Congrats.

[@RahulNath]

Thanks a ton! Here are my popular series twitter.com/rahulpnath/status/1499626419357630466?s=20

[@kumaramber6593]

Very informative...could you please make a series or a single video at least on Azure search services with a demo?

[@RahulNath]

Glad you like it and Thank you Kumar for your suggestion. Will add it to my list.

[@salimansari8438]

Thanks for explaining easier way

[@RahulNath]

Most welcome Salim 😊Checkout the full Azure series here bit.ly/azure-series

[@barwalgayatri4655]

Thanke Rahul.

[@RahulNath]

You're welcome!

[@nilokillian]

mate, your channel is awesome

[@RahulNath]

Thanks mate!

[@ajaysonar662]

as always Great session Rahul, Its helping me a lot. Specially your azure configuration service with feature management. QQ, Do you have any plan to have a kubernetes session in upcoming videos? Would love to hear your thoughts on docker, ACR, services, ingress and overall K8s. More power to you ! 🙌

[@sarathbaiju6040]

Hi rahul, do you know how the request handling pipeline works in azure function? If you know please share some useful doc/video links :)

[@RahulNath]

What specifically are you looking for Alacrity. The DI video walks through a bit more on the flow www.rahulpnath.com/blog/dependency-injection-in-azure-functions/ Not sure if that helps you.

[@sarathbaiju6040]

Hi@@RahulNath , actually i am curious about the working of Azure function. As we know for a .net core application we have a startup.cs file that contains configure method to configure all the Middlewares , but in azure function i didn't find any such methods. So i have desire to know how the Middlewares working in Azure function that's why i asked you.. kzbin.info?app=desktop&list=PLmmYSbUCWJ4x1GO839azG_BBw8rkh-zOj this documentation explaining about Middlewares in Azure function. Thanks 💟

[@TommiLipponen]

Please consider Azure Kubernetes Service tutorial videos too. Like how to architecture ASP NET Core CRUD app with Azure SQL for to be deployed to AKS.

[@RahulNath]

Thank you Finn for your suggestion. I have added it to my list. Not sure when I will get it to it though, most of my current work is around Serverless and haven't used AKS much.

[@madhurisharma601]

Thanks for very informative session. I would request you to make a video on Azure Logic App. It would help me to understand.

[@RahulNath]

Glad you like it and Thank you Madhuri for the suggestion. I have added it my list, but not sure when I will get to it! 😀

[@Noor-Mohammed-S-248]

Please make videos on Azure durable functions

[@RahulNath]

Thank you Noor for the suggestion - It's on my list!

[@manaspal5]

Hi Rahul, your tutorials are very much informative and very easy to understand. I have a requirement that, I don't want to process all queue items concurrently from azure function. Its like I want to process 10 items batch at a time and after completion want to process another 10 items batch. Is it possible to do with azure function or I need to move in Azure Batch service. Please suggest, and if possible please make a video on azure batch service.

[@RahulNath]

Glad you like the content Manas. Have you looked at concurrency settings in Azure Functions? learn.microsoft.com/en-us/azure/azure-functions/functions-concurrency

[@barwalgayatri4655]

Hi Rahul . one doubt i had after looking in ur previous videos was What is diffeernce between Azure ueue storage and Azure Service bus Queue . and if when to use which one coz they both are Queue and sounds similar. Also my next question is In Service bus queue , we can set the Lock and do some setting , so can you give link or make another video specifying how to set this Lock settings ???

[@RahulNath]

Great question - I plan to do a video on Service Bus soon. Meanwhile you can check here if you haven't already docs.microsoft.com/en-us/azure/service-bus-messaging/service-bus-azure-and-service-bus-queues-compared-contrasted?WT.mc_id=AZ-MVP-5003875

[@mdabusaleh358]

Could you please add a series or video on logic app. Your videos are great!!!!

[@RahulNath]

Good suggestion, but not sure how soon. Haven't done much on logic apps yet.!

[@bharatkrishna4396]

Hi Rahul can u pls make a session about .net microservices using azure service bus

[@RahulNath]

I have one on Azure Service Bus - check out the azure playlist bit.ly/azure-series. Does that help you Bharat? Any specific questions you had

[@hector9079]

Muy bueno

[@RahulNath]

Thank you Hector!!

[@AmitArora-e2b]

hi, its a very helpful video but i need to add a Nuget reference into my function. i created Http triggered function through azure portal. how to add this package ?

[@dotnet8925]

Nice video. How to get azure account for practice, they are not giving trial for new account.

[@parvathyr6670]

Can yu pls do a vedio on how to use extensions in azure functions

[@RahulNath]

So using the Configuration in the video did not help to inject it into your function and pass the Options class to your extension? www.rahulpnath.com/blog/dependency-injection-in-azure-functions/#app-settings Can you please send me a sample code on what problem you are trying to solve? Email details in About page

[@x12624]

Very comprehensive solution, Rahul. Thanks, learnt a lot. I have a question, Is it possible to trigger the exception messages in the poison queue again after fixing the code that's causing the exception? Can they be triggered again automatically by sending them to the queue?

[@RahulNath]

Yes you can replay messages from the dead-letter queue to the main queue. Hope you resolved this?

[@swamysivakumarYalamati]

Any full course on Azure deops from you.

[@RahulNath]

Not yet! This the full series bit.ly/azure-devops-series

[@VICKYCHAWLA]

Hi Rahul, ****PLEASE HELP**** Firstly Thank you so much for covering the topic in detail. Also, I wanted to *understand* that which is the best option to use among the BackgroundService and Azure function for my usecase? *USECASE:* *STEP 1:* will send the uploaded CSV file to the message queue by converting it to JSON string. *STEP 2:* Using the appropriate service(as per your recommendation) to retrieve the message. Each message data is responsible to invite the CSV users based on mandatory CSV columns, add each user to a group and patch/update user properties based on additional/optional CSV columns. *STEP 3:* Need to MAIL the uploader the CSV File with the status of the users invitation and properties updates. Currently what I was doing is processing the whole CSV in the HTTP POST method in controller after receiving the uploaded CSV file but with huge no. of users to process the request, it was getting timed-out due to the *230 seconds* limit. :( PLEASE HELP!!

[@RahulNath]

Hey Vicky, Glad you like the videos. Couple of things to consider - How do you want to handle errors? Assuming you have 100 user details coming in the CSV file, what if we a set of records in that fail to process? Do you want to retry this again on it's own? Even though the work is coming in as a CSV file (a batch) do you want to process it as a batch? Depending on this you can split out each record in the CSV file as independent messages and process them individually. Assuming you have to report back to a user on the progress, you will have to do some mapping on which message came from which CSV file. But if you want to process the CSV as batch in itself, you will need to handle exceptions in processing in those records. I would save the CSV file in a blob store and use the link to the in the message rather than serializing the whole CSV to a message. You will need to keep in mind the max size of messages etc, depending on how big this CSV file can get. Hope that gives you some ideas. Let me know if you have additional questions

[@VICKYCHAWLA]

@@RahulNath Bhai Thanks for such descriptive and detail-oriented response. Actually I was thinking the same for passing the complete CSV file but didn't knew that it can be passed via blob store. Could you share some *reference* , if possible on how that can be achieved like passing files to store and reading it in Azure function/BackgroundService via Message queue? 🧑🏾‍💻 Another thing which I wanted to get your suggestion on as I asked above as well which is the best option to use among the *_BackgroundService_* and *_Azure function_* for my usecase especially where MAIL functionality would be involved as stated in *STEP 3* ? ✅ In regards to errors and status actually I am creating a list of model object with the status(valid/invalid) and status details that I will be passing further to the exported file in mail.

[@RahulNath]

@@VICKYCHAWLA I don't have a reference for blob store - but what it would look like is upload the file to blob and send the link/reference to it in the message. or you can use Blob Triggers (learn.microsoft.com/en-us/azure/azure-functions/functions-bindings-storage-blob-trigger?tabs=in-process%2Cextensionv5&pivots=programming-language-csharp&WT.mc_id=AZ-MVP-5003875) I would prefer Azure Function for this over BackgroundService, especially if you want to use Triggers etc. Also you can easily scale up/down the Function if there are more processing required. A lot depends though on your setup, load and frequency of the files. If you are using BackgroundJobs you could still write it to a blob and use almost similar flow.

[@VICKYCHAWLA]

@@RahulNath Bhai Thanks for writing in and sharing your valuable recommendations. I will look at it and proceed accordingly. Thanks so much!! 😊

[@shwetak925]

Nice video. Is there a way to speed up insertion in queue storage..I'm using timer trigger Azure function to store 2lakh test runs from Azure devops organization into Azure storage queue. The function is throwing timeout error and I can see only 32 testruns being stored. so is there a way to speed up insertion of messages in Azure storage queue and also how can we check how many messages are being stored in queue storage as only the first 32 are visible and rest are hidden?

[@RahulNath]

Hey Shweta, What timeout error is it throwing? Did you already come across this in SO stackoverflow.com/questions/22903312/trying-to-batch-addmessage-to-an-azure-queue

[@shwetak925]

@@RahulNath Yes I did. I want the Azure function to finish execution within 10mins ie.to store 2lakh test runs in storage queue.But it is taking an hour to finish execution. Below is my code for storing testRuns in queue: public bool SaveTestRunsToStorageAccount(IEnumerable> testRuns) { Parallel.ForEach(testRuns, testRun => { var testRunStr= JsonCovert.Serialize(testRun); _queueClient.SendMessageAsync(testRunStr}); return true; } Please guide.

[@sunnypatel1045]

Thank you sir! Could you do a video with service bus please.

[@RahulNath]

Good suggestion Sunny. Added to the list. And you can call me Rahul 😀

[@barwalgayatri4655]

How to return million of records from web api .can u make video on it .I told my requirement last time

[@chetan9902]

Returning millions of records is a bad design. You should probably paginate it.

[@barwalgayatri4655]

@@chetan9902 can you give any video link for that. I am truely looking for that solution

[@RahulNath]

Maybe this is a good start - code-maze.com/paging-aspnet-core-webapi/ Google should help you here. Based on the type of the database implementations will change. But the general idea is that you page records. You would definitely not be showing 1 million records in a UI so there is no reason to get that back in API. I will try and cover a video some time later on pagination in this channel. Hope that helps you for now.

[@kainatkhan2459]

Is it possible when azure function trigger on adding message in a queue after receiving message from queue it won't remove from queue util I want?

[@RahulNath]

If you throw an exception, Functions trigger will not mark is as processed. It will reappear in the queue after the default message timeout. Does that help? Between what use case are you trying to address here?

[@cricketfever5345]

Hi, I am working on azure keyvault and want to send notifications on my email when Keyvault secret is about to expire within 3, 7 and 15 days. Plz help me to do this using azure logic app.

[@RahulNath]

I wrote about this a while back here www.rahulpnath.com/blog/expiry-notification-for-azure-key-vault-keys-and-secrets/ You could also look at this learn.microsoft.com/en-us/azure/key-vault/general/event-grid-tutorial?WT.mc_id=AZ-MVP-5003875

[@mdabuzar2130]

Sir, azure with redis cache

[@RahulNath]

Sure will do soon!

[@terigopula]

Rahul your videos are really good but why do you speak like a robot? :P

[@RahulNath]

Haha thank you Swapnil, glad you like the videos. I'm improving on my camera presence, and working on it slowly. My newer videos are less robotic 😝