How to Save Web Activity Output to Blob | Create Json file in Storage from Web Activity Rest API

[@Ayreek]

This is the most accurate and to the point info to get the output of a Web into a blob. Found this after 3 days of messing around with this.

[@prakashchinni6126]

I searched for this solution in internet , finally found here . Great explaination :) thanks

[@CloudKnowledgeChannel]

Glad it helped! Thanks

[@manojtati7581]

Thankyou for the detailed steps, it helped alot for me. Appreciate ur effort

[@FarhanSayed-j3z]

Explained the task in an Excellent way! Great work.

[@CloudKnowledgeChannel]

Thanks 👍

[@tanukupratap8469]

@@CloudKnowledgeChannel Thanks for the Clear explanation - i have a question what if my response is in XML format ?

[@circle2098]

good shareing, thank you.

[@CloudKnowledgeChannel]

Thank you 😊

[@maaateee148]

Is it possible to store the output with a dynamic file name in the blob container, e.g. the pipeline runid?

[@roselingowda4756]

Good explanation.... This helped me in my task

[@CloudKnowledgeChannel]

Glad to hear that 👍

[@SonuBhai28023]

Can we dynamically create a file like appending date at the end

[@mitashimalkani8367]

hi, is there any way to do this for saving multiple output files to blob storage? I am using foreach activity to hit multiple Api links and then store data of each web activity to a separate Json file in blob storage

[@madhavrhtdm]

Using web activity to put the file into adls like you have done, is there any file size limitation?

[@mateusz5434]

Thank you, great job!

[@CloudKnowledgeChannel]

Thank you

[@PaulCss-h6b]

Good video however one tiny but crucial part is missing, if you want to save only proper json without web activity metadata you need to fetch only response property in activity.output.

[@ajinkyaadhotre5336]

12:24 hey i didnt get it whats the use of header and why are we specifiying the name as x-ms-blob-type and Value as BlockBlob ? can you please explain

[@CloudKnowledgeChannel]

Refer: learn.microsoft.com/en-us/rest/api/storageservices/put-blob?tabs=azure-ad#request-headers-all-blob-types

[@ajinkyaadhotre5336]

@@CloudKnowledgeChannel hey , i am asking what is the reason we are putting that header

[@CloudKnowledgeChannel]

Read the page for your knowledge

[@ajinkyaadhotre5336]

@@CloudKnowledgeChannel i did read it but didnt find anything useful :( , could you just help me out with it ?

[@V-Barah]

i tried the scenario but in my case the response is binary file(.zip file) while writing the BLOB loc it's getting corrupted. however i check the API using postman/python the response is .zip and data is looks good.

[@CloudKnowledgeChannel]

Please share sample endpoint details to test. If you have already tried, kindly unzip file after loading it to container

[@damn68]

Instead of using share access token, can we use the key access or create a key vault. If I am not here and it expires it will be hard to figure this out

[@ASNPersonal]

same question. Did you get any solution?

[@damn68]

Can you please do one with synapse. I am trying ur prbut I am not getting the same result

[@CloudKnowledgeChannel]

Sure let me try and post a video.

[@damn68]

Share the link please

[@harshitagupta3443]

how to append data in the file in blob when web activity is in for each loop

[@AnkitSingh-sv6ym]

How to set filename like everytime it should create or save a file with different file name😊

[@CloudKnowledgeChannel]

Please explain exact usecase

[@luckyrajgopal]

While saving to json in second web activity, i am getting error as not authorised ,can you help

[@CloudKnowledgeChannel]

Check Adls account container permissions

[@Jorge-H]

Same error could you fix it? I have an authorised error when i debug

[@souranwaris142]

I'm trying to do the same thing but in my case, it's showing an error. I don't know why. I'm using my company synapse account so is it possible this is some kind of firewall error.

[@CloudKnowledgeChannel]

May I know what error you are getting? The step at which error pops up. Make sure you have set up SAS correctly for the storage account and using the correct URL.

[@souranwaris142]

@@CloudKnowledgeChannel I am getting error when I am trying to debug to get data.

[@souranwaris142]

what is SAS correctly for the storage account?

[@CloudKnowledgeChannel]

@@souranwaris142 revisit the video to see what is Sas url and state what Error message you recieve