pwc azure data engineer interview questions | adf real time interview questions | BIG 4 Companies

[@goluSingh-su1xs]

It's a great video, this question was asked in UST Global interview as well. Thanks for sharing ☺️ Please upload more videos on data engineer interview question and answer.

[@ssunitech6890]

Thanks for your appreciation Sure will be uploading more videos.

[@badashgr8]

how did they ask this question? Like did they provide a sandbox environment and asked to create a pipeline ?

[@ssunitech6890]

They asked what could be your approach if you have this scenario?

[@badashgr8]

@@ssunitech6890 okay thank you, your videos are really helpful, I wanted to try these scenarios but unfortunately I have used up my free credit do you know anyother ways I could get access to a sandbox?

[@badashgr8]

@@ssunitech6890 one more thing, I am unable to understand the role of @item() everywhere, can it be used anywhere inside the current pipeline by using @item().??

[@ShyamuKumar-xi6lb]

Keep uploading more videos, superb video

[@ssunitech6890]

Thank you, I will do

[@Rk-mv8sz]

Your videos are very helpful. Please make more interview questions on azure data engineer. Thank you🙏

[@ssunitech6890]

Sure thanks Please share to others

[@ranjansrivastava9256]

Good Video , Friend one confusion here, are you creating the parameter for the pipeline or GetMetadata2? Could you please elaborate if possible?

[@ssunitech6890]

Thanks, We have to create parameter on dataset level in get meta data activity 2, we are receiving all the files from get meta data activity 1 and passing files one by one into get meta data activity 2 dataset.

[@tejasnandu1]

Thanks for your scenarios, in this scenario can we use filter by lastmodified date in get metadata1 to filter the prior 30 days files. And use for each loop() and delete() activity. Will that work?

[@ssunitech6890]

I think, this should work too. Please try at your end and confirm. Thanks

[@vikrantrathaur_]

"formatDateTime" is not required. UTC Now already returns date in the same date format as a string. My delete activity was not getting triggered as long as i have the formatDateaTime in my expression. After i removed it, it ran fine.

[@ssunitech6890]

Great 👍 Thanks

[@vamsi.reddy1100]

Hai sushil. It was a very nice explanation. I have a small question. How to get the list of file names sorted in the order of their last modified date? Thank you...

[@ssunitech6890]

Thanks for your appreciation We can get it by using get meta data activity + sorting

[@vamsi.reddy1100]

@@ssunitech6890 can you make a video on it...!

[@vamsi.reddy1100]

If possible...!

[@vamsi.reddy1100]

It was an interview question that I faced .

[@ssunitech6890]

Sure will record it soon

[@srinubathina7191]

thank you sir. the way of explanation is very clear

[@ssunitech6890]

Thanks for your appreciation 🤠

[@satishkumar-bo9ue]

in delete activity r u using dataset is azure blob storage here r u using csv delimintor or binary .....y u using binary1

[@ssunitech6890]

Both will work either csv or binary dataset

[@satishkumar-bo9ue]

@@ssunitech6890 ok thank you

[@adityakardile5062]

Can't we use append variable activity to get the name of the fine in for loop rather using another get metadata activity?

[@Sandy-zn7vy]

Hello Sir, I am unable to create Microsoft azure free trial account, even after entering correct card details. I tried doing it with different cards as well. it shows "Check the info you entered. It doesn't match the info for this card." every single time.

[@ssunitech6890]

Are you using credit card or debit card?

[@Sandy-zn7vy]

@@ssunitech6890 debit card

[@VinodKumar-gz8bk]

HI bro Can you make one video of, How to explain project in an interview ?

[@ssunitech6890]

Sure, will upload soon

[@thyagaraj1124]

Very Good Explanation.

[@ssunitech6890]

Thanks 😊

[@thyagaraj1124]

@@ssunitech6890 can you do a video for this ADF requirement: "I will receive the files for each day into Azure blob storage and need to copy them into ADLS. created a folder with files received date and copied them into it. If the pipeline fails during the copying process, Need to copy missed and current the source files' respective date folders on the next schedule.

[@MrTejasreddy]

nice and grate video ....bro...but how did make the 20days date expression...

[@ssunitech6890]

Thanks for your appreciation Where I have used 30, you can use 20 so that will be executing for 20 days.

[@PankajKumar-px2kl]

Keep growing 💗

[@ssunitech6890]

Thanks

[@sivaani37]

i believe we can use just one get metadata, could you please if it will work?

[@kalaivanan.s5042]

Can we take last 30 days file using filter by modification option in get meta data?

[@ssunitech6890]

Directly we cannot do that because it will get modified date of folder, not on file level

[@ramabijigiri6433]

Hai sir In interview are they asking us to solve practically or is it enough to tell orally please reply

[@ssunitech6890]

No need to do practical, only explain the flows. Thanks

[@amritasingh1769]

Nicely explained..

[@ssunitech6890]

Thanks for your appreciation

[@sammail96]

How to retrieve deleted file in azure storage?

[@ericsos101]

Do you provide training and job assistance

[@ssunitech6890]

Yes

[@ericsos101]

@@ssunitech6890 IM INTERESTED

[@SayandipPaul-w9v]

I think you are confused .

[@ssunitech6890]

How?

[@mk-ho9iz]

kaha click kar rahe ho kya bol rahe ho pata hi nahi chal raha hai bro ..sahi se thoda video banao

[@ssunitech6890]

Bro kuchh problem ho gayi recording m is video ki Sorry for inconvenience