It's a great video, this question was asked in UST Global interview as well. Thanks for sharing ☺️ Please upload more videos on data engineer interview question and answer.
@ssunitech68902 жыл бұрын
Thanks for your appreciation Sure will be uploading more videos.
@badashgr8 Жыл бұрын
how did they ask this question? Like did they provide a sandbox environment and asked to create a pipeline ?
@ssunitech6890 Жыл бұрын
They asked what could be your approach if you have this scenario?
@badashgr8 Жыл бұрын
@@ssunitech6890 okay thank you, your videos are really helpful, I wanted to try these scenarios but unfortunately I have used up my free credit do you know anyother ways I could get access to a sandbox?
@badashgr8 Жыл бұрын
@@ssunitech6890 one more thing, I am unable to understand the role of @item() everywhere, can it be used anywhere inside the current pipeline by using @item().??
@ShyamuKumar-xi6lb Жыл бұрын
Keep uploading more videos, superb video
@ssunitech6890 Жыл бұрын
Thank you, I will do
@Rk-mv8sz Жыл бұрын
Your videos are very helpful. Please make more interview questions on azure data engineer. Thank you🙏
@ssunitech6890 Жыл бұрын
Sure thanks Please share to others
@ranjansrivastava9256 Жыл бұрын
Good Video , Friend one confusion here, are you creating the parameter for the pipeline or GetMetadata2? Could you please elaborate if possible?
@ssunitech6890 Жыл бұрын
Thanks, We have to create parameter on dataset level in get meta data activity 2, we are receiving all the files from get meta data activity 1 and passing files one by one into get meta data activity 2 dataset.
@tejasnandu1 Жыл бұрын
Thanks for your scenarios, in this scenario can we use filter by lastmodified date in get metadata1 to filter the prior 30 days files. And use for each loop() and delete() activity. Will that work?
@ssunitech6890 Жыл бұрын
I think, this should work too. Please try at your end and confirm. Thanks
@vikrantrathaur_Ай бұрын
"formatDateTime" is not required. UTC Now already returns date in the same date format as a string. My delete activity was not getting triggered as long as i have the formatDateaTime in my expression. After i removed it, it ran fine.
@ssunitech6890Ай бұрын
Great 👍 Thanks
@vamsi.reddy1100 Жыл бұрын
Hai sushil. It was a very nice explanation. I have a small question. How to get the list of file names sorted in the order of their last modified date? Thank you...
@ssunitech6890 Жыл бұрын
Thanks for your appreciation We can get it by using get meta data activity + sorting
@vamsi.reddy1100 Жыл бұрын
@@ssunitech6890 can you make a video on it...!
@vamsi.reddy1100 Жыл бұрын
If possible...!
@vamsi.reddy1100 Жыл бұрын
It was an interview question that I faced .
@ssunitech6890 Жыл бұрын
Sure will record it soon
@srinubathina7191 Жыл бұрын
thank you sir. the way of explanation is very clear
@ssunitech6890 Жыл бұрын
Thanks for your appreciation 🤠
@satishkumar-bo9ue Жыл бұрын
in delete activity r u using dataset is azure blob storage here r u using csv delimintor or binary .....y u using binary1
@ssunitech6890 Жыл бұрын
Both will work either csv or binary dataset
@satishkumar-bo9ue Жыл бұрын
@@ssunitech6890 ok thank you
@adityakardile50623 ай бұрын
Can't we use append variable activity to get the name of the fine in for loop rather using another get metadata activity?
@Sandy-zn7vy Жыл бұрын
Hello Sir, I am unable to create Microsoft azure free trial account, even after entering correct card details. I tried doing it with different cards as well. it shows "Check the info you entered. It doesn't match the info for this card." every single time.
@ssunitech6890 Жыл бұрын
Are you using credit card or debit card?
@Sandy-zn7vy Жыл бұрын
@@ssunitech6890 debit card
@VinodKumar-gz8bk Жыл бұрын
HI bro Can you make one video of, How to explain project in an interview ?
@ssunitech6890 Жыл бұрын
Sure, will upload soon
@thyagaraj11244 ай бұрын
Very Good Explanation.
@ssunitech68904 ай бұрын
Thanks 😊
@thyagaraj11244 ай бұрын
@@ssunitech6890 can you do a video for this ADF requirement: "I will receive the files for each day into Azure blob storage and need to copy them into ADLS. created a folder with files received date and copied them into it. If the pipeline fails during the copying process, Need to copy missed and current the source files' respective date folders on the next schedule.
@MrTejasreddy Жыл бұрын
nice and grate video ....bro...but how did make the 20days date expression...
@ssunitech6890 Жыл бұрын
Thanks for your appreciation Where I have used 30, you can use 20 so that will be executing for 20 days.
@PankajKumar-px2kl5 ай бұрын
Keep growing 💗
@ssunitech68905 ай бұрын
Thanks
@sivaani37 Жыл бұрын
i believe we can use just one get metadata, could you please if it will work?
@kalaivanan.s50428 ай бұрын
Can we take last 30 days file using filter by modification option in get meta data?
@ssunitech68908 ай бұрын
Directly we cannot do that because it will get modified date of folder, not on file level
@ramabijigiri64337 ай бұрын
Hai sir In interview are they asking us to solve practically or is it enough to tell orally please reply
@ssunitech68907 ай бұрын
No need to do practical, only explain the flows. Thanks
@amritasingh17692 жыл бұрын
Nicely explained..
@ssunitech68902 жыл бұрын
Thanks for your appreciation
@sammail966 ай бұрын
How to retrieve deleted file in azure storage?
@ericsos1012 жыл бұрын
Do you provide training and job assistance
@ssunitech68902 жыл бұрын
Yes
@ericsos1012 жыл бұрын
@@ssunitech6890 IM INTERESTED
@SayandipPaul-w9v6 ай бұрын
I think you are confused .
@ssunitech68906 ай бұрын
How?
@mk-ho9iz10 ай бұрын
kaha click kar rahe ho kya bol rahe ho pata hi nahi chal raha hai bro ..sahi se thoda video banao
@ssunitech689010 ай бұрын
Bro kuchh problem ho gayi recording m is video ki Sorry for inconvenience