IICS | Start Taskflow for multiple Files using File Listener in Informatica Cloud

[@nishantchavan2980]

Ur contribution is marvellous for ETL community, beginners, intermediates. Please keep contributing. Thanks Roshan.

[@ETLSTATION]

thank you nishant for kind words . keep watching.

[@jagadesh4220]

Super... Awesome...concept

[@ETLSTATION]

thank you jagdesh , keep watching. cheers

[@VPM526]

Thank you, Roshan, for your guidance. I attempted to replicate the steps as advised but encountered an error stating "String index out of range: -1" when executing the task flow. The scenario involves a landing layer (S3) where multiple files reside, which we must transfer to another layer.

[@venkateshmangamolla]

If there are no of files in source will we get all those at time by using file listener..?

[@ETLSTATION]

i doubt it that it will happen , but you can try it and see what happens , i have not tried it because usually for such cases we have filelist option . if i get time i will try and see , meanwhile you also try putting multiple file and see

[@aveshchev]

Do you know a way to move a processed file into a different folder as a part of the same Taskflow?

[@ETLSTATION]

Please give complete requirement , then i can say how it can be done and may be create some video on it if its possible

[@aveshchev]

@@ETLSTATION, it’s exactly the solution that you have recorded with an addition of an extra step of moving the source file to another folder “archived” for example. But it needs to copy that file only. Not all the files in the incoming folder.

[@ETLSTATION]

that is need to see may be file processed can be passed as variable . i have done this in normal scenario where we create file list and load files and then in post processing read list files and move only those files to archive. but using this file listener i need to see if here also list file is possible or not , if file list is there then job becomes very easy to archive

[@informationcounter1983]

I would like to see if 2 files are arriving same time. in your example you feed 2 files but with time gap

[@ETLSTATION]

yes you can try that

[@informationcounter1983]

@@ETLSTATION IICS doesn't support, I guess

[@madeshetl6728]

Can u make a video on Complex mapping in iiics

[@ETLSTATION]

when you say complex , what is complex mapping , because we create many videos like unique and duplicate , excel parser , what exctly is complex as per you , kindly provide details so i can see , explain the scenario you have in mind

[@madeshetl6728]

@@ETLSTATION The interviewer ask mostly the complex mapping which your faced in our project , and why it is complex and explain ?

[@ETLSTATION]

@@madeshetl6728 see complex is vague term , even this video can be complex for someone , where we read different file using file watcher , this itself someone can say my requirement was like i had to use file listener but file names were different and i had never worked on such scenario so i brainstormed and finally found out that i can use wildcard option and then pass the filename usinga assignment task to data task and then it will load pattern file one by one . so when interviewer is asking you such questions its tricky question, they just want to see if you have really worked or done hands on in iics . you can make any video as complex as i explained above . there are other example as well like dynamyic mapping task , you can very well say that i had to load 400 tables along with audit column but client said they dont want 400 jobs , so previously i had worked in iics or powercenter and i had only loaded 10-20 tables in same mapping using pipelines (10,20) but for 400 tables i was struggling , then i found that i can use dynamic mapping task and parameterize all 400 source tables with audit columns and define order as well and it was single job so thats how i resolved and client was happy . so basically you can make ur anything as complex because all new learning are unique , for someone it may be complex for someone it may not , they are only looking for how you frame your answer and confidence in answer . still i will see if i see any such scenario and video if we can make later

[@somilkumar1519]

​@@ETLSTATIONwhat a response this is.....loved it.

[@ajayaj470]

Most of the project discussions They will ask only just assume you are 2-3 years experience candidate if your facing the question Then what would be your explanation that would be helpful for us also Just make a video on it am waiting for that one bro

[@sukhdeosingh182]

If we have to load multiple source file on a multiple target file and target file name should be same as the source files name. Could you please help to get this done? Thanks in advance Sir!

[@ETLSTATION]

i did not understand this , if source and target file names gonna same , how thats a load job , that can be copy job right . if its load job then use currently processed name file property write that value to use as target file name or write that value to one target and rename target file using this name using shell script . watch my video about currentlyprocedded file name what is it and how to load file name

[@ETLSTATION]

IICS | Add Timestamp to Target Files in Informatica Cloud kzbin.info/www/bejne/Z3rKmX-agdypZtk

[@ETLSTATION]

IICS | LOAD Source Filename without PATH Prefix in ORACLE in Informatica Cloud kzbin.info/www/bejne/eWSwm4h8pt11bsk

[@sukhdeosingh182]

​@@ETLSTATIONYes it is like copy, but we are using some transformation to modify the data as per business requirements. As this is not a file list/indirect file job, we have to transfer multiple source files as a multiple target file each time with file name same as source file name. Also, not getting option of 'currently processed file name' in source as this not file list. Please help on this sir!

[@ajayaj470]

Most of the project discussions They will ask only just assume you are 2-3 years experience candidate if your facing the question Then what would be your explanation that would be helpful for us also Just make a video on it am waiting for that one bro

[@ETLSTATION]

just watch all interview questions thats enough for 2-3 year exp person

[@aveshchev]

If you copy two files at the same time though, the FL will not process both of them like that. Only one would be.

[@ETLSTATION]

this question is not clear to me , one by one it will pick right

[@aveshchev]

one by one - yes. Try copying two files simultaneously. Only one will be processed. The solution needs to be more complex than just taking a Name from the FL. @@ETLSTATION

[@ETLSTATION]

i dont any issue if another file gets processed in next run , this is file watcher , its usually work one by one only . if we want all the similar structure files in one shot then we already have filelist option . not sure if i am understanding your requirement