IICS | Incremental data load - simplified version |

[@realrecker]

How to do incremental load with a rest API source having from date and todate as API parameters ?

[@KavyaSri-b6p]

Thank you for this video! Sir I have implemented till what you have explained, my requirement is to update the $$max_hire_date to last run date even though it is not loading any records in to the target table. How can I implement this scenario could you please help.

[@mubinahmad9785]

If the job fails in between loading of data, what would be the variable value, what it was holding before the job run? or what it picked in the current run at the time of failure? Is there a way to override the mapping variable value?

[@karanrajkasat60]

How to parameterized source connection in mapping task?

[@PradeepKanaparthy]

sir, will $$max_hire_date remain for all/any runs without reset to default?

[@pullaiahmaddumala1844]

Dear Sir - I have implemented the same approach but the incremental data ans whole data is extracted and the only new records inserted but the other records error occurred due to constraint. We nedd to pick only the new records. We have LastModifiedDate and Created Date. Kindly help where I did the mistake.

[@dhaswaktheterrificboy1057]

Here source is db if suppose source is flat file then how to do cdc on date column

[@pullaiahmaddumala1844]

Sir still the value we define that one only assigning in fitler. The max variable holding the correct value buy while delta still picking whole records. Pls assist me 🎉

[@RiteshGatpalli]

sir one major question, how you got iics running on a mac. as i saw that secure agent is only supported on windows and linux ?

[@keeplearning9447]

I have responded to your mail are by step instructions. You may follow as explained.

[@rsntechnologies5345]

Static cache vs Dynamic cache in which scenario we can go with Dynamic? .In which scenario you will use Static?

[@keeplearning9447]

Static is same constant during the session won’t change, whereas dynamic during course of session the change data would be considered as similar variable. Hope this clears your doubt

[@srikanthdanda4031]

Hi, Do we really need to use filter transformation and filter after expression. Using set max variable we are assigning max of value to the mapping variable and the value is going to be applied in source qualifier to pull only incremental data sets correct?

[@keeplearning9447]

You are right, every subsequent run will ensure latest been referred based on mapping variable assigned from earlier used to filter it

[@slyroy7562]

What if we don't define default value for mapping variable. Which value it will pick if we don't define the value

[@keeplearning9447]

It’s good practice to define initial value. Otherwise, it’s consider default vale from integration service as configured…

[@vijayalakshmikg6590]

Hello Sir am trying to $lastrundate system variable in IICS for my incremental . How do I query $lastrundate - 1 ? Appreciate your response ..

[@keeplearning9447]

You can use mapping variable defined with Max agg selected then the next thing filter source side using that variable $$lastrun and under expression transformation ensure setmaxvariablen used to set current run max run date set appropriately.

[@vijayalakshmikg6590]

Sir, my source is DB2 and target is snowflake . So every time I want to make I pull only delta records from DB2. How to achieve this using $lastrundate previous …

[@keeplearning9447]

@@vijayalakshmikg6590 can we connect quick call drop me an email

[@vijayalakshmikg6590]

Email address pls

[@keeplearning9447]

@@vijayalakshmikg6590 you may check under about section / in case you can’t you can send it across [e-mail]

[@syedkirmani9009]

Sir, can you explain about taskflow

[@keeplearning9447]

posted new video -- kzbin.info/www/bejne/fpXKop2MmdF1jKM, explained different task usage on taskflow. hope that helps!

[@rsntechnologies5345]

Thanks a lot Sir

[@keeplearning9447]

My pleasure

[@MarQKis]

That's so correct sir

[@keeplearning9447]

Sounds good