Qlik - 043: Incremental Load - Insert Only (with Practical Example of 60 Million records)

[@tevinoloo221]

Thanks very much Manish. You are truly a life saver. Keep up the good work!

[@saikishore2401]

Appreciate from my bottom of the heart for your effort.Eagerly waiting for other parts of incremental load as well.

[@kothaisudharsan9246]

Thank you so much for detailing the basics and concepts clearly..

[@bayazjafarli3867]

Thank you very much! 👏

[@pavaniswarna3070]

Wonderful explanation sir...we need more videos from you 👍👍

[@surenderbabu8766]

Thanks Manish,Very much informative....

[@bhargavireddychavva6280]

Very well explained.. how can we achieve if we don’t know the qvd exists or not please explain

[@anbaarasi8068]

அருமை

[@AkaankshhaSharma]

Thanks for the video. How can I do the Incremental load for two tables in a single script.

[@venkym3148]

Nice video, please do video on hierarchy

[@beckbeck8315]

a very well explained vlog, I have a question: how can I apply this solution when I have no column: max_updateddatetime. Thanks a lot

[@manishkumarkachhia1683]

If you don't have updatedatetime then you can only do INSERT ONLY incremental load based on Primary Key.

[@beckbeck8315]

@@manishkumarkachhia1683 thanks for your feedback, did you have such a case where one did not have the maxdate column. How can you solve such a case technically effectively? Thanks a lot

[@saikishore2401]

Manish.. Can you post a video on how to implement SCD in qlik?

[@manishkumarkachhia1683]

SCD is similar to IntervalMatch. I have already created video on this topic. But if you want to have another video with specific example, let me know. I will try to create video.

[@saikishore2401]

@@manishkumarkachhia1683 please post a video dear. Thanks in advance.

[@manishkumarkachhia1683]

@@saikishore2401 Please check all videos of my channel. You will find videos on IntervalMatch with example.

[@SachinKumar-lk8gx]

getting error out of memory error while loading. My data is over 2 crore....why is this error happening ?

[@manishkumarkachhia1683]

This error will come when you RAM is not able to handle the size of data. First try to do partial load. If nothing is wrong in your script and no cross join is happenning then definitely wrong with your RAM capacity.

[@SachinKumar-lk8gx]

@@manishkumarkachhia1683 Yes Sir,,, Partial load is working now and how can I add the rest of the data into it ? Can we use Concatenate below this entire code like In the first code I have used where createdat::date '2022-02-28' in SQL Query please suggest Sir Thanks in advance

[@manishkumarkachhia1683]

​ @Sachin Kumar When you do the full load, check your RAM usage. If RAM is not able to handle it, you need to increase RAM. You will not be able to load full data in that case.