#50. Azure Data Factory - Generate Sequence numbers in Mapping data Flow with Surrogate Key activity

Quite often we will end up generating sequence numbers for real world applications. ADF makes it simpler with Surrogate Key activity. Watch this session to know the steps to implement it and provide your comments.

[@swaminathankv4486]

Congratulations for 50th video. Very neat explanation on surrogate key.

[@AllAboutBI]

thanks Mr.swamy.

[@saiharispeakztech876]

I second ms.nagalaxmis comments on your. Videos. They are helpful

[@AllAboutBI]

thanks mam

[@drnighttime]

Great Video Thank you so much!

[@nagalaxmich6208]

Really your explanation and examples are very use full to new guys for Azure. Thank you very much mam

[@AllAboutBI]

Thanks a lot mam for your feedback.

[@manojsrivastava7055]

Amazing...clear explanations!!

[@QuickSlickStories]

Very useful. Thanks

[@sunilpatil4393]

I really love your videos

[@AllAboutBI]

thanks a lot. keep watching and provide your feedback.

[@saikumar-it1gl]

Hai mam i am doing incremental copy activity. If i add new data. For new data it creating other csv but i need to copy new data in old csv file only how to do that mam

[@dorgeswati]

Is it not possible to use max number as a start value for surrogate key? This will avoid adding one column in dataset

[@AllAboutBI]

It is possible. We may have to use lookup for getting that max number and use the same in surrogate key.

[@oriono9077]

Excellent!

[@AllAboutBI]

thanks much.

[@srinivasreddyd5331]

Is there any way to generate sequence number with out using surrogate key flow pls let me know?

[@AllAboutBI]

Yes you can try using rownumber() function in window transformation .. and add it to any constant value, for instance with 1 to generate sequence of numbers

[@srinivasreddyd5331]

@@AllAboutBI Great .. Thank you😊 let me try..

[@AllAboutBI]

You are welcome 👍

[@srinivasreddyd5331]

One more scenario.. I have 10gb data I want to load on premises to azure blob storage monthly base files or table using data factory.. How can we achieve it

[@AllAboutBI]

Try using data flow activity and increase partitions

[@vaidehithirumalai6612]

Is this the same way if our Destination is a file?

[@AllAboutBI]

no, with respect to files, we may have to do little bit differently since we have to append records. may be a union is required.

[@barwalgayatri4655]

too lengthy

[@AllAboutBI]

Oops. Sorry for that. 🫣