Microsoft Fabric in Hindi: How to load data in Warehouse using Data Pipeline | End to End Scenario

[@dipeshkoyande8078]

Hello Sir, I have a query,. I run a pipeline to load data in a warehouse and apply the transformation. But when I run pipeline for the second time, instead of replacing the previous data, it appends to the previous data which result in data duplication. The No.of times I run the pipeline data keeps on adding to previous data in the data warehouse . Is there way to avoid this duplication? Can we delete the previous data in data warehouse next time when we run the pipeline?

[@AmitChandak]

Check the copy step, you might have used append in place of replace

[@dipeshkoyande8078]

@@AmitChandak I didnt find any replace or append setting while implementing copy activity.