Fabric Pipelines for Dataverse Part 4: Upsert the Records

[@LearnMicrosoftFabric]

Thanks for this series Scott! Very interesting to see the upsert write behaviour available for the Dataverse connector 👀

[@MSFT_ScottSewell]

Thanks! - And I'm enjoying your series on your channel as well. - you're doing great work in breaking out the learning process for everyone including me. - Thanks for that!

[@LearnMicrosoftFabric]

@@MSFT_ScottSewell Ah no wories, thanks for watching Scott!

[@MrFdebacker]

Thank you sharing this videos. I believed to become crazy with the new buggy button "Clear unmatched value" 😱. I'm not really convicted to use fabric to import tables depending on each others (thank you for the next video about lookup), because, if i have to wait that the linked table i just imported is synchonized in onelake, it will be impossible to run all actions automatically. Or I didn't understand something

[@MSFT_ScottSewell]

@@MrFdebacker I reported that bug yesterday to the feature owner.

[@MrFdebacker]

​@@MSFT_ScottSewellthank you (removing the mapping from the json is the easiest way to clear unmatched fields, up to now). For the other part, creating records in the dataverse, and being able to get the newly id, i use, in place of the link between fabric and dataverse, a dataflow importing and matching the id (or not) and the datas in lakehouse (like you do). So, after the dataflow, i can import the datas from the table in lakehouse to dataverse. The fabric link is no more mandatory. But what about the volume restriction when i do this imports from dataverse ¯\_(•᷄‎ n •́)_/¯

[@florisvanderzwaard4163]

Hi Scott, really like your videos. They are really usefull. Is it me or is the video from minute 9:15 not aligning with your talking!? I miss the visuals of what you are saying for the rest of the video...😢

[@MSFT_ScottSewell]

I missed this earlier. Let me see if I have the rest of the source video.

[@rkneti]

Hi Scott, Thanks for this useful video for upserting records. Is there a video for implementing the same functionality with MS Fabric Warehouse table as the destination? I am trying to implement the feature MS Fabric Warehouse table but the Advanced Settings are different. There is no Write behaviour option and related settings. There is however, 'Pre-copy script' and Write batch timeout settings instead.

[@MSFT_ScottSewell]

The functionality delivers a lakehouse - if you'd like to copy that data into a warehouse, you can build your own pipelines to summarize, filter, supplement, and restructure the data into your own "sliver" layer there.