Hey Simon, yep your correct at the time of writing this comment you are only able to connect to the Synapse Pool, with a bit of hacking you could use the SQL Server connector but this requires a convoluted setup. also the Synapse lineage is also not available yet.
@AdityaJain-xg3ms2 жыл бұрын
Hi Simon, does this feature provide query capability to synapse through data objects registered in purview, like how Glue + Athena works in AWS world
@chaudhryalisalam36682 жыл бұрын
super star mate very valuable tutorials.
@chriswood89662 жыл бұрын
Hi, Has Microsoft updated this integration with Synapse now? I want to use Purview for end-to-end lineage on Azure. But we use spark pools in Synapse for most pipelines. If there is still no way to get visibility into this, it's a bit of a showstopper.
@AdvancingAnalytics2 жыл бұрын
No major update that I've seen! There has been some work on a custom spark connector, but I've not tried it with Synapse Spark Pools, and there are some real limitations - docs.microsoft.com/en-us/azure/purview/how-to-lineage-spark-atlas-connector. Realistically, you're better off manually pushing lineage to the Purview Atlas API :(
@irenes36103 жыл бұрын
We did this already linked Synapse to Purview...Sad Purview doesn't include other services like the pipeline, dataset and especially Hive tables. Hopefully they will include these someday. And lineage are important, but nothing is showing up. Thanks for sharing this video