Data Profiling in Azure Synapse Dedicated SQL Pool

  Рет қаралды 1,116

Mark Pryce-Maher

Mark Pryce-Maher

Күн бұрын

In this video I show how to profile data in Azure Synapse Dedicated SQL Pools.
Hello Sweeties,
Profiling data in tables is hard and slow, but worth doing.
There are a couple of good reasons for this;
a) Everything runs faster when you use the right data types!!! Pick the smallest data type for each column.
b) Picking the best column for HASH distributions ; select a column with a large amount of distinct values. If the number of distinct values is close to the number of rows, then you might as well pick round robin.
But WARNING this script looks at every row in every column, making it very slow. So be careful, test this on small tables (small number of columns and rows) first.
The script is here; gist.github.co...
Enjoy,
Love you!!
#AzureSynapse #DedicatedSQLPool

Пікірлер
Mark Kromer : Data profiling and cleaning in Synapse with Data Flows
41:08
Database vs Data Warehouse vs Data Lake | What is the Difference?
5:22
Alex The Analyst
Рет қаралды 785 М.
这三姐弟太会藏了!#小丑#天使#路飞#家庭#搞笑
00:24
家庭搞笑日记
Рет қаралды 123 МЛН
At the end of the video, deadpool did this #harleyquinn #deadpool3 #wolverin #shorts
00:15
Anastasyia Prichinina. Actress. Cosplayer.
Рет қаралды 19 МЛН
отомстил?
00:56
История одного вокалиста
Рет қаралды 4,7 МЛН
How I Use SQL as a BI Analyst
9:01
Adam Finer - Learn BI Online
Рет қаралды 25 М.
Architecture of Azure Synapse Dedicated SQL Pool (Simplified)
2:31
Mark Pryce-Maher
Рет қаралды 445
What is Azure Data Lake and When to Use It
11:54
CBT Nuggets
Рет қаралды 75 М.
What is Data Profiling? A simple explanation.
3:43
Abhilash Marichi
Рет қаралды 13 М.
Implementing a Data Quality Framework in Purview
51:07
SQLBits
Рет қаралды 10 М.
Azure Data Factory Tutorial | Introduction to ETL in Azure
24:59
Adam Marczak - Azure for Everyone
Рет қаралды 852 М.
ADF Data Flows: Store Summary Profile Stats
9:00
Data Factory
Рет қаралды 2,3 М.
Why you should look at Azure Synapse Analytics!
5:31
Guy in a Cube
Рет қаралды 77 М.
Create a Power BI streaming dataset for real-time dashboards
5:46
Guy in a Cube
Рет қаралды 186 М.
Azure Data Engineer Mock Interview - ADF Scenario Based Special
25:36
Azurelib Academy
Рет қаралды 6 М.
这三姐弟太会藏了!#小丑#天使#路飞#家庭#搞笑
00:24
家庭搞笑日记
Рет қаралды 123 МЛН