5. Analyze data with dedicated SQL Pool in Azure Synapse Analytics

In this video, I discussed about Analyzing data with dedicated SQL pool in Azure Synapse Analytics
Link to download parquet file used in demo: azuresynapsest...
Link for Azure Synapse Analytics Playlist:
• 1. Introduction to Azu...
Link for Azure Databricks Play list:
• 1. Introduction to Az...
Link for Azure Functions Play list:
• 1. Introduction to Azu...
Link for Azure Basics Play list:
• 1. What is Azure and C...
Link for Azure Data factory Play list:
• 1. Introduction to Azu...
Link for Azure Data Factory Real time Scenarios
• 1. Handle Error Rows i...
Link for Azure LogicApps playlist
• 1. Introduction to Azu...
#Azure #AzureSynapse #AzureSynapseAnalytics

[@rohitsolanki246]

Hi Maheer, You are simply superb. The way you teach is very easy to understand for anyone. One thing I like to ask that I am not able to see the Database option under the Data/Workspace, Could you please help. Thanks in advance.

[@Me_Aftab]

I am from infrastructure background started learning it with a hope to transform my career to data engineer!

[@ADAMSIVES]

Excellent. Thank you for this. It's really helping me for DP-900

[@WafaStudies]

Thank you 😊

[@lifechamp007]

Very helpful, indeed. Thank you!!

[@WafaStudies]

Thank you 😊

[@amadousallah8916]

Thank you sir. Very helpful videos.

[@WafaStudies]

Thank you 😊

[@ytphani9002]

HI Wafastudies, i am not able to find this parquet file & unable to analyze the file which uploaded recently. Can you help on it?

[@rk-ej9ep]

Nice info sir...

[@jopsdairies]

Nice one,Maheer!

[@SSingh-lr2ue]

Thank you for sharing your knowledge. You have mentioned there is always SQL database associated with dedicated sql pools. How much storage/space we get with associated database ? Is any cost involved with associated Database ? what will happen to the associated database if Dedicated sql pools are deleted ? I hope you will keep sharing your knowledge.

[@reshavraj4090]

If a particular sql pool is deleted, then the database associated with it will also removed automatically from workspace.

[@praveenm172]

Good work, keep it up. I got below error when tried to access the demo file "This request is not authorized to perform this operation.", please help , thanks

[@alekhyakundu7894]

can you provide the parquet file please, the above link is not working

[@sudhirnakkana8745]

Hi, i am running below error, HdfsBridge::recordReaderFillBuffer - Unexpected error encountered filling record reader buffer: ClassCastException: class java.lang.Integer cannot be cast to class java.lang.Long (java.lang.Integer and java.lang.Long are in module java.base of loader 'bootstrap')

[@venkateshdamacharla]

I would like to know, where can I download this PARQUET file from microsoft site. I tried to do that, but didn't get it. As the microsoft updated the documentation, I am getting new SQL script when I try to copy it from docc. The new script column names and datatypes are different from the file that you provided. OR it can be easy for me if I find the older documentaion of Azure Synapse Analytics

[@krishj8011]

nice tutorial..

[@WafaStudies]

Thank you ☺️

[@federicosardo2314]

Hi Maheer, I am unable to download the parquet file. Public access is not permitted on this storage account.

[@alfredsfutterkiste7534]

Nice mate

[@WafaStudies]

Thank you 😊

[@kumarsura-g6y]

not able to download the parquet file

[@sonamkori8169]

Thank You Sir

[@WafaStudies]

Welcome 😊

[@UmerPKgrw]

Can you access the data from a database associated with a different SQL pool or when dedicated SQL pool is stopped?

[@Pahadi_Manka]

I am getting error 6:03:01 pm Started executing query at Line 1 Incorrect syntax near 'DISTRIBUTION'. Total execution time: 00:00:02.327

[@IronMan.11]

Can we create ServerLess SQL Pool? Just like dedicated SQL Pool? and how? Why this option is not there?

[@simachala]

Please share the SQL script

[@MRMB-qn3ru]

Super 👌😍

[@WafaStudies]

Thank you ☺️

[@rajdeepsinghborana2409]

💥💥💥💥

[@WafaStudies]

Thank you 🙂

[@vinayagamoorthyboobalan6268]

Hi Maheer, Thanks for your valuable content that is shared.. I am doing the same with my account but getting error while querying the parquet file like below, External file access failed due to internal error: 'Parameters provided to connect to the Azure storage account are not valid.' Could you pls check and assist?

[@Imty78]

Did you get past this?

[@Manisood001]

suprrrrrr

[@WafaStudies]

Thank you 😊

[@hafizadeelarif3415]

Hallo Sir I'm working the piratical lab But "This type of error, I can face." HdfsBridge::recordReaderFillBuffer - Unexpected error encountered filling record reader buffer: ClassCastException: class java.lang.Integer cannot be cast to class java.lang.Long (java.lang.Integer and java.lang.Long are in module java.base of loader 'bootstrap') Sir kindly help me...... 🙂

[@ajaiar]

same error

[@hafizadeelarif3415]

@@ajaiar bhie ya mapping error ha cross check karo

[@ajaiar]

@@hafizadeelarif3415 Should we create Linked service with gen 2 storage or boob storage

[@YadavTechs]

@WafaStudies can you please come up with this error as most of are facing the same error while executing the script(copied from MS documentation) and we are unable to proceed until we fixed it.

[@nikhilnagendra1984]

Thanks for the video. Can we link our existing dedicated SQL pool to Synapse?

[@desparadoking8209]

Thanks a lot Sir for informative video 🙏🙂, however can you provide a scenario based approach , specifically which should use dedicated or serverless ? In interview they ask these kind of qestions

[@akashsharma4769]

The Serverless SQL Pool is perfect for ad hoc queries, as it requires no extra configuration and the resources scale automatically. However, for a data warehouse solution where the processed data is difficult to predict, it could mean unexpected costs. In a case like that, Synapse offers the Dedicated SQL Pool, where resources are chosen by the user and the costs can be easily measured by the active time.

[@ramukanna1218]

thanks bro

[@sumamalanidrabingi6699]

Hi Maheer, As you mentioned dedicated SQL pool will be associated with SQL database, Can we create and load the table from file using serverless SQL pool.

[@huzischannel]

Were you able to load data in table?

[@jayanthbalina4500]

please share the SQL Script. Thank you.

[@swapnilmule1873]

Can you share all this presentation with us

[@WafaStudies]

I will plan to create a website soon and share all content in text and slides.

[@ratnach9067]

Can you please create a video to load a CSV file to external table in server less poll.

[@santoshprasanth6633]

Ithink we can create a view but not a table in serverless poll.

[@ratnach9067]

@@santoshprasanth6633 I am thinking may possible external table.

[@hiee8850]

this is hilarious, it comes up an ad like every 20-30 secs, I am watching more ads than your talks, this is very bad

[@WafaStudies]

Ha ha that means your views generating lot of money 🤑 for me 🤣🤣🤣🤣🤣. Just kidding. Usually in youtube when we watch some videos very frist time then for initial few days it's like that only. After few watches adds will automatically get reduce. 🤗

[@ramshataqdees5570]

could not download parquet file used in demo saying public access not permitted