3 Skewness in Databricks

www.databricks...
docs.databrick...
bhawnabedi.gra...
If you need any guidance you can book time here, topmate.io/bha...
Join to get channel membership for exclusive content - / @cloudfitness
Follow me on Linkedin
/ bhawna-bedi-540398102
Instagram
www.instagram....
You can support my channel at: bhawnabedi15@okicici
Data-bricks hands on tutorials
• Databricks hands on tu...
Learn data-brick in 30days
• Learn Databricks in 30...
Data Build tool [DBT]
• DBT Data build tool
Machine Learning
• Machine Learning
Duck DB
• Duck DB
Snowflake Data warehouse
• Snowflake Datawarehouse
Azure Event Hubs
• Azure Event Hubs
Azure Data Factory Interview Question
• Azure Data Factory Int...
SQL leet code Questions
• SQL Interview Question...
Azure Synapse tutorials
• Azure Synapse Analytic...
Azure Event Grid
• Event Grid
Azure Data factory CI-CD
• CI-CD in Azure Data Fa...
Azure Basics
• Azure Basics
Data Bricks interview questions
• DataBricks Interview Q...
Microsoft Fabric
• Microsoft Fabric Tutor...
Databricks Lake house Monitoring
• Playlist
Unity Catalog
• Unity Catalog
Spark Functions
• Spark Functions
Python For ALL
• Python for ALL
Snowflake Interview Questions
• Snowflake Interview Qu...

[@gudiatoka]

After spark 3.0 AQE already enabled...so skewness can easily handled...

[@madhukarjaiswal0206]

Its ok, but seems like its getting covered like a common theory session skipping some parts here and there. I feel it could have been better in case it would have been demonstrated practically. I don't see anything talked about the performance improvement each of these optimizations caused, neither was skewness or spill shown in spark UI.

[@Rakesh-if2tx]

Thanks Bhawna!

[@subhashyadav9262]

Great