extremely helpful. Thanks for putting the concepts together

Hi I am trying to upload the wheels files to databricks volumes via GitHub actions is there any videos or documentation is there pls share?

I could not understand what this was about. I was completely lost. I, perhaps, gotta watch it once again.

You are just awesome in your basics and thanks for easily explaining these concepts !!

It feels like It ended promptly in the end. A technical issue, I guess

I am not able to find the staging folder under the models

Very neatly explained. Thank you mam !

Boring confused

hello mam your explaining very fast way and not at all sharing like how we need to install and setup kind of things. For better understanding it should better for go with smooth way with proper setup

Does the order of columns for clustering matter? For instance I have 2 different queries one uses column A as filter most of the time, and other query uses column B, and if I define cluster by (A,B), then will the query B get benefits of clustering?

What are the various use cases where tables in Unity Catalog are preferred over Azure SQL Database? As I understand tables in UC hold user tables like Azure SQL Databases.

What is cost of implementing this, any idea ?

Very clear cut explanation covering most of the details. Good job. Do you have any other video - Integrating Apache Kafka with Azure Event Hub?

tech mahindra- how many linked service we need to create for copying the data from source to sink, sink is in same adls

will changes made in one table in one workspace will impact in another workspaces. How this will impact, please let me know

Hello Bhavana, If we are introducing salted skews, then will it not introduce more of shuffles when performing the joins? pls answer

Set Set ❤‍🔥

Well explained! - without unecessary jargon, thank you

How to see the column lineage and performance for models?

Excellent tutorial on DABs . Thank you

Best video on Spark that i have seen so far. Kudos to you madam!

One doubt - do we have to use asc =0 in orderby for higher??

Lady it would have been better if you would NOT have said "RIGHT" in your every sentence. It's very annoying to listen to that word "RIGHT" repeatedly. Looks like pretty much everyone in India does this mistake!

superb , well explained & this ia a Interview q for ltts

Very good solutions and scenarios👍

Thanks for Spreading your valuable knowledge🙏

You are the Best...Kudos !!!

very well explained...🙂

looking for video on event grid custom topic

Super!!

Thnku

Thank you so much

helllo maam ...could you share this PPt for study purpose??? and it is enough for interview prepration of pyspark, databricks?

Super madam.

I think you have upgraded version of databricks will you help me with cost and how to avoid more cost so that I can try this

Here i have a doubt about this col('value') code. how did you defined the column name as value?. Everything is a bunch of text right, then how the name "value" is assigned as a column name for that df?

Adf also supports real time data processing..correct your slide

Doesn't presto / trino support this via its connectors?

Thanks a lot for the video, it's really helpful. Are you planning to upload video on upgradation from HMS to UC using UCX workflow as we completed assessment in this video.

2 GB file = 2 Gibibyte 1 Gibibyte= 1024 Mebibyte 2 Gibibyte= 1024*2= 2048 Mebibyte partition spark = 2048/128=16 Gigabyte is different 1 Gigabyte = 1000 Megabyte Gigabyte - Decimal unit based on SI system unit Gibibyte - Binary Unit Example : 400 GB drive might appears as 372 GB in windows as its actual 372Gi(Gibibyte )

Everytime Bahwna - "you know........." me: "No, thats why I'm watching it " jokes apart, these are helpful videos!!

Good one Crystal clear

Thank you so much ..

Is there any way a whl file can be used with databricks notebook deployment. Does it provide any benefit?

Is there any live sessions for data engineer course?

Really good video. would you be doing the video by creating all of this with terraform?

🎉

250001 (n/a): Could not connect to Snowflake backend after 2 attempt(s).Aborting If the error message is unclear, enable logging using -o log_level=DEBUG and see the log to find out the cause. Contact support for further help. I'm facing that error.