All About Delta Lake | Databricks | Lakehouse | Deep Dive into Delta

Databricks tutorial for beginners
In this tutorial, you will understand the All About Delta Lake | Databricks | Lakehouse and Deep Dive into Delta. Introduction to Azure Databricks.
Databricks playlist for complete beginners
#deltalake #databricks #lakehouse #delta #deltalivetablesdatabricks #LearnAzureDatabricks #WhatisAzureDatabricks #AzureDatabricksCourse #databricksforFree #CommunityEdition #deltaCorpsharelatestnews #LoginWithDatabricksCommunityEdition #Cluster #CreatingTheNotebook #AzureDatabricksTutorial #AzureDatabricksforBeginners #MicrosoftAzureDatabricks #AzureDatabricks #AzureDatabricksTraining #navalyemul
Link For Databricks Creating Community Edition Account:
www.databricks.com/
Link For Databricks Playlist:
• Databricks
Link For SQL Playlist:
• MySQL
Link For Power BI Playlist:
• Power BI Full Course |...
Link For Python Playlist:
• Python
Link For Azure Cloud Playlist:
• Azure Cloud
Link For Big Data: PySpark Playlist:
• Big Data with PySpark
1:47 What is Lakehouse
2:31 About Delta Lake (Data Warehouse, Data Lake, and Delta Lake)
7:48 Key Features
9:24 Introduction of Pipeline using separate storage systems
10:34 About Using Delta Lake for both stream and table storage
11:37 Databricks Hands-On about the Delta Kake
12:12 Start Creating a Notebook in Databricks
15:07 How to Create a Delta Table
16:26 Creating an Empty Delta Table
17:34 Create a Database using SQL in Databricks
20:36 Describe extended using SQL in Databricks
23:56 How to Display the File Path in Databricks
29:55 Create Delta Table using Parquet File with SQL in Databricks

[@sumitambatkar3903]

so much helpful video sir keep suporting...

[@thedatamaster]

Thank You 🙏 Glad it helped you. 😊

[@learnwithfunandenjoy3143]

Thanks Naval for creating such powerful video. You have explained the things so easily that everyone would able to understand all concepts very easily. Great Going Naval.

[@ChanduShekhar-vg7qk]

Nice explanation. One correction for external tables only the metadata gets deleted from your external location that can be your S3 or ADLS. Still you can access to the data.

[@ashishbhardwaj1655]

I mentioned in your other video also.. you explained very well, specially ""what and where"" all components exists..

[@thedatamaster]

Thanks for your kind words! I'm glad you found the explanation helpful. If you have any more questions, feel free to ask!

[@suman3316]

Best explanation about delta thanks

[@rushikeshsonune8779]

You explained it very well Sir.

[@akhtarattar2744]

Best explanation bro..I have seen lot of videos but you explained in a very simple way.Thank you.

[@prabhatgupta6415]

Just a small confusion. In hive i studied that if internal gets dropped both data and metadata get deleted. but if we drop external only meta data get deleted the actuall is stored in hdfs/s3/adls. but here u r saying for external if we drop this meta data wont get deleted only data get deleted. I did not get this plz explain

[@suchitranair683]

When you drop an external table, the table gets dropped from the hive metastore, i.e. you lose the schema definition for the table, but the external location still has your data in parquet format along with metadata (your transaction logs in json format and your history).

[@priyankasrivastava3247]

Well explained video.. helped to clear lots of concepts thanks

[@divyamsaxena3198]

Thank you very much brother..

[@thedatamaster]

Thank you so much for your kind words! 😊 We're thrilled to hear that you're enjoying our content.

[@rushikeshsonune8779]

Very helpful video 👍

[@pankajjagdale2005]

very well explained Thank you😊

[@thedatamaster]

You're very welcome! I'm delighted to hear that you found the explanation helpful. If you ever have more questions or need further clarification on anything, please don't hesitate to ask. Thanks for watching, and I appreciate your support! 😊👍

[@aslamnaturalfarming2128]

Much appreciated

[@thedatamaster]

You're most welcome! If you have any more questions or need assistance in the future, don't hesitate to ask.

[@shubhamavhad9269]

thanks

[@thedatamaster]

You're welcome!

[@anantghuge6258]

Thanks sir 😅

[@thedatamaster]

Glad it helped you.

[@sandhyauppu2472]

Is it mandatory for databricks you should have handson experience of 6months

[@user-qn7ll8hb1u]

When you drop an external table, Databricks removes the table metadata but leaves the underlying data in the external location intact. correct me If I am wrong.

[@samarpittuli4113]

Correct

[@user-nc8co6se4b]

Could you please make a video how to read delta tables in powerbi ?

[@thedatamaster]

Check out my video on connecting it to Power BI kzbin.info/www/bejne/f4C2h4WhnNqofsksi=t-TGk0lgMijHSMLs

[@user-zv9um9pb6w]

Lake House is more than delta. Its open meaning open technology, its the same treatment and technology for streaming and batch ie not lambda or kappa. Ect ..

[@DesiGodOfWar]

Incorrect information at 30:02. When an external table is dropped, only the metadata is deleted. Data stays.

[@Ajjeshh]

Nope. When an external table is dropped, data only gets dropped but metadata always stays as we are storing outside dbfs ..

[@user-qn7ll8hb1u]

r u sure??@@Ajjeshh

[@rohitsharma-mv5xw]

@@Ajjeshh correct me if im wrong Dropping Table: When you drop a managed Delta table, both the table metadata and data are deleted from the storage layer. However, when you drop an unmanaged Delta table, only the table metadata is deleted, and the data remains intact in the external storage layer. Therefore, you need to be careful when dropping unmanaged tables, as you could lose your data if you’re not careful.