26. Time Travel/Versioning in Delta Table

Follow me on Linkedin
/ bhawna-bedi-540398102
Instagram
www.instagram....
What is Delta Lake?
Delta Lake is an open source storage layer that brings reliability to data lakes.
Delta Lake is a data format based on Apache Parquet. Delta Lake provides ACID transactions, scalable metadata handling, and unifies streaming and batch data processing.
Delta Lake runs on top of your existing data lake and is fully compatible with Apache Spark APIs.
Delta features overview
Delta Lake is an open-source storage layer that brings reliability to data lakes.
ACID transactions on Spark - Delta is not RDBMS right away.
Scalable metadata handling
Streaming and batch unification - A table in Delta Lake is a batch table as well as a streaming source and sink.
Schema enforcement - Automatically handles schema variations to prevent insertion of bad records during ingestion
Time travel - Data versioning enables rollbacks and full (or rather up to your retention settings) historical audit trails.
Upsert and deletes - Supports merge, update and delete operations to enable complex use cases like change-data-capture, slowly-changing-dimension (SCD) operations, streaming upsert, and so on.
Data-bricks hands on tutorials
• Databricks hands on tu...
Azure Event Hubs
• Azure Event Hubs
Azure Data Factory Interview Question
• Azure Data Factory Int...
SQL leet code Questions
• SQL Interview Question...
Azure Synapse tutorials
• Azure Synapse Analytic...
Azure Event Grid
• Event Grid
Azure Data factory CI-CD
• CI-CD in Azure Data Fa...
Azure Basics
• Azure Basics
Data Bricks interview questions
• DataBricks Interview Q...

[@mranaljadhav8259]

I never find such a detailed explaination of databricks in youtube. Thanks alot mam for this complete databrick series.

[@biyongalain46]

Very good explanation. I don't know why you don't have much likes. Thanks a lot !! I'm going for the next course

[@Learn2Share786]

Nicely explained, thanks, looking forward to learn other features of delta lake esp. metadata handling, schema enforcement, merge etc.

[@arupnaskar3818]

Thank you so much ma'am .. your work is excellent and it is really really helpfull .. Thank you so much for these awesome great video ..

[@hitendrachavan6276]

very well explain with the practical example !!!

[@sravankumar1767]

Nice explanation 👌

[@samk_jg]

Well done!!👋

[@subhamdas5609]

if possible can you create a video on how to handle metadata and schema validation

[@DhirajKumar-nt2jq]

Thanks for the video. I have one question The last cell that was for restoration right. So that comes under 3rd version or now it will show only one version in version history table?

[@rijubajracharya2996]

Hello Bhavna, Is it possible to display all the historical data along with latest dynamically at once?

[@user-zm5jx9gw5u]

It would be better if you had gone with one complete API it's either PYTHON or SCALA. It is uncomfortable switching to this and that.

[@bhangrazest]

history() function is not coming up for me. Are you using any package or library to use history() ?

[@beau4532]

𝓟Ř𝔬𝓂𝔬𝐒ϻ