[Live Demo] Checkpointing In Spark Streaming | Fault Tolerance & Recovering From Failure In Spark

[@tanushreenagar3116]

NICE SIR

[@Tarun_Vlogs-ks2fe]

What IDE you have used to run this project

[@ManishaSingh-cg2jv]

When we read messages from Kafka and write it to delta table , how to tackle the problem when we have a mix of messages with 2 different schema in Kafka topic. eg: total offset scanned in checkpoint's offset folder is 0 to 50. But 0-10 has old schema and 11-50 has a new schema. How tackle this kind of situation without cleaning up checkpoint(as this is not always possible on prod env)

[@tushar207]

Thanks amazing video

[@Tarun_Vlogs-ks2fe]

I have done exactly as you shown in video but my batch count and table is not displaying can you please help me with it

[@chinnathambivlogs1769]

Nice

[@vedantshirodkar]

Thanks for the video. How to store this checkpoint to blob storage account instead of local file system. I tried replacing the old directory location with my blob storage account https SAS Token but it's not working. Can you please suggest me something ?