What is Cache and Persist in PySpark And Spark-SQL using Databricks? | Databricks Tutorial |

Hello Guys,
I explained about cache and persist in this video using pyspark and spark sql.
How to use cache and persist?
Why to use cache and persist?
Where cache and persist data saved?
If you like this video please share and subscribe to my channel.
Full Playlist of Interview Question of SQL:
✅ • 1.Second Highest Salar...
Full Playlist of Snowflake SQL:
✅ • How to setup Free Acco...
Full Playlist of Golang:
✅ • Hello World Program | ...
Full Playlist of NumPY Library:
✅ • Hello World Program | ...
Full Playlist of PTQT5:
✅ www.youtube.co....
Full Playlist of Pandas:
✅ • How to use PandasGUI f...
KZbin Link: www.youtube.co....
Facebook Profile: / geeks.coders.3
#databricks #pyspark #azure

[@rashmimishra2445]

Do we have "persist" in azure databricks also?

[@baskarr5004]

Hi Bro, I am beginner in spark. As per my understanding spark always process the data in memory Then why cache is required?

[@pratikpatil6816]

Hi Sagar, Does the stored cache get cleared once the program is closed or we have to unpersist every DF before closing the program? Thanks.

[@GeekCoders]

As per my knowledge, untill your cluster is up there will be cached stored

[@pratikpatil6816]

@@GeekCoders so then we will have to unpersist before the code ends?

[@rakeshdash5417]

Hi sagar can you please one example of salting technique for skewness

[@GeekCoders]

Hey Rakesh, Sure allow sometime