Spark Scenario Based Question | Dealing with Date in PySpark | Beginner's Guide | LearntoSpark

[@rajashreepatil7859]

Awesome vedio sir thanks a lot for this vedio

[@mrthakurs]

Bro this interview series curated by you Is saviour & guide for many people like me, these questions never cease to amaze me ! Thank you & God bless🙂

[@Gamer_Dooby]

Super ji, expecting more real-time scenario

[@vikasYadav-ho9ot]

Very helpful 👍

[@mdtausif3480]

Can you please provide equivalent scala code always.. like your content a lot..🙏🙏

[@ramuram7986]

Hi please explain some more related to telecom real-time spark jobs

[@AzarudeenShahul]

Sure bro :)

[@Azardeen-sb1wr]

hi Azar , can you delimiter it - > Mohamed,Azar,BE-4year Prakesh,Kummar,Btech-3year Ram,Kumar,Mtech,3year Jhon,Smith,BE,2year

[@MrManish389]

How to calculate number of partitions required for a 10 GB of data, please help??

[@rajashreepatil7859]

First convert 10gb in mb 10gb=10240mb/128mb=80 partitions

[@purnimabhartibharti1014]

could you please provide the dataset

[@mahesh97413]

df2 = df1.withColumn("Expiry_date", date_add(col("Expiry_date"), col("Remaining_days"))) Why it is not working. Encountering "Column not iterable". If I use expr, it's working fine.

[@chaithanyamannem5040]

How to find max min date

[@localmartian9047]

Once you format string date to date type, simply use max or min df.select(F.max("s_date"))