Cache and Persist DataFrame PySpark Interview Question | Maersk Interview Question |

data = [("Raj","Doe",None),
(None,"Samuel","VIZAG"),
("David","Smith", None),
("Samson",None, "HYD"),
("Immi", "Steve", "BNG"),
(None, None, None)]
columns = ["Firstname", "Lastname", "City"]
df = spark.createDataFrame(data,columns)
df.cache()
Databricks-PySpark RealTime Scenarios Interview Question Series
www.geekcoders.co.in/courses/...
Project Link:
www.geekcoders.co.in/courses/...
#hashtags #cache #persit #maersk
#tags #pysparkinterview #pysparkforbeginners

[@souravdas-kt7gg]

nice question

[@satyabratasahoo6945]

json files with 10000 records Everey record has 10 elements, with 2 and 8 elements contain 5 child elements pls read the json and parse it

[@GeekCoders]

Sure will do this

[@9940114158]

I was asked questions like create table with schema without schema reading file from s3 writing to s3