23 DataFrame.transform() function in PySpark | pyspark tutorial

#spark #pyspark #dataengineering
In this video, I discussed about dataframe transform function in Pyspark using which we can apply custom transformations on dataframe.
Want more similar videos- hit like, comment, share and subscribe
❤️Do Like, Share and Comment ❤️
❤️ Like Aim 5000 likes! ❤️
➖➖➖➖➖➖➖➖➖➖➖➖➖
Please like & share the video.
➖➖➖➖➖➖➖➖➖➖➖➖➖
script
data=[(1,'manish',10000),(2,'rani',50000),(3,'sunny',5000)]
columns=['id','name','salary']
df =spark.createDataFrame(data,columns)
df.show()
➖➖➖➖➖➖➖➖➖➖➖➖➖
AWS DATA ENGINEER : • AWS DATA ENGINEER
Azure data factory :
• Azure Data Factory
Azure data engineer playlist : • Azure Data Engineer
SQL PLAYLIST : • SQL playlist
PYSPARK PLAYLIST -
• Pyspark Tutorial
➖➖➖➖➖➖➖➖➖➖➖➖➖
📣Want to connect with me? Check out these links:📣
Join telegram to discuss t.me/+Cb98j1_f...
➖➖➖➖➖➖➖➖➖➖➖➖➖
what we have covered in this video:
➖➖➖➖➖➖➖➖➖➖➖➖➖
Hope you liked this video and learned something new :)
See you in next video, until then Bye-Bye!
➖➖➖➖➖➖➖➖➖➖➖➖➖

[@mdabdulaziz5476]

Well explained

[@jainfoods27]

Thanks for pyspark tutorial sir, this is very helpful.

[@mukkaraganeshkumar2251]

Thank you very much for really doing a great job. Could you please make one video on what is predicate push down and how parquet helps for that and also data skewness causes and how to handle that. Thanks