20. alias(), asc(), desc(), cast() & like() functions on Columns of dataframe in PySpark |

In this video, I discussed about alias(), asc(), desc(), cast() & like() functions which are useful while working with dataframe columns.
Link for PySpark Playlist:
• 1. What is PySpark?
Link for PySpark Real Time Scenarios Playlist:
• 1. Remove double quote...
Link for Azure Synapse Analytics Playlist:
• 1. Introduction to Azu...
Link to Azure Synapse Real Time scenarios Playlist:
• Azure Synapse Analytic...
Link for Azure Data bricks Play list:
• 1. Introduction to Az...
Link for Azure Functions Play list:
• 1. Introduction to Azu...
Link for Azure Basics Play list:
• 1. What is Azure and C...
Link for Azure Data factory Play list:
• 1. Introduction to Azu...
Link for Azure Data Factory Real time Scenarios
• 1. Handle Error Rows i...
Link for Azure Logic Apps playlist
• 1. Introduction to Azu...
#PySpark #Spark #databricks #azuresynapse #synapse #notebook #azuredatabricks #PySparkcode #dataframe #WafaStudies #maheer #azure

[@polakigowtam183]

Thanks Maheer . Good Vedio

[@WafaStudies]

Welcome

[@sangam22-m]

Thanks explaining well

[@WafaStudies]

Welcome

[@penchalaprasadsusarla3962]

Thankyou so much for uploading pyspark videos . I have a request sir . Please do upload full series in pyspark . Thankyou sir.

[@WafaStudies]

Thank you for your support. Ya doing it. Stay tuned more videos will come in this playlist

[@penchalaprasadsusarla3962]

@@WafaStudies Thankyou sir. And also please upload the real-time scenarios . thankyou.

[@sumanthb3280]

So, alias will be same as withcolumn_renamed. Please let me know when should use alias and when should we use withcolumn_renamed?

[@DataWithNagar]

alias not change the column name in database but withcolumn_renamed do. it's recommended to use alias when you want to create a new DataFrame with renamed columns, and use withColumnRenamed when you want to modify the existing DataFrame. However, the choice between them ultimately depends on your specific use case and requirements.

[@sumanthb3280]

@@DataWithNagar Thanks for the response. This is helpful...N

[@chittaranjanpradhan5290]

Hi, I am trying to sort a data frame based on Sal and I want to keep the sorted output in a new column. I am trying to achieve this withcolumns and sort but getting an error. My scenario is , id,name,sal 1,'a',1000 2,'b',2000 Required Output ------ id,name,sal,sorted_sal 1,'a',1000,2000 2,'b',2000,1000 Tried like this but not working, df.withColumn('sorted_sal;,df.sort(df.sal.desc()))

[@Kohli079]

sort function will return dataframe, you will not able to use inside withcolumn as parameter which is expecting column type

[@vutv5742]

Completed

[@ManishGupta-vs3nw]

Cheers