Tutorial 5- Pyspark With Python-GroupBy And Aggregate Functions

[@anandvardhan5]

Enjoying your videos. I was puzzled with all the stuffs out there on the internet. Lucky to find your channel which is a full package in itself.❤️

[@sarthakmodi3250]

Great person❤️

[@karthikkarthik-ls9wg]

Really nice and inspiring sir for all your work and knowledge 👍

[@ajaykiranchundi9979]

Appreciate your crisp and neat explanation.

[@manu93ize]

Sir my question is by creating df.createOrReplaceTempView("temp_table") you can run sql query like spark.sql('select * from temp_table') why we need to learn pyspark syntax .

[@ashishbhatnagar9590]

amazing content. Very very useful for us. Keep continuing this series. Again thanks a lot for such amazing content

[@UmerPKgrw]

No example of allias. No example of applying the different aggerate operation on different columns For Example Average salary against each deprt and Count on number of people in each dept.

[@Sreeni007]

Please request decently rather than complaining, this is not a paid service and he is mostly creating free these informative knowledgeable videos just for benefit of knowledge sharing

[@jithmiranatunga5870]

Most awaited seiries❤Thanks a lot sir.

[@naveenkrishnan9619]

Sir this time deep learning course in ineuron is available or not? Sir

[@subhajitdey4483]

Thank you for this video. I have one question. Is it possible to get all columns when using groupBy()?

[@rohitjagdale4648]

Hi Krish, I have used koalas with PySpark 3.1.1 on Google colab. I am getting error while using "figsize" in plot method of Koala dataframe. All other code is working fine. Can you please help me with "how to set figsize while using plot method of Databricks Koala dataframe". I am using latest version of koalas and plotly.

[@vinayakdhruv6457]

Hi sir, been following your videos and articles for a while, and it has helped me a lot you are an amazing teacher and guide. I do have a query regarding data science career options, where can I get in touch with you sir?

[@riajain3898]

Hi Sir How much time will it take for you to upload entire pyspark series?! Also, thanks for the amazing content.

[@papachoudhary5482]

Thanks! Sir , how should get complete session of these . What is fees and cintact number or links to connect with you

[@krishnaik06]

No fees everything is free

[@papachoudhary5482]

@@krishnaik06 Thanks! SIR, You will provide full session of pyspark and scala

[@sarthaksarjine5534]

i want to get max 5 values from a particular column of dataset. how should i do it by using max function?

[@abhinavsoni102]

Can we apply select and groupby in a single statement? tried searching a lot but did not find anything

[@anshuljoshi8585]

HI Krish, I have a query: how can we get result as person who has highest salary in particular department (eg. 1st row as 'krish', 'Data Science', 10000) ? I know in SQL we generally use rank function, but it seems somewhat complicated in pyspark. So is there any other way we can do it without using rank ?

[@jikkuization]

why no videos about RDDs which is the main datastructure in pyspark

[@zohaibramzan6381]

One thing is still not explained: how to add new coloumn to pyspark dataframe if column is a list. Kindly explain this one too ?

[@pavanjoshi6732]

Hi Sir whenever i am reading .csv file by using df_pyspark.show(), I cannot able to see data more than 8 rows, Can u plz help

[@chillagundlavamshi8504]

I get this error by using groupBy function and solve this error Analysis Exception: Column 'Name' does not exist. Did you mean one of the following? [Name , Salary, Department]; 'Aggregate ['Name], ['Name, sum(Salary#19) AS sum(Salary)#152L] +- Relation [Name #17,Department#18,Salary#19] csv

[@amitbudhiraja4135]

Hi everyone , When i am pressing tab after this to see the more functions df_pyspark.groupby('Department'). i am not getting the results instead i am getting this ipynb_checkpoints/ again and again . Now how to see the more functions then ?

[@abhayjain5775]

Very useful material

[@wellpaidmasonnothingisfree1085]

Can get enough of this 😘😘😘

[@rohitjagdale4648]

Thank you for the video 👍🏽 Can you please make video on how to use koalas and pyspark ?

[@ashutoshrathi1378]

I need to read data from a table using pyspark.. please help me in this..

[@soubhikbandhyopadhyay8160]

Plz include how to deal with outliers