15. MapType Column in PySpark |

[@rk-ej9ep]

Nice content..Thanks for your efforts Maheer.

[@ShekharBhide]

df1 = df.withColumn('hairs', col('properties.hair'))\ .withColumn('eyes', col('properties.eye')) df1.show(truncate=False) we can use thse as well Thanks Nice Explaination

[@dugginenivenkatasubbaiah7547]

Thanks for uploading videos regularly.

[@WafaStudies]

Welcome

[@sachinvs1230]

I started my career in data engineering and your videos help me a lot.. Thank you sir.. keep going so that we can learn more from you..

[@polakigowtam183]

Thanks Maheer . Good Vedio

[@WafaStudies]

Welcome

[@caiyu538]

Great lectures.

[@meghasridhar4286]

Sir, Please explain how to use HELP function to know synatx about the function getItems() . Basically any thing nested

[@timidjex9675]

Sir aap videos mei git add krskte ho kya

[@ratnakarm-tr9lg]

Hi Maheer, Can you please share the entire notes for Pyspark tutorial. You session are very helpful and detailed.

[@anandmohanreddykarri2338]

In this example, both keys and values are of same datatypes So we directly specify MapType(StringType(),StringType()) If we have different datatype values in mapType columns then how can we specify the datatype for that particular value??

[@RakeshKumar-dq3db]

we will provide the data type of the Key and Value respectively. eg : {name:'xyz', age:21} MapType(StringType(), IntegerType() )

[@vinodhvijay7180]

Hi brother Appreciate your videos to learn basics of various technologies Is it good career path to learn Pyspark with Azure data factory Please differentiate both any please brief any relation between PySpark and ADF also, Please give your words and release one video for Azure data factory jobs in 2023

[@shankrukulkarni3234]

Hi Maheer,first I will say thanks for making this video, my question is what is the reason you have used MapType here, if you could expalin by taking example it would be clear for us..Thank you

[@Basket-hb5jc]

there are situations where the number of elements inside a structure may vary....u will come back here when u come across complex and nested datatypes

[@nagulmeerashaik5336]

Thank you...

[@WafaStudies]

Welcome 🤗

[@dolla_shrey]

i understood sir well xplained but what if our maptype col has mixed datatypes value like {name:xyz, age:21}

[@RakeshKumar-dq3db]

we can give the key and value data type in the map function respectively like this: MapType(StringType(), IntegerType) or MapType(keyType=StringType(), valueType= IntegerType() ) since the name is a sting data type and age is Integer data type

[@dolla_shrey]

@@RakeshKumar-dq3db {'name':'xyz', 'age':24} -> now it has mixed dtypes, one pair is stringtype, stringtype and another pair is stringtype, integertype....now how to specify?

[@vutv5742]

Completed