Q11. Realtime Scenarios Interview Question | PySpark | Header in PySpark

  Рет қаралды 6,119

GeekCoders

GeekCoders

Күн бұрын

Here is the link to the project course:
www.geekcoders...
If you haven't taken my Azure End-to-End Project course then here is the link(More than 450 users have already taken it)
www.geekcoders...
"""
path='/FileStore/tables/csv_with_no_header.csv'
df=spark.read.option('header',True).option('inferschema',True).csv(f'{path}').limit(1)
if(df.schema==schema):
df.write.mode('overwrite').save('/FileStore/tables/csv_with_header_output/')
else:
df=spark.read.option('header',False).schema(schema).csv(f'{path}')
df.write.mode('overwrite').save('/FileStore/tables/csv_with_header_output/')
"""
Please visit my website also for more info
www.geekcoders...
Looking for 1:1 Long mentorship
app.preplaced....
HASHTAGS
TAGS
#tags #hashtags
KZbin Link: / @geekcoders
GeekCoders: www.geekcoders...
LinkedIn: / sagar-prajapati-86073b155
Telegram: lnkd.in/dKz7s3y8
Instagram: lnkd.in/dKz7s3y8
#pyspark #pysparkinterview #spark

Пікірлер
@sachinshinge9917
@sachinshinge9917 Ай бұрын
cool nice bro
@rawat7203
@rawat7203 Жыл бұрын
Thank you Sir
@sravankumar1767
@sravankumar1767 Жыл бұрын
Nice explanation bro, keep it up🎉❤
@GeekCoders
@GeekCoders Жыл бұрын
Thank you
@sravankumar1767
@sravankumar1767 Жыл бұрын
HI bro can u please make a video on excel files with multiple sheets how can we read and to convert each sheet as single csv using pyspark using user defined functions dynamically read the files as well as json and nested files how can we read using pyspark. please make video.
@GeekCoders
@GeekCoders Жыл бұрын
I have included these things in my end to end project
@azingo2313
@azingo2313 Жыл бұрын
Poor presentation...need to create script before recording....lot of issues. Also pay attention to pronounciation...looks like this person having problem while pronouncing many words having letter R and S.
@rawat7203
@rawat7203 Жыл бұрын
bruh, focus on content rather than these shenanigans
@aniketraut6864
@aniketraut6864 5 ай бұрын
can you do better than him? please do it. Let me know your channel name. Thanks
Solve using REGEXP_REPLACE and REGEXP_EXTRACT in PySpark
17:50
Маусымашар-2023 / Гала-концерт / АТУ қоштасу
1:27:35
Jaidarman OFFICIAL / JCI
Рет қаралды 390 М.
SLIDE #shortssprintbrasil
0:31
Natan por Aí
Рет қаралды 49 МЛН
4. Write DataFrame into CSV file using PySpark
28:05
WafaStudies
Рет қаралды 52 М.
The ONLY PySpark Tutorial You Will Ever Need.
17:21
Moran Reznik
Рет қаралды 152 М.