110. Databricks | Pyspark| Spark Reader: Reading Fixed Length Text File

[@ShivamGupta-wn9mo]

great video raja

[@rajasdataengineering7585]

Thank you! Keep watching

[@thepakcolapcar]

nice and very explainatory I have a requirement to write to a text file, with fixed width column sizes, and no separators. I tried finding documentation specific to this scenario but could find one. If you can create a video on it that would be great

[@sharmadtadkodkar2038]

Do you have a video showing how to attach a file to databricks filestore?

[@rajasdataengineering7585]

I am yet to create a video on this requirement

[@AshokKumar-ji3cs]

Awesome content i have implemented the same in daflows but never implemented in pyspark. I really appreciate your efforts

[@rajasdataengineering7585]

Thanks for your comment. Happy to help!

[@oiwelder]

Excelente caso de uso, obrigado!

[@rajasdataengineering7585]

Thanks and welcome!

[@akshaybhadane6527]

Hello Sir, great content. Can you provide your inputs on how to write fixed width file. Thanks in advance.

[@rajasdataengineering7585]

Create your dataframe with fixed lenth values for each column and write it using dataframe writer

[@dasarikrishnaprasad]

Can we do this process if we have above 300 columns

[@rajasdataengineering7585]

Yes we can do

[@ylast3756]

how do we deal with non-fixed length txt files?

[@rajasdataengineering7585]

For non-fixed length txt file, we definitely need a delimiter, at least space

[@manjunathbn9513]

Sir, Can you please upload on Delta Lake end to end project?

[@rajasdataengineering7585]

Sure, will create an end to end project on delta lake

[@khandoor7228]

excellent!

[@rajasdataengineering7585]

Thank you! Cheers!

[@kumarvummadi3772]

Good morning sir excellent video. Could you please make a video for reading a csv file by skipping the first 4 rows in the file. Requesting you sir please

[@rajasdataengineering7585]

Hi Kumar, sure will make a video on this requirement soon

[@zack497]

P R O M O S M