110. Databricks | Pyspark| Spark Reader: Reading Fixed Length Text File

Azure Databricks Learning: Spark Reader: Reading Fixed Length Text File
========================================================================
Spark Reader is one of basic and widely used concept in Spark development. In this video I have covered how to read text file and create Dataframe out of it. I used a fixed length text file for this exercise and splitted the fixed length records into multiple columns
To get thorough understanding of this concept, watch this video
#SparkReader, #SparkReadTextFile,#SparkFixedLengthTextFile,#DatabricksReadTextFile,#DatabricksFixedLengthTextFile#CreateDataframeTextFile ,#SparkDevelopment,#DatabricksDevelopment, #DatabricksPyspark,#PysparkTips, #DatabricksTutorial, #AzureDatabricks, #Databricks, #Databricksforbeginners,#datascientists,#bigdataengineers,#machinelearningengineers

[@oiwelder]

Excelente caso de uso, obrigado!

[@rajasdataengineering7585]

Thanks and welcome!

[@AshokKumar-ji3cs]

Awesome content i have implemented the same in daflows but never implemented in pyspark. I really appreciate your efforts

[@rajasdataengineering7585]

Thanks for your comment. Happy to help!

[@sharmadtadkodkar2038]

Do you have a video showing how to attach a file to databricks filestore?

[@rajasdataengineering7585]

I am yet to create a video on this requirement

[@khandoor7228]

excellent!

[@rajasdataengineering7585]

Thank you! Cheers!

[@akshaybhadane6527]

Hello Sir, great content. Can you provide your inputs on how to write fixed width file. Thanks in advance.

[@rajasdataengineering7585]

Create your dataframe with fixed lenth values for each column and write it using dataframe writer

[@user-bg5qc1ux3k]

Can we do this process if we have above 300 columns

[@rajasdataengineering7585]

Yes we can do

[@kumarvummadi3772]

Good morning sir excellent video. Could you please make a video for reading a csv file by skipping the first 4 rows in the file. Requesting you sir please

[@rajasdataengineering7585]

Hi Kumar, sure will make a video on this requirement soon

[@manjunathbn9513]

Sir, Can you please upload on Delta Lake end to end project?

[@rajasdataengineering7585]

Sure, will create an end to end project on delta lake

[@ylast3756]

how do we deal with non-fixed length txt files?

[@rajasdataengineering7585]

For non-fixed length txt file, we definitely need a delimiter, at least space

[@zack497]

P R O M O S M