PySpark in Microsoft Fabric - Delta and Magics (Ep. 2)

Download Student Files prag.works/pyspark-in-microso...
Delta is a powerful data management tool that enables efficient and reliable data processing, while Magics allow for interactive data exploration. Join us as we explore these useful PySpark tools.
👍 If you enjoy this video and are interested in formal training on Microsoft Teams, Power BI, Power Apps, Azure, or other Microsoft products you can visit prag.works/AUSTIN40 for 40% off On-Demand Learning!
-- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -- - - - - - - - - - - - - - - - - - - - - - - -
Next step on your journey:
👉 On-Demand Learning - Start With The FREE Community Plan: prag.works/odl-trial-yt
🔗Pragmatic Works On-Demand Learning Packages: pragmaticworks.com/pricing/
🔗Pragmatic Works Boot Camps: pragmaticworks.com/boot-camps/
🔗Pragmatic Works Hackathons: pragmaticworks.com/private-tr...
🔗Pragmatic Works Virtual Mentoring: pragmaticworks.com/virtual-me...
🔗Pragmatic Works Enterprise Private Training: pragmaticworks.com/private-tr...
🔗Pragmatic Works Blog: blog.pragmaticworks.com/
Let's connect:
✔️Twitter: / pragmaticworks
✔️Facebook: / pragmaticworks
✔️Instagram: / pragmatic.works
✔️LinkedIn: / pragmaticworks
✔️KZbin: / pragmaticworks
Pragmatic Works
7175 Hwy 17, Suite 2 Fleming Island, FL 32003
Phone: [phone]
Email: [e-mail]
#pragmaticworks
00:00 Introduction and Setting Up Environment
02:02 Creating a Variable for Table Name
03:38 Writing Data Frame to Lakehouse Tables in Delta Format
09:15 Creating a Temporary View for SQL Operations
11:12 Using SQL Magic Command for Spark SQL

[@Nalaka-Wanniarachchi]

Nice..

[@notoriousft]

Hmmm. At 7:32 I received an error "AnalysisException: Failed to merge fields 'isPaidTimeOff' and 'isPaidTimeOff'. Failed to merge incompatible data types BooleanType and StringType: when using your Holidays.csv file.