Microsoft Fabric Data Engineering - How to make the reference file work in Spark Job Definitions?

Join us in this Fabric Espresso episode as Qixiao Wang and Estera Kot explore the integration of reference files in Spark Job Definitions in Microsoft Fabric.
🎙 Meet the Speakers:
👤 Guest Expert: Qixiao Wang, Principal Program Manager in Microsoft
Linkedin: / %e5%90%af%e9%9c%84-%e7...
👤 Host: Estera Kot, Principal Product Manager at Microsoft.
LinkedIn: / esterakot
Twitter: / estera_kot
👍 Liked this video? Don't forget to hit the 'Like' button and share it with your peers!
🔔 Stay Updated: Subscribe to our channel for the latest in Microsoft Fabric Data Engineering, Data Science, and groundbreaking tech. Hit the notification bell to never miss out on the Fabric Espresso series!

[@user-rd7di6tx4v]

In my years as a data engineer; SQL is the most preferred querying technique. Yes, with introduction of spark & NoSQL we use Python & Java. But T-SQL was our bread & butter; surely not anymore in future I believe.

[@7effrey]

What is SED?

[@StanleyCruvinel]

When will we have the Apache Spark version 3.5?

[@EsteraKot]

@StanleyCruvinel - Thank you for the question. Very soon, please make sure to read the upcoming announcements. As always, submit your ideas or needs through ideas.fabric.microsoft.com/ - for example, if you require specific Spark, Java, Python, or Delta versions, or have any other needs. We read and act on these submissions.