Databricks News Dec 2024 - Advancing Spark

December was a fairly quiet month on the Databricks side, but there's still a fair bit to talk about! Last month saw a bunch of releases around Agentic framework functionality and evaluation, new Unity Catalog features, a bunch of new integrations and security features as well as a blast from the past with Collation Support in DBR 16.1!
In this video Simon walks through the Azure Databricks release notes, talking about the various features and what it means to us - as always, make sure you take a run through the release notes yourself to see what matters to you!
For the Databricks Release notes, see: learn.microsof...

[@lancasm]

Happy New Year! And welcome back. Lol

[@alexott74]

One correction regarding "Delegate the ability to create a storage credential in Unity Catalog to a service principal" - SPs were able to create storage credentials before as well, but they needed to be Account Admins. New fix allows to create storage credentials only having "create storage credential" grant.

[@AdvancingAnalytics]

Ahhh, rightio, that's on me! I'll pop a quick note in the video description, thanks Alex! - Simon

[@pedroarnold1457]

Guys, thanks for your videos! How to stay tuned and receive some kinf of notification when there is an update on databricks?

[@UmashankarKonda]

can we expose data of sql query on deltatble as rest api to consume by other system?

[@arsenystarostin662]

Check their docs here's a starting point /api/2.0/sql/statements/

[@MrMikereeve89]

I wonder how much Databricks paid for 8080 labs only to deprecate bamboolib. I know some big fans of bamboolib who will be very disappointed by this news.