Advancing Spark - Databricks Runtime 7 3 Beta Review

After just one week away there's already a new Databricks Runtime beta released! In this video Simon is looking through the release notes for Databricks Runtime 7.3, picking out the key features and talking about how we can use them and see them in action!
As usual, don't forget to like and subscribe, and let us know what you think of these new features - anything that stands out for you?
Runtime 7.3 release notes - docs.databrick...
If you're looking at taking Databricks to the next level, or even just starting on your Data Lakehouse journey, why not stop by www.advancinga...

[@ArcaLuiNeo]

I like your content. Keep it coming. I'd love if you could be covering a bit: - how best to do CI/CD for Databricks - there seem to be a few gotchas; - how to administer Databricks workspaces in the context of Azure - how the integration with AAD has evolved and what are the recommendations there;

[@AdvancingAnalytics]

Hey! So CI/CD we can do, although we use Azure DevOps and Databricks have just released a load of GitHub Actions... When I get over my annoyance I'll make a vid! Workspace admin is on the list AAD Integration - are you thinking for rest API, user admin or Power BI integration? (Or all of the above!)

[@ArcaLuiNeo]

@@AdvancingAnalytics To be honest the AAD Integration is an ongoing development and quite confusing - at least SCIM looks promising. What I really want to say is that I for one would find topics like proper industrialization, administration, security quite useful. For example there are 2-3 options of publishing a python library (containers or workspace libraries pushed to clusters or immutable clusters). Even more basic topics like should I have jobs using notebooks or python files as entry points. Not to mention that even the creation of the cluster now is a complicated matter given the options available: API, db cli, terraform provider.... I hope I am making some sense :)

[@phy2sll]

The tan's looking good! Would love to hear more about how Delta and structured streaming are enabling different ETL / CDC use cases with your clients.

[@AdvancingAnalytics]

Hah, I'll be back to pasty white before you know it :) Sure, I'm ruminating on a good way to structure a vid on how delta has evolved ETL and the various patterns it has enabled... Just need to figure out how to make it less than a 2 hour lecture! Watch this space... Simon

[@1234rediff]

Hello there, do you know any backward compatibility issues in upgrading from runtime 6.4 to 7.3 lts ???