Advancing Spark - The Data Intelligence Platform

There's a bit of an arms race currently to be the most AI-Driven Data Platform - Back in December we saw a big announcement from Databricks that they're aiming to deliver the first, full Data Intelligence Platform... but what exactly is that? Is it a new tech category? An evolution of data platforms as we know it? A marketing buzz created to sell more products?
In this video Simon takes a look at the announcements and talks about the future of Data Platforms as we know them, digging into Databrick's vision for the Data Intelligence Platform!
You can find the blog in the video featured here: www.databricks.com/blog/what-...

[@allthingsdata]

I pretty much agree 100% with Simon. I don't care much about the semantics but to me this vision of the platform integrating AI everywhere makes sense and is helpful to understand the overall roadmap and prios of Databricks. On one roadmap slide some months ago, they were talking about driverless lakehouse which to me is the AI-infused backend indicating their intention of building it as a hands-off, automatically tuning platform. The ease of integrating AI tools to me is the crucial factor and compared to other vendors they seem to be on a good track.

[@HandpanEnPleinAir]

Wonderful video Simon , short and sweet

[@gardnmi]

That's nice, now can they please deploy arcion into their platform.

[@AdvancingAnalytics]

Hah! It's all quiet on that front so far, but we're looking out for announcements / roadmap!

[@alexischicoine2072]

I just wish you could move data across clouds without paying exorbitant fees. If your business is built on aws the azure tools could be great but it would be hard to justify the data costs to move between the two.

[@NeumsFor9]

The better you model and differentiate, the better AI should be able to parse your content and the better you be able to secure your model. It is always about enabling the business user.

[@Fernando_Calero]

Happy not so new Year!

[@AdvancingAnalytics]

Better late than never! :D

[@alexischicoine2072]

I don’t like having to push a button to get the AI I like the copilot auto compete on steroids.

[@14robisco]

going for a DIP in the Lakehouse

[@AdvancingAnalytics]

It definitely has some great slogan potential!

[@user-uh6dg5yg4l]

@@AdvancingAnalytics It leaves me deeply DIPpy for 2024! kzbin.info/www/bejne/qqCTnWppqLKbm9k

[@wesleyboyd2714]

Needs patented! Yanks patent everything! Get it done!

[@alexischicoine2072]

It’s a great business move if they can get businesses to let their users rack up bills running bad sql written by the AI.

[@alexischicoine2072]

I think ai should remain a productivity tool to write faster what you could write yourself and are able to review.