The Azure Spark Showdown - Databricks VS Synapse Analytics

[@Markttt5]

What a great video - really well put. Any chance of a rematch factoring in where we are now in 2022. Seriously though, when you work in an environment where your management don’t fully understand the technology and get swept away with the latest buzz words, it’s hard to keep their feet on the ground. I now feel more empowered to push back when appropriate. You’re a natural speaker and clearly very passionate about what you do. Cheers.

[@SQLBits]

Hey! As this is from our last event Simon covered all things about 2022 updates at our most recent event (SQLBits), it's an event in the Uk that hosts all the data professionals and shares brand NEW updates and releases.

[@RajeshRRajamani]

I know its a bit late to comment on this given Synapse has evolved and so has Databricks . Nevertheless worth every second . Really comprehensive overview . Thank you for this great work Simon.

[@imsushantjain]

Brilliant stuff - the best introduction to Databricks and comparison to Synapse that I have ever seen. Thank you Simon!, looking forward to more videos from this channel.

[@alexischicoine2072]

I don't have access to synapse at work yet but we've had access to databricks for a bit. My current thinking is to keep using databricks for spark, but to use synapse for the pipelines and the sql pools. Synapse also has powerbi integration and the pipelines can run databricks notebooks. The other question for me will be to see what works better to serve a Tableau report between synapse sql pools or sql endpoints in databricks. For small tables on very specific queries I'm thinking synapse might work well with its indexes. I've tried using zordering and bloom filters in Databricks but these don't seem to help much with relatively small data where each hive partition only has one file of about 100mb.

[@Niranjan6029]

Hi @alexis ,can you please help with the azure databricks transformations.please let me know most used azure databricks realtime transformations by you

[@gravenguan]

Really great content, hard to find such in depth comparison, respect and keep it up!

[@dans4786]

Your distributed compute explanation is crystal clear thx

[@carltonpatterson5539]

Another fantastic overview. Thank you so much

[@SQLBits]

Glad you enjoyed it!

[@jochenjuelke265]

excellent overview & comparison, thanks for that insights!

[@osamaasif9601]

It's easy to integrate both azure synapse and azure data bricks so instead of using spark pools in synapse you can use data bricks for azure

[@MezMezMez1]

Excellent video - so much information packed in and very well presented!

[@smdemmery]

Great video, interesting stuff indeed, thanks

[@jakubdaleki7941]

Excellent comparison! I just wonder why in price comparison Synapse Spark Pools went with 2 instances vs 3 Databricks instances? What is more Databricks has job cluster, which are created for the given job and terminated after completing, and these clusters are much much cheaper :) 40:33

[@Krumelur]

Great video! Have you considered making an update, now that Syapse is GA? Meanwhile it has R, it scales and what not. Also an updated cost comparison would be nice.

[@SQLBits]

Hey, if you reach out to the speakers on LinkedIn/Twitter i'm sure they'll be able to answer any questions you may have!

[@crouch.g]

I thought synapse analytics including spark went GA on 3rd Dec 2020 am I incorrect? I'm confused that you videos is only a month old?

[@simonwhiteley8486]

This is a replay from a session around September last year - I'd take the info with a pinch of salt as it's nearly a year out of date now :)

[@tajinderkumar7073]

Great videoo👏🏻

[@ihafidh]

Great comparison! Do a showdown between Databricks and Snowflake.

[@concert_music]

Wow - fab video!

[@SQLBits]

Thanks so much!

[@henryebube3576]

What has improve is Synapse?

[@vishwajeetpol2495]

waiting for latest release its been a year where we can see round 2. @SimonWhiteley

[@SQLBits]

Hi Vishwajeet, our speakers share our updates at our live event in the UK (this year was in March) where they shared all the new information and tips on new features, and updates. Be sure to grab a ticket to the next one to see Simon live in action :D