I'm at the 52 min mark, and the discussion of spot instances, I'm looking forward to seeing how Snowflake "Serverless task Flex" develops.

I've been looking for this kind of information! Great job! I also have a pretty strong distrust of Spark, and really almost anything that came out of the Hadoop world. In the early days of Snowflake I remember a customer story where their old data system had a huge backlog of work, and when they switched to Snowflake their back log dropped to almost nothing, AND they gave back 5 Java engineers to be used elsewhere in the company. Think about the cost of 5 Java engineers in your total cost of ownership.

Around the 35m mark you’re asking about Databricks and connecting to Postgres etc…. Lakehouse Federation - allows you to query Snowflake, Big Query, Postgres, SQL Server, etc. it doesn’t sync but does allow access and I guess you should be able to copy into etc. And I can verify Fivetran, Airbyte, etc work great with it. Portable I believe has Databricks on their roadmap.

Thanks

very good stuff!! im also really interested in the work you do(snowflake cost optimization), would be great if you can make an episode on that!

What about Snowflake vs Databricks vs AWS services comparison?

Great perspective. Create another list of discussion items and host another one.