Explaining what a Lakehouse is!

[@esteban-alvino]

It's a very nice talk with a lot of energy. That is contagion; it draws a smile from me. Thanks guys

[@brianengelbrechtandersen9435]

We have been using Data Lakehouse mostly with sql serverless for around a year now and it works very well for our customers.. We have to think differently when designing the ETL/ELT but basically we still end up with a snowflake schema and great performance. However, it requires a tool like Power Bi premium for caching data bc of the rather slow and unpredictiable latency from the serverless.

[@dagg497]

Yup we lost the fast data retention of an SQL server and instead have to deal with parquet file conversions..

[@osPA78]

We are looking to implement a DW, DL, and/or DLH where I work so I am looking EXTREMELY FORWARD to those videos. Thank you!!!

[@simon2093]

Yep, now building out a company wide lakehouse - early days at the moment. But this thing is nuts fantastic. Especially loving delta tables.

[@dagg497]

I hate Delta parquet.. 😂 Convert files upon stahing, build delta logic and shit.. Then everything sucks when handling upserts and deletion.

[@juliangimbel1583]

Great video, but using the Azure machine learning icon for the data lake is confusing for me 😅

[@spilledgraphics]

where does the concept of datamarts (not Power BI datamarts) fit into this combo of data lakehouse?

[@beverlywesterkamm-wallrauc5808]

This is exactly what we use. It is great for ad hoc analysis as well.

[@SetYourBarTo10]

I wonder if the increase in remote work impacted naming conventions? …data lakes…data streams…lake house…I am started to feel like someone has a better view while they work.

[@johnnyw5627]

When the Data Warehouse and the Data Lake went out for a few beers... was it in Belgium?

[@jamieclarke2694]

Where else? 😅

[@definitelynorandomvideos24]

Great Video, at my company we are currently trying to identify which architecture is the best to unify the many data silos we have. Looks like I can show a possible solution ;)

[@lausmaja]

Great overview guys. Love it!

[@shilpapathi]

Great content and engaging, worth every minute.

[@WilliamRockseo]

Amazing information, Thank You

[@mwaltercpa]

Chris Wagner is pointing us toward Synapse Analytics, I got a book and would love to also watch GIAC videos!

[@kurrysamir]

Great content as always! Awaiting the slowed down version with some hands!!

[@7anishok390]

Hi Please help me. I have created an external table in the synapse lake database, Now I like to load the records from the external table into the dedicated SQL pool table. Please advice on the procedure.

[@premcst]

Waiting for the slow downed version Patrick !!

[@Al-vl3tp]

Yes, we are building a data lake house with the structured data transformed pointing to redshift and all of the unstructured data pointing to the S3 buckets. But the data scientists can't query the data in Athena and point the data to Power BI for analytics and data visualizations.

[@Cero_GT]

Neat. We’ve been taking this approach for a couple years now but didn’t give it a fancy name.

[@dagg497]

Yeah Fabric is nothing new to me... Data factory and Synapse existed 3years ago.. Sem-structured data storage alternatives as well and Apache Spark and Cosmos DB

[@minathanh7072]

Great video, thank you!!!

[@matheww9944]

Was that you Patrick on the "Power BI Update - October 2022" ? :)

[@surfh3r0]

interesting! thanks!

[@rohansrivastwa827]

Can your audio be more clear with less base and noise?

[@MichaelGreen831]

I would have loved to hear the problem DW has that DL and DLH solves. I only heard “large” data in contrast to DW historical data.

[@dagg497]

Personally i don't like DLH all that much due to the slow loading of new data into parquet and the fact you read files instead of SQL tables with history. Who would've known merging 10'000parquet files would be slower than an RDB database?

[@Expateer]

Q: What happens to all those BI reports with their virtual schemas when the "Silver Layer" data structure changes?

[@kevinruckstuhl2378]

More like data swamp

[@dagg497]

Yeah. I liked Storage Blobs, Data Factory into a Synappse or Azure SQL Database. Lakehouse and parquet is very dependant on a coded scala/python framework and makes every step 10x more confusing and code dependant. We are back to SSIS 2005 and have to code an ETL framework in C+ or instead of working in BI moving into fullstack coding instead..

[@brianxyz]

What is a Databrick? TIA

[@benhalicki9749]

Microsoft implementation of Apache Spark. Connects to the data lake etc but for in memory, clustered computing. Geared towards big data analytics.

[@nourlchann]

Patrick really likes data LMAOOO

[@Milhouse77BS]

But... what about...a...: "Lake Database" :)

[@martiruda]

funny this is called data constelation, someone added lakehouse just to sell training courses I bet.

[@1yyymmmddd]

Data warehouses are dead, aren't they?