ETL Tools For Business Intelligence. Do We Still Need Them?

Рет қаралды 3,016

Күн бұрын

Пікірлер: 13

@Nachtaktiv2000 2 ай бұрын

You are neglecting the important T part, which often already contains a lot of data and business logic. Without T, it's just a 1:1 data replication tool that produces an unnecessary amount of (duplicate) data. The business logic still has to be done, now in the data hub, but again with data in unusable raw format. Many BI tools shine in their pretty dashboards with quick results and ignore the time-consuming part of data preparation!

@LearnBI 2 ай бұрын

Unfortunately, you've neglected the entire premise of the video. I'm not saying Looker Studio is a better tool overall than Power BI, just that it is for the majority of Business Intelligence use cases. And I do cover (briefly) the T part of ETL. Perhaps you missed that part of the video?

@Nachtaktiv2000 2 ай бұрын

If for you T only means normalization and cleaning, then EL is sufficient and many tools can do that, but many sources actually require a transformation first, and not only in the enterprise environment. You can see this from the fact that PowerQuery-Editor is built into Excel. Without T and the knowledge of the importance of formatting for the business layer, the user is often blinded by supposedly quick solutions. A few sources can be used 1:1 in reporting, but most require preparatory work and I never get tired of mentioning this again and again 😉

@LearnBI 2 ай бұрын

@@Nachtaktiv2000 The fact is that in Business Intelligence, an area I have worked in for almost 15 years - during which time I've worked on hundreds of BI projects for hundreds of different organisations, the vast majority of data is either contained in SQL databases/warehouses or in third-party SaaS solutions. For SQL-based data, any T is usually done using SQL to both prepare data and build data sources that feed BI projects. For SaaS solutions, the data is accessed via API and is usually clean and ready to go. The latter explains exactly why there has been an explosion in the number of data hubs whereas traditional ETL tools are on the wane. Power Query is essentially a gimmick when it comes to real BI and big data scenarios. I kind of get where you're coming from but it's not the reality on the ground.

@ArchanaHome-l8j 4 ай бұрын

Really helpful. We have been observing that enterprise data migrations have been using legacy methodology for too long

@aiasaiascon3894 11 ай бұрын

Hi Adam ! Hope you are well! That was a really useful video - for quite a long time, new tech referring to driving data from DBs , aggregating, "digesting" etc platforms show up, and it has been a "mess" in trying to understand what is happening and how. Each company offers some common & some different capabilities and stuff, show - the video was a relieving explanatory one. Mille Merci !

@LearnBI 11 ай бұрын

Glad it was helpful!