Building an Enterprise Data Warehouse

[@brutedebik1708]

when I thought my teacher was the best , then I found James Oliver....wow ....what an explanation ......wow ......i understood it from a better perspective now ....Thank you Sir James

[@helovesdata8483]

I like how you go through a real-life project. I wanted to get an idea of how I would begin a job once I get into this field. This is great!

[@helovesdata8483]

I'm returning with more knowledge than previously...lol Wouldn't it be beneficial to start with the business process? How were you able to run the new environment in parallel with the existing, if you are moving the data? I think I'm getting something mixed up here.

[@danhendo4664]

Thanks you so much! Your thought process is so well explained, this video is gold.

[@bilalmujahid9239]

This video is goldie gold. Thank you.

[@i_maverickmonica]

Thanks! you explain things in simple words, great solution !

[@Ayuk1]

Beautiful illustrations. Clear and easy to understand. Thanks alot

[@JamesOliver]

Really appreciate the kind words. :)

[@michaela64]

Hi James, Nicely done, how you explain step-by-step what is going on in a project. This shows you need to understand business requirements, the architecture which needs to be migrated and the data warehouse architecture, where you want to integrate.

[@thangtran145]

Thanks, you made it easy to understand!

[@hiwotworkneh5101]

Awesome video!! Subscribed👍

[@NattyWerewolf]

You’re a legend

[@filibertogarced]

Great vid 👌 Thanks for explaining everything so detailed 🙂

[@SimohmedRaiss]

Amazing ! Very helpful

[@andynelson2340]

Wow, this is so informative. Thanks 😊

[@thirumalaip6458]

Thanks for the video. Can we please have more deep dive sessions on building a datawarehouse.

[@JamesOliver]

I don't see why not. Was there any particular aspect of building a data warehouse you had in mind?

[@thirumalaip6458]

@@JamesOliver Yes more insights on the design and the ETL part. Maybe you can start a series on Udemy on how to build an EDW end to end.

[@norpriest521]

@@thirumalaip6458 Can you recommend a book for EDW design please. Thank you.

[@axequalsb8431]

Great Video!!!

[@jerzykepinski]

This is nice. Thanks!

[@olukimkan3837]

This is a sharpener, sharpened some rough edges. Cheers

[@NattyWerewolf]

Thanks so much. Subscribed !!

[@Diamond_Hanz]

omg... this is great!

[@pathfinder750]

How does this only have 5k view?

[@rapo107]

James... could you please make a video on edit links on metrics and thresholds on attribute? Thanks in advance

[@sangnykungkea8011]

Can you upload the video demo the process build in SQL please!

[@Fourtitude44]

good video

[@rezwanakhatun1015]

Hi James, thank you so much for your thorough and detailed explanations and analogies. I really found your video helpful. One question I have on my mind, how long did it take for you to complete building and designing the DWH? What was the overall time frame for this project to deliver this solution to business?

[@JamesOliver]

Great question. This was done under a compressed timeline that not only included building the data warehouse but a new reporting environment and making the users comfortable with the new environment through training. The total time was approximately 6 months. However, under normal conditions, this is extremely aggressive but I had no choice so there were many sleepless nights and long weekends. Because I was the main architect doing most of the technical work I was able to save time by cutting out overhead and providing all the direction to the DBA and ETL teams.

[@rezwanakhatun1015]

@@JamesOliver Thank you so much for your response, really appreciate it!😊

[@JoshuaWilsonNZ]

What was total project time from spec to users using the EDW ? Intrigued because I'm about to start building a dwh for the org I work for. That tip about the views was genius! much easier for devs to have something to shoot for that's in front of them, compared to doing discovery work.

[@JamesOliver]

Sorry for not answering sooner, missed this one but I would say make sure that the subject matter experts (ie those that understand the data best) are made to feel like they are part of the project. When building a data warehouse inevitably the devs will have many questions about the data and they cannot be waiting on people for answers or it can significantly impact the timeline. Do the developers have prior data warehouse experience?

[@JoshuaWilsonNZ]

@@JamesOliver The org is quite fresh to modern data practices. Undeniably the devs will be enrolled in all the conversations. Its green fields here, likely we would bring in extra skill required. My big concern is the business doesn't have a clear picture on what end state should look like. I have my own vision for it, just wanted a baseline for total time if alignment is succinct across the biz

[@JamesOliver]

Yes it can be a challenge for the business to wrap their heads around what this is going to do for them. Funny enough I’m starting up a new Edw project myself and I presented to leadership and made sure I used examples they could relate to. For example, are there a specific report request for an executive that took forever to deliver because IT had to go hunting down the data? Let them know this will bring these requests down from weeks to days or months to weeks with a data warehouse. That should help.

[@rapo107]

Hi james... can we expect frequent uploads on microstrategy? Please make more videos on mstr.

[@JamesOliver]

ramesh pedakotla Yes, they will continue. Just been taking some summer vacation time with family so uploads have slowed for now. :)

[@rapo107]

@@JamesOliver.. enrolled in udemy for your videos.. 😊

[@JamesOliver]

@@rapo107 Thank you so much for enrolling! :)

[@NattyWerewolf]

Do you use python for data cleaning ?

[@JamesOliver]

I do not use Python for data cleansing but you absolutely could. Typically I would handle data cleansing at the source if possible.

[@boobkoo]

You forgot to mention that you use Kimball method to build your DW. Also there is other options as well.

[@rdbtumpy]

Too much circumlocution. bored. stopped in the middle.