Data Architecture vs. Data Engineering Deep Dive

[@edeline5574]

Another great video, Bryan! Very informative and helpful. Keep up the good work!

[@BryanCafferky]

Thanks!

[@pakpak6590]

Funny and informative~ The most important thing is that it saved my assignment. Thanks!

[@user-ox1ud8zn9g]

I would add that, after conducting data analysis, the data scientist develops and tunes a machine learning (ML) model or a set of models. They test these models and design the overall ML pipeline to prevent issues like model drift and other undesirable effects. The ML engineer then takes over, building the ML pipeline, including configuration files, and deploying it. They also test the deployment cycle and provide feedback to the data scientist. This process includes monitoring and notification systems as part of the MLOps framework. This description is based on my personal experience, though practices may vary across different industries.

[@Pan_Padre]

Amazing content as always. I added more words to the comment for YT algorythms.

[@paukazapalka-x1j]

great content, keep it up Bryan, thank you so much!

[@KrisKoirala]

This is awesome and I found this very informative, thanks for sharing.

[@BryanCafferky]

You're welcome!

[@kvin007]

Love your videos! Keep up the good work!

[@NoahPitts713]

really appreciate this breakdown!

[@MuhammadKhan-wp9zn]

I like Brian, your contents always gave me confidence, thank you

[@BryanCafferky]

You're Welcome!

[@joyo2122]

The preferred timeframe for completion is always as soon as possible! :D

[@andyvandenberghe6364]

Excellent deep dive! But what if you're designing microservice app solution architectures including OLTP datamodels and data feeds into BI but not beyond that ?

[@BryanCafferky]

Sounds like an application architecture rather than a data architecture. Regardless, the architecture should be based on the requirements.

[@JimRohn-u8c]

Thank you so much for this! As a young Data Engineer who in the future wants to a great Data/Solution Architect I needed this! Also, just to clarify, is the Data Architect doing Solution Architecture AND Data Modeling? I’m still confused between Data Architect and Solution Architect.

[@diydrivenGA]

Good content.

[@babuganesh2000]

Can you make a video about Databricks for Students who are interested to learn on how much it would cost for learning it using pay as you go and what all the techniques we can use to reduce the cost. There are many videos in youtube unless we do hands on nothing goes into head

[@BryanCafferky]

This video explains how to get the Free Databricks Community Edition. Note: The screens may have changed a bit but it is still available. kzbin.info/www/bejne/opSsYopolLCIhtE

[@thybui1368]

How many languages do you know? (i am not talking about Sql. python or spark) :D Jokes aside, I really like how judgemental you are and your content is very crisp and to the point. Please keep sharing your learning!

[@BryanCafferky]

Thanks. I'd guess I've learned about 30 or so languages over the years. Now there's a lot of spin off languages like Power BI has several sub languages.

[@GhernieM]

Thanks, you're really good at explainin these topics!

[@BryanCafferky]

Thank You!