Data Architecture vs. Data Engineering Deep Dive

  Рет қаралды 5,409

Bryan Cafferky

Bryan Cafferky

Күн бұрын

Пікірлер: 23
@edeline5574
@edeline5574 9 ай бұрын
Another great video, Bryan! Very informative and helpful. Keep up the good work!
@BryanCafferky
@BryanCafferky 9 ай бұрын
Thanks!
@pakpak6590
@pakpak6590 8 ай бұрын
Funny and informative~ The most important thing is that it saved my assignment. Thanks!
@user-ox1ud8zn9g
@user-ox1ud8zn9g 3 ай бұрын
I would add that, after conducting data analysis, the data scientist develops and tunes a machine learning (ML) model or a set of models. They test these models and design the overall ML pipeline to prevent issues like model drift and other undesirable effects. The ML engineer then takes over, building the ML pipeline, including configuration files, and deploying it. They also test the deployment cycle and provide feedback to the data scientist. This process includes monitoring and notification systems as part of the MLOps framework. This description is based on my personal experience, though practices may vary across different industries.
@Pan_Padre
@Pan_Padre 10 ай бұрын
Amazing content as always. I added more words to the comment for YT algorythms.
@kvin007
@kvin007 9 ай бұрын
Love your videos! Keep up the good work!
@paukazapalka-x1j
@paukazapalka-x1j 7 ай бұрын
great content, keep it up Bryan, thank you so much!
@andyvandenberghe6364
@andyvandenberghe6364 9 ай бұрын
Excellent deep dive! But what if you're designing microservice app solution architectures including OLTP datamodels and data feeds into BI but not beyond that ?
@BryanCafferky
@BryanCafferky 9 ай бұрын
Sounds like an application architecture rather than a data architecture. Regardless, the architecture should be based on the requirements.
@joyo2122
@joyo2122 9 ай бұрын
The preferred timeframe for completion is always as soon as possible! :D
@KrisKoirala
@KrisKoirala 10 ай бұрын
This is awesome and I found this very informative, thanks for sharing.
@BryanCafferky
@BryanCafferky 9 ай бұрын
You're welcome!
@NoahPitts713
@NoahPitts713 8 ай бұрын
really appreciate this breakdown!
@JimRohn-u8c
@JimRohn-u8c 7 ай бұрын
Thank you so much for this! As a young Data Engineer who in the future wants to a great Data/Solution Architect I needed this! Also, just to clarify, is the Data Architect doing Solution Architecture AND Data Modeling? I’m still confused between Data Architect and Solution Architect.
@MuhammadKhan-wp9zn
@MuhammadKhan-wp9zn 9 ай бұрын
I like Brian, your contents always gave me confidence, thank you
@BryanCafferky
@BryanCafferky 9 ай бұрын
You're Welcome!
@thybui1368
@thybui1368 Ай бұрын
How many languages do you know? (i am not talking about Sql. python or spark) :D Jokes aside, I really like how judgemental you are and your content is very crisp and to the point. Please keep sharing your learning!
@BryanCafferky
@BryanCafferky Ай бұрын
Thanks. I'd guess I've learned about 30 or so languages over the years. Now there's a lot of spin off languages like Power BI has several sub languages.
@babuganesh2000
@babuganesh2000 10 ай бұрын
Can you make a video about Databricks for Students who are interested to learn on how much it would cost for learning it using pay as you go and what all the techniques we can use to reduce the cost. There are many videos in youtube unless we do hands on nothing goes into head
@BryanCafferky
@BryanCafferky 9 ай бұрын
This video explains how to get the Free Databricks Community Edition. Note: The screens may have changed a bit but it is still available. kzbin.info/www/bejne/opSsYopolLCIhtE
@diydrivenGA
@diydrivenGA 8 ай бұрын
Good content.
@GhernieM
@GhernieM 5 ай бұрын
Thanks, you're really good at explainin these topics!
@BryanCafferky
@BryanCafferky 5 ай бұрын
Thank You!
Master Data Workload Automation: Introduction
24:09
Bryan Cafferky
Рет қаралды 1,8 М.
Master Dimensional Modeling Lesson 02 - The 4 Step Process
14:25
Bryan Cafferky
Рет қаралды 4,6 М.
To Brawl AND BEYOND!
00:51
Brawl Stars
Рет қаралды 17 МЛН
Introduction to Scaling Analytics Using DuckDB with Python
29:33
Bryan Cafferky
Рет қаралды 4,4 М.
Understanding Data Lakehouse
11:46
Bryan Cafferky
Рет қаралды 8 М.
How and When to Use Databricks Identity Column
15:00
Bryan Cafferky
Рет қаралды 2,7 М.
Master Dimensional Modeling Lesson 01 - Why Use a Dimensional Model?
9:57
Core Databricks: Understand the Hive Metastore
22:12
Bryan Cafferky
Рет қаралды 18 М.
Dimensional Modeling
53:54
Bryan Cafferky
Рет қаралды 173 М.
What to Learn for Your Career Path
16:53
Bryan Cafferky
Рет қаралды 1,9 М.
Data Mesh, Data Fabric, Data Lakehouse - SQLBits 2022
56:26
James Serra
Рет қаралды 53 М.