Apache Airflow Overview | Architecture | What is DAG | Tasks | Operators | Use Cases

  Рет қаралды 41,956

Sleek Data

Sleek Data

Күн бұрын

Пікірлер: 19
@SleekData
@SleekData 5 күн бұрын
🚀 Check out the full playlist for more awesome Apache Airflow videos! 👉 kzbin.info/aero/PLc2EZr8W2QIAI0cS1nZGNxoLzppb7XbqM
@Kicajz7
@Kicajz7 8 ай бұрын
Really good videos. Quickly, but well explained, without all the boring stuff. I was able to watch the whole series without any breaks:) That's exactly what I needed!
@SleekData
@SleekData 8 ай бұрын
Dear Friend - Thank you for your kind words! We're delighted to hear that you're enjoying our content. To stay updated with our future videos, consider subscribing and sharing with your friends. Your support means a lot to us. Thanks again for your encouragement!
@DavidG-qm5vf
@DavidG-qm5vf 9 ай бұрын
I was searched silver and i found gold! so many thanks brother. Really appreciate your tutorial and your time.
@SleekData
@SleekData 9 ай бұрын
Dear Friend, Thank you so much for your kind words! I'm glad you found the series helpful. We appreciate your support and would love it if you could like and subscribe to our channel to stay updated with our future content. If you could share our video/channel with your friends, we would be so grateful! Once again, thank you for your encouragement.
@bikramkoirala8847
@bikramkoirala8847 8 ай бұрын
Very nice job. Quick and to the point, no need to watch hours and hours to get to required stuff.
@SleekData
@SleekData 8 ай бұрын
Dear Friend - Thank you for your kind words! We're delighted to hear that you're enjoying our content. To stay updated with our future videos, consider subscribing and sharing with your friends. Your support means a lot to us. Thanks again for your encouragement!
@pushankarmakar1783
@pushankarmakar1783 Жыл бұрын
the tutorial is aweome!. you installing airflow tutorial helped me a lot. thankyou so much!
@SleekData
@SleekData Жыл бұрын
Cheers Dude, thanks for your kind words. appreciate if you could like the video and subscribe to my channel. Any time, any technical help, pls add a NEW comment to any of my videos. Pls feel free to share this with your friends. Good luck.
@SouhaCherif-vp2vw
@SouhaCherif-vp2vw 8 ай бұрын
hey, i want to create a dag with a task that allows you to clone a repo from gitlab but im having problems with ssh
@SleekData
@SleekData 8 ай бұрын
Pls try something like below: from airflow import DAG from airflow.contrib.hooks.git_hook import GitHook from airflow.operators.python_operator import PythonOperator from datetime import datetime def git_clone_task(): git_hook = GitHook(git_conn_id='your_git_connection_id') repo_url = 'git@gitlab.com:user/repo.git' # Update with your GitLab repository URL local_path = '/path/to/clone/repo' # Update with the local path where you want to clone the repository git_hook.clone(repo_url=repo_url, destination_folder=local_path) default_args = { 'owner': 'airflow', 'start_date': datetime(2024, 4, 13), 'retries': 1, } with DAG('gitlab_clone_dag', default_args=default_args, schedule_interval=None) as dag: git_clone_task = PythonOperator( task_id='git_clone_task', python_callable=git_clone_task ) git_clone_task
@Wuroyewuro
@Wuroyewuro 6 ай бұрын
I really prefer the AI voice over real human voice. It is clear to follow. Great choice!
@SleekData
@SleekData 6 ай бұрын
Dear Friend, Glad you like them! To stay updated with our future content, I kindly request you to consider subscribing and liking our videos. If you could share our video/channel with your friends, it would be so grateful! Thank you for your encouragement.
@kaaviansis1485
@kaaviansis1485 Жыл бұрын
Thank you
@SleekData
@SleekData Жыл бұрын
Dear Friend, Thank you so much for your kind words! I'm glad you found the series helpful. We strongly believe that learning should be simple, free, and designed to save your valuable time. And that's exactly why we've started this new initiative on a mission to make in-demand data skills accessible to everyone. If you could share our video/channel with your friends, we would be so grateful! Once again, thank you for your encouragement.
@Sam56891
@Sam56891 10 ай бұрын
Ai voice is used
@SleekData
@SleekData 10 ай бұрын
Dear Friend - Thank you your kind feedback! To stay updated with our future content, I kindly request you to consider subscribing and liking our videos. Your support is valuable to us. If you ever need technical support, please feel free to leave a comment on any of our videos, and we'll be sure to respond promptly or create a video addressing the issue.
@mohsenkheirabadi8211
@mohsenkheirabadi8211 10 ай бұрын
@@SleekData I like this AI voice. For non-native english speakers like me listening to standard voice is easier and help me to focus more on content. please keep up the good work.
번쩍번쩍 거리는 입
0:32
승비니 Seungbini
Рет қаралды 182 МЛН
What is Data Pipeline? | Why Is It So Popular?
5:25
ByteByteGo
Рет қаралды 224 М.
Apache Airflow Architecture 101
18:29
Bryan Cafferky
Рет қаралды 13 М.
Don't Use Apache Airflow
16:21
Bryan Cafferky
Рет қаралды 100 М.
Airflow for Beginners - Run Spotify ETL Job in 15 minutes!
16:38
Karolina Sowinska
Рет қаралды 144 М.
When to Use Kafka or RabbitMQ | System Design
8:16
Interview Pen
Рет қаралды 150 М.
Why Airflow? The Top 5 Reasons To Use It!
10:01
Data with Marc
Рет қаралды 26 М.
Airflow DAG: Coding your first DAG for Beginners
20:31
Data with Marc
Рет қаралды 236 М.