Focus On: The Apache Airflow PythonOperator, all you need in 20 mins!

  Рет қаралды 21,507

Astronomer

Astronomer

Күн бұрын

Пікірлер: 31
@chris0628
@chris0628 Жыл бұрын
To the point, no fluff 👍🏽
@goodmanshawnhuang
@goodmanshawnhuang 5 ай бұрын
Great job, thanks for sharing it.
@FranVarVar
@FranVarVar Жыл бұрын
Amazing. Thanks Marc!
@Astronomer
@Astronomer Жыл бұрын
My pleasure!
@Leonardo-jv1ls
@Leonardo-jv1ls 3 жыл бұрын
Thank you. You've helped me a lot.
@amitjain000
@amitjain000 3 жыл бұрын
Awesome.. thanks for such a beautiful knowledge share.
@JosePla
@JosePla 2 жыл бұрын
This is exactly what I was looking for
@steliosioannides7128
@steliosioannides7128 3 жыл бұрын
Thanks Marc for this very useful video! High appreciated ! Keep it up !!
@andrikramer686
@andrikramer686 3 жыл бұрын
Awesome. Thanks a lot, Marc.
@AbhishekAmeria
@AbhishekAmeria 3 жыл бұрын
That's was very useful. Thanks :)
@shivangitomar5557
@shivangitomar5557 3 жыл бұрын
Very good vidoe!!!
@SpiritOfIndiaaa
@SpiritOfIndiaaa 3 жыл бұрын
Excellent thanks a lot...I have to check oracle table if a record exists for current date ,if exists then only call downdown stream task ,how to achieve this ?
@vladimirobellini6128
@vladimirobellini6128 3 жыл бұрын
this is great. thanks!
@averychen4633
@averychen4633 11 ай бұрын
you are the best
@sridhar43299
@sridhar43299 2 жыл бұрын
How to send object from gcs to email bu airflow. If possible send me code
@GeandersonLenz
@GeandersonLenz 3 жыл бұрын
How to turn ON this module includes?
@leomax87
@leomax87 3 жыл бұрын
did you resolve it?
@bullandrooster
@bullandrooster 3 жыл бұрын
Can I run 2 dags with different python version and different pandas version? For now I see airflow offers only one python version at the time, and only predefined required dependencies. And all my dags must match that specs.
@manjunathmani3678
@manjunathmani3678 3 жыл бұрын
nice man
@eunheechoi3745
@eunheechoi3745 Жыл бұрын
whenever I first run the airflow test command, it throws an error saying 'sqlalchemy.exc.NoReferenceTableError: Foreign key associated with column 'dag_run_note.user_id' could not find table 'ab_user' with which to generate a foreign key to target column 'id' do you what it is about? and how to fix it? Second run it doesn't occur....
@Astronomer
@Astronomer Жыл бұрын
Hmmmmm interesting, if it works on the second run maybe it needs to generate the table first?
@brendoaraujo9110
@brendoaraujo9110 2 жыл бұрын
instead of calling the script function, is there an operator that I can call the script completely to be executed?
@valetta6789
@valetta6789 2 жыл бұрын
I am trying to pull the value from another task in a different folder, however, I see only the current task instance. Is this new behaviour, or am I unable to pass between different directories?
@Astronomer
@Astronomer Жыл бұрын
So your DAG's are in different folders?
@valetta6789
@valetta6789 Жыл бұрын
@@Astronomer I have no idea what I was talking about😄
@BalvanshHeerekar
@BalvanshHeerekar 3 жыл бұрын
Hey, while using includes I get the error - ModuleNotFoundError: No module named 'includes'
@leomax87
@leomax87 3 жыл бұрын
I'm facing the same error. How Can I resolve it?
@eldrigeampong8573
@eldrigeampong8573 2 жыл бұрын
@@leomax87 you can import the sys module in python after which you will navigate a number of levels either up or down into the directory your file is located. import sys sys.path.append(".") # that's move a level up into the dags folder from includes.my_dags.functions import process
@archanam4224
@archanam4224 2 жыл бұрын
import airflow cannot be resolved
@MariaMartin-q8d
@MariaMartin-q8d 3 ай бұрын
Gonzalez Betty White Scott Anderson Jennifer
Scheduling in Airflow
54:23
Astronomer
Рет қаралды 10 М.
Airflow XCom for Beginners - All you have to know in 10 mins
11:36
Data with Marc
Рет қаралды 47 М.
小丑女COCO的审判。#天使 #小丑 #超人不会飞
00:53
超人不会飞
Рет қаралды 16 МЛН
Don’t Choose The Wrong Box 😱
00:41
Topper Guild
Рет қаралды 62 МЛН
coco在求救? #小丑 #天使 #shorts
00:29
好人小丑
Рет қаралды 120 МЛН
Try this prank with your friends 😂 @karina-kola
00:18
Andrey Grechka
Рет қаралды 9 МЛН
Airflow for Beginners - Run Spotify ETL Job in 15 minutes!
16:38
Karolina Sowinska
Рет қаралды 145 М.
Airflow DAG: Coding your first DAG for Beginners
20:31
Data with Marc
Рет қаралды 238 М.
Getting started with XComs in Apache Airflow
28:53
Astronomer
Рет қаралды 6 М.
Python's Type Annotations DON'T Do What You THINK They Do
8:10
The Airflow BranchPythonOperator for Beginners in 10 mins
12:27
Data with Marc
Рет қаралды 21 М.
Best Practices For Writing DAGs In Airflow 2
46:24
Astronomer
Рет қаралды 10 М.
A Deep Dive Into Iterators and Itertools in Python
21:01
ArjanCodes
Рет қаралды 62 М.
Начало работы с apache airflow -  "Школы Больших Данных" г. Москва
17:55
小丑女COCO的审判。#天使 #小丑 #超人不会飞
00:53
超人不会飞
Рет қаралды 16 МЛН