DAG Writing Best Practices in Apache Airflow

  Рет қаралды 12,217

Astronomer

Astronomer

Күн бұрын

Пікірлер: 24
@atom
@atom 3 жыл бұрын
They are sharing their code with 360p quality. Genius
@chrisfalter5183
@chrisfalter5183 3 жыл бұрын
Astronomer has published a handy summary of this presentation here: www.astronomer.io/guides/dag-best-practices The code from the webinar is published here: github.com/astronomer/webinar-dag-writing-best-practices Both resources are available and quite helpful.
@chanpreetsingh007
@chanpreetsingh007 3 жыл бұрын
Thanx
@haro_carlos
@haro_carlos 2 жыл бұрын
Thanks!
@JasonZhang-se2jo
@JasonZhang-se2jo 2 жыл бұрын
Your Guys are amazing , pass the airflow " kindness" to all the people who are looking forward to airflow : )
@Astronomer
@Astronomer Жыл бұрын
Thank you so much!
@haliltaylan6181
@haliltaylan6181 2 жыл бұрын
Did you record this with a toaster?
@wailshudar
@wailshudar 3 жыл бұрын
If posting this video in 360p was suppose to be a joke. I'll tell you now that it ain't a good one.
@Astronomer
@Astronomer 3 жыл бұрын
We upgraded our platform after realizing the quality issues and will be reshooting the content soon.
@chrishanni2779
@chrishanni2779 2 жыл бұрын
great video: can you do the next ones at higher resolution so we can read the code
@davyroger3773
@davyroger3773 Жыл бұрын
Seconded!
@Astronomer
@Astronomer Жыл бұрын
Definitely, thanks for the feedback!
@md.shahriarrahmanrana3866
@md.shahriarrahmanrana3866 3 жыл бұрын
Can you please provide the files used here, its unclear and not readable at all :(
@Astronomer
@Astronomer 3 жыл бұрын
You can find the example DAGs linked at the beginning of this article: www.astronomer.io/blog/dag-writing-best-practices-in-apache-airflow
@majorcemp3612
@majorcemp3612 3 жыл бұрын
The link is broken "404 error"
@bitsofinfo8934
@bitsofinfo8934 3 жыл бұрын
@@Astronomer where are the examples? there is no github link or source code in the link you have...
@cherrejim
@cherrejim 3 жыл бұрын
Interesting but the quality of the video is very bad... but thanks for the content. What's is the best practices for historical loads? Make sense have a dag that will only execute once? Thanks
@Astronomer
@Astronomer 3 жыл бұрын
We upgraded our platform after realizing the quality issues and will be reshooting the content soon.
@majorcemp3612
@majorcemp3612 3 жыл бұрын
Hi, when is the "soon" ? 😅 It seems that a lot of people are waiting for a fix of this bad quality video 😅
@brendoaraujo9110
@brendoaraujo9110 2 жыл бұрын
Hello, I have an airflow running on my machine with Postgresql on the scheduler's backend and LocalExecutor, but when I put my dags to run it consumes a lot of server CPU, how could I solve this high consumption problem?
@ayushm777
@ayushm777 3 жыл бұрын
How to get the different log and error info in two different files instead of one common log.?
@harshitsinghai1395
@harshitsinghai1395 3 жыл бұрын
at least use 720p
@vahidshoeibinia498
@vahidshoeibinia498 3 жыл бұрын
360p?????????
@erkansirin6849
@erkansirin6849 3 жыл бұрын
Codes are not readable \:
Best Practices For Writing DAGs In Airflow 2
46:24
Astronomer
Рет қаралды 10 М.
TaskFlow API in Airflow 2.0
56:27
Astronomer
Рет қаралды 11 М.
“Don’t stop the chances.”
00:44
ISSEI / いっせい
Рет қаралды 62 МЛН
Airflow on Kubernetes: Containerizing your workflows
1:01:27
Apache Airflow
Рет қаралды 19 М.
Airflow for Beginners - Run Spotify ETL Job in 15 minutes!
16:38
Karolina Sowinska
Рет қаралды 144 М.
How to write your first DAG in Apache Airflow - Airflow tutorials.
10:47
Qubole: The Cost-Efficient Data Lake
Рет қаралды 113 М.
Airflow 101: Essential Tips For Beginners
52:12
Astronomer
Рет қаралды 7 М.
The Newcomer's Guide to Airflow's Architecture
27:26
Apache Airflow
Рет қаралды 24 М.
Introduction to Apache Airflow [Webinar]
53:26
Astronomer
Рет қаралды 9 М.
“Don’t stop the chances.”
00:44
ISSEI / いっせい
Рет қаралды 62 МЛН