Right now try switching between Airflow and Prefect. Sometimes Airflow is a lil bit overkill for certain ETL/ELT operations. Much modular with prefect and more pythonic than Airflow I guess, coz developing ELT/ETL orchestration in Prefect feels less hassle than Airflow. Just based on my experience.
@MartinCharles4 ай бұрын
great instead of negative engineering i'm now spending my time configuring five thousand broken python dependencies fuck this i'll negative engineer any day over this mess