How to Create Data Quality Checks in Snowflake Using Airflow!

[@manuelschipper]

Superb video! I would appreciate more of this kind of content with Airflow, Snowflake, and DBT

[@thedataguygeorge]

Amazing, have you seen my most recent video? It goes through exactly that! kzbin.info/www/bejne/jIjRkp6MdrlgeM0&lc=UgygxTnD2kJoJd0jxcZ4AaABAg

[@merhaiakshay9625]

Great , i need more content on Apache airflow, including the installation on a kubernetes cluster. Apache airflow is a great tool i believe but there is not so much content on youtube for easily learning it. Im happy with what you do and i thank you for that :)

[@thedataguygeorge]

I'm so glad! Have you checked out the Astro CLI? Makes it really easy to get started: docs.astronomer.io/astro/cli/overview

[@pyalgoGPT]

Can't resist to subscribe in the midst of watching this amazing , real world usecase.... Eager to see some real-time streaming data preprocess pipeline with data observable tool on top of it....

[@thedataguygeorge]

Ooooo real time streaming with observability is a great idea, will get on it!

[@planetnicky11]

sick!

[@thedataguygeorge]

Thanks!!

[@pyalgoGPT]

Post video on prefect also.... How to work with timesheets db like timescale db with data flow orchestration tool for log monitoring of like sensor data of vehicles or websocket data feed analysis for finding missing values or other quality checks, anomaly checks.... I believe your expertise can provide contents on above topics here with great quality

[@thedataguygeorge]

Definitely in the works, need to get up to speed on prefect! Would lineage be a data observability tool that would be interesting to you?

[@jafarakinfenwa475]

Very insightful! For the next videos, you can make the code in in them bigger

[@thedataguygeorge]

Yes definitely thank you for the feedback!

[@himanshu2787]

im confused can you help me out on what to learn and not there are so many videos i want to learn as an beckend dev

[@thedataguygeorge]

What do you want to learn? Would be happy to help!

[@himanshu2787]

@@thedataguygeorge i would like to learn pipeline scheduling automation data synchronisation to other areas and all thanks for the reply brother