Complete Master Class on Pydeequ & AWS Glue Data Quality for ETL Pipelines

[@mohammadaftab5032]

thanks for this amazing content, expecting more videos on complex etl pipeline using aws glue

[@KnowledgeAmplifier1]

sure @mohammadaftab5032, Stay Tuned

[@sanjaybedwal2385]

Awesome work again . Please keep it up and educating us good stuff .love it

[@KnowledgeAmplifier1]

Thank you @sanjaybedwal2385 😊🙏

[@stanleysamy1769]

Great work all around! Thanks for all your time / hard work and I'm sure this will be very useful for many out there.

[@KnowledgeAmplifier1]

Thank you for your kind words @stanleysamy1769! Happy Learning

[@NaveenSabbarapu]

Great work your doing we are in position of integration of DQ checks to our Glue pipeline. Dilema in to go with Great Expectations or PyDeequ now it's clear.

[@KnowledgeAmplifier1]

Glad to hear this @NaveenSabbarapu! Happy Learning

[@NaveenSabbarapu]

@@KnowledgeAmplifier1 how much complex is the transition of data engineer to ML engineer as AI is must skill to add to our profile in the coming days any thoughts on this please?? Because the compensation has vast difference here in USA almost double they are paying for data scientist what we are getting as data engineer.

[@mk11_ftp51]

Can i list all failed records? Not just metrics using pydeequ?