AWS Tutorials - AWS Glue Pipeline to Ingest Multiple SQL Tables

[@terrcan1008]

Thanks for great content. The videos in you content is relatable in terms of real world problems which is great. Looking forward to get more of like this and if possible put all these steps on your website as well as easy to compare during practice session. 😀

[@AWSTutorialsOnline]

Great to hear!

[@durgarasane-kolapkar1842]

very nice explanation and implementation... thank you so much !

[@khandoor7228]

Great content from new sub. Please do more big data stuff!

[@AWSTutorialsOnline]

Thanks, will do!

[@sonynavi]

Nice content. A video on CDC would be great.!

[@debaratiaich16]

Is that cost effective to have a single job running multiple times or multiple job runs once?

[@deveshv9273]

How to create parameterized AWS Glue Job but with CDC injestion, because in this case the job will be run continuously every 5 minutes to update data (or doing an Upsert). Is there a way to make upserts in a generic way (or parameterized way)?

[@mohammedkandelhassan]

Superb👍

[@AWSTutorialsOnline]

Thanks 🤗

[@nagarjunau1803]

Hi if orderdata failed to write into destination others will fail or flow is running

[@cassianocalimansantos5258]

Hello sir. Do you have any content about how to ingest from a external DB for the GLue ingestion job, using VPC (such as using a connection - MySQL or SQLServer datasource instead an AWS Redshift source)

[@veerachegu]

Can you pls do concurrent run on workflow also

[@AWSTutorialsOnline]

yes both Glue Workflow and Step Function can run concurrent.

[@Nobrezando]

I crrated a step function just like yours, but my step function is running forever

[@AWSTutorialsOnline]

not sure why. did you refresh the browser?

[@Nobrezando]

@@AWSTutorialsOnline I found out, when you create the IAM role for step functions, you also need to grant awsglue:getjobstatus in the policy