AWS Tutorials - Build Enterprise Scale Python ETL Jobs using AWS Glue on Ray

[@jvmunhoz98]

Great video. I'm currently refactoring some python shell jobs into Ray cause most of them were getting a bit too big for just 1 DPU. But I'm having problems importing job parameters into the script. I usually import the getResolvedOptions function from the awsglue.utils library, but ray it doesn't support awsglue, which is odd. Should I add it manually or just use another method for importing job paramenters?

[@AWSTutorialsOnline]

Approach to retrieve the parameter is different. Check this link - docs.aws.amazon.com/glue/latest/dg/author-job-ray-job-parameters.html

[@KannanPoompatham]

Hi, I watched some of your videos and liked it, but I didn't see any videos that covers AWS Amplify. Do you want to cover that as well?

[@AWSTutorialsOnline]

Hi, unfortunately, I don't have expertise in AWS Amplify. Sorry about that.

[@KannanPoompatham]

@@AWSTutorialsOnline No Problem. Thanks

[@unw1718]

is there a way to add a vpc?

[@cheluvesha]

Brother Thanks for the video, When to use Glue and when to use EMR?

[@AWSTutorialsOnline]

Glue can be used only with Apache Spark and Python. While, EMR support additional frameworks such as Hadoop, Hive, Presto etc. So use EMR when you want to work on these framework other than Apache Spark and Python. Hope it helps.

[@cheluvesha]

@@AWSTutorialsOnline thanks it makes sense now.