AWS Data Engineer Project | AWS Glue | ETL in AWS

[@namratachavan6317]

Your channel needs more appreciation.You are really teaching people valuable stuff😃

[@rajasekhar4023]

Hi, The way you are teaching learning by doing it is very nice n expecting more videos from you related on Spark, Hive and related to Data engineering projects. Thank you in advance.

[@karthikeyanudayakumar9553]

Excellent work 😊

[@babarhassan7726]

Well done mate, good work.

[@adityatomar9820]

Just one suggestion, Please do provide the github repo link tooo.....and also explain how to push these projects on github.

[@rajeevsinha2632]

Good demo dear, subscribing you as token of appreciation.

[@ayushsakure6098]

Great Work

[@pratinaik405]

well explained.

[@storageone6397]

I had done everything but at the end it's generating the file in the snappy format but the targeted format is csv

[@learnbydoingit]

Pls debug

[@storageone6397]

@@learnbydoingit It's working but it's generating .gz file in S3 how can we convert it into CSV?

[@learnbydoingit]

@@storageone6397 have u selected target file csv Or json

[@learnbydoingit]

@@storageone6397 ohh have you selected compress option

[@storageone6397]

@@learnbydoingit I have selected target file CSV and Compress option is 'None' and also checked in script which is auto generated by visual so there is also CSV and Compress is None.

[@olaabijo]

Thanks for your presentation.Please how can another glue can another glue?

[@harshitdtu7479]

output is with Snappy compression. how se se output in arvo format

[@learnbydoingit]

Compression u have to make none in sink

[@harshitdtu7479]

@@learnbydoingit can you please explain

[@gayatrikhandalkar8966]

can i add this project to resume?

[@learnbydoingit]

Yes

[@gayatrikhandalkar8966]

@@learnbydoingit Thank you Sir !!! And Can you upload more project videos on AWS Glue...

[@Sairam-c9g]

Is ETL job (Glue) not free with aws free tier? My job charged me with 1.60 $ bill.

[@harshitdtu7479]

same how to handle this?

[@charudattbelsare2903]

Hello, Is your udemy course available in udemy business?

[@learnbydoingit]

Not sure, need to check

[@Vilayat_Khan]

where is csv file?

[@bernasiakk]

ok

[@maihuire11]

Hello, where is the sample data?

[@learnbydoingit]

Please join the telegram group

[@sreevasudhavalli]

@@learnbydoingit can you send the link to teelegram group?

[@alekhprasadsahu6705]

provide source files

[@ravijade5848]

Add your script on comment. How would you expect everyone to have the script ready? Wasted my time in following this video.

[@learnbydoingit]

That is automated generated script

[@RaajKiranReddyAnumula]

@@learnbydoingit 🤣🤣🤣🤣🤣🤣

[@rohitpandey9920]

I am getting the following error at the end in AWS lambda when trying to run the code "errorMessage": "An error occurred (AccessDeniedException) when calling the StartJobRun operation: User: arn:aws:sts::888437166735:assumed-role/aws_glue_lambda/lambda_glue is not authorized to perform: glue:StartJobRun on resource: arn:aws:glue:us-east-1:888437166735:job/glue_project because no identity-based policy allows the glue:StartJobRun action", "errorType": "AccessDeniedException" Please help

[@learnbydoingit]

This is access error... U have to go to the role and need to assign policy of s3 and glue

[@shubhamroy1094]

yes it resolved@@learnbydoingit

[@harshitdtu7479]

@@shubhamroy1094 can u tell me how to resolve it