AWS Glue Tutorial for Beginners [FULL COURSE in 45 mins]

ℹ️ johnnychivers.co.uk
☕ www.buymeacoffee.com/johnnych...
📁 github.com/johnny-chivers/glu...
☕ www.buymeacoffee.com/johnnych...
00:00 - Intro
00:36 - Note About Job Tab Locations
01:01 - Course House Keeping
02:11 - Course Overview
03:07 - What is AWS Glue?
04:03 - Why use AWS Glue?
04:44 - Set Up
09:32 - AWS Glue Data Catalog
12:05 - AWS Glue Databases
14:40 - AWS Glue Tables
15:57 - AWS Partitions
18:00 - AWS Glue Crawler
18:33 - Create Table In The Glue Data Catalog
25:37 - AWS Glue Connections
27:19 - AWS Glue ETL Job
34:41 - AWS Glue Triggers
39:23 - AWS Glue Dev Endpoints
40:44 - Outro
In this course we take a look at AWS Glue in full using the console. In under 45mins we go from zero to hero. The course covers the AWS Glue Data Catalog, AWS Glue ETL, AWS Glue Triggers and AWS Glue Dev Endpoints. We use the customer CSV data, available on my GitHub, to create S3 backed tables before ETLing this data into Parquet format.
😎 About me
I have spent the last decade being immersed in the world of big data working as a consultant for some the globe's biggest companies.My journey into the world of data was not the most conventional. I started my career working as performance analyst in professional sport at the top level's of both rugby and football. I then transitioned into a career in data and computing. This journey culminated in the study of a Masters degree in Software development. Alongside many a professional certification in AWS and MS SQL Server.

[@sayakutube]

you were preparing the video when the entire west world was yelling "Happy New Year"! Great commitment and awesome result!

[@TerminatorAyan]

in 41 minutes, I never knew I can gain this much knowledge and at least be ready with AWS glue as we are in a transformation project. It really helped, thank you so much!

[@farhodotaboev3324]

If you had watched with 1.25 playback speed, it would take you 33 minutes

[@martinvuong6652]

Such an amazing tutorial! Thanks for getting this together. Looking forward to more content.

[@adeyemitunji343]

This the most detailed AWS glue video i have ever seen. Keep up the great work Johnny.

[@Josh-og9eo]

So excited to find this channel. Looking forward to watching all your videos!

[@waeldimassi3355]

Amazing content by far !! Please continue with Glue. Never seen such high quality tutorial :D

[@JohnnyChivers]

Thanks for watching

[@hankbirkdale2154]

One of the best tutorials I've ever seen - let alone on a topic that is not easy.

[@roarmarketingconceptsllc5074]

This was a great tutorial! I really learned a lot about AWS Glue and I plan to leverage this knowledge to be more effective in my job tasks. Thanks so much, Johnny!!

[@gabesusman4592]

this channels a great resource for learning data engineering on aws, it's been a big help. Keep up the good work Johnny!

[@ThanhTran-wf2jf]

This is one of the best tutorials i've seen in youtube videos. Very well-explained, very useful. Thank you for uploading this!

[@JohnnyChivers]

Thanks for the comment and supporting the channel.

[@lyndsaymizen1881]

Great intro to AWS Glue for someone who's never seen it before. Needed to know these basics as we're moving to Glue for our data transformation/warehousing and this video does just that! Thanks!

[@JohnnyChivers]

Thanks for watching Lyndsay!

[@Pavan-kn5pg]

One of THE BEST videos on AWS Glue. Thank you Johnny :)

[@asifalimir3043]

Such an amazing video. Gives end to end idea about Glue in just 45 mins. Keep it up.

[@bitashamsss]

fantastic video, very helpful and useful. Looking forward to seeing more. keep up the great work and thank you so much.

[@EEdgerocks]

excellent Glue tutorial .. One of the best I have come across which teaches in a composed pace and easy to pickup for anybody

[@JohnnyChivers]

Thanks for watching!!!

[@akashdasgupta5088]

This is one of the best AWS Glue tutorial that I've come across on KZbin. Totally worth a like and sub❤️

[@JohnnyChivers]

Thanks for the sub!

[@JulioSerratos]

This tutorial is pure gold. Thanks

[@augustogoldner4267]

That was fantastic, mate! Thank you very much for sharing your knowledge!

[@vedprakash9413]

41 minutes was sufficient for me to get hands-on AWS glue. Thanks, Johhny for this awesome tutorial.

[@JeffLentz]

Fantastic! Thank you for putting this together. It helped me a lot.

[@davidlean8674]

Great & comprehensive coverage of AWS Glue. I was hoping it did much more. Makes you appreciate how much easier, faster & cheaper it is to develop in Azure DataFactory. Where a single pipeline can consume multiple different CSV files, parse the filename, figure out the metadata on load, & redirect the output based on lookup parameters. All graphical or generated via script.

[@DataEngUncomplicated]

Hi David, This video did not cover AWS Glue Studio which provides more of a compressive graphical interface that I think would be more comparable to Azure Data Factory.

[@vamsikrishna5950]

Awesome content!! Appreciate the effort. Thank you

[@ToddCunningham]

right when i needed this, always amazing content

[@JohnnyChivers]

Thanks for watching Todd

[@Rk23able]

Wonderful and neatly described in such a short video

[@ryoutausami6817]

Thank you. This is an awesome introduction to AWS Glue for beginners.

[@guilhermejf8642]

I just can't believe it's free here on KZbin! Great content, very well explained. Thanks!

[@JohnnyChivers]

Thanks for watching the video and a supporting the channel!

[@jeevangangavarapu8683]

Excellent work Johnny. Keep continuing the work .

[@JohnnyChivers]

Thanks, will do!

[@diegogiardini]

It was very usefull for someone who is starting with AWS from scratch! Thank you :)

[@obedrajugantala3489]

Good tutorial. I was able to follow and execute. Thanks Johnny!

[@GauravSakhuja]

Great tutorial in 40 mins you covered everything essential in Glue 👏

[@sriravi815]

Thanks for nice video, it helped me understand glue and setting up the pipeline in aws.

[@SungSam-wz2vk]

Awesome. I've never met people like you that you're so young with solid data science & aws skills.

[@JohnnyChivers]

Thanks Sung!

[@PURAMSAIPRIYA]

Thank you for this video, it is very helpful gives a clear glimpse of AWS glue. This is a very important video for me for the interviews :)

[@debarshiacharya3729]

This was a really nice video. Lot of learning within a very short time. Thanks

[@hemantmattoo]

Very nice and easy to learn video especially for begineers. Thanks for posting this.

[@venkatrao7868]

You are amazing and a natural teacher !!

[@1209youandme]

Superb course, covering all features with examples

[@JohnnyChivers]

Thanks for comment.

[@ryanshuell]

Very well done! Thanks for sharing this!!

[@mohamedyasser5285]

Fantastic video, going to binge-watch your videos for the next few months!

[@JohnnyChivers]

Thanks for watching.

[@vjsnapp8178]

Amazing Content and style of teaching, Thanks a lot for making these videos.

[@sagnikmukherjee5108]

Thoroughly enjoyed, Thanks.

[@robdood2]

Thanks for this! So much better explained than AWS's own tutorials!

[@lucasmatborges]

Excelent tutorial. I made three others courses before that and only with this that I understead complete this tool

[@vrlchebolu]

Great intro on AWS Glue! Thanks!!

[@nishaddheeraj2]

really amazing and fun learning with Johnny :)

[@adarsharora6097]

Thankyou so much. Very informative Johnny!

[@chamila.fernando.us2fernan663]

You are Awesome. watching in 2024... ETL steps needs minor updating but I was still able to follow ! Keep up the great work !

[@KoEDeath]

Impressive free content. Thank you!

[@JohnnyChivers]

Thanks for watching

[@shadabbigdel5017]

Thank you very much for you great explanation and hands-on! It was very useful for me.

[@muadddib4734]

Excellent content! Hope you keep it coming. I just subbed

[@JohnnyChivers]

Thanks for watching.

[@gabrielegbenya7479]

Great content! very educative and informative.

[@JohnnyChivers]

Thanks for watching the video.

[@gonzalea35]

This was awesome explanation of glue, thanks.

[@ishabisht3685]

Thank you very much, it was very helpful video to learn end to end AWS Glue. 🙂

[@qadiralidanish7529]

Awesome tutorial.

[@ateshhastam]

Nice session. Thanks!

[@deetechbee]

awesome video!

[@ahmeddadjio2003]

Amazing video👏

[@junaidraza6774]

I am not sure, does anyone said this before or not, but i wanted to say, You are a rock start.

[@javiermadriz7834]

Great video for beginners I hope to build some projects for keep learning

[@TheSimpGatsby]

thanks mate, u made my day.

[@whitewalker7750]

great content keep up the good work and I understood every concept thanks

[@JohnnyChivers]

Great to hear!

[@ravulasandeep2512]

Really Awesome!

[@patriciacafundo1626]

Very good course, gave me a good view of glue AWS service

[@augustocarrillo5927]

I don't like subscribing to people but lit I wouldn't be able to learn aws without you. Best and unique content

[@kicknotes]

Good video. Thanks for this!

[@picassoofai4061]

Great Job, Thanks

[@PatrickMcDonoughVanWash]

Highly recommend!

[@mgd.kn111]

Love this tutorial, thanks!

[@JohnnyChivers]

Thanks for watching!

[@anarossetto2742]

wonderful tutorial, great explanation, thank you! Unfortunatly aws glue job console has changed a lot and I could not finished the tuto :(

[@guilhermmontealto2160]

huge fan from brasil, thank you for your great content, it helped me a loooot

[@LoveisHell85]

Amazing content. Thank you

[@victors9585]

Johnny, you ROCK, man!!! 🔥👏🔥👏🔥👏🔥 Thank you so much and please don't stop spreading the wisdom of the GURU!!!! 🙏🙏🙏👍👍👏👏🚀🌟

[@kjewelson]

happy new year

[@maryo1134]

Amazing teacher..Many thanks for this

[@JohnnyChivers]

Thanks for watching.

[@StephenGillie]

Troubleshooting tip for especially complex environments: If the user has access to ALL S3 locations in the table, then Glue will assemble the table for Athena to query. If even one S3 location can't be accessed by the user, then the table won't show up in Athena. Hope this helps complex schema lovers.

[@JohnnyChivers]

Good tip.

[@AvinnashP]

excellent video on glue

[@KayYesYouTuber]

Fantastic!

[@DeepakkumarSLatentView]

just amazing 🥳

[@ammar9700]

Nicely done and explained. I have done my first AWS Glue job, without any issue... thumbs up bro 👍

[@JohnnyChivers]

Fantastic news Ammar!!

[@i_am_out_of_office_]

Very helpful, thanks :)

[@deepshah2137]

Just Awesome!

[@danielboza5747]

For me the most amazing thing is that he was working in the morning of January 1st. My respect! 😅

[@AdityaSingh0]

best video and very informative

[@Ajay-nc9yn]

I have spent many hours on Udemy for Glue Job and Glue data Catalog, but after watching your video. I must say Damn Good Stuff, Sir!

[@pnk]

As a skilled Ops Engineer / Developer i have search for infomartion about whats Glue and how its working in the basic and thanks so much for your video, its late me understanding the basic about what Glue are and whats it can be used for, :)

[@balledachandrahas8326]

Super helpful.... Thank you so much.

[@JohnnyChivers]

Thanks for watching!

[@didier566]

Awesome content. Thank you

[@JohnnyChivers]

Thanks for watching.

[@ambhat3953]

Very helpful for my studies

[@Maxiker21]

Great stuff

[@tullez01]

Amigo, muito obrigado pelo vídeo... Ficou ótimo! Abraços! Dear friend, thanks for this video. It's really great, helped a lot... Hugs from Brazil :)

[@rodrigoschammass5205]

cool!! congrats😃

[@gauravseth7757]

Great tutorial 😀

[@JohnnyChivers]

Thanks for watching!

[@warrrioronwar]

great tutorial

[@prajwaltidke1435]

Amazing 🤩

[@bernardogarciadelrio3630]

great content! Thanks!

[@JohnnyChivers]

Thats for watching!

[@Essentialliv52]

Amazing.

[@jackthewisedog5171]

great content thanks

[@user-xi4wh5sd2z]

You are my hero!!! That is so so so good!!!!

[@JohnnyChivers]

Thanks for watching

[@bmcseal01]

Excellent work.

[@JohnnyChivers]

Thank you! Cheers!

[@WithAshGoPlaces]

Great Tutorial, Thank you

[@JohnnyChivers]

You are welcome!