AWS Athena Tutorial l Athena Hands On LAB | Athena + Glue + S3 Data Lake | Athena AWS Tutorials

[@satishakuthota6290]

Hi Ajay Your teaching is superbbbb and please make more videos on analytics services in aws Tqq so much

[@AjayWadhara]

I am glad you liked it. I will be making more videos on AWS server less . Subscribe for updates

[@AakashKumar-by1jt]

@@AjayWadhara Thanks Ajay...This is the best piece I have found on you tube.

[@ultravidz]

Very valuable to see this process visually. Thank you

[@sudhirtandon5712]

Best tutorial on Athena, cleared all my doubts, highly recommend

[@ManojSingh-dm2jy]

Excellent video, I learnt Athena from here 👍

[@jayashreeavanthika4250]

Nice tutorial with clear explanation 🎉

[@SZ-ZS-]

small tip for anyone running into this issue. If you are uploading multiple .csv files they must be in their separate folder and you need to point glue to each of them in the step at 12:55 you would click "YES" and then point glue to the next folder

[@ayushvarma9657]

Crisp and clear 👌👌 Great job Ajay!

[@lawdale]

excellent video with superb explanation

[@AjayWadhara]

Thanks 🙏🏻

[@harshajammu]

Better than most of the paid tutorials out there! Please keep posting more videos.

[@AjayWadhara]

I will ✅✅ Don’t forget to subscribe 🚀

[@metaldragon24x7]

Very informative for a newbie - ty!

[@gauravmathur56]

Thank you for the video it helped me a lot . Thank you Ajay bhaiya .

[@AjayWadhara]

I’m glad you liked the video. Don’t forget to subscribe 🚀

[@mathivanan4239]

It's a very good on AWS Athena. Neat explanation and the demonstration is great.

[@AjayWadhara]

Thanks , I am glad you liked it.

[@saurabhagarwal5692]

Hi Ajay, Very informative video...Thank you so much..

[@AjayWadhara]

Thanks Saurabh, do check out other videos also. Don’t forget to subscribe, this keeps me motivated to publish more🚀

[@mounishgoud8417]

Explaination was very clear. Thank you AJAY

[@AjayWadhara]

Glad you liked it

[@uzairmustafa5844]

Thank you so much. This is an awesome video. Much appreciated!

[@thedarkknight579]

Thank You :)

[@nainabhartia9260]

Very nice tutorial.

[@Youtoo138]

Awesome

[@mrqmrq-cr2hq]

Excellent tutorial!

[@OludareBagbile]

Thanks so much bro for this tutorial. I have been having problem creating the output query bucket until I watched this video, thank you so much. Pls do more.

[@suchismitagoswami5609]

Great explanation. Thanks for sharing your knowledge. I found it really helpful

[@healthdatascience6577]

Thanks for this!

[@vammy55]

Great stuff and easy to understand.Thanks alot Ajay

[@pandiyarajs6464]

Excellent !!!!! Explanation you covered end to end :-) , Thanks a lot

[@ManojKumar-od7of]

Nice video Ajay it is really helpful to keep going on.

[@gnanieswaruduvengalasetty2790]

Nice explanation 👌 👍

[@AjayWadhara]

I’m glad you liked it. Don’t forget to subscribe ✅

[@govind274]

Good one

[@AjayWadhara]

I'm glad you like it.

[@KundanShahu]

Very informational for a newbie. Thanks, Keep Sharing :)

[@rajkante0793]

Superb tutorial.... Plz make more videos in depth on AWS

[@AjayWadhara]

Do subscribe and share ✅

[@akhilsingh5122]

Nice

[@AjayWadhara]

Do subscribe 🚀

[@bantimatrix]

Great Tutorial. Can you share some more briefs about partitions and where it using in athena.

[@AjayWadhara]

Partitions are most important thing when considering Athena as a Big Data querying tool. You can’t go to production without propers partitions in place as per your usage patter. I would suggest going through official AWS documentation.

[@kashif3683]

Yes, 10/10!

[@ashutoshsrivastava264]

Thanks for the knowledge transfer! it is to the point and very clear!

[@AjayWadhara]

Glad you liked it. 🤘🏻

[@manikumarsingh2823]

its great and you should make a video series of aws.

[@mattborisov]

Thank you!

[@morgann4276]

Great explanation, to the point and very clear!!

[@Ashok-oe3lo]

Thank you very much for your time, it was really helpful....

[@consistentthoughts826]

Hey Ajay, I completed your course on Udemy and it was good man!!

[@debasishghosh3958]

Nice Demo Ajay, help me a lot. Please let me know all your Video path for S3-Athena-Glue-Hive related.

[@yawarhumayun9847]

awasome

[@bennystow3720]

This is great thanks so much Ajay!

[@AjayWadhara]

Glad you liked it!

[@aneelakilaru8307]

Very nice explanation sir. Would you mind please make vedios on How to move data from on premises to Aws And how to build data lake in AWS. I know individual services in AWS but bit confusing about how to move data to AWS(means which service is best) Please sir

[@artemkovalenko7257]

Thanks, a great tutorial!

[@udayreddy3653]

Hi Ajay, Your explanation was too good. Can you please make some videos on Aws Glue architecture and hands on that would be great..

[@sujoydeypalta]

Hi Ajay, first of all, many thanks for such a detailed hands-on. Great!. How about a part 2 of the video by exploring further? I mean take the data from Athena table and put it into Quicksight and then to a BI report? That will close the circle. Looking forward to this request.

[@AjayWadhara]

Hey Sujoy, definitely I will come up with Athena Integration with QuickSight..Stay tuned

[@ashawareb]

@@AjayWadhara Looking forward to the video as well, I know it's been a year but will be great if you can post. Many thanks!!

[@ashwithchakinarapu3947]

Hi Ajay Your Explanation is awesome can you please add more videos on Analytics and S3 to cloudfront Thanks

[@AjayWadhara]

Definitely Ashwith...Stay tuned for more videos ✅

[@kitlabcinc3098]

Great job Ajay

[@techtransform]

Awesome explanation @ajay

[@AjayWadhara]

Thanks 😊 Don’t forget to subscribe and share 🚀

[@navarrodba]

Thank you for the valuable information

[@AjayWadhara]

Glad you liked it...Don't forget to subscribe and share

[@dipanjandeb5245]

Hi Ajay, Very informative video. Can you please post a video on Athena connecting with different data source other than S3.

[@AjayWadhara]

Sure Dipanjan, I will surely create one video for this.

[@srbhmtr]

Thanks

[@rawtigro]

Very useful

[@roxcy333]

10 out of 10 ,you covered the topics in best and simplest way

[@debg1424]

Great video. Can you please talk about Workgroup as well. ?

[@vaibhavtripathi200]

Great job bro

[@shovan3112]

So detailed & informative. You didn't skip any single point to cover. Really loveed it & could follow every single points that you covered. Good job brother. Keep uploadoing such videos.

[@RajeshKumar-br2vx]

Nice explanation bro

[@AjayWadhara]

Thank you 🙂

[@pepex90]

Hi Ajay Kumar!! It’s possible up to mdb files to S3 and work ETL with Glue ? Greeting from Chile.

[@dipankarmukherjee9337]

Very impressive Bro!!!

[@Pradify_AI]

Nice one brother! 🔥🔥🔥

[@ravishanker6003]

Thanks for such an awesome demo and explanation. just an query how can be specify the query result location before getting that error in athena

[@rupeshkumarsahu6869]

Now how to reflect the output into the quicksight?

[@amirkazemi2517]

Hi Ajay - can you do one on one training. I will pay for it of course.

[@naturebyprs]

Good presentation 👍

[@srinuchandra6008]

Good one bro

[@kavajvlogs1457]

Good presentation. How to you add PARTITIONS/modify to a table which was created used GLUE?

[@panupongsrithonratkul9231]

The beneficial of using glue is that we don't need to create all column manually isn't it? or Is there something more to using glue?

[@AjayWadhara]

This is just the tip of iceberg. Glue has all the features what an ETL tool provides.

[@roybudhaditya1726]

Good job buddy

[@vsr1727]

Thank you....

[@srbhmtr]

Can we have a complete course about AWS data engineering ? Ready to pay for it.

[@AjayWadhara]

Hi Saurabh, this is on my bucket list for long but not finding time for this :(

[@chidambaranathanmanian4183]

Hi Ajay, Could you Please provide the video on how to query Postgresql data in Athena (Postgres as a data source in Athena)

[@AjayWadhara]

Yeah..I can work on that...✅

[@chidambaranathanmanian4183]

@@AjayWadhara Thanks

[@sargambypabitra3678]

how to select single file from a folder to create athena table. I have folder with different files . I want individual tables for different files in same folder in Athena

[@raghunandanreddy9324]

Hi Ajay please help me in providing topic wise questions for aws associate certification

[@mvjrao123]

Nice one. That means we can use Athena without using Glue. So why should we use Glue in Athena?

[@AjayWadhara]

Glue is used for table metadata....Structure of table that you refer in Athena is stored in Glue. Glue is AWS' centralized Data Catalog. You can create tables in Athena by yourself, but consider other scenarios such as changing data in s3 (new columns , columns data types), federated queries. For all these scenarios we create Glue Data Catalog and in Athena we don't indulge into pain of DDL changes.

[@bighnarajraj]

Can we use glue for xml, rdbms souce types

[@rameshthamizhselvan2458]

The function of the crawler will provides the automated schema for our data. correct if I'm wrong...

[@AjayWadhara]

Correct

[@chaitanyabhadane2236]

Ur voice is too low.... But ur video is great buddy

[@AjayWadhara]

Thanks 😊 I have improved my voice in later videos. Do check the latest tutorials on Lambda✅ Don’t forget to subscribe 🚀

[@chaitanyabhadane2236]

Sry for this but we have trouble to listen due to low voice ur voice is proper to get understand..... Thank for

[@KundanShahu]

Nice video, but just one question.In real time scenario, do they use this Athena manually or will they encapsulate with any script to run as part of whole process, e.g. Lambda or anything ?

[@AjayWadhara]

Kundan, this Glue Catalog creation is a one time activity and you can set up crawlers manually. Otherwise you can use Cloudformation (cftemplate) to set up Athena automatically.

[@pyspark_datascience_Kittu]

How to copy multiple files into folder in crawler job using python and Athena glue

[@ramons.g5135]

Great video! Do you know if when using a crawler, can it automatically detect data partitions? Meaning if you specify the S3 path to a data folder, assuming we have year subfolders within that data folder, will it load the partitions for you or you have to do that manually? Thanks!

[@AjayWadhara]

It will load automatically Don't forget to subscribe and share ✅

[@mmahi2007]

Thank you its very nice explanation . my query is when run query from athena on Glue catalog table , the data will fetch from catalog table or in back end it will connect to S3 bucket and fetch data ?

[@AjayWadhara]

Catalog table is just metastore, it contains information about schema but actual data is in S3. Query will fetch data from S3 only

[@sakinafakhri1320]

How did you specify that the tables will be created in athena

[@sudiptabiswas5137]

Hi Ajay, thanks for the great video. I wanted to ask, if we could capture more metadata information in AWS glue catalog apart from just data types, can I manually feed in more metadata , and will it still hold when next time AWS glue updates the catalog. Thanks

[@siddhantgarg2051]

Hello! I did same as you did but while running query in athena, it shows "zero records returned". Kindly help in this.

[@aakanshapatil1932]

Hello sir please upload new more videos of aws

[@AjayWadhara]

Sure...Btw I uploaded one tutorial on SNS today, do check here kzbin.info/www/bejne/eHe4pqx3rraMja8

[@billmask]

DO you know where we can find an example with terraform to setup a simple environment? And use API to consume data from Athena?

[@AjayWadhara]

Not sure Bill

[@aaravbhateja4592]

👌👌👌👌

[@TheRed662]

Is it possible to query Athena from within Postgresql's sql session? Basically, I want to do SQL joins between Athena tables and RDS tables

[@AjayWadhara]

Hey, Thats possible Check Athena Federate queries.🚀

[@brendachirata2283]

Hello. New subbie here. I love your teaching. May I ask if it is possible to do preprocessing of many text files with anthena?

[@AjayWadhara]

Hi, you can use Lambda to pre process files on S3 put object or use Glue

[@shovan3112]

Can I request you for some detailed videos on Glue ETL transformations using pyspark as scripting language.

[@shovan3112]

Is that a yes I can take it as? Will you kindly make some videos on py spark coding in glue transformation examples?

[@19sangeeta]

Hi Ajay, Can we use Athena without Glue catalog, incase I want to use informatica EDC instead of Glue catalog?

[@jineshwarnoraje568]

Hey Ajay, superb video. Just want to ask that, can we use all the syntax available in SQL in Athena. Like creation of temp table, conditional & looping statements and dynamic query generation. Thanks in advance

[@AjayWadhara]

I will say.. Syntax is almost SQL like. For more details check this link

[@AjayWadhara]

docs.aws.amazon.com/athena/latest/ug/querying-athena-tables.html

[@pritamsarkar2075]

@@AjayWadhara thanks

[@spoorthysankuru168]

Hi Ajay, May I know how do we connect the glue crawler to Athena. You haven’t showed it. Should we click on the ‘Connect data store’ option?

[@AjayWadhara]

You don't have to connect Glue and Athena Glue is centralized data catalog. Database ,tables, views are automatically visible in Athena console.

[@spoorthysankuru168]

@@AjayWadhara thanks a lot. It was really helpful ✌🏻😁

[@AjayWadhara]

Subscribe and share...🎯✅

[@reemadass1824]

Hi Ajay, we are exactly doing the same but our requirement is we dump data related multiple events in s3 path and create a multiple athena tables for selective fields .. this filter condition how can we enable.. if u can help me with this..

[@AjayWadhara]

You can do segregation of your S3 files using Lambda function or use regex while giving path in Athena so that only files matching with the regex would be scanned

[@The_Meditech]

After running query how to transfer that in S3 (in target system)

[@AjayWadhara]

Output of the query is stored automatically in the Output folder specified, otherwise you can manually handle that part.

[@The_Meditech]

@@AjayWadhara thank you❤

[@kesanaresh9033]

Hi Ajay I have created a table in Athena but data is not coming It is giving message like zero records returned Can you please help me how to proceed to get the data

[@AjayWadhara]

Make sure your Glue schema is correct and you are specifying correct bucket

[@vibhorgupta8198]

if the file type is parquet, not CSV. Will the process is going to be the same and how the crawler is going to read a parquet file.

[@AjayWadhara]

Process would be exactly same. Crawler supports Parquet also. You don't need to handle anything explicitly

[@logan7814]

It is showing labelled error

[@akshikabishnoi9095]

Can anyone help in providing this csv?

[@jamieg1802]

old coworkers wont let me use my pc or get my work done, they only let me go to youtube

[@AjayWadhara]

Whats the point Jamie😃