AWS Tutorials - Using Apache Spark in Amazon Athena

Amazon Athena is a serverless, interactive service to query and analyze data stored in Amazon S3 and other data sources. In addition to SQL based query, Amazon Athena now supports Apache Spark as the engine which allows to query and analyze data using Spark Scripts. Learn how to configure and use Amazon Athena with Apache Spark.

[@hyju9260]

great video, super clear and answers all question I may ask.

[@cheluvesha]

Sir, Dev endpoint is legacy now. Thanks for the video

[@AWSTutorialsOnline]

Yes, it is. But I don't think there is anything which allows local development like Dev Endpoints does.

[@tcsanimesh]

Thanks

[@AWSTutorialsOnline]

Welcome

[@sheikirfan2652]

Great video! One question here is that I an getting error when i am trying to setup a Glue catalog to query my glue tables(I have given full access to Glue and S3 and also added Glue service in trust relationship)

[@sheikirfan2652]

Also one more question, we already have spark notebooks available with Glue and Sage Maker then in what use case we should select this one

[@anuradha6892]

Thanka!

[@kavithakr2362]

shall i know the difference of using apache spark with glue and athena

[@AWSTutorialsOnline]

Difference it Glue used for job creation and Athena for adhoc query/analysis.

[@dhanshrigawli]

sir i have one doubt , Is Athena charge for queries while whil running with s3 data

[@AWSTutorialsOnline]

It is charged based on amount of data scanned for the query

[@faraheluasghiri5738]

Does anyone know how to run these spark queries from JS Lambda?

[@vvkk-vl9jw]

sir in account i dont have analytics engine spark as a optiion. i can only able to athena query engine version. and addition to that i dont have option of notebook in toggle menu.pls guide me.

[@vvkk-vl9jw]

got it in mumbai region spark is not available

[@AWSTutorialsOnline]

I was expecting it to be a regional availability