What is AWS Athena? Service Overview

  Рет қаралды 43,472

Be A Better Dev

Be A Better Dev

Күн бұрын

Пікірлер: 24
@haluktutuk
@haluktutuk 2 жыл бұрын
Don't forget about the cost of API calls that Athena does to read from the objects stored on s3. If you have a bucket with too many very small files that becomes problematic and expensive. Larger (128MB - 256MB) and compressed (parquet, orc) file formats are preferable to avoid too many API call and consequently high cost.
@ruixue6955
@ruixue6955 2 жыл бұрын
0:33 Athena is serverless big data analysis tool 3:30 how it works
@quanhglam
@quanhglam Жыл бұрын
Good and concise explanation.
@BeABetterDev
@BeABetterDev Жыл бұрын
Glad it was helpful!
@farzadb
@farzadb 4 жыл бұрын
Great summary as usual! 👍
@BeABetterDev
@BeABetterDev 4 жыл бұрын
Thanks farzad! You the man!
@trimalakismeno
@trimalakismeno 18 күн бұрын
Thank you!
@uptowngirl1313
@uptowngirl1313 4 жыл бұрын
This was very helpful! Thank you:)
@BeABetterDev
@BeABetterDev 4 жыл бұрын
You're so welcome!
@yogithakakarla1716
@yogithakakarla1716 3 жыл бұрын
This is really helpful
@vinitsunita
@vinitsunita 3 жыл бұрын
When data gets loaded into database table if we are constantly inserting new files into s3 bucket ? I am assuming it is also possible that when we are submitting query to athena, internally it scans the s3 folder and loads that data into table and return us the result set. That might be the reason it is asynchronously processing the query.
@haneulkim4902
@haneulkim4902 4 жыл бұрын
Thanks for a great video! @3:01 you mention "perfect for infrequent queries" I am thinking of using Athena and Quicksight for daily reporting. Would that be a considered frequent and should use different service?
@BeABetterDev
@BeABetterDev 4 жыл бұрын
Hi Hanuel. I would consider your use case to be infrequent and would be a good candidate for Athena. Good luck!
@haneulkim4902
@haneulkim4902 4 жыл бұрын
@@BeABetterDev Thanks! Is there a way to automate athena query and visualize in quicksight?
@sparshkhurana5390
@sparshkhurana5390 2 жыл бұрын
@@haneulkim4902 use a lambda function and then use event bridge rule for automation. I think this will work.
@vinothsmart1
@vinothsmart1 4 жыл бұрын
if athena can parse the data and show the results synchronously then this would be a great tool. for now, nobody can wait for the results to arrive at S3 and see the data.
@BeABetterDev
@BeABetterDev 4 жыл бұрын
Completely agree with you Vinoth, that would be the dream!
@alexandersage967
@alexandersage967 3 жыл бұрын
@@BeABetterDev how did we step backwards. Immediate results should be expected in 2021
@pengli7213
@pengli7213 3 жыл бұрын
Let's say I have a 2 tables table1, table2. Each table has 1000 records. When I do a join on the 2 tables. At worst, it generate result with 1000*1000 number of records. Will Athena only charge by the size of 2000 records from 2 original tables, or Athena charge by the size of 1000*1000 records?
@Mahmoud-ys1kt
@Mahmoud-ys1kt 2 жыл бұрын
thank you
@haciendadad
@haciendadad 4 жыл бұрын
Can you do a video on Amazon's AppFlow? Thanks
@BeABetterDev
@BeABetterDev 4 жыл бұрын
Will add this to my todo list - thanks for the suggestion joey.
@vinothsmart1
@vinothsmart1 4 жыл бұрын
@@BeABetterDev Hi, I am waiting for the Amazon Appflow. fingers crossed
@farshadaghasharif2986
@farshadaghasharif2986 5 ай бұрын
How to Query Your DynamoDB Table with SQL using Athena
26:13
Be A Better Dev
Рет қаралды 16 М.
“Don’t stop the chances.”
00:44
ISSEI / いっせい
Рет қаралды 62 МЛН
Support each other🤝
00:31
ISSEI / いっせい
Рет қаралды 81 МЛН
Top AWS Services A Data Engineer Should Know
13:11
DataEng Uncomplicated
Рет қаралды 183 М.
AWS Redshift Service Overview
7:41
Be A Better Dev
Рет қаралды 62 М.
What is AWS Cloudformation?
28:07
Rahul Wagh
Рет қаралды 4,7 М.
Intro to Amazon EMR - Big Data Tutorial using Spark
22:02
jayzern
Рет қаралды 37 М.
AWS SQS Overview For Beginners
28:49
Be A Better Dev
Рет қаралды 134 М.
AWS Hands-On: ETL with Glue and Athena
22:35
Cumulus Cycles
Рет қаралды 33 М.
Intro to Amazon EventBridge
9:14
Amazon Web Services
Рет қаралды 116 М.