Don't forget about the cost of API calls that Athena does to read from the objects stored on s3. If you have a bucket with too many very small files that becomes problematic and expensive. Larger (128MB - 256MB) and compressed (parquet, orc) file formats are preferable to avoid too many API call and consequently high cost.
@ruixue69552 жыл бұрын
0:33 Athena is serverless big data analysis tool 3:30 how it works
@quanhglam Жыл бұрын
Good and concise explanation.
@BeABetterDev Жыл бұрын
Glad it was helpful!
@farzadb4 жыл бұрын
Great summary as usual! 👍
@BeABetterDev4 жыл бұрын
Thanks farzad! You the man!
@trimalakismeno18 күн бұрын
Thank you!
@uptowngirl13134 жыл бұрын
This was very helpful! Thank you:)
@BeABetterDev4 жыл бұрын
You're so welcome!
@yogithakakarla17163 жыл бұрын
This is really helpful
@vinitsunita3 жыл бұрын
When data gets loaded into database table if we are constantly inserting new files into s3 bucket ? I am assuming it is also possible that when we are submitting query to athena, internally it scans the s3 folder and loads that data into table and return us the result set. That might be the reason it is asynchronously processing the query.
@haneulkim49024 жыл бұрын
Thanks for a great video! @3:01 you mention "perfect for infrequent queries" I am thinking of using Athena and Quicksight for daily reporting. Would that be a considered frequent and should use different service?
@BeABetterDev4 жыл бұрын
Hi Hanuel. I would consider your use case to be infrequent and would be a good candidate for Athena. Good luck!
@haneulkim49024 жыл бұрын
@@BeABetterDev Thanks! Is there a way to automate athena query and visualize in quicksight?
@sparshkhurana53902 жыл бұрын
@@haneulkim4902 use a lambda function and then use event bridge rule for automation. I think this will work.
@vinothsmart14 жыл бұрын
if athena can parse the data and show the results synchronously then this would be a great tool. for now, nobody can wait for the results to arrive at S3 and see the data.
@BeABetterDev4 жыл бұрын
Completely agree with you Vinoth, that would be the dream!
@alexandersage9673 жыл бұрын
@@BeABetterDev how did we step backwards. Immediate results should be expected in 2021
@pengli72133 жыл бұрын
Let's say I have a 2 tables table1, table2. Each table has 1000 records. When I do a join on the 2 tables. At worst, it generate result with 1000*1000 number of records. Will Athena only charge by the size of 2000 records from 2 original tables, or Athena charge by the size of 1000*1000 records?
@Mahmoud-ys1kt2 жыл бұрын
thank you
@haciendadad4 жыл бұрын
Can you do a video on Amazon's AppFlow? Thanks
@BeABetterDev4 жыл бұрын
Will add this to my todo list - thanks for the suggestion joey.
@vinothsmart14 жыл бұрын
@@BeABetterDev Hi, I am waiting for the Amazon Appflow. fingers crossed