AWS Tutorials - Access Glue Catalog using Amazon Redshift Spectrum

[@Omzodijacky]

Great tutorial i can see the schema created from the glue catalog but no the tables in it

[@ricardoevers5496]

Great tutorial! It helped me a lot. Greetings from Brazil my friend, it's just because there are people like you in the community that I'm able to improve my skills and knowledge with more accuracy and less brain aches. Thank you!

[@michaelrobinson9112]

You made this topic simple to understand. Thanks!

[@mohankewlani1357]

Extremely good tutorial. Loved the way you explained Redshift Spectrum

[@ladakshay]

Good explanation of the need for Redshift Spectrum and the demo.

[@AWSTutorialsOnline]

Thanks.

[@ankur1jain2soft]

Amazing clarity on service integration

[@AWSTutorialsOnline]

Thanks

[@swagatamchakraborty3352]

Thanks for this comprehensive tutorial on accessing Glue data catalog from Redshift spectrum! On this channel there is another video on accessing s3 data in Redshift using Redshift spectrum. Can you help me to understand what is the difference between these two videos since there also we are making use of Glue data catalog tables to access S3 data?

[@aksharjamgaonkar3672]

Hello, thanks for the video, very informative. would love to see a video about Serverless Redshift with focus on billing and usage limits. Thanks again.

[@AWSTutorialsOnline]

Sure - let me plan about it

[@pradnyavantkalamkar6936]

Thank You Dojo Sir...... Its very nice and informative explanation....We expect some more videos on redshift from you ......

[@AWSTutorialsOnline]

Sure. Please recommend some topics about Redshift.

[@priyanshubansal5517]

Really really nice and helpful video!

[@AWSTutorialsOnline]

Glad to hear that!

[@ryany420]

Hi AWS Tutorials, I am still confused of when to use Spectrum. Suppose I have star schema data warehouse on Redshift, should I put fact table or dim table into Spectrum for storage? or typically data warehouse has different layers eg: landing, staging, we just put staging layer of data into Spectrum? if you can answer my question, thanks

[@Habeshaanalyst]

Great content as always!!

[@data-freelancer]

Can we use python to query this awsdatacatolog

[@TimoKraus-sg2gk]

Cool Tutorial, thanks!

[@AWSTutorialsOnline]

Glad you like it!

[@sabyabera]

Excellent tutorial.

[@AWSTutorialsOnline]

Glad you liked it!

[@ladakshay]

My query: We see a lot of, new things added to Lake Formation and Glue and lot of promotion by AWS but I do not see any good tool to consume the final data created on this Data Lake. Athena's use case is for adhoc analysis and it has its limiations on the complex queries you can run and the number of parallel queries whcih can be run. So how do end users consume the data which is created on AWS Data Lake? Redshift Spectrum is one way but it needs a Redshift Cluster for it, if we create only a Data Lake using S3, what is the end user consumption method/UI? If I want to compare it with something like a DataBricks, what does AWS provide?

[@AWSTutorialsOnline]

Please explore Amazon QuickSight. Let me know if it helps.

[@ladakshay]

@@AWSTutorialsOnline Does it not proivde a dashboard and visualization experience? My query is how can Data Analysts run queries on the data to get useful information?

[@AWSTutorialsOnline]

@@ladakshay Glue is for catalog and ETL only. For visualization, you can use QuickSight which connects seamlessly to Glue Catalog and provides self service features.

[@prannoyroy5312]

Awesome video

[@hsz7338]

Thank you AWS Tutorials for the video. I was wondering do you have some info on their query performance difference: Query via Spectrum using Redshift Compute Power vs. Query via Athena?

[@AWSTutorialsOnline]

I am not aware of any public number. In Redshift, we can control compute; hence we can increase performance if we want. In Athena, we have no control to allocate compute. Let me think, if I can do apple to apple comparison and make video about it. Thanks for the feedback.

[@rishadm1771]

Amazing video thank you!

[@shankarmendyala9167]

If i have added multiple csv files in single folder. Does it get the output or not???

[@AWSTutorialsOnline]

You are working at catalog level. Catalog can handle multiple files. So in summary, Redshift will give output for the multiple files as well.

[@MathSquad_24]

Thank you, it was a nice video.

[@RichardPeterShon]

s3 is not a query engine.......???

[@harshvardhan1156]

Awesome

[@channuangadi7504]

crystel clear explnation