Amazon Redshift for Beginners (Full Course)

  Рет қаралды 32,241

ETL SQL

ETL SQL

Күн бұрын

Пікірлер: 61
@ETLSQL
@ETLSQL Жыл бұрын
Did you like this video? What else do you want to learn about AWS ? Drop a comment below.
@lakshmivaishnavi7547
@lakshmivaishnavi7547 7 ай бұрын
Why is no 'distkey' mentioned for other distribution styles like all and even?
@ETLSQL
@ETLSQL 7 ай бұрын
There are 4 options - distkey , all , even, auto. Key is applicable to only first option. Rest 3 distribution styles does not need any key for data distribution.
@sreechivukula8115
@sreechivukula8115 Жыл бұрын
Best 30min I have spent in recent days! Add next video with more details.
@ETLSQL
@ETLSQL Жыл бұрын
Thanks for leaving a comment. Any specific topic would you like me to cover next ?
@GouravSharma-us9yq
@GouravSharma-us9yq Жыл бұрын
I like the way you put lesson, simple, easy and clear in understanding, Thanks, GS
@ETLSQL
@ETLSQL Жыл бұрын
Glad you liked it 👍
@ETLSQL
@ETLSQL Жыл бұрын
If you like this video, please drop a comment to share your reaction. ❤
@verosirvi
@verosirvi Жыл бұрын
I like the distribution style of the content in this video and the way you chose to present it
@ETLSQL
@ETLSQL Жыл бұрын
Glad you liked it. 👍
@kolawolegabriel6558
@kolawolegabriel6558 7 ай бұрын
Excellent video i have ever watched on AWS Redshift, this is the best that Explained redshift in details
@ETLSQL
@ETLSQL 7 ай бұрын
Glad you liked it ❤️
@mohammedkaif5223
@mohammedkaif5223 2 ай бұрын
mind blown with some knowledge as beginner thanks a lot
@ETLSQL
@ETLSQL 2 ай бұрын
Glad you liked it 👍
@adityaf17
@adityaf17 Жыл бұрын
Hands on tutorial on Redshift will be the best one.
@ETLSQL
@ETLSQL Жыл бұрын
Noted. I do plan to work on that one in the coming weeks.
@ETLSQL
@ETLSQL Жыл бұрын
Hey @adityaf17 I am working on hands-on tutorial however redshift is not free and incur cost. Do you think people will be ready to shell some coins for the hands on tutorials ? Or would you prefer to have video like me doing the actual work and you just watching it ?
@sreechalasani9268
@sreechalasani9268 3 ай бұрын
Somehwat confused about your point that Redshift is a columnar database (so data is split by columns , rather than rows). Yet, in the 25:30 where you are talking about Distribution styles, the distribution is row based ?
@ETLSQL
@ETLSQL 3 ай бұрын
Hi, thanks for asking the question. Redshift is columnar, so while storing data in storage blocks, it arranges all column values together. This is the actual physical storage. Distribution style determines which slice will get what portion of table data. If you chose distkey then each slice will get some portion of table data depending on the key value. Say 4 slices and 12 rows. So each slice may save 3 rows, but physical storage will have column values together. Distribution determines spreading rows among the slices and columnar determines actual way of storing data in blocks.
@ShubhamPhadtare-o8l
@ShubhamPhadtare-o8l Жыл бұрын
Hats Of you sir, keep making content like this, Clear explanation
@ETLSQL
@ETLSQL Жыл бұрын
Glad you liked it. I remember this video took the most time I have invested in any video till date. Do you have any recommendations for next set of videos.
@sriharisrinivasan1307
@sriharisrinivasan1307 2 жыл бұрын
Enrolled to the course, Looking forward to gr8 and Informative content as always.
@ETLSQL
@ETLSQL 2 жыл бұрын
Hope you liked it
@arokiarajan1230
@arokiarajan1230 2 жыл бұрын
Superb... Good pitch
@aniketbahalkar223
@aniketbahalkar223 11 ай бұрын
Thanks for such nice video, please create a complete course on this.
@ETLSQL
@ETLSQL 11 ай бұрын
Hey @aniketbahalkar223 Can you suggest few topics that I shall cover in the course
@Atlas-ck9vm
@Atlas-ck9vm Жыл бұрын
Very clear and concise introduction to aws redshift.
@ETLSQL
@ETLSQL Жыл бұрын
Glad you liked it
@krishnasingh-tf9jw
@krishnasingh-tf9jw Жыл бұрын
Thanks for insightful tutorial. My only question is while going with distribution style key vs even will choosing key column distribute the rows and retrieve much faster than doing even distribution style as even will distribute evenly
@ETLSQL
@ETLSQL Жыл бұрын
Yes you are right. If you have distkey and you use that in the query, then it will return rows faster than even distribution style. You should be little careful while picking distkey column. Ideally it should be the one with unique values and used in the queries. Good luck.
@krishnasingh-tf9jw
@krishnasingh-tf9jw Жыл бұрын
@@ETLSQL Thanks for clarification
@prabhuthiyagarajan7437
@prabhuthiyagarajan7437 9 ай бұрын
Can same node slice share two different column values in case of same datatype?
@ETLSQL
@ETLSQL 9 ай бұрын
Yes it can. But remember data is distributed using distkey only.
@heetshah5923
@heetshah5923 Жыл бұрын
Is there any videos power BI + amazon redshift
@ETLSQL
@ETLSQL Жыл бұрын
Not sure about any video with power bi, generally teams prefer to use quicksight with redshift though.
@petersteelenator
@petersteelenator 3 ай бұрын
Such a wholesome session, pity myself it took a while for me to access this- top notch elucidation. Would you care for a rejoinder on a query? As much as clarity you have brought to the viewers on data sources and its ancillaries, I would like to bring up a nuance - If the source system places the data on a SFTP server (Batch running daily or weekly) and a file-based rule system helps the data to reach to S3 bucket and eventual journey to Redshift? Is that scenario possible?
@ETLSQL
@ETLSQL 3 ай бұрын
Yes it is very much possible. As soon as the file lands on s3 event is generated. This event can be used to trigger lambda function to run copy statement into redshift table. You can also create external table in redshift pointing to s3 path and as soon as file arrives you can see the data without loading as well.
@hafizadeelarif3415
@hafizadeelarif3415 5 ай бұрын
In AWS Redshift cluster, what is zero ETL and how does it work, sir?
@ETLSQL
@ETLSQL 5 ай бұрын
Hi Hafiz, Good question. Zero ETL is a concept that is gaining popularity especially in aws ecosystem. In simple terms, it means that you connect to source directly and read the data at run time rather than bringing in data from source through ETL process. In redshift, you can connect to different data sources like RDS , dynamodb and read the data directly via sql query. You don't have to create etl pipeline to bring in data from these sources. Additionally, you can read data directly from data lake via spectrum query. Also if other source has data in redshift then you can read data directly via datashare from your redshift. In short, zero etl means the capability to read data directly from the source without the need to build etl pipelines. I strongly believe this concept will gain even more popularity in the future.
@shakthimaan007
@shakthimaan007 5 ай бұрын
Hi, Can please post further videos on Redshift
@ETLSQL
@ETLSQL 5 ай бұрын
Sure. Any specific topic on redshift?
@shakthimaan007
@shakthimaan007 5 ай бұрын
@@ETLSQL Firstly, Awesome content as usual..! Can try to cover topics under CDC options in Redshift, Orchestrate the data movement to redshift, how Redshift can be integrated with other AWS systems, data recovery options, About redshift specturm and any PROD use cases.
@ETLSQL
@ETLSQL 5 ай бұрын
These are some good points. Noted.
@AllAboutDataTechnology
@AllAboutDataTechnology Жыл бұрын
good video, clear explanation of this topic
@ETLSQL
@ETLSQL Жыл бұрын
Glad you liked it 👍
@aykhan.g
@aykhan.g Жыл бұрын
Thanks for awesome video !
@ETLSQL
@ETLSQL Жыл бұрын
Woo hoo. Thanks for the comment. 👍
@maheshkumar.s2513
@maheshkumar.s2513 Жыл бұрын
Please provide a video on azure data factory like this with atleast ome example
@ETLSQL
@ETLSQL Жыл бұрын
Hey Mahesh, I am not planning to cover azure as of now. Will focus on general concepts and aws. Hope you find a suitable tutorial soon.
@adityaf17
@adityaf17 Жыл бұрын
Best one for Redshift!
@ETLSQL
@ETLSQL Жыл бұрын
Glad you liked it. 👍
@LoveisHell85
@LoveisHell85 Жыл бұрын
Very clear tutorial. Thank you
@ETLSQL
@ETLSQL Жыл бұрын
Glad you liked it. 👍
@SurajPatil14
@SurajPatil14 7 ай бұрын
Great 👍
@ETLSQL
@ETLSQL 7 ай бұрын
Thanks
@gloirebeya5127
@gloirebeya5127 Жыл бұрын
Thanks for your video
@ETLSQL
@ETLSQL Жыл бұрын
Glad you liked it 👍
@Piyushjoshi6767
@Piyushjoshi6767 9 ай бұрын
nicely explained
@ETLSQL
@ETLSQL 9 ай бұрын
Glad you liked it. Can you suggest me any relevant topic which I can cover next.
@andriys5772
@andriys5772 9 ай бұрын
Thank you!
@ETLSQL
@ETLSQL 9 ай бұрын
You're welcome!
What is Amazon Redshift | How to configure and connect to Redshift
26:54
AWS with Avinash Reddy
Рет қаралды 9 М.
AWS Glue Tutorial for Beginners [FULL COURSE in 45 mins]
41:30
Johnny Chivers
Рет қаралды 285 М.
How Strong Is Tape?
00:24
Stokes Twins
Рет қаралды 96 МЛН
Сестра обхитрила!
00:17
Victoria Portfolio
Рет қаралды 958 М.
Арыстанның айқасы, Тәуіржанның шайқасы!
25:51
QosLike / ҚосЛайк / Косылайық
Рет қаралды 700 М.
AWS Redshift Query Tuning and Performance Optimization
1:45:40
Aurobindo Saha (Auro)
Рет қаралды 46 М.
Getting Started with Amazon Redshift - AWS Online Tech Talks
46:39
AWS Developers
Рет қаралды 60 М.
Aws Redshift tutorial |Amazon Redshift Architecture | Data Warehouse Concept(Hindi)
1:28:06
What is ETL | What is Data Warehouse | OLTP vs OLAP
8:07
codebasics
Рет қаралды 438 М.
AWS Glue Tutorial for Beginners [NEW 2024 - FULL COURSE]
53:03
Johnny Chivers
Рет қаралды 11 М.
Top AWS Services A Data Engineer Should Know
13:11
DataEng Uncomplicated
Рет қаралды 184 М.
How Strong Is Tape?
00:24
Stokes Twins
Рет қаралды 96 МЛН