What is AWS Glue?

  Рет қаралды 219,832

Amazon Web Services

Amazon Web Services

Күн бұрын

Пікірлер: 77
@csie123
@csie123 5 жыл бұрын
Just a note: Organize/ move/ transform your data for (business/analyze use) 1. Serverless 2. Schema-Inference 3. Autogen ETL scripts ex: 1.ad-click log(JSON) : S3 2.user: RDS ToDo: schema/table -> catalog(目錄) ?: Run a script, transforming data(trim/throw away noNeed column), RedShift(data warehouse) console: intuitive graph(graph-base UI interface)
@adamtran5747
@adamtran5747 Жыл бұрын
thx man
@funkyos
@funkyos 7 жыл бұрын
He's great at writing backwards.
@pretheby212
@pretheby212 7 жыл бұрын
I agree.
@yesweet
@yesweet 7 жыл бұрын
funkyos don't think that's real, it might be post edit with some technics in which way for better readable presentation.
@rajeshthallam9298
@rajeshthallam9298 7 жыл бұрын
It's lightboard - a glass chalkboard pumped full of light. You face toward your viewers, and your writing glows in front of you.
@knappwurst
@knappwurst 7 жыл бұрын
I had to watch it twice as first time, I was distracted trying to figure out how this was done. Was thinking mirror, but thanks for the answer.
@0505sandr
@0505sandr 7 жыл бұрын
He's just writing normally, but then they mirrored the whole video
@leandromana
@leandromana 4 жыл бұрын
great and concise explanation related with Glue as ETL, Data Catalog as well as the integration with a Data Warehouse.
@admendoz25
@admendoz25 4 жыл бұрын
What a great short explanation of Glue!
@varuncanhandle
@varuncanhandle 4 жыл бұрын
Please create a tutorial on how to write backwards
@vitserp
@vitserp 10 ай бұрын
he writes as normal person, then in video postproduction it is mirrored.
@JeanAlesiagain3
@JeanAlesiagain3 3 жыл бұрын
I love the way he speaks English!
@harivgl
@harivgl 3 жыл бұрын
What are the differences between these 3: AWS Glue, AWS Data Pipeline, Informatica. What are the advantages/disadvantages of using each ? Also confused with Informatica as it has an Informatica Powercenter and Informatica Intelligent Cloud Services (IICS). Within AWS why does Glue and Data Pipeline exist as seperate services ? How will anyone choose between informatica and either of the AWS services ?
@sashafroyland
@sashafroyland 3 жыл бұрын
Wow! Talk about being simpler than Azure Data Factory. A++
@bencohenvi
@bencohenvi 3 жыл бұрын
1:48 where can I purchase those bracelets?
@Noname-yu8sx
@Noname-yu8sx 3 жыл бұрын
Those are not really bracelets. they are basically sacred thread that Hindus tie or it could also be 'Rakhi' which sisters tie to their brothers on an occasion called "Raksha Bandhan".
@chrisl.9750
@chrisl.9750 4 жыл бұрын
in all tutorials and presentations, I'm seeing the data source file being a tabular csv (or any other structured data). while the content itself (the values) might be messy, the format itself is very straight forward to work with. my question is: how is aws glue dealing with consistent, yet messy spreadsheets? you know, your usual business spreadsheets containing not tabular data, but formatted content that every sends around. those are a pain to process, not a usual csv that follows a pre-set structure. thank you
@TheReluctantCoder
@TheReluctantCoder 3 жыл бұрын
Yeah, mine is in json. :) Don't see much videos sharing how we can work with that. :(
@MrKane101111
@MrKane101111 6 жыл бұрын
Volume up please guys.
@marcosmit97
@marcosmit97 2 жыл бұрын
My biggest question is how do you write from right to left?
@anildasari
@anildasari 2 жыл бұрын
He was standing behind a transparent glass and wrote them on it the usual way, with his right hand. He was filmed from the other side of the glass. Then they flipped the image during the editing process. (That's why his shirt pocket, which should've been on the left side, appears on the right side in this video.)
@snoweepeaks
@snoweepeaks 6 жыл бұрын
I thinking of using Glue to prep data for machine learning. After training a model, could I then use the transform scripts to transform source data 1 record at a time, in real time to be ready for my model?
@jasonzhang6534
@jasonzhang6534 3 жыл бұрын
great explanation! It is very clear and concise!
@butterflymantis
@butterflymantis 4 жыл бұрын
Is it necessary to use redshift to store data? Is it ok to just use s3 buckets organize in folders for data storage since we have a glue catalog that can generate table definition and athena to for query analysis.
@externalbiconsultant2054
@externalbiconsultant2054 7 ай бұрын
how to schedule the ETLs ? and how to make different ETL's run in a specific order and a time. how to set dependencies between ETLs? Lot of gaps in this video
@awssupport
@awssupport 7 ай бұрын
Hi! Thanks for your feedback on the video. Please feel welcome to ask these questions on our re:Post platform: go.aws/aws-repost. You can also see this doc for more info: go.aws/45pA0o4.^NR
@shashikantkrishna4156
@shashikantkrishna4156 Жыл бұрын
How can we connect with local postgreSQL through AWS glue job?
@awssupport
@awssupport Жыл бұрын
Hi Shashikant, here's an article that might be just what you're looking for: go.aws/3qicskI. 🧐 If this isn't quite what you had in mind, our community of experts on re:Post may be able to weigh in & share their knowledge: go.aws/aws-repost. 🎓 ^AK
@shashikantkrishna4156
@shashikantkrishna4156 Жыл бұрын
@@awssupport Unfortunately - This is not helpful. Please guide!
@varunsood8509
@varunsood8509 6 жыл бұрын
How to do incremental loading while reading the data from database? Is there a way to create a filter on date while reading from source database?
@hariharanr4411
@hariharanr4411 5 жыл бұрын
hi, I got a similar use case, did you find a way to implement this increment use case using glue?
@nishantthakur2890
@nishantthakur2890 6 жыл бұрын
Thanks for the video. Can we create complex interfaces in GLUE which can be easily created in INFORMATICA PC. I mean does GLUE has same capabilities what PC has.
@nanapunewar8870
@nanapunewar8870 6 жыл бұрын
Hi , Can you please advise how to view UTF 8 encoded file on s3 to view using Athena ?? Looks like Athena does not support UTF 8 encoded file ??
@ProGuitarUA
@ProGuitarUA 4 жыл бұрын
omg how he draw the 3?? backwards? so we can see it thru transparent glass as normal? how it works?)
@kaisle8412
@kaisle8412 3 жыл бұрын
I'll give you a hint: he's right-handed.
@NutmegThumper
@NutmegThumper 2 жыл бұрын
Great explanation!
@twasden
@twasden 6 жыл бұрын
is glue hipaa compliant?
@saadabbasi2063
@saadabbasi2063 5 жыл бұрын
good question.
@dharam35
@dharam35 3 жыл бұрын
Very good session, thank you
@venuvenu5039
@venuvenu5039 6 жыл бұрын
may i know how to setup Glue?
@letslearnjava1753
@letslearnjava1753 3 жыл бұрын
Hello venu venu , if are still having the doubt, you can check this video--kzbin.info/www/bejne/n5THdX-HaLecb7M Happy Learning 😊✌🏻
@subbudreamboy007
@subbudreamboy007 3 жыл бұрын
Crisp and Clear
@WaitingHeartRavi
@WaitingHeartRavi 7 жыл бұрын
Can glue connects to Oracle ?
@isrraelmendoza92
@isrraelmendoza92 7 жыл бұрын
Yes you can provision an Oracle DB instance in AWS.
@Karthya
@Karthya 6 жыл бұрын
Yes, it supports JDBC interface
@varunsood8509
@varunsood8509 6 жыл бұрын
Did you figure out a way to filter only incremental data while connecting to database?
@ashisnaral
@ashisnaral 4 жыл бұрын
Its like one of those Bruce Lee movies where the English voice over is utterly out of sync.
@saadabbasi2063
@saadabbasi2063 5 жыл бұрын
Good service, but not a very good name for what it does.
@MarCastro-i1e
@MarCastro-i1e Жыл бұрын
Serverlessless -- misnomer name. There is a server running in the background forrrrrrr you.
@peteyjoe85
@peteyjoe85 Жыл бұрын
Impressed he could write backwards... oh wait they probably just mirrored the video
@sandortoth5243
@sandortoth5243 4 жыл бұрын
Nemen csinálom ok belépés atelefonomda es nem kapok eseményeket lesotetik akep ernyő es egyre elviselhetetlenül amagyar telekom hoz fizetek korlátlan deszelgetest es nem úgy működtetik a vételt én sok mindenről nem tehetek ok irányítanak mindent sajnálom ah lehet kerem akivizsgalast agogul deleszol esmar fenyeget
@tangobayus
@tangobayus 6 жыл бұрын
Choosing a Machine Learning Project: kzbin.info/www/bejne/bKeaZZmKms9lrqs
@antquinonez
@antquinonez 5 жыл бұрын
Hot dang. Step 1, Step 2, there's no Step 3.
@Sidrockfitness007
@Sidrockfitness007 6 ай бұрын
🙏
@raj-nq8ke
@raj-nq8ke 2 жыл бұрын
Their was no need for fake accent. But lecture was ok.
@Xantala
@Xantala 9 ай бұрын
Did you mean "There"?
@Xantala
@Xantala 9 ай бұрын
I would love to see you give a better lecture with your REAL accent.
@StephenSmith-ko5fl
@StephenSmith-ko5fl 7 ай бұрын
Mehuuuuuuuuuuulllllllllll !
@kiranmane8504
@kiranmane8504 4 жыл бұрын
His voice doesn’t match his personality
@data-dynamo-guy
@data-dynamo-guy 5 ай бұрын
Great explanation!!!
@amazonwebservices
@amazonwebservices 5 ай бұрын
Thank you. 😇
Top 50+ AWS Services Explained in 10 Minutes
11:46
Fireship
Рет қаралды 1,6 МЛН
To Brawl AND BEYOND!
00:51
Brawl Stars
Рет қаралды 17 МЛН
coco在求救? #小丑 #天使 #shorts
00:29
好人小丑
Рет қаралды 120 МЛН
Sigma Kid Mistake #funny #sigma
00:17
CRAZY GREAPA
Рет қаралды 30 МЛН
Tuna 🍣 ​⁠@patrickzeinali ​⁠@ChefRush
00:48
albert_cancook
Рет қаралды 148 МЛН
AWS Glue Tutorial for Beginners [NEW 2024 - FULL COURSE]
53:03
Johnny Chivers
Рет қаралды 10 М.
Working with AWS Glue Studio - Part 1
16:36
Amazon Web Services
Рет қаралды 117 М.
What is Amazon EMR and how can I use it for processing data?
9:02
Amazon Web Services
Рет қаралды 85 М.
Getting Started with AWS Glue Data Catalog
5:21
Amazon Web Services
Рет қаралды 54 М.
What is ETL | What is Data Warehouse | OLTP vs OLAP
8:07
codebasics
Рет қаралды 437 М.
Importing CSV files from S3 into Redshift with AWS Glue
17:04
Majestic.cloud
Рет қаралды 81 М.
AWS Glue ETL Vs EMR - Which one should I use?
8:05
Johnny Chivers
Рет қаралды 43 М.
AWS Glue Tutorial for Beginners [FULL COURSE in 45 mins]
41:30
Johnny Chivers
Рет қаралды 284 М.
AWS Redshift Service Overview
7:41
Be A Better Dev
Рет қаралды 62 М.
To Brawl AND BEYOND!
00:51
Brawl Stars
Рет қаралды 17 МЛН