Hadoop Distributed File System (HDFS)

  Рет қаралды 74,081

Data Engineering

Data Engineering

Күн бұрын

Пікірлер: 66
@asish.02
@asish.02 2 жыл бұрын
You are really doing a wonderful work bro. There are a lots of people, doing podcasts, sharing roadmaps and etc. But you have understood the problem of newbie like us to this field. Huge respect for your hardwork brother 👍🏻👍🏻👍🏻👍🏻
@mamadouaw3129
@mamadouaw3129 Жыл бұрын
Since I discovered your chanel , I never missed any second in your videoes . never had such a full of quality information about big data
@sudhanraj7163
@sudhanraj7163 9 ай бұрын
glad that very minutes are explained, especially the detailing over zookeeper L&F allocation over Leader failure.
@yashwantdhole7645
@yashwantdhole7645 2 жыл бұрын
Lovely video brother. We need more people like you on KZbin. You were not in a hurry, you were calm, composed and clear with what you were saying. Understood 100% of what you said.... God bless you... 🙏🙏🙏🙏🙏
@lavesh90
@lavesh90 3 жыл бұрын
Content quality is one of the best on KZbin on Big Data related Technologies. Really appreciate your knack to share minute details. If you can get the drawing bigger and neatier, that would be icing on the cake. Cheers 🍻
@sundsrik2154
@sundsrik2154 Ай бұрын
For a 7 years experience guy, your knowledge is exceptional
@veerendranathn
@veerendranathn 5 ай бұрын
Thank you so much sir for your knowledge share
@dataengineeringvideos
@dataengineeringvideos 5 ай бұрын
🤗
@ittecheval1868
@ittecheval1868 3 жыл бұрын
Realy nice explation, and that give more confident to face interview. I have to appreciate, the way you tell one after another topic with need.
@jaymakam9673
@jaymakam9673 2 жыл бұрын
I am banging my head since the last 3 years around big data... Finally I think I can stop banging it... Thank you Goutam for this video & saving my head.....🙏
@tejaskl9550
@tejaskl9550 3 ай бұрын
I wish I found this video earlier. Thanks for the video!
@zafarkheshki2670
@zafarkheshki2670 2 жыл бұрын
A great explanation. I am sure many have and will benefit from this content.
@googlemani
@googlemani Жыл бұрын
Good work bro. Well explained the HDFS in a clear manner. Thanks for the video.👏
@sairamanamara5335
@sairamanamara5335 3 жыл бұрын
Well Explained ..really helps in understanding the Basics of this tech stack.
@korchageen
@korchageen 3 жыл бұрын
People like you from industry should teach in the universities as a guest faculty
@alinawaz8147
@alinawaz8147 2 жыл бұрын
Hey hello brother A big thanks to you from bottom of my heart your explanation and in depth intuition is just superb I gone through many videos and other online platform none has explained in the manner you did😊😊 Thank you For your efforts to make this video and sharing your valuable information 🙌🙌🙌
@RiaNadar
@RiaNadar 2 жыл бұрын
Supera explain pannirkinge sir
@SSRKFJ
@SSRKFJ 3 жыл бұрын
Excellent... Pls continue sharing your knowledge
@surajpatil3579
@surajpatil3579 3 жыл бұрын
Amazing explanation.. I appreciate your work 🙏🙏
@ambeersrikanth8585
@ambeersrikanth8585 Жыл бұрын
excellent dear good teaching...
@AngamVijaykumar
@AngamVijaykumar 2 ай бұрын
Bro what is read / write words related to big data
@aditipandey1769
@aditipandey1769 5 ай бұрын
But sir, you said that slave nodes don't communicate with each other, then how come pipeline is able to distribute the data among other nodes. pls refer to 50:29
@dataengineeringvideos
@dataengineeringvideos 5 ай бұрын
hey bro , I have answerd for that question in the same video, not sure about exact minutes , but i will clarify here , so when I say no communication that means they dont share heart beats , but the data pipeline will happen via them and the pipeline control is with the client api , not the slave nodes , hope this answered for your question , thanks :) :) :)
@sasank411
@sasank411 3 жыл бұрын
really great help... now I understood Hadoop Architecture (write and read flows).. Can you do a video on How to write/read data from HDFS using Python.?
@chandramouli1330
@chandramouli1330 6 ай бұрын
Great, Nice explanation. thanks for the video.
@MadhukumarMogulla
@MadhukumarMogulla 11 күн бұрын
brother you told there is no direct communication between the master and the slave node and the communication only happens between the client and slave and then client and master, but you mentioned the Heart beat that the communication happens between the master and slave for every 3 seconds, im confused here, please give replay here
@dataengineeringvideos
@dataengineeringvideos 11 күн бұрын
Brother , I said no direct communication between slave to slave only , Master to master always communication will happen
@sanandhakumar5132
@sanandhakumar5132 3 жыл бұрын
Excellently explained. Map reduce ku video pannunga bro.
@satyadommeti
@satyadommeti 3 жыл бұрын
regarding replication. You said 1Actual + 2 Replication. However, in the example i see 1 Actual + 1 Replication of block b0 ? When you say 2 Replication there will be only 1 copy of b0 block ?
@AniketGupta-et7zw
@AniketGupta-et7zw Жыл бұрын
Hi i have a doubt. Let's say on my laptop i have hadoop ecosystem installed and I am working on a project. I have saved 1gb of data so will that 1gb of data be replicated ???
@supriyajadhav2325
@supriyajadhav2325 3 ай бұрын
Can you pls provide the notes for the same
@MohamedFazan-w2y
@MohamedFazan-w2y 6 ай бұрын
Great explanation bro
@alikarooni9713
@alikarooni9713 2 жыл бұрын
Very nice explanation. Thanks
@rohitbhagwat3031
@rohitbhagwat3031 3 жыл бұрын
Great explanation , keep it up!!
@aniketpant9337
@aniketpant9337 2 жыл бұрын
your content is very good.I want to ask a question that is edge node can be called as client node because it is handling all client request.
@aniketpatil4217
@aniketpatil4217 2 жыл бұрын
Great explanation bro...
@done8959
@done8959 3 ай бұрын
so if one node sends multiple requests simultaneously , are different APIs created for each request or each node gets one only? @Data Engineering
@dataengineeringvideos
@dataengineeringvideos 3 ай бұрын
No each node will get multiple request
@BharathKumar-mq1fs
@BharathKumar-mq1fs 3 жыл бұрын
Awesome explanation bro!
@swathipanguluri3992
@swathipanguluri3992 3 жыл бұрын
Really nice explanation.
@ronakchitlangia3643
@ronakchitlangia3643 4 ай бұрын
Hey do you provide any course for Hadoop
@dataengineeringvideos
@dataengineeringvideos 4 ай бұрын
no bro
@as9552
@as9552 2 жыл бұрын
At 46.35 sir I am get confused replica ( 1 + 3) total 4..... Or 1 + 2 total 3... Plz guide...thankx
@anshumishra5107
@anshumishra5107 2 жыл бұрын
1 main + 2 copies (in total 3 replicas of a file) is stored if replication factor is set to 3
@venkateshvenky2880
@venkateshvenky2880 2 жыл бұрын
Great explanation 😍
@mustaphaafaynou5118
@mustaphaafaynou5118 3 жыл бұрын
Can u do how to code hdfs with Python for storage data
@dataengineeringvideos
@dataengineeringvideos 3 жыл бұрын
Sure
@mhaya1
@mhaya1 2 жыл бұрын
Thanks for sharing knowledge.
@Journey_OF_Karthi
@Journey_OF_Karthi 2 жыл бұрын
sir i want map reduce and yarn video !
@sathishp258
@sathishp258 3 жыл бұрын
Hi , your videos are very informative...i have been following your videos to learn HADOOP. Thank you Guruji how the Secondary Name Node in Hadoop 1.0 version works. will it not act as a backup once the primary goes down? plz help
@dataengineeringvideos
@dataengineeringvideos 3 жыл бұрын
In Hadoop v1 , Secondary namenode will never act as standby namenode , SNN is just used for checkpointing for the metadata
@kunalvijay7646
@kunalvijay7646 5 ай бұрын
Hi. Anyone here who made notes of the entire playlist ?
@ARATHI2000
@ARATHI2000 2 жыл бұрын
Very well done. Thank you!
@MrinalDas3107
@MrinalDas3107 3 жыл бұрын
Super content macha. loved it. Would love if you could post a roadmap specific to Azure Data Engineer Role. Thanks again Macha
@dataengineeringvideos
@dataengineeringvideos 3 жыл бұрын
thanks bro , sure :)
@SaichandChivukula
@SaichandChivukula 3 жыл бұрын
I tried to email to the given id but it bounced back, what would be the best way to reach you?
@dataengineeringvideos
@dataengineeringvideos 3 жыл бұрын
Pls reach at. linkedin.com/in/sbgowtham/
@swabigdata6782
@swabigdata6782 2 жыл бұрын
Thank you for your help hand
@عطاءمحمد-و3د
@عطاءمحمد-و3د 6 ай бұрын
Greeeeeeeat, thanks bro❤❤
@raviy10
@raviy10 2 жыл бұрын
Thanks a lot... Great video...
@ganeshdhareshwar6053
@ganeshdhareshwar6053 3 жыл бұрын
you are just amazing
@sreejithpeethambaran8156
@sreejithpeethambaran8156 3 жыл бұрын
Bro, thanks! its useful
@pulkitmohan92
@pulkitmohan92 2 жыл бұрын
Awesome 🙏🏻
@omkarm7865
@omkarm7865 3 жыл бұрын
Just 1 word....wow
@dipanjanghosh395
@dipanjanghosh395 2 жыл бұрын
Nice video
@subee128
@subee128 Жыл бұрын
Thanks
HDFS Quotas , Use Cases
12:54
Data Engineering
Рет қаралды 12 М.
Hadoop Distributed File System (HDFS) தமிழ்
1:39:43
Data Engineering
Рет қаралды 53 М.
It’s all not real
00:15
V.A. show / Магика
Рет қаралды 17 МЛН
Unboxing [Hadoop Framework]
22:55
Data Engineering
Рет қаралды 32 М.
Apache Hive Introduction & Architecture
17:40
Data Engineering
Рет қаралды 116 М.
Big Data Engineering Road Map
19:00
Data Engineering
Рет қаралды 136 М.
The Google File System - Paper Explained
1:15:34
Arpit Bhayani
Рет қаралды 33 М.
What is Apache Iceberg?
12:54
IBM Technology
Рет қаралды 33 М.
MapReduce Complete Video
2:04:16
Data Engineering
Рет қаралды 32 М.
Google File System - Paper that inspired Hadoop
12:26
Defog Tech
Рет қаралды 93 М.
Apache Spark Introduction
48:54
Data Engineering
Рет қаралды 60 М.
Understanding HDFS using Legos
15:03
InfoQ
Рет қаралды 150 М.