Apache Hive Introduction & Architecture {தமிழ்}

  Рет қаралды 24,929

Data Engineering

Data Engineering

Күн бұрын

#hive #apachehive
Apache Hive Introduction & Architecture
Video Playlist
-----------------------
Big Data Shorts in Tamil - bit.ly/3v2aL8p
Big Data Shorts in English - bit.ly/3tVEs9T
Hadoop in Tamil - bit.ly/32k6mBD
Hadoop in English - bit.ly/32jle3t
Spark in Tamil - bit.ly/2ZzWAJN
Spark in English - bit.ly/3mmc0eu
Hive in Tamil - bit.ly/2UQVUgv
Hive in English - bit.ly/372nCwj
NOSQL in English - bit.ly/2XtU07B
NOSQL in Tamil - bit.ly/2XVLLjP
Scala in Tamil : goo.gl/VfAp6d
Scala in English: goo.gl/7l2USl
Email: atozknowledge.com@gmail.com
LinkedIn : / sbgowtham
Instagram: / bigdata.in
KZbin channel link
/ atozknowledgevideos
Website
codewithgowtha...
atozknowledge.com/
Technology in Tamil & English #DataEngineering #BigData #CloudComputing #DataAnalytics #ETLTutorials #SQLTutorials #DataEngineeringTamil #BigDataTamil #TamilTech #TamilTutorials #TamilITProfessionals #TamilDataEngineeringChannel #HadoopTutorial #ApacheSpark #FlinkTutorial #NoSQLDatabases #MongoDBTutorial #AWSDataEngineering #GCPDataEngineering #AzureDataEngineering #EngineeringStudents #TamilEngineeringStudents #ITCareerTamil #TechJobsTamil #LearnInTamil #TamilTechChannel
Tamil Data Engineering Tutorials, Best Tamil Data Engineering Channel, Data Engineering in Tamil, Big Data Tamil Tutorials, Hadoop Tamil Tutorials, Spark Tamil Videos, Flink Tamil Tutorials, Data Engineering Concepts Tamil, AWS Data Engineering Tamil, GCP Data Engineering Tamil, Azure Data Engineering Tamil, NoSQL Tamil Tutorials, BigQuery Tamil Tutorials, Data Pipeline Tutorials Tamil, Cloud Computing Tamil, Hadoop Tamil Tutorial, Hadoop Ecosystem Tamil, MapReduce Tamil Explanation, Apache Spark Tamil, Spark Streaming Tamil, Spark SQL Tamil, MongoDB Tamil Tutorial, Cassandra Tamil Videos, NoSQL Tamil Explanation, AWS Tamil Big Data Tutorials, Google Cloud Tamil Data Engineering, Azure Data Engineering Tamil, SQL Tamil Tutorials, ETL Process Tamil Videos, Data Warehouse Tamil, Tamil Tech Channel, Data Engineers Tamil Nadu, Tamil IT Professionals, Engineering Students Tamil Tutorials

Пікірлер: 45
@frasherleon3375
@frasherleon3375 Жыл бұрын
Awesome Brother, Usual 20 mins video do get bored, but your video is looking like a good movie, feels like this video don't get end likewise.. This is my first video on your channel, soon I am going to complete all the playlist bro..
@dataengineeringvideos
@dataengineeringvideos Жыл бұрын
So nice of you
@kailaayamart8941
@kailaayamart8941 13 күн бұрын
Awesome teaching 👏
@sundarrajan211
@sundarrajan211 Жыл бұрын
Crispy and clear explanation buddy keep upload more video
@tamilissaiulagam2941
@tamilissaiulagam2941 Жыл бұрын
Very clear explanations about Hive Bro ❤ Thank you for sharing the knowledge 🙏🙏Vazga Vazamudan ☺️🙏👍
@divyashree2902
@divyashree2902 2 жыл бұрын
Really awesome.. Understood the concept very clearly.. This is my first time on watching your video.. And subscribed in this itself.. Thank you so much for ur effort in giving this lecture in tamil..
@saranp4114
@saranp4114 2 жыл бұрын
Thank you for the wonderful explanation. concepts are clear sir.
@prabharamachandran998
@prabharamachandran998 3 жыл бұрын
Hi Gowtham, U r Awesome teacher... Concepts are clear..
@serendipitous263
@serendipitous263 3 жыл бұрын
Awesome explanation as always bro. The difference between embedded and remote metastore was clearly explained. I have a doubt, why to use RDBMS separately if we can store metadata in HDFS? Is there any limitation in HDFS to act as metastore?
@dataengineeringvideos
@dataengineeringvideos 3 жыл бұрын
Thanks 🙂 And this is the exact reason The storage system for the metastore should be optimized for online transactions with random accesses and updates. A file system like HDFS is not suited since it is optimized for sequential scans and not for random access. So, the metastore uses either a traditional relational database (like MySQL, Oracle) or file system (like local, NFS, AFS) and not HDFS. As a result, HiveQL statements which only access metadata objects are executed with very low latency. However, Hive has to explicitly maintain consistency between metadata and data. Source - stack overflow
@serendipitous263
@serendipitous263 3 жыл бұрын
@@dataengineeringvideos wow got it! Thanks bro 😁
@Ranjithkumar_official
@Ranjithkumar_official 7 ай бұрын
Clear explanation bro thank you😊
@mkrishnan9289
@mkrishnan9289 3 жыл бұрын
Awsome bro !!! Concept is clear and perfect👍👍
@raghav6516
@raghav6516 7 сағат бұрын
Bro I have doubt While using spark.sql does it means on underlying spark is using hive or does spark have inbuilt suppirt of sql
@CRT26
@CRT26 5 ай бұрын
Nice explanation ji & thank you
@sarathkumar6541
@sarathkumar6541 3 жыл бұрын
Superb explanation sir, sounds clear. good job.
@aravindan6061
@aravindan6061 3 жыл бұрын
Super explanation... Really great
@shibiraj1680
@shibiraj1680 2 жыл бұрын
Well explanation bro
@velkumaranap2269
@velkumaranap2269 3 жыл бұрын
Vera vera level !!!
@__MahendranD
@__MahendranD Күн бұрын
bro , if we multi node MYSQL to store meta by HIVE, how HIVE handles CRUD with multiple MYSOL? by simultaneous CRUD on all MYSQL, async or master - slave again?
@gnana30siva58
@gnana30siva58 2 жыл бұрын
Super explanation
@solomon3542
@solomon3542 2 жыл бұрын
awesome expalnation bro
@stevensteynz
@stevensteynz 5 ай бұрын
Hive meta store ku oru video podunga bro
@santhanalaxmi1776
@santhanalaxmi1776 3 жыл бұрын
Bro you said HIVE don't have database then while inserting record again how it will store data in hive table ? Before moving the insert record to HDFS you said it will go into hive table
@jokerraj843
@jokerraj843 3 жыл бұрын
Super bro,is there any documents to Learn more?
@mathankumars896
@mathankumars896 3 жыл бұрын
Hi Gowtham , Thanks! . For remote rdbms, we have to purchace another machine. Totally, slave nodes machine, master node machine and rdbms node machines. Am i right?
@karth12399
@karth12399 2 жыл бұрын
Sir, I learnt that Spark uses RDD and is RAM based unlike HDFS which uses hard disk. I am little confused here. Does it mean with the same infrastructure that is made up of hard disk , one cannot fully utilize the benefit of Spark and requires infrastructure change using RAM? Please correct my understanding gap
@vigneshkrish4742
@vigneshkrish4742 3 жыл бұрын
Thank you bro for the wonderful videos, i have a question, Will the RDBMS spread across multiple nodes for HA?
@dataengineeringvideos
@dataengineeringvideos 3 жыл бұрын
Exactly
@mathankumars896
@mathankumars896 3 жыл бұрын
How we access the unstructure data? Is sperate technology for that.
@aakashmohan9827
@aakashmohan9827 Жыл бұрын
Bro pls can you do it for impala?
@hijaga
@hijaga 3 жыл бұрын
You said about saving metadata outside of HIVE because HIVE is not having storage ?
@VigneshPasupathy7
@VigneshPasupathy7 3 жыл бұрын
Thank you bro
@ashrafshaikh4340
@ashrafshaikh4340 2 жыл бұрын
Can you tell me the difference between command load, insert and import In detail?
@hijaga
@hijaga 3 жыл бұрын
Why metadata in RDBMS why not in HDFS? sorry if you mentioned the reason in video.. not derby i mean
@giridharaneee
@giridharaneee 3 жыл бұрын
Hive stores metadata information in the metastore using RDBMS instead of HDFS. The reason for choosing RDBMS is to achieve low latency as HDFS read/write operations are time consuming processes.
@serendipitous263
@serendipitous263 3 жыл бұрын
@@giridharaneee Thanks, even i was wondering why to use RDMS separately if we can store metadata in HDFS itself. Your answer is convincing. Thank you.
@naveenfascinate5224
@naveenfascinate5224 3 жыл бұрын
Sqoop with hive Ku oru video podunga
@dataengineeringvideos
@dataengineeringvideos 3 жыл бұрын
please refer this video kzbin.info/www/bejne/fnKwYp1-l9WXbJY
@gobi.tuk-tuk
@gobi.tuk-tuk 3 жыл бұрын
How to check the metadata in RDBMS? If it is stored outside...
@dataengineeringvideos
@dataengineeringvideos 3 жыл бұрын
For example , just login to mysql and execute show databases command , u will metastore_db this is where hive metadata will be stored
@gobi.tuk-tuk
@gobi.tuk-tuk 3 жыл бұрын
@@dataengineeringvideos Thank you so much for the explanation bro...
@mathankumars896
@mathankumars896 3 жыл бұрын
Hive we can get only structure data, how we can see the relations of the tables and various keys ER relationship. Does hive provide DBMS managing solutions?
@parasuramanIyer
@parasuramanIyer 2 жыл бұрын
இதில் tez னு இருப்பது Google pay வா?
@dataengineeringvideos
@dataengineeringvideos 2 жыл бұрын
no this is different one
Apache Hive Introduction & Architecture
17:40
Data Engineering
Рет қаралды 119 М.
Мен атып көрмегенмін ! | Qalam | 5 серия
25:41
Сестра обхитрила!
00:17
Victoria Portfolio
Рет қаралды 958 М.
Hive Partition [ Static Vs Dynamic] தமிழ்
23:14
Data Engineering
Рет қаралды 9 М.
Unboxing [Hadoop Framework in தமிழ்]
26:29
Data Engineering
Рет қаралды 34 М.
Kamali - Tamil Full Movie - Kayal Anandhi, Rohit, Imman Annachi, Rekha Suresh
2:22:07
Hive Bucket End to End in தமிழ்
22:54
Data Engineering
Рет қаралды 7 М.
Big Data On Cloud AWS EMR {தமிழ்}
16:45
Data Engineering
Рет қаралды 9 М.
But what is a neural network? | Deep learning chapter 1
18:40
3Blue1Brown
Рет қаралды 18 МЛН
What if all the world's biggest problems have the same solution?
24:52
Мен атып көрмегенмін ! | Qalam | 5 серия
25:41