[Hindi] Bucketing in Hive , Map side join , Data Sampling

Theoretical and practical discussion about Bucketing In hive
FB page link :- / bitwsandeep

[@TechnologicalGeeksHindi]

For Online classes Visit our website technologicalgeeks.com/ Course Details : kzbin.info/www/bejne/gXOuaWh7ia1opKs

[@shubhadakarluke9977]

wahh kya style hai padhane kii...i just love it...i enjoying your teaching while learning

[@hemantmeghwanshi8100]

He is so underrated man.!!. Providing his knowledge for free of cost in such a way that paid courses can never provide. Worth watching this. I will definitely share your content.

[@prashantkillada4969]

I am watching ur videos while completing the full ad time. So that u get benefited for the efforts u did. Cheers

[@saurabhkumar-nj6tp]

Became your fan..first time ever didn't get bored after watching tutorials... superb bro.. expecting your stuffs on windowing in hive. Also if you could make some interesting stuffs for spark

[@SsKEntertainment143]

संदीप सर, तुमचे व्हिडिओ खूप भारी आहेत . माझे सर्व शंका दूर होतात. तुमचे व्हिडीओ पाहिल्यावर. मी खूप खूप आभार वेक्त करतो तुमचा. असेच माहितीने भरपूर व्हिडिओ बनवा. सर एक व्हिडिओ project वर पण बनवा Real time project कसा करायचा असतो त्या वर. प्लीज

[@arifsultan2009]

This tutorial is really awesome. Covered all important bucketing concepts with example. Great sir..!

[@princemitra1545]

Literally ,its too good.Amazing way to explain. Was not that stretched. Mazedaar

[@learnwithfunandenjoy3143]

Sandeep I have listened all your videos on different topic of Hadoop like Pig, Hive,Spark etc. Undoubtedly you have created all the videos very interactive and practical oriented. I appreciate you great efforts. Please also make videos on all others topic related to Hadoop like Flume, Oozee, Yarn, Impala etc.... Thanks.

[@yamalinga]

Great job bro.. really nice to see how theoritical concepts linked with practical stuff with clarity of thoughts.

[@deepika9358]

U r amazing 👏👏👌 first time I got my concept clear by watching ur video😁.

[@aneesh_m]

Awesome tutorial 👏 Haven’t watched full yet but sada_table had me totally 👍 Keep making such tutorials

[@mnagesh7794]

really appreciate the way you have teached the bucketing concept

[@prasadligade4825]

creative way of teaching. good one!

[@shantanubugadi3188]

Impressive and very clear understanding...! Keep it up bro

[@devendraprasad3057]

Best ever explained and interesting, hats off👌👌👌👌

[@amanraj3038]

Super…absolutely fantastic ❤

[@shantanushiirodkar6314]

Hi Sir, the way of explaining the concepts is awesome. I'm requesting you to upload the video on Apache Flume with few scenarios.

[@KailashAade]

Your presentation is great. Keep uploading.

[@kalpanajain933]

just awesome presentation and excellent expalantion.Keep it up!

[@the_high_flyer]

Hi sirjee... I like the way you explain partitioning and bucketing.. thanks a lot

[@mayankjainyou]

well done Sandeep...you are giving wonderful videos... please upload some more exampes for spark DF and RDD when you get time

[@ddhanigond]

Very nice....learning with entertainment and that too free... :)....keep the good working going....thank you

[@202rupesh]

wow..!! such a great way to teach.. :D Thanks!

[@kirankumarchandrasekaran518]

thanks a tonne to teach in hindi..or its so confusing to learn inenglish...native lang rocks...i will share as much sir

[@surajkumarsingh8592]

Thanks sir, I was waiting for your video

[@sagarjitdash7058]

For any video tutorial I always wait when the video will be ended but it is not applicable at all for yours. When I watched your video on partitioning I really enjoyed for the first time. Very few have this teaching ability that you have. Keep it on.

[@jaisingh-lb6fp]

well explained..i have watched all your videos..waiting for new ones..

[@royzistify]

Appreciate d way of teaching😊

[@MrNau007]

Technical Join Filmy = Sandeep Patil . Awesome:)

[@nonie1107]

Superb video Sir. Really!

[@kirankumarchandrasekaran518]

so clear understandng..thanks lot brother.

[@fayazmahivlogs1429]

awesome style for learning keep it up we want more videos related Hadoop

[@rohini845]

very beautiful and brief concepts..........:)

[@learnwithfunandenjoy3143]

Hi Sandeep..... I have heard all your videos created on Hadoop. All your videos are very informative and simple to understand. Could you please make some videos on different topics like Sequence Files. ORC files, CBO, AVRO and HAR file format files. If possible could you please make some videos on performance tuning in SQOOP/HIVE etc.... Thanks.

[@ranabirdas5855]

Excellent teaching !

[@faizmohdarifkhan4368]

Great WorK... Awesome Teaching Skill.. Well Done

[@TechnologicalGeeksHindi]

Thank you ...

[@thanooj]

Simply superb

[@prashantkillada4969]

Very Good Job Bro.....Thank you

[@arunavalad7684]

excellent explanation!!

[@rajuchoudhari2409]

Very helpful thanks for sharing

[@kanchanvarma1399]

Hahaha 1 no video... Superb

[@yashpatil9564]

Great Job

[@rajuchoudhari2409]

Sandeep your videos are fun to watch Could you make video on converting t-sql into hive queries and /or spark sql queries, I am ingesting and extracting big data to and from Hadoop using highly complex sql queries and would love to hear from you any comments/suggestions

[@rajatht.g6584]

Good one buddy, keep it up👍

[@sagarmehla2102]

great explanation

[@manchurianful]

Very helpful! Please post more videos

[@aloksahoo7909]

Great video

[@rajatsharma5791]

Khoob Chan Bhau :)

[@ankitsrivastava8019]

how the mod function will handle string or float value?

[@sourabh4994]

Amazing bro!!

[@sachink9102]

Good one... one Ques.. for map side join tables needs to be partition tables or on normal table also MAP SIDE JOIN can work ?

[@NRS31]

Hi Sandeep , Kindly create a vedio on Serde and sequence file format...... please also include hive optimization technique....

[@vishal_gadhave]

ek no. marathi manus

[@kirankumarchandrasekaran518]

moreover too fun with diff creations of ur duplicates...pics haha great no bored

[@ddhamija1234]

awesome!!

[@sarveshmahajan180]

Thank You.

[@shiwangibhatia1843]

Superb...

[@achin4140]

i beg you sir please tell about NOSQL databases in and how KEy Value Pair (KYP) is employed over it ?

[@varunajmera]

nice presentation wid funny way

[@pandiyarajvaithinathan8795]

Is their any limit to create the partition in hive table. If it is their How much we can create in one table.

[@pushandeb187]

ultimate...

[@asimabdulwahab9444]

YES I HAVE ALSO BECOME YOUR FAN

[@bhavitavyashrivastava8600]

how can i configure set hive.execution.engine=spark; at backend . My spark sql is working fine hive on mr is fine only when i am changing execution engine to spark it is not working can you me

[@sandipsawant7525]

Thanks for videos. Please post video on casting concept. If in my staging table I have used string data type and in my parquet table I have used timestamp data type for that field. I'm getting null in my parquet table, what I can do to get correct date field. In staging table I have values like 12-07-1995, how to get this same value In parquet with timestamp

[@arpithas2568]

Please start making videos again.....! Can't find such good explanations anywhere.

[@fayazmahivlogs1429]

please upload some flume related videos theory and practical's using 1 agent ,2 agents and 3 agents

[@surajkumarsingh8592]

Great job,

[@TechnologicalGeeksHindi]

+suraj kumar Singh Thank you Sir 😊

[@nowwin09]

awesome

[@ankitamorey1838]

Sir u told that u will make videos on hadoop administration too! Pls do it asap

[@soumya3558]

Please make a video on Vectorization..

[@sheetalwanchoo4095]

Please add mapper , reducer info as well while explaining that give more clarity.

[@learnwithfunandenjoy3143]

Hi Sandeep, I have one query here. In this video you have used one extra line at end "stored as textfile" in creating all the buckets table. But in all your old videos like Partitioning in Hive or Pig related examples, you didn't use this syntax. Can you please tell us what is the significance of this particular line. If we don't use this line what will happen ? ... Thanks.

[@TechnologicalGeeksHindi]

That line just instructs hive to store the dataset on HDFS as textfile, even if you don't specify this line hive will store the dataset as textfile on HDFS as textfile is default format in which hive stores data.

[@learnwithfunandenjoy3143]

Thanks for quick response.

[@samadhankakde6818]

2022

[@sudhanshupatwardhan9900]

Sirji Tussi Great Ho!! Education with Entertainment :) ==> Just 1 doubt: After running Hive query, we get a message saying 'MR is deprecated. Use Tez or Spark'. Still the query is triggering a MR job. Can you please clarify on this point?

[@TechnologicalGeeksHindi]

+Sudhanshu Patwardhan Thank you 😊 That is just a suggestion to use tez or spark as they are the new frameworks , however we are working with Hadoop so MR job is being fired.

[@vishal_gadhave]

nice

[@sandeeptandon2059]

Bro, Love ur teaching style , Keep posting nice Videos ...I have one question , How do we determine the number of buckets ...lets say mujhe bucketing karni hain , then how will i decide on no of buckets ....plz reply...

[@TechnologicalGeeksHindi]

Thank you bhai ,Number of buckets jo hai wo bucketing ke objective wise vary hoti hai , lets say apko data sampling krna hai ,to kitne records aap process krna chahte ho , matlab ek bucket me aap kitne records chahte ho ye apko decide krna pdta hai , aisa koi standard to nahi hai jise folow krke number of buckets decide krne chahiye , it completly depends on the tasks that you have to perform on the data.

[@priyshankar]

kitne bucket bnane h yeh kaise decide karenge...how do we decide the no of bucket

[@M-Fash0070]

Syntax me maine 5 bucket mention kiya tha but op me 1 hi bucket tyr hui....how

[@amanahmed6057]

BHAI AAP OR video kyu nahi daal rahe ho agar aap or video nahi daal sakte toh plzzz interview question ke video upload kardo plzzzzzzzzzzzzzzzzzzzzz

[@joerokcz]

Nice video as usual. But you missed a little point,except setting this property bucketing doesn't work ,atleast for me it was like that :D set hive.enforce.bucketing= true;

[@sakshi0070]

sir plz 1 more vdo on sort by , cluster by,distributed by,order by in hive

[@NripaEmpowerthroughknowledge]

sahi hai

[@PrasoonSingh075]

i am getting this error while insert overwrite - Error during job, obtaining debugging information... FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask MapReduce Jobs Launched: Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 FAIL Total MapReduce CPU Time Spent: 0 msec

[@kulbhushansinghal2019]

Very good

[@TechnologicalGeeksHindi]

+Kulbhushan Singhal Thank you 😊

[@aleemshaikh5280]

would anyone please expain that mod concept

[@datascience2143]

sir unable to understand mod term and calculation.

[@himanshubhardwaj584]

TOO GÖÖD...

[@snehapatil7067]

Marathi manus 👏👏👏

[@akashrathod9701]

Sir HS2 concept samjaoo na plz Uska bhi video banao 😇🙏🏻

[@pratikchaudhari2631]

Bucket 3 out of 5 on ID What is the meaning of ID here?

[@muneerabegum4474]

plz map Reduce ke bhi videos banavoooo

[@myworld802]

sir show Profamanc tunning please

[@Amarnathandugul]

Ek video JSON data processing ka bana do please

[@ganeshpatil9380]

Please provide dataset sir

[@sagarmehla2102]

plz provide us ppt and datsets.

[@nitinjagannath9219]

New video upload kro

[@kirankumarchandrasekaran518]

write a book

[@93divi]

bhai pls dataset bhi daal diya karo..

[@TechnologicalGeeksHindi]

Sure bhai , blog start krna hi hai , waha upload kr dunga , abhi ke liye apka emailid share kro , Ill share those files ..

[@93divi]

[e-mail] aur bhai sab datasets fwd karo.. Thanks

[@dineshdas2961]

sada Table , rofl