Big Data Project Explained -1

[@naveenchenamarla642]

Very Good and important video. Can you, if possible, create a video by doing practically using a dataset in this pipeline model? It would be very helpful for us :)

[@TannerBarcelos]

This was massively helpful in getting me a little more understanding of how all this stuff works. At work I’m being requested to help on some big data applications that follow somewhat of a similar data flow but given I’m not a data engineer, all this has been confusing and overwhelming. This provided me enough of the clarity I needed to help me understand my work and how it’s not all magic!

[@viswajitnayak8325]

wow man .. just wow..... the simplest explanation I have seen .. I was easily able to relate to my etl projects .. and now am very curious to start my hands-on ... i wish could have come to this video of yours earlier .... please upload more videos.... :)

[@sivaramsivasakthivel799]

Thanks for the explanation. Can you please help to clarify the below two questions? 1.Can you give details about the volume of the data involved in this project.2.Can you explain more about the location of the shell script(where inside the cluster) used to call the jar will be placed

[@poojapatil05]

Pls always make a videos in English only na some vdos in Tamil language some pls don’t understand Tamil like me that’s why but you explain so clear and understandable that’s really helpful 😊

[@dataengineeringvideos]

Thanks , all these videos are available in English too 😃

[@bilal-mx2jw]

This is what im searching for man thank you so much 💝

[@bsvrangaraju9851]

Very clean and clear explanation.Understood very well.Waiting for others videos.

[@praneethbhat6361]

Beautifully explained. We can get complete overview of big data project. Bro please make a small real time pyspark project from end to end like what you have explained in the video. Really it will help us a lot bro.

[@chrisleggett7877]

Great video! Thank you for sharing your architecture and project examples.

[@pirate11n11]

This is great, even we are using similar on-prem architecture. If possible can you make a video on migrating this project to cloud.. like replacement for spark, hive, sqoop, hdfs in aws/gcp?

[@amittaywade8753]

This use case is helping me a lot in my current project, Your explanation cleared my so many doubts thanks buddy ! :)

[@navk4960]

Very very very useful knowledge sharing

[@indhumathy7648]

Very informative bro… thank you so much.. request you to put few more samples of projects please

[@meghana_g87]

Really helpful content. Please do more of such Project explanation videos. Thanks for sharing

[@AWSoptimization]

Thank You for this video. Can you explain more on audit tables, error handling & frequent fall outs.

[@pridename2858]

Excellent information, great job.

[@dikaneshdnesh4693]

Eagerly waiting for next videos. Wonderful explanation buddy. Keep rocking and please train us along with you in this beautiful startup of KZbin session. My full support for you buddy❤️❤️❤️.

[@dataengineeringvideos]

Sure and thanks for your support and love

[@jayanthvik]

thanks bro very clear!

[@AkHiL-cg3qb]

very informative and usefull thnq bro

[@sushmareddi3103]

Thanks alot...It is really great explanation. Could you please say can we encrypt and decrypt the data after storing it into Hive and then use it for spark transformation

[@arvindarigela1]

excuse me mam have you did any project in big data and hadoop ??

[@lajpatb.l8340]

Thank you Gautham, very useful please upload more issues or challenge faced and how you resolved it?

[@swapnilendole1366]

Thanks for this video, help full this video for us, can you create one more real-time use-case video.

[@HemanthKumar-kc5os]

Thanks a lot bro.Waiting for another video on big data projects

[@garnet7904]

hi really good explaination sir

[@jananiin3390]

Thank you for the explanation. Can you please explain about data lake preparation in Big data.

[@kishorekumarkatte3202]

How can Hive be used to store Big data files.It can just store metafiles in the metastore.Actual data blocks are stored in HDFS and its mapped to hive tables.Correct me if I am wrong

[@himalayasaikia5762]

Yes you are right...files are stored in HDFS and the metastore db is created in derby or mysql

[@ririraman7]

Awesome! Could not thank you enough!

[@harshal3123]

Thanks it helps alot

[@ankitayadav6224]

Thanks a lot 🙂

[@prathivenkatasaipavan9909]

Very great session More to come

[@rakeshjadhav1618]

Very helpful information buddy.

[@sachinchandanshiv7578]

Big thanks Sir...!

[@sachinchandanshiv7578]

Hi Sir, One of my interview they asked, how you manage your source code? Can you please guide me on this?

[@DepMahesh]

Hi, Can we bring production data into dev and uat environment? Is that allowed... Please ignore, I have watched your deployment video, and got the understanding that we won't be having production data in Dev and test environments.. thanks

[@mehmetkaya4330]

Thank you!

[@Sharmasurajlive]

Good work bro👍Jhakaas !!

[@simhakotni]

Good work. Thanks for sharing.

[@shruthiv463]

Good one. Thanks a lot!

[@KoriviSandhiPriya]

can you send link for bigdata project explained -2

[@Data_Engineering_By_Sri]

You mentioned sqoop used to transfer data from rdbms to hive or hive to rdbms right ?..db2 is also rdbms ??

[@himalayasaikia5762]

Yes, he means IBM DB2...

[@namnguyenngoc1948]

bring data into hive by sqoop, now hive play role is datalake ?, to my knowledge hive is a data warehouse system.

[@AVillager5]

hi I have 1.5 years experience on Apache nifi,what should needs to be done to get a role in data engineering profile curruntly im serving notice period. please suggest me.

[@worldbankofvideos8643]

hi how much scope for hadoop now and in future

[@shailabh3306]

For a fresher what do you suggest , getting started with data engineering or ML? In my college placement most companies are coming for ML profile but I'm more interested towards data engineering part I'm confused Can you please suggest sir?

[@dataengineeringvideos]

please go for data engineering roles , because of MR it has less scope for now in industry ( thats the fact actually )

[@ranvijaymehta]

Thanks Sir

[@rohanrohan2758]

where to find the data sets to build the project shown in the video

[@omkarm7865]

Helpful content

[@pkcommence4601]

how do i get this sample data... i want to implement simple project

[@kjvmpandurangarao3536]

Hi sir how to connect with you if we are having any doubts...

[@NishantSingh-w9u7w]

is there any sites that has these sort of data

[@kavithabalasubramaniyan3390]

great

[@anupshastry5969]

Will hive stores data

[@geta9722]

It is great

[@SaiKumarkaranam]

Hi bro do you provide any training or support?, Please revert

[@arvindarigela1]

can you please this source code please please it is very very important for me

[@charansai1133]

is it better to do masters on big data i am at my btech 3rd year sir plz advice

[@dataengineeringvideos]

Btech is wide enough for getting into big data , masters not req but if you are interested you can do .

[@shadabsiddiqui28]

great explanation

[@shadabsiddiqui28]

thank you sir