Big Data Engineering Mock Interview | Big Data Pipeline | AWS Cloud Services | Project Architecture

[@thetransformer2217]

Satinder has in-depth understanding and a lot of experience and he explains things in precise and easy to understand language. Kudos to him. Thanks a lot Sumit Sir.

[@MANGESHpawarsm42]

One of the most Informative interview I ever Watched. Big Shout Out to Satinder Singh as he explained topic clear and most understandable way. Thank You.

[@imranhossain1660]

parquet is a columnar based storage format, so it is a very good file format in terms of retrieving the data through the query. It definitely reduces the usage of i/o read and network bandwidth. Besides that it has built in support for compression in the form of snappy format. So it reduces the space usgae. Another one I can think of is, parquet files comes up a structure with 3 components, they are header, body and footer. Heder actually the name of the file(part001,part002). Body is actual data content which it is storing and footer is basically for the metadata. This metadata includes the minimum and maximum values of the columns. So whenever we try to query the data which is stored in parquet format this metadata helps us for the data skipping which in turn fast our query execution. Hope it helps.

[@pallavigosavi6851]

Thank you!! 👍

[@sruthiselvakumar9817]

This interview is really great as Satinder explained some concepts like property for broadcast etc more clearly. Thanks Sumit Sir!! Expecting more videos like this..

[@sumitmittal07]

satinder will be conducting more interviews

[@KiyanshLife]

Best Interview I ever seen. Both of you too good at your level.

[@sumitmittal07]

yes this interview was next level

[@mohammedalikhan9819]

The interview was more focused on pyspark, sql we expect interviewer to ask more qns on AWS cloud as well. Because in most of the interview videos posted pyspark has been asked a lot.If qns on AWS would have been asked it would have been very helpful.

[@sumitmittal07]

Hi Mohammed, will definitely have some interviews planned specifically for AWS in the upcoming days.

[@mohammedalikhan9819]

Thank you sir😊

[@avinash7003]

I see mostly asked 70% in Pyspark SQL rest cloud ​@@mohammedalikhan9819

[@Hope-xb5jv]

23:05 use dense rank instead of row number because may be more than one student have same highest number in same subject

[@grim_rreaperr]

Hi Sumit Sir, In the first sql problem where we are required to find subject wise toppers, one case where row_number() will fail is when we have two top-scorers with the same marks in a specific subject. Please check the example below: student_name, subject, marks (-- derived column) stud_1, maths, 90 -- 1 stud_2, maths, 90 -- 1 stud_1,economics, 95 --1 stud_2, economics, 90 -- 2 stud_3, economics, 88 -- 3 Instead of row_number(), we can choose any one from rank or dense_rank as we just need the first rankers(based on highest marks scored in each subject). My approach will be as follows: WITH top_scorers AS ( SELECT student_name, subject, marks, DENSE_RANK() OVER(PARTITION BY subject ORDER BY marks DESC) AS rnk FROM student_marks ) SELECT student_name, subject, marks FROM top_scorers WHERE rnk = 1;

[@SreemantaKesh]

This was a good interview. Different from the earlier one's. Satinder's question and advice was very good.

[@sumitmittal07]

this interview has really gone well

[@sunitasolankar5161]

Thank you so much satindar sir its very informative and useful while giving interview excellent.

[@abhishekmodak8496]

This was a good interview and Satinder has good experience as an interviewer.

[@safarnama65]

Very Informative one of the best mock interview with proper answering and details

[@sumitmittal07]

Keep watching for more such insightful interviews

[@goldykarn5922]

Best interview session so far.

[@tanujarora4906]

Satinder sir is awesome, always something to learn from his questions.

[@mojibshaikh4092]

Informative and Excellent interview.

[@Sagar0155]

Interview was insightful. Learnt core concepts of spark from Satinder

[@sumitmittal07]

glad that it helped you

[@abhishekkmalik4399]

Very informative video, liked the point of view by Satinder Sir.

[@sumitmittal07]

satinder is a very knowledgeable person

[@DesireIsIrrelevant]

Thanks for uploading such a great Interview video Sir!

[@sumitmittal07]

Glad you found the interview informative!

[@AliKhanLuckky]

Sir i personaly want to see satinder sirs more interviews 😊

[@sumitmittal07]

yes definitely, he will be conducting more interviews

[@akshaykumarverma8644]

This was a very good video

[@sauravroy9889]

Really nice interview sir.❤

[@DataJourneyHuub]

It’s really helpful sir. Thank you so much

[@sumitmittal07]

Most welcome

[@sabyspeaksonline]

What's the difference between parquet and delta format?

[@ashwenkumar]

Aditya - u need to be strong in the basics and always answer straight forward and crisply on points . Don’t beat the bush

[@akashprabhakar6353]

i felt the same.

[@ameygoesgaming8793]

My SQL would be: SELECT student_id, max(marks) FROM class GROUP BY subject

[@grim_rreaperr]

every non-aggregated column in your select statement must be included in the group by statement.( here student_id is a non aggregated column and it should be in your group by clause and same applies for the subject column too which is not being called in the select statement)

[@ameygoesgaming8793]

@@grim_rreaperr Oh yes, its a typing bug. It should be: SELECT subject, max(marks) FROM class GROUP BY subject

[@Abhishek-14]

Sir please continue python course along with this 🙏

[@sumitmittal07]

yes, one video coming tomorrow at 7 pm

[@Abhishek-14]

@@sumitmittal07 thank you so much sir that's a relief to hear this.

[@Amrit-Manash]

Very nice interview

[@sumitmittal07]

glad that you liked it

[@zaffer2024]

Excellent

[@sumitmittal07]

Thanks

[@ameygoesgaming8793]

what is NC SQL way?

[@SB-ix7db]

ANSI

[@ameygoesgaming8793]

so ANSI SQL is normal SQL syntax which we write right?@@SB-ix7db

[@doyouwanttoknow3366]

Please upload a gcp data engineer interview video sir

[@sumitmittal07]

very soon

[@mohitbutola1140]

have anyone have taken the course ?

[@sumitmittal07]

Please share your contact number if you would like to know more about the courses that I offer

[@zaffer2024]

Why data engineer roles have very easy questions

[@sumitmittal07]

we make it look easy, else its complex.. haha

[@akhilsingh3801]

Bro is cheating on mock interview with zero fundamental knowledge of Spark or Hadoop 😂😂😂. At least interviewer has asked questions to get something out of this video.