Must-Know PySpark Interview Question for Data Engineers - Live Demo & Tips!

[@062nanthagopalm6]

Great video brother! Looking forward to the upcoming videos . Thanks for the efforts 🎉

[@mr.ktalkstech]

Thank you so much :)

[@emil0847]

Thank you for the dedication on your vidoes man they are very helpfull for hands on projects and learning

[@mr.ktalkstech]

Thank you so much :)

[@billionairemindset7192]

Waiting on your full data engineer tutorial video Mr KT.... Some months ago you said you are working on something, i hope you are still working on it, I really look forward to that video as it will help me a lot. Thank you for this too.

[@mr.ktalkstech]

Working on an End to End Project, will try to upload soon :)

[@billionairemindset7192]

@@mr.ktalkstech looking forward to seeing it.... Thank you for your amazing work.

[@jaypandya2714]

Your explanation skill is too good ❤️ hoping for more videos on topics suchs as Projects, airflow , dbt , snowflake :)

[@mr.ktalkstech]

Thank you so much, very soon :)

[@Abhinavkumar-kt8gj]

Very nice explanation..Very good.. Waiting on your full data engineer tutorial video..

[@mr.ktalkstech]

Thank you so much, very soon :)

[@sharaniyaswaminathan8760]

Good one. Waiting for your next project video :)

[@mr.ktalkstech]

Thank you, very soon :)

[@moyeenshaikh4378]

Sir please upload scenario based questions for adf, key vault etc It's asked in interviews

[@TheMapleSight]

What is the difference between doing it in PySpark and SQL? I think in SQL it's much easier: %sql drop table if exists test; CREATE TABLE test ( id int, total int ) INSERT INTO test (id, total) VALUES (1,10), (1,20), (1,30), (1,40), (2,20), (2,40), (2,60), (2, 80); SELECT *, SUM(total) OVER (PARTITION BY id ORDER BY total) as emp_run FROM test;

[@reachrishav]

Don't we also need to add order by col(total) in the window spec? That would make the code deterministic

[@mr.ktalkstech]

Good point, it's better to add it, you are absolutely right :)

[@rahulmittal116]

Unboundedpreceding and current row is default, right?

[@mr.ktalkstech]

Yup, the main intention is to explain what's happening behind the hood :)

[@rahulmittal116]

Right :) You are doing great work.. I learned Azure projects from your videos only.. Thank you so much🤙 God bless you🙏

[@DheerajMaddula]

Even if we don't add rowsBetween, it works the same way right? I mean it's default right?

[@mr.ktalkstech]

Yup, the main intention is to explain what's happening behind the hood :)

[@arunKrish11-yl4sb]

Explain in tamil also

[@KeyBooksInsights]

@mr.ktalkstech do videos on regular basis your subject is awesome

[@mr.ktalkstech]

Sure, I am trying my best :)

[@KeyBooksInsights]

@@mr.ktalkstech can you please do video on unity catalog

[@mr.ktalkstech]

Sure, will upload that soon :)