I am following your content for some time. Looks like , your channel is one "best kept secret"...it deserves many more views and subscribers
@rajasdataengineering75855 ай бұрын
Thank you so much!
@abhisekmondal40768 ай бұрын
Your Databricks series is GEM .
@rajasdataengineering75858 ай бұрын
Thanks!
@manikanta-zq1ygАй бұрын
thank you for all your efforts😊😊
@rajasdataengineering7585Ай бұрын
Glad you like it! Thanks for your comment
@amazhobner7 ай бұрын
Hi Raja, this was a wonderful series and I learned a lot of things in depth. Thank you for doing this for us..!! :) If possible can you also make videos on below topics as you get time: 1. Implementing SCD2 using pyspark. 2. Handling incremental files using pyspark. 3. Like your video on .explain() please make a video to help us understand all components of spark UI as well as the DAG. 4. Please make 1 video where you go through queries and help us understand the .explain() plans as well as DAGs on spark UI. As you already have taught well and in-depth in the explain plan video, you can go through 5-10 different queries quickly and teach us on a high level. 5. What are the common transformations and cleaning of data done in real world. 6. One real world project architecture, you don't have to make a practical video on this, just some slides should be enough, regarding how after data comes in source, what all things are done in terms of ADF, Pyspark, different environments, etc.
@mateen1618 ай бұрын
Very helpful and well explained. Thank you!
@rajasdataengineering75858 ай бұрын
Thanks! Glad you liked it
@SureshBabu-kf5jx6 ай бұрын
HI Raja, Thank you so much for your videos. Really helpfull. Can you also make a video on CI/CD Integration of notebook and promoting notebooks to higher environments
@rajasdataengineering75856 ай бұрын
Hi Suresh, thank you for your comment. Sure will create a video on CI/CD
@sameersamu24278 ай бұрын
Raja Sir it would be great if you can show us one example like take data from azure data lake.
@rajasdataengineering75858 ай бұрын
Sure Sameer, I will create end to end pipeline once covered all building blocks through concepts
@quiet86917 ай бұрын
Pls reply raja data engineering I recently landed on your channel to learn databricks. Can you pls tell me the order to watch and go through your channel
@rajasdataengineering75857 ай бұрын
Pls follow this playlist kzbin.info/aero/PLgPb8HXOGtsQeiFz1y9dcLuXjRh8teQtw&si=E_HULOI6j9wVebOG
@prathameshpashte68817 ай бұрын
Hii, Raja could you please provide the slides and notebooks used in the tutorials? Thank you!
@quiet86917 ай бұрын
Hlo sir, Today is the first time i landed on you channel. Can you pls tell me the order to go through your channel?
@rajasdataengineering75857 ай бұрын
Pls follow this playlist kzbin.info/aero/PLgPb8HXOGtsQeiFz1y9dcLuXjRh8teQtw&si=E_HULOI6j9wVebOG
@code_nation7 ай бұрын
Totally out of context question, but can you please tell me is it possible to do changes like update or delete a row in ssms using databricks. We can make a connection using jdbc, but not sure if we could do changes other than inserting a new row. If it is possible, please make a video on this one or explaining here would be helpful too.
@rajasdataengineering75857 ай бұрын
We can't do this action directly on SQL server. Instead, we can push Databricks data into SQL server into one of the staging table and we can perform this operation
@andrew_ng6 ай бұрын
May I check when will 125 be released? DLT series will be have how many more videos to complete? Thank you Raja
@ankitgoyal64586 ай бұрын
Hello - I do not see LIVE demonstration of DLT (i.e. on Notebook) in video # 122-123-124. Are you planning to add more in this series? by when?
@rajasdataengineering75856 ай бұрын
Hello Ankit, I will add live demo also soon. Due to workload, I couldn't get time to create one yet. Will create soon
@ATHARVA898 ай бұрын
in which playlist can i watch autoloader concepts ?
@rajasdataengineering75858 ай бұрын
Pls watch this video - kzbin.info/www/bejne/fZu5Y6Bul56ZhLs
@DSALectures218 ай бұрын
Why the playlist numbering is incorrect?...
@rajasdataengineering75858 ай бұрын
The numbering is video creation sequence but playlist is grouping relevant videos on particular topic
@user-cl8pn8co6q6 ай бұрын
Hi sir create End-To-End Project's
@rajasdataengineering75856 ай бұрын
Hi, sure I will create end to end projects
@rajunaik88038 ай бұрын
Hi Raja, have a doubt, in materialized view or live table, you mentioned that it is going to re compute the entire dataset. Is it true? I believe it will capture only the CDC data from defined query.
@rajasdataengineering75858 ай бұрын
Hi Raju, yes it will be recomputed each time based on the query. If we don't give any query but ingesting from source, then no recomputation