Рет қаралды 1,358
In this video, we'll continue on our journey of discussing performance optimizations that we can do while running our spark workloads in dataproc.
The optimization we are discussing in this video is adding Local SSDs to our worker nodes and how they can positively impact performance of shuffle heavy jobs.
This video is part of the course Apache Spark on Dataproc. You can find all the videos for this course in the following playlist.
• Apache Spark on Datapr...
I regularly blog and post on my other social media channels as well, so do make sure to follow me there as well.
Medium : / sushil_kumar
Linkedin : / sushilkumar93
Github : github.com/kay...