Mastering Spark Unit Testing (Ted Malaska)

[@taylorperkins5279]

Thank you so much! I have inherited a scala spark streaming code base and have been in the process of learning all that it does. This code base does not have any actual unit testing, and this talk has given me the confidence and encouragement to be able to write unit tests to make it stronger and to better understand what it does. Figuring out how to test spark outside of a production environment has been a big challenge. This has definitely helped a lot

[@singhharmeet]

This is probably the best explanation of RDD, DF and streams and how to test them. Thanks for sharing

[@recordable542]

Has more insight than some paid courses. It was really helpful

[@outofbody4788]

Great video. Can we get something similar but for spark structured streaming?

[@sadanandametikala]

can spark unit test run on cluster also ?if yes how to get the test failures report ??

[@prayaspagade2234]

It was great thanks for sharing!

[@sukumaar357]

Thanks you for informative video,please provide link of this side.