Recipes for Running Spark Streaming Applications in Production - Tathagata Das (Databricks)

[@tejashwinis3360]

Understood well..please put some more videos on spark..

[@RajneeshKumar-em2ir]

Excellent Tutorial on spark streaming. Thank you very much.

[@stefanthies85]

A very interesting talk - actually setting up monitoring is not that easy and needs it's own infrastructure to be prepared. Thats why Spark Developers might be interested in blog.sematext.com/2014/10/07/apache-spark-monitoring/ - it's a scalable solution (SaaS or On-Prem) with an easy setup and provides a free plan to start e.g. for developers - Especially when you combine Spark with other big data engines like Cassandra, Kafka, Storm, HBase or any JVM - SPM provides more insights. Beside standard metrics for Spark/JVM etc. the option to enable transcaction and function call tracing for any JVM app is available to monitor slow function calls or discover communication between the systems (just define the function calls you like to monitor). Stay tuned blog.sematext.com/?s=spark