Spark Monitoring: Streaming

[@yohannistelila8879]

Thank you Dustin, this was very much helpful to me!

[@aminaferhati7432]

Thank you for the information

[@himanshurathi1891]

Hey Dustin, Thank you so much for the video, I still have one doubt, I've been running a streaming query in a notebook for over 10 hours. The streaming query statistics only show specific time intervals. How can I view input rate, process rate, and other stats for different timings or for the entire 10 hours to facilitate debugging?

[@DustinVannoy]

Check out how to use Query Listener from this video and see if that covers what you are after. kzbin.info/www/bejne/n6KslaB5q7iqrbc