Real-time Vehicle Telemetry stream processing with Azure Stream Analytics, Event Hub and Synapse

Contoso Auto is collecting vehicle telemetry and wants to rapidly ingest and store the data in its raw form, then do some processing in near real-time. In the end, they want to create a dashboard that automatically updates with new data as it flows in after being processed. What they would like to see on the dashboard are various visualizations of detected anomalies, like engines overheating, abnormal oil pressure, and aggressive driving, using components such as a map to show anomalies related to cities, as well as various charts and graphs depicting this information in a clear way.
In this Scenario, we will use Azure Event Hubs to ingest streaming vehicle telemetry data as the entry point to a near real-time analytics pipeline built on Event Hubs, Azure Stream Analytics, and Azure Synapse Analytics. Azure Stream Analytics extracts the vehicle sensor data from Event Hubs, performs aggregations over windows of time, then sends the aggregated data to Azure Synapse Analytics for data analysis. A vehicle telemetry data generator will be used to send vehicle telemetry data to Event Hubs.
Please follow and ask any question to our linkedin profile and twitter or our web site and we will try to help you with answer.
Linkedin
/ softwizcircle
twitter
/ soft_wiz
website
FB
/ softwiz-circle-1132262...
Here Group of People are sharing their Knowledge about Software Development. They are from different Top MNC. We are doing this for community. It will help student and experience IT Pro to prepare and know about Google, Facebook, Amazon, Microsoft, Apple, Netflix etc and how these company works and what their engineer do.
They will share knowledge about Azure, AWS , Cloud, Python, Java,.Net and other important aspect of Software Development.

[@rahulsood81]

Dude, can you include an architecture diagram Slide at the beginning. And a slide for the Steps.....Randomly switching between multiple services can be confusing to the user.

[@SoftWizCircle]

Sure i will update

[@rohitshukla7051]

Can you explain how the SQL query is running every two minutes, Have you scheduled it on Synapse, Or the SQL query itself triggers because you mentioned the tumbling window of 2 minutes interval?. Your show and tell video is nice but screen switching is too fast

[@uttamchaturvedi]

Could you please provide git repo for the code used to generate data seeding

[@SoftWizCircle]

Sure will upload and let u know

[@swa2u86]

How the steam incremental data load can you share example

[@azimsayed1971]

did you find out how ? or need help

[@eosovngas4285]

can you share the download link for the telemetry software

[@SoftWizCircle]

Please find it from MicrosoftLearning Git hub. it is bit old . May need to update packages to run. github.com/MicrosoftLearning/DP-203-Data-Engineer/blob/master/Allfiles/TransactionGenerator.zip

[@rthariqs]

hi @@SoftWizCircle this cannot be downloaded can you please give proper access please