Рет қаралды 556
In this lab I show you how to process the data which was ingested in lab 1 and lab 2. You can find the instructions for this lab at github.com/davedoesdemos/Data... to follow along yourself.
In part one of the Data Lake in a Day series I showed you how to set up the infrastructure for the whole workshop with a simple one click deployment using an ARM template. If you've not already done so, go and run through that video at • Data Lake in a Day 1 -... .
In part two of the series I took you through Lab 1, this lab showed you how easy it is to ingest data from a database into the data lake. See that video at • Data Lake in a Day 2 -...
Part three introduced you to what a data lake is and what it's for, and can be found at • Data Lake in a day - S...
Part four was the second session covering how a data lake is organised and is at • Data Lake in a Day - S...
In part five I covered lab 2 where we downloaded weather data for various cities and can be found at • Data Lake in a Day - L...
0:00 - Introduction to the lab
1:56 - Copying a full data set
3:34 - Create a pipeline and consolidate files
6:31 - Create a data flow to process and model data
23:29 - Showing the modelled data and the pipeline run
24:47 - Wrap up
You can find the whole one day workshop at github.com/davedoesdemos/Data... including all lab materials, data and instructions.
If you're new to data lakes please ask any questions you have below. Also please comment if you found this workshop series useful or if you'd like to see more of this kind of content.
For all of my other demos, go to davedoesdemos.com or go straight to the GitHub page at github.com/davedoesdemos/Demo.... Also please subscribe to the channel to make sure the latest demos show up in your playlist!