Data Pipelines Explained

Learn more about Data Pipelines → ibm.biz/BdPEPM
Data is a lot like water; it often needs to be refined as it travels between a source and its final destination. That’s where data pipelines come in - they merge, filter, and summarize raw data, providing the end user with a clean product to analyze. Luv Aggarwal, a Data Solution Engineer at IBM, explains how several processes often embedded within data pipelines - like ETL, replication, virtualization, machine learning, and batch processing - help generate actionable business intelligence.
Get started with IBM Cloud free of charge → ibm.biz/BdPEPS
Subscribe to see more videos like this in the future → ibm.biz/subscribe-now
#Data #DataPipelines #DataAnalyses #DataIntegration #BusinessIntelligence #ETL

[@Geeee33]

Now that's one of the best explanations with the simplest examples for data pipelines! Thank you

[@vishalk02]

Explained simply & effectively. I would like to see more elaborate content on big data & data science fields.

[@balakrishnanr7149]

Very precise explanations with simple examples. 👏👏👏

[@victorgromov1548]

Great explanation with easy to follow examples!

[@well9851]

Greatly explained. Easy to understand and clearly.

[@Flankymanga]

I would like to know how the Data Virtualization works. At first i thought that it is just "faking" a real data source in order to test data pipeline configuration?

[@emrepiristine7967]

Thank you very much, it was the most explanatory and beautifully explained video I've ever watched.

[@saikiranmahajan5981]

Awesome Luv! You made it simple for the Sales guys.

[@alexpishvanov736]

I think, Data Virtualization would be a great topic for the next educational video from this instructor.

[@carsonmasterson]

Hey Alex -- check this out: kzbin.info/www/bejne/aImlZYiXd66phKs

[@1apocalyps]

Yes I agree. When I hear virtualization, I get locked into is it based off data models, Is it "place holder data"? I'm assuming we have no information about the data without the transformations

[@peterluo1776]

This is some good work. Well done. Thanks for sharing 👍

[@harshalh3513]

Greatly explained , would be more great if you could explain a few more processes to build pipelines in a breif

[@Manav-zo9bn]

such a Quality content . Very well explained

[@alaad1009]

Excellent analogy

[@hasanmougharbel8030]

Hey dear, god bless your efforts in this channel. I have a general enquiry as a new sql learner. How could i create a pipeline to extract and load data from existing accounting program into our SQL server instances. How can i know if the export mechanism in the software permits me to undertake this extraction process, and how can i know if an application have an api? Thanks for taking care of my enquires. Looking forward to gain more knowledge from you

[@ChanceMinus]

Thank you. Extremely helpful.

[@LeonidAndrianov]

Nice analogy and explanation!

[@keviin077]

Thanks for the amazing explanation

[@obiradaniel7391]

Nice video, just when you think you have heard it all, here comes "Data Virtualization". If possible that could be elaborated more.

[@kikitauer]

My company uses data virtualization when rendering a final picture from our car configurator. It doesn't physically download the pictures, it just calls for the chosen color, wheels, accessories interiors etc and caches them - stores them in the temporary storage.

[@pritamdaware9674]

Does this technology use all automobile industry?

[@davidallyn1818]

Beautiful tutorial!!

[@suck-myballs1152]

I love these IBM videos. No organizations simplifies things the way they do.

[@chuachua-hj9zd]

Very good example quote using examples

[@msbthedataengineer]

Good Explanation!!.....

[@surabhijagadish5210]

Awesome explaination.

[@user-uh6vk2zl1k]

This is excellent!

[@aniruddhabhosale6715]

Explained really well .👊🔥💖✨💯

[@Trendykid]

Cant wait for data virtualization video.

[@f-alzahraa_Ahmed]

thanks, realy usful

[@uwalakab]

Great analogy. 👍🏿👍🏿👍🏿

[@dabdoube92]

b

[@Deleted_Account_2023]

Awesome video!

[@claudiusdsouza2379]

well explained

[@babasahebmane3473]

Well explained

[@explorertribe]

Data virtualization is something looks interesting

[@Helloimtheshiieet]

In a roundabout way this is why ERP systems are so popular

[@pudgewars6447]

I would like to know how does your screen board work? Are you writing iin inverted xd?

[@Lilwar195]

I believe they are writing normally but the video is inverted post production

[@Tordekh]

kzbin.info/www/bejne/rXSypqhmYtRoj6s Lightboard videos

[@evanshlom1]

I WILL IMPLEMENT STREAMING MACHINE LEARNING AT WORK VERY SOON

[@vansf3433]

Your l English language is ambiguous because streaming data and transforming data are 2 different process. Streaming data is to make it concise or compacted, while transforming data can be changing it into another form to make it suitable for a certain purpose

[@splashoui3760]

How this kind of videos are made? Typing to the screen and it shows up on camera? What is the tech behind this?

[@IBMTechnology]

See ibm.biz/write-backwards

[@splashoui3760]

Thanks!@@IBMTechnology

[@faisalk.7520]

How was this video made? How are the words not backwards lmao. This is crazy

[@IBMTechnology]

Search on "lightboard videos"

[@user-xx1sw1dj9o]

yooo i just relaized this man just wrote all those letters and words backwards so we can see it normally....... right ? or is this some camera trick

[@IBMTechnology]

See ibm.biz/write-backwards

[@rohannair4039]

how is he writing in reverse

[@ScriptureFirst]

Whiteboards suck. Spring for the full blown motion graphic. Too slow (even at 2x) didn’t finish

[@samwelemmanuel7976]

My only question is why do they always ask lefties to do these videos?

[@IBMTechnology]

See ibm.biz/write-backwards --they're actually righties.

[@dharanik7530]

worst experience guy

[@vansf3433]

Your explaining chart is nonsense because you do not need to clean water from a lake or river for agricultural activities

[@temitopekade590]

Appreciate efforts. This explanation is basic and it does not mean there are no other use cases like the agriculture you mentioned. He is talking obout end use of water in this case. Majority of us understood this. Be more positive!