Data Analysis 0: Introduction to Data Analysis - Computerphile

[@Computerphile]

Check out the full Data Analysis Learning Playlist: kzbin.info/aero/PLzH6n4zXuckpfMu_4Ff8E7Z1behQks5ba

[@lenoraballantyne8367]

@Z3U5 ]

[@TheChondriac]

Mike is definitely my favorite from Computerphile. As a college computer science student, these videos are amazing for me. I definitely think that this channel should host a niche playlist of more involved programming videos for those of us that are aspiring programmers! Thanks for all of this great content.

[@kuhluhOG]

He is my second favourite. (My favourite is Professor Brailsford )

[@benanderson3701]

Big up mike, he's my favourite

[@megumi_0]

agree

[@TheFoosie]

10 part series with mike pound yes plz

[@JesusisAlive_33]

i love this guy, the way he explains things so clearly and his voice

[@leonhardeuler9839]

With open source datasets

[@chethelesser]

>computerphile >Starting counting from 1 Yeah right

[@theinnominatoidk3821]

@@JesusisAlive_33 his accent is cool too

[@RubiconDota]

I love it when someone who is actually a Dr explains complex topics to me in an accent I can understand.

[@hamedal-khateeb7360]

what accent did you use to hear?

[@tarkamlokar9709]

@@hamedal-khateeb7360 Probably indian.

[@israelcyabukombe2267]

When KZbin recommends you a useful data analysis video, to help you understand, how you always get recommended the other stuff.

[@spockfan2000]

Numberphile, NetFlix style: whole season marathon! :) Love it! (hehe... I meant Computerphile!)

[@xnossisx5950]

yay two series in one day extending over 2 1/2 hours each how wonderful

[@tamnguyentri6405]

Love for counting the episodes from 0. It helps me a lot with the terms as well. Thank you.

[@brantwedel]

Using R for the explanations, but using a 0 based index for the series titles ... That's not going to be confusing at all 😆

[@caughtbynothing]

Nope, not confusing at all. 0 ist the first index of EVERY enumeration, makes sense for all of us ;)

[@RIURIU4]

@@caughtbynothing R is not zero indexed

[@andre9897]

@@caughtbynothing really?

[@MaximilianBerkmann]

@@RIURIU4 Literally every computer language aside from R, Matlab and Fortran are zero-indexed.

[@BrunoCarlin]

@@MaximilianBerkmann Lua

[@rialyandriamiseza9814]

Beginning my thesis on Learning Analytics. "LA is the measurement, collection, analysis, and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs" - Siemens, G., & Gašević, D. (2012). Special issue on learning and knowledge analytics. Educational Technology & Society, 15(3), 1-163. Your videos are very helpfiul :) Thanks a lot

[@Plan36c]

You have a talent for teaching and technology. I’m currently interviewing for my first analysis position so this is very reassuring information. Thank you for sharing.

[@wandersgion4989]

Is computerphile transitioning into being a tutorial channel? I like it.

[@matzeh3498]

ARE YOU SERIOUS, I CANNOT WATCH THIS AND TOM SCOTT AT THE SAME TIME

[@pgnhd_]

Same

[@BicyclesMayUseFullLane]

$DEITY DAMN IT, GOOGLE. I CAN ONLY PAY ATTENTION TO ONE THING AT A TIME.

[@s0ngf0rx]

tom scott?

[@iamtheusualguy2611]

yup, same

[@nobodykid23]

same dude, same

[@crystalsoulslayer]

I absolutely love the product descriptions for the saws.

[@ninja_goose4360]

The instance I hear 'data mining' in is usually finding data where it is not easily accessible. For example, you can data mine the console log of a video game to figure out how the game works and whatnot.

[@adityamankar8723]

Thank you so much for this amazing playlist. As a CS student, this was very helpful.

[@PasselivreEdicoes]

Was looking forward for this playlist :`). Thanks Mike and Computerphile.

[@raadwan]

Feel bad for all the people that skipped this video and went to Part 1. lol

[@nonaviandino8387]

R index starts at 1 lol

[@Wolves2314]

Just Being Socially Awkward no it's not

[@Wolves2314]

@Just Being Socially Awkward you don’t know what you’re talking about and you should feel bad

[@Elite7555]

@@Wolves2314 But R can suffer from really bad performance; often it is even much worse than CPython. So in that sense I would just use Python or C++. There are some great libraries out there for statistical analysis. Or use Julia which serves the same purpose as R but is much faster and also has awsome tools for plotting.

[@MaximilianBerkmann]

@@nonaviandino8387 True and it shouldn't be the case. But aye, it was designed for statisticians who don't count from 0.

[@RamkrishanYT]

When you realize that it's a 10 part series, but it uses R *A small price to pay for salvation* When you see that R indexes from 1 *Reality is often disappointing*

[@sherwinparvizian2414]

@@krakensoup7439 Mostly convention. A lot of languages use 0-based indexing.

[@caughtbynothing]

​@@sherwinparvizian2414 Have never worked with a programming language that does not start the enumeration at 0. Once more you see that R was developed by statisticians

[@VandalIO]

@Matthias Julia also indexes from 1 , there are other languages out there which index from 1 too , R is built up on FORTRAN and FORTRAN also indexes arrays from 1

[@kalebjuliu7944]

You have no idea how much i need this, Thanks!

[@mohammaddawas481]

This is the series I always waited from Mike Pound! Thank you! But I have a note, at 13:16, high dimensional data (samples with large number of variables) is not necesserily a big data, it's just a very high dimensional data.

[@skydrow4523]

I see Dr. Mike, I click.

[@chandrahasaroori317]

Can you guys do a machine learning series as well? This is really amazing!

[@zohebdholakia3782]

Beautifully explained

[@iraklismoutidis204]

Amazing series.

[@Jupiter__001_]

Lol the text on the DIY website is really funny! The chainsaw even had The Lumberjack Song xD

[@teekanne15]

just had a course "introduction into data analysis in R" at uni a few weeks ago. This is a nice revisit :D

[@rag3r926]

Birkbeck, UOL?

[@EliteGamerpk]

Man I Can't miss any of these videos, ringing those bells :D

[@znull3356]

Doing this in R instead of Python probably won't age well, but I'll still watch it because of Dr. Pound.

[@garmands]

And then another series with Robert Miles

[@heksqer1022]

To think this and Tom's playlist come out at the same time :D

[@andrarias]

I always thought that Data Mining was acquiring raw data from 3rd parties, like Twitter, Facebook and the like, using their API. For example I once knew of someone trying to predict earthquakes in Japan with Twitter (I don't know how successful this attempt was), but I makes sense to me that this is what Data Mining is -in opposition to working with data you or your company collect, or the cleaner data that other organizations publish.

[@dudeguy8864]

god bless mike pound 🙏🏾

[@KUBKO17]

Dr Mike is Bear Grills of the IT 👍

[@faustin289]

An intelligent model is the one that would predict what I NEED; not what is similar to what I looked at in the past.

[@chloem.872]

Are you ready for that? Tell me, truly, are you ready for an algorithm to predict what you need? Imagine the data they need in order to do that. Smart houses coming to a neighborhood near you...

[@hiqwertyhi]

A+ product descriptions for those saws

[@AndreAmorim-AA]

Data Analysis is important but... Is it possible to have some talk about the boundaries of data analysis regards to personal privacy?

[@Youtuber111-p2x]

your personal privacy is protected. the names and IPs would be data that would not be used, just the purchases.

[@ricma9710]

@@KZbinr111-p2x yes but they still get to know all about you while you don't know nothing about people that analyse you, your privacy might be protected from other civilians but not from companies that crunch your data

[@sepgorut2492]

This tutorial might not be in Python but Python appears at 11:23 with the lumberjack song. Anyone else notice this?

[@matthewrussell5448]

I'm a lumberjack and I'm OK, I sleep all night and I work all day...

[@DominicGo]

love this guy (i could listen to his voice all day 🤣)

[@bruinflight]

BRILLIANT. THANK YOU!!!

[@gooadam]

We were using "data mining" in place of scraping in the early 2000's. That's likely where that got fuzzed into analyzing and finding use for data.

[@zerokelvin3626]

I will binge watch this

[@JemMawson]

I always knew "Data Mining" to be about sourcing data (e.g. web scraping), not pre-processing your existing data.

[@StvnTheFuzzy]

I suppose data sourcing would imply categorizing the actual data you're scraping, right? So in a sense you're pre-processing the data that has yet to be sourced, which of course in turn you're able to (pre-)process further for analysis. Come to think of it, using 'mining' as a definition for it would imply you're digging for gold in land that you might or might not own, hence the ambiguity and why Mike describes it as a buzz word.

[@tallwaters9708]

Jasus... this is a great idea for a series, but even an introduction is going to take a year of videos lol. Good luck.

[@vhz04]

Great content. Is there a repository where we can get the data files?

[@NF-ru8on]

11:20 "...and then you end up having 10 saws...don't know how to use any of the saws, but you know, the retailer's job is done..." lol I'm excited about learning how to analyse data using tools like R; but capitalism sure is depressing.

[@chickenshieee]

Great teacher

[@palmpixiplus]

❤️ loved this!!!

[@exm3266]

If the first part of the actual series is episode [0], then what number do we give the introduction without some people interpreting it as the last episode in the list?

[@1zl541]

i

[@marcinszubryt2088]

There will be subtitles for this series? On what it depends if YT will generated it. Automatically generated are fine.

[@rodrigolara6733]

How can I get him to teach me more about computers? Is there a place we can go so that he can specifically teach us or pay for his classes?

[@TheSam1902]

13:00 I wouldn't agree with your definition of data mining. In a company setting, it's hard to get your hands on a lot of data to start preprocessing, analysing etc, that's when data mining is required: you ask around each department what data they have lying around on hard drives, collect that or spam an API to get more data. So that's prior to preprocessing (because you need the raw material first).

[@BiancaAguglia]

I think most of us make that mistake when we first hear the term "data mining". 😁Once we learn what data mining actually is, then the term makes sense: we "mine" the data we already have to discover valuable information in it. The process of getting data from other departments or other sources is called, prosaically enough, data gathering or data collection. 😊

[@leonhardeuler9839]

Mike, what are you going to do with that saw?

[@alexgarratt5693]

10 part series with Dr Mike, sign me up

[@subschallenge-nh4xp]

Peter Parker:like Datacamp comment

[@4.0.4]

Buzzword soup: "data mining big data with AI-based cloud computing"

[@samuelposejpal2983]

What program did you use to create Browserisor(fake browser)? Thanks

[@nashaut7635]

I thought it was just me until I checked another audio source: sound seems to be «deaf», i.e. lacking a fair amount of treble. I seem to encounter this with more and more youtube videos/channels although I haven't done exhaustive nor detailed analysis, just an observation. Anyway it feels a bit uncomfortable to listen to. Is it also perceived that way by anyone else?

[@wiez543]

Maybe get your ears checked?

[@nashaut7635]

@@wiez543 Sorry, can't hear you.

[@wiez543]

@@nashaut7635 🙉

[@daanielacosta2395]

Why all the professors or scientists in the videos of CF use the same kind of sheet? Are you recycling or something?

[@juliavanderkris5156]

Eyyyy Mike uses a thinkpad! My man!

[@tenseikenzx-3559]

Standard issue at uni I guess?

[@postmodernist1848]

Of course you start counting from 0

[@bahtiyarozdere9303]

This is beautifull 🤩

[@CasualProfundity]

Forgive my noob question but how does it know the dimensions of the matrix without a header file?

[@chloem.872]

This is my best answer, someone more knowledgable please feel free to correct me if I'm wrong. read.csv() automatically returns a data frame, which is very similar to a matrix, but has additional properties and operations that can be performed on it. If you pass a data frame with higher dimensions, then the function will automatically treat each element in it as 2D unless told otherwise. Judging by how difficult it is to figure out just how to assign higher dimensions to data frames, I'm going to guess that most csv files are 2D and that this isn't a common problem. I'm not sure what you mean by header file, unless you're coming from C++ where header files are a sort of prototype for classes you'd like to implement. C++ is a compiled language, and these header files are preprocessed by the compiler (all lines are gotten from the files) and IIRC, they are not included in the compiled object files. The compiler refers to these files for class and function definitions, so it can know how the class or function is supposed to be structured. It's considered a 'strongly typed' language, where arguments given to a function or class are checked for validity and rejected if invalid according to the definition. R is in contrast to this, because it's an interpreted language and is much more relaxed about type checking. In such languages, types are automatically assumed unless told otherwise. For example, you may need to frequently convert between "factor" and "character" data types in R, because characters are often assumed to be factors (at least, in RStudio they are). Beyond this, you can leave arguments out or explicitly state which argument you're passing to it by name, making the number and order of arguments irrelevant, eliminating the purpose of a header entirely. I hope this helped answer your question! :)

[@ruairihair]

No mention of sas?

[@AnythingGoesCodes]

In this series, we will explain how to get people to buy things they'll never use for profit.

[@beautyofsylence]

>starts series at episode zero >uses program for series which starts arrays at 1

[@Jamie-st6of]

these videos should REALLY have subtitles

[@daft_punker]

I'm Mike, and you've just been Pounded

[@kkslidersnan]

Why doesn't this comment have more likes?!

[@satoshinakamoto171]

please make more on AI and ML and data science

[@balping]

What about FORTRAN?

[@marin.aldimirov]

4:38 - vectrices?!

[@AshishAgrawal-br1ji]

Which IDE is that?

[@Iknash]

RStudio

[@pureatheistic]

I would let Dr. Mike POUND, take me to POUND town any day.

[@Dusk-MTG]

How big is big? I don't know.

[@jaffreyjoy]

What does this guy not know about 🙌

[@charlieangkor8649]

"sponsorship from by Google" - was this piece of English generated by Google's AI?

[@Afdac247]

i think 'you may also like' works horribly because its data related to the number of people who bought the item not on data about what they see as missing in their lives. its not peer pressure to have a webpage say 'people also bought" but companies should pay each other to advertise based on tht missing concept

[@o0December0o]

Thumbs up for using R!

[@M1cr0p47]

I usually say data mining when I can't think of the word parsing.

[@wiez543]

R right?

[@silentinferno2382]

Google: let's sponsor computerphile and Tom Scott to make long playlists that you have to watch, and make people spend more hours on KZbin than 24/day.

[@wiez543]

Somehow I feel like KZbin wants me to become a data scientist.

[@nimagameroil1099]

Challenge: take a shot Everytime he says Data

[@Ankit-vc3gx]

Expecting in python ....

[@Littellittel1]

The Egss with ai on it are secretly brilliant in germany. In german 'e'i means egg and it is pronunced just like 'I'

[@FAKETV96]

Visualization*

[@Smile8924]

ML|AI == Rectangle|Squares

[@Catastropheshe]

0:47 you mean pics from vacations? 😁

[@samirz7]

"We as a species produce a lot of data."

[@mileswilliams527]

Who gave this a dislike? Why?

[@dijoxavier]

Excellent, I am python guy, should I learn R ? Is it a good investment of time to learn R ?

[@LordOfTheBing]

No. With python, you get everything R can do with pandas, matplotlib, and numpy, but faster, and with ML with tensorflow/keras. And it's an actual programming language, you can do some actual process with your data then.

[@DarshanSenTheComposer]

Spider-boy has grown up!

[@JesusisAlive_33]

i like the 3d effect

[@wouldntyaliktono]

Lol, an example in R indexed at zero

[@GammabitFilms]

nice white ballance :) finaly ;p just a bit green under the chin ^^ i know. its a pain, if u are not in a studio with same light sources :) keep up @ camera & edit :)

[@andrestone]

"Big data", "Machine Learning", "Data mining", "AI": Good old computer science and statistics rebranded so Silicon Valley can market old tech as new tech. And investors are buying like Apple fans.

[@Slarti]

I did a Python AI course and realised half way through that what I was being taught was statistical modelling. AI? Pffffft!

[@jasondads9509]

Darn, don't really like R

[@perschistence2651]

What is data? Am I data?

[@doctorpex6862]

Training neural network... same as training population