Maximum Likelihood estimation - an introduction part 1

[@adamomer9658]

i really appreciate as many other econometricians through over the world,because we, in the third world we suffer so much from inconvenient environment to persue high education especially in the field of statistics.God bless you Mr.Ben

[@semmicolon]

Im in Canada and my masters level econ lecturer couldn't teach this properly

[@wanjadouglas3058]

wouldn't agree more

[@Alessio11092]

Today I have my Econometrics exam in my master. Let 1 millionth of Ben's knowledge resides in me. For real, this is truly a life savior. Many people including me really appreciate your hard work and dedication. Thanks to your explanations, this subject has became much easier and interesting. You are the Khan Academy for econometrics!

[@lastua8562]

His voice is much easier to listen to than Khan academy. Do you have any recommendation for Tobit estimation? I could not find it in Ben's work.

[@sami-samim]

I thank YOU and the founder of KZbin... and the internet!

[@SpartacanUsuals]

Hi, many thanks. Glad to hear you found it helpful! Thanks, Ben

[@lissakolotova4387]

*Only 18* 👇👇👇 405465.loveisreal.ru

[@nesleyorochena6223]

One of the best videos I have seen on MLE.

[@wut_heart]

thanks so much Ben, you are a really gifted teacher. a mere half hour of your videos have really opened up this concept for me!

[@estelleliu7195]

Much more clear than what my professor taught us. Thanks for making this video!

[@jaredgreathouse3672]

This is the Khan Academy of econometrics

[@kursworld]

Best explanation so far about the meaning of Likelihood function!

[@Partho2525]

you know you are a great teacher...thanks

[@SpartacanUsuals]

Hi, many thanks for your message, and kind words. Best, Ben

[@enassabed4102]

Ben Lambert thank you for your courses, they are very helpful, you are a great teacher Mr. Ben

[@Paswansonu80]

great sir

[@jamejustice00]

Thank you sir. To be honest, I am not sure about the different between likelihood and probability, but I did understand MLE after watching your videos.

[@wanjadouglas3058]

Paul, this was very helpful. Doing QM2 as part of my Ph.D. coursework in economics and you always help clarify concepts. A real estimation and especially with normal PDF would suffice to elucidate things more.

[@khumomatlala7106]

I might be wrong but this is my understanding of this video: P is the probability that we pick/choose/observe a male from the population. That mean that 1 - P is the probability of choosing/picking/observing a female. In this video, he is trying to estimate what P (i.e the probability of choosing a male in the UK) is if it was not already given to us. Note: The distribution used is a Bernoulli Distribution.

[@ayikkathilkarthik4312]

Really appreciate that explanation, I was getting confused in this thing. You cleared all my doubt. Thanks.

[@stolfan1234]

It’s so nice to get some sort of intuitive feeling about this. Thank You!

[@busarahall7554]

You saved my grade on my last midterm! Thanks!!!

[@yanhaong5309]

Best explanation on ml I have ever seen...thanks.

[@MrAndrewDAmato]

This was really helpful. I still don't know how to do my homework lol but this was definitely a step in the right direction. Thank you!

[@MrScotchpie]

For something so simple and intuitive, this makes it sound very complex.

[@Mr1Lemos]

Great video, good explanation that allows to clearly understand the concept.

[@ProgrammingTime]

Excellent videos, I've been interested in statistics as a personal interest and these videos are extremely helpful, Keep up the good work!

[@lizrael]

You are a life-saver.

[@gello1337]

Ben you are truly amazing.

[@luciapage-harley8860]

Hi, I have a question! Why are you using the conditional pdf f(xi | p)? In other tutorials i've seen them use this one, the marginal pdf and the joint pdf but I can't find an explanation on why :) thank you!

[@2beokisgr8]

Great refresher for me, thanks

[@kelpgy]

this is ridiculously helpful thank you

[@GAment_11]

Extremely clear. Subscribed. Thank you so much for taking the time to do this.

[@lastua8562]

Most of all, he is doing it all completely for free. Best man, helping thousands of people, but if people would know, probably a few millions.

[@connyv.3807]

Thank you for this wonderful explanation.

[@Grandremone]

Great explanation, thank you!!

[@junkfire4554]

I'm lost at 5:49. Are you saying that we're seeing whether the observations we ended up getting align with the probability of getting those observations? So that the higher the 'likelihood', the less biased and more consistent our estimator is?

[@Daniel-cu9wj]

As usual, great explanation Ben Lambert. Thank you for the effort you put in making these videos. I come here everyday after my econometrics II class to get a refresher. More often than not, I learn more from your videos than from class. Cheers.

[@MrRynRules]

Thank you! Really appreciate your explanation!

[@yusifovaze]

Your videos are great, man, thank you very much and wish u good luck!

[@lastua8562]

1) Our original function is only for the binary case, i.e 1 vs 0? 2) Is MLE only for binary cases? If not, how would we use p in alternate functions? Thanks.

[@saargolan]

Excellent explanation.

[@lawrencecohen1619]

Excellent video providing great clarity on the Maximum Likelihood estimation.

[@mastahid]

which one is given? the parameter or the observed data?

[@tenzinnamdhak]

hi there, i really enjoyed your video. It helped me in understanding the concept. it would have been much better if you use the two variable model and Yi being normally and independently distributed between mean and variances.

[@alirezagyt]

So how in the last line we get to the joint probability from the conditional probability? I think the fact that the variables are independent would let us write each conditional probability separate, but I don't think it would let us change conditional probability to joint probability.

[@Ha-mb4yy]

why haven't you included the binomial coefficient in the function?

[@zoomnguyen951]

Excellent! Thank you very much!

[@violinonero]

How does taking the derivative of the function give us the maximum estimation? The derivative can be zero not only for maxima, but also for minima and saddle points. This would only work for unimodal distributions. How do we proceed for distribution functions that have many local maxima and minima??

[@airhead3409]

@Ben Lambert how exactly did you derive that f(x_i | p) = .... ? Is that some sort of bernouille cross-entropy? I just would like to know how to get to that result :)

[@charlesledesma305]

Excellent explanation!

[@70ME3E]

what's "the idere is"? is that short for 'the idea here is'?

[@leojboby]

Still at 0% progress wrt to MLE. Peaks and valleys exist at derivatives of 0, we are assuming the shape of L. Moreover, p is in turn expressed in terms of x. How is this dealt with? Even before finding the derivative of this joint probability I'm at a loss...

[@diodin8587]

At 1:34, P(X_i|p) should be written as P(X_i; p).

[@MaksUsanin]

Hello Ben, can you explain me some moments please. in your example you using f(Xi | P) in video 1:23 - this style you created for yourself ?, Who created the rules ? Can its be like f(Bj \ T) ... ? (or another style from my imagination ) how you decode this symbols/formulas to useful information? Thanks you for the answer

[@1994RandomUser]

+Maks Usanin Hi Maks, using Xi is fairly standard procedure because you are wanting to know a certain value of x, given a probability distribution. The P however is usually whatever parameter tends to be used. For this specific scenario, P is appropriate as it follows a bernoulli distribution (can take values 0 or 1) and p tends to be the parameter used. Try not to get too hung up on symbols, just think the second part is the parameter from the distribution function, and the first is what you want to know from that distribution function.

[@atrus3823]

Can't we simplify this more by just summing the exponents for p and (1 - p), since p^{x_1}*p^{x_2} = p^{x_1 + x_2}?

[@rohanvaswani9418]

Shouldn't the probability function be p(xi|p) = ... rather than f(xi|p) = ...?

[@musicjunkie8228]

Wish you'd enable community contribution so we could fix those subtitles for you! :)

[@SpartacanUsuals]

Hi, thanks for your idea -- I didn't know such a thing existed! I have switched this on now, so anyone who wants to help, can do. All the best, Ben

[@coconutking23]

thank you sir, just made my day :)

[@Theirviewmatters]

I don't know if this is a stupid question. I'm studying statistics right now and in my book it says P(p/x)=productsign f(xi/p). In your lecture it's turned around: p(x/p) instead of p(p/x). Can you explain it to me? I don't have a clue what I'm doing here!

[@nasirminhas1163]

Hi I want to learn History of MLE ..can you uplaod its history ..

[@michaelleming9123]

nicely done (and the subtitles are a hoot)

[@brianclark4796]

what does the likelihood function look like for a distribution that is not binomial but is still discrete? say my y is not just male and female but also transgender?

[@andrewkivela5668]

I actually understood this!

[@fgatzlaff]

Hi Ben, I much appreciate your video and introduction to the likelihood function. It's really straight forward and i like the way how you structured the video. However i can't wrap my head around the function p^xi*(1-p)^1-xi. Could you may explain what the logic behind this formula? Like, why this assumption is logically correct and how it was created? kind regards, florian

[@praveenkumar-mh2dt]

Since, It is a binary outcome, you can consider it as Bernouli random variable. That's the function for modelling a Bernouli RV. You can think of it as binomial distribution with n=1.

[@statisticstime4734]

Excellent!

[@billykovalsky8149]

I don't get it. The expression 'dL/dP = 0' is not explained, taken out of nowhere.

[@shgidi]

Great Lectures! I would suggest differentiating capital X from x by writing the small x by making it more curly, like this כc

[@GAWRRELL]

Can you make an example using real world data? I'm a programmer and I want to implement this algorithm.

[@mixxxxaxxxx]

if you found anything please pass it to me...every prof is giving great lectures with some gorgeous mathematical notations (i guess the reason for that that they dont communicate in plain english anymore) with no real world examples at all

[@OsamaComm]

Very Nice, I am so thankful.

[@jakobtheking1]

I really like your videos, they help a lot but to be honest in this video in the end your explaining is very vague..what to you mean we maximize the likelihood over choice of p?

[@saketanand6076]

You are great teacher..could you add a series of lecture on time series as play list..you have the videos but it is scattered

[@deepintheslums]

Great explanation

[@juliangermek4843]

What I still don't understand is the following: If you look at a sample of 100 people to estimate p (probability that its a man) for the whole UK, you use the Likelihood way which is quite a complicated calculation. Why don't you just count how many men you got in the sample to get the ratio #men/#everyone? Eg 60 men out of 100 makes p=0,6.

[@aBigBadWolf]

+Julian Germek If you follow this series you will see that this is actually the case.

[@engkareemhamed]

i need help in matlab program in this topic please if you able to help me

[@shoutash]

@Ben I'm a little confused. The pdf that you use is supposed to be the actual pdf or is this something you define arbitrarily?

[@Prithviization]

+Ashish Vinayak my question too

[@SpartacanUsuals]

+wannawinit Hello both, not sure I fully understand the question? The pdf that we define represents a model of the given circumstance - in most cases it is an abstraction used to try to understand, and interpret reality. It is not actually a real thing. Therefore, there is no such 'actual' thing (apart from the trivial cases of where we are doing simulations from a given distribution on a computer). It is just a tool used to try to make sense of things. However, it is not 'arbitrary' either. A given likelihood has a raft of assumptions behind it, which dependent on the situation, may make more or less sense. Therefore, we need to be careful when choosing our likelihood to make sure we pick one that is pertinent to the particular circumstances. Not sure if any of this helps, or if I've not understood the question. Best, Ben

[@Prithviization]

+Ben Lambert Thanks Ben. But f(x|p)= p*xi + (1-p)*(1-xi), also gives the same result. ie when xi=1, f(x|p) = p, else when xi=0, then f(x|p) = 1-p. This makes sense too. Why have you specifically chosen Bernoulli distribution as the PDF of the population?

[@SpartacanUsuals]

+wannawinit Good question! Essentially your distribution is the same as that of a Bernoulli r.v.. Because it is that of a Bernoulli r.v! It is the same because, xi can only take the values 0 or 1, meaning that the overall likelihood (of all your date) is the same as mine. Therefore all ML estimates will be the same. Hope that helps! Best, Ben

[@Prithviization]

+Ben Lambert Thanks for your reply. But when I try to find [Product(p*xi + (1-p)*(1-xi)) for i = 1 to n] , take its log and differentiate it wrt p, I don't get the same result. Could you please explain?

[@kerolesmonsef4179]

very helpful . thanks

[@arjunjung2007]

i would love to get your help on some work I'm currently doing!

[@gongyaochen]

Very clear!

[@SpencerLupul]

Thanks for the lesson! Very helpful. Though after spending the last few days brushing up on statistics… it amazes me just how many stats teachers use binary gender as an example in their videos… isn’t this actually a mistake? I mean… it’s no mystery that there exist people outside of male/female definition. Therefore, it makes an empirical lesson feel like it is making a socio-normative conclusion. I will keep leaving this comment on stats teacher‘s videos, because i think it’s a conversation worth having. After all, if what you are teaching is factual…. Then the examples should be without a doubt factual in nature. Or do you disagree?

[@chh376]

Super clear!! tks!!

[@Feyling__1]

you have saved me

[@saurabhsinha940]

Awesome!

[@lauramiller7418]

The closed captioning is pretty laughable so it's a good thing I can actually understand! Might be less useful to someone not a native English speaker

[@evanrudibaugh8772]

The intro looks rather scary to most of the world in the 18th and 19th century. The UK is invading that purple island!

[@user19107]

can Xi be any value?

[@BobWaist]

great video, but please get a better mic!

[@gzlc]

Amazing

[@shiwenzhang4343]

thanks a lot!

[@gijsbinnenmars2891]

Love you xx

[@razaws6967]

great!

[@andersonbessa9044]

It seems that you used p to represent the population and the probability hahaha. Just this was a little confusing. Other than that, great explanation!

[@GuillaumeR666]

I still don't get it, guess it's not my cup of tea

[@siddhantvats9088]

I didn't get what is P here

[@khumomatlala7106]

P is the probability that we pick/choose/observe a male from the population. That mean that 1 - P is the probability of choosing/picking/observing a female. In this video, he is trying to estimate what P (i.e the probability of choosing a male in the UK) is if it was not already given to us. Note: The distribution used is a Bernoulli Distribution.

[@vijoyjyotineog1896]

voice is damn low

[@tinlizzyification]

Yowsahs the captioning for this is completely whacked.

[@seth69]

IS THIS MLE????

[@SpartacanUsuals]

Yes! Best, Ben

[@ccuuttww]

@@SpartacanUsuals Is it equal to grand mean at the same time ?

[@shynggyskassen942]

watch with 2x

[@adorablecheetah2930]

Voice is too low

[@larry3317]

you should explain things more thoroughly for the dumb people like me, maybe show all the work out

[@movahediacademy9017]

Why are women number 0? sexiiisttttt.. Im triggered :p

[@johnwayne2349]

I am a feminist and this is offensive

[@larry3317]

is this guy trying to copy khan academy?

[@kykise1395]

Just another waste of brain power in school. The chances of you needing this for a job are so low. Unless your pursuing the career of becoming a meteorologist or something related.

[@sammypan3528]

MLE is in fact used in almost most of fields that uses statistics, that includes your banks, your financial services, the phone you are using, and any policy making (I can't make a list of everything but there are actually quite a lot of applications)...

[@souravdhiman385]

your Audio sucks. you should be little louder

[@ryllae8059]

Seriously, u cant teach. Just stop. After 5:22 He just starts talking gibberish.

[@coconutking23]

thank you sir, just made my day :)

[@SpartacanUsuals]

Hi, thanks very much for your message and kind words. Best, Ben