Thank you for this! Ive been waiting for 3blue1brown's 3rd part of the probabilities of probabilities series. There are a lot of very comprehensive videos on beta distribution out there but this has been the most intuitive so far.
@felipec2 жыл бұрын
This is exactly the same reason I came here.
@ihgnmah3 жыл бұрын
For those who don't know why we use the Beta function as the normalizing factor: We need to sum up all the probabilities of all the coins. Since we have infinite numbers of coins, that summation means the area under the distribution curve. In calculus, the area under the curve is defined by the integral of the function of that curve. In this case, the function is x^(q-1)*(1-x)^(r-1) (q=8, r=4 for the example in the video; substituting them in the equation, you will have x^7*(1-x)^3). The integral of x^(q-1)*(1-x)^(r-1) from 0 to 1 (x is a probability, it can only take on a value from 0 to 1) is exactly the Beta function.
@lucassullivan21098 ай бұрын
Holy shit! That's awesome!
@xxxx3732 Жыл бұрын
i stuck in beta baz they do not explain gamma to me now i knew which step they sliped you are the grokking machine learning‘s writer! i just be recommend this book.
@bobbyc11203 жыл бұрын
For years I've been trying to understand the beta distribution. I'm out of college and studying for a probability exam, and it finally makes sense thanks to your video.
@Kornackifs9 ай бұрын
@@mazmillion451 Mutually exclusive events
@mmilrl57685 ай бұрын
@@mazmillion451 He's probably talking about exam P for the actuarial exams
@sidharthdash26663 жыл бұрын
To Luis Serrano- The most humble and articulated teacher I know so far. I am a data scientist who is self taught through videos/blogs and books and do not have any academic training in this field. I wish I could roll back time and start learning these watching your videos. You are an institution yourself. I request you if you could have a series of videos in the field of optimization in general.
@testme20262 жыл бұрын
This crazy, top professors can not explain as good as this guy! thank you
@wootcrisp3 жыл бұрын
Very good. I aspire to teach with your level of clarity and kindness.
@mantidream81793 жыл бұрын
Great video, you've got a real knack for teaching
@rush197721122 жыл бұрын
Dr Serrano thank you for your well explained video. Watching your videos understood in 1 hour more than I have been studying for months. that's a talent and thank you so much for your analysis. EVERYTHING IS MUCH APPRECIATED
@sdsa007 Жыл бұрын
I went the mile to learn the beta and gamma integrals! But that was just to understand what you explained soooo very well! Thank you!
@davegoodo3603 Жыл бұрын
Thank you Luis, that was a very good video. Clearly presented, easy to follow, it has helped me enormously in understanding this distribution. I'm studying Bayesian Statistics so it has helped me with that as well. I've subscribed, so I'll look at other videos in your collection. Much appreciated.👍
@srinivasanbalan24693 жыл бұрын
Kudos Dr. Serrano. You are an excellent teacher as always! Looking forward for the Thompson sampling
@dansplain23932 жыл бұрын
Really good. Never seen the intuition of bayes explained like that: “these have to add to 1”
@allisonal Жыл бұрын
Clear and methodical exposition. Thank you!
@dyoolyoos3 жыл бұрын
Just have to say, I've watched the binomial distribution vids of 3Bl1Br and your explanation made more sense!👍🏼 Granted we're still waiting for his Part 3; pls help prod him for it!😊
@hardwarejunkie92 жыл бұрын
Absolutely. Hunting around to fill the gaps for Part 3.
3 жыл бұрын
A very neat way to introduce this topic. Thanks sir
@robharwood35383 жыл бұрын
Luis, I have a request. It may be something too difficult (I have been trying to find a good, understandable answer for many years now), but on the other hand, it is absolutely *fundamental* to the topics you cover on your channel. The question is: How would one go about calculating (or approximating numerically) values for the Gamma Function without the aid of a black-box tool like a spreadsheet gamma(x) or gammaln(x), or Wolfram Alpha, or anything like that? And not just for special values like for integers n or (n + 1/2), but for a general rational/real number r. Everywhere I look there are either a) appeals to an existing black-box function that will return a value for you, without understanding where it came from, b) resorting just to the general properties of the Gamma function (such as Gamma(x + 1) = x * Gamma(x)) and special pre-known values such as Gamma(1/2) being some value involving Pi, I believe, or c) virtually impenetrable mathematical formulas that assume the reader knows way more advanced calculus and advanced theorems that themselves require other advanced theorems to even *understand* what they're *for!* It's very frustrating, because the Gamma function is used everywhere when you start digging down into the fundamentals of probability theory, Bayesian statistics (and classical stats, too), information theory, machine learning, and a whole host of other areas. But *nowhere* have I found an explanation of how to calculate it that goes from 1) here's the definition and some properties of it, to 2) here's how you can actually calculate it for yourself if you really want to. Is it really that opaque??? Compare the situation with say the exponential or natural logarithm. If you have the patience, you can use the Taylor series to calculate them for whatever input you like. Likewise for most other common functions you can think of, trig functions, even things like the Normal distribution can be approximated in various fairly straightforward ways. Surely someone can open up the black boxes and explain how they work to us non-super-advanced-math folks?!?! Especially for such a fundamentally important function! Anyway, if you have any ideas you could mention or perhaps if you get inspired to even make a video about it, I personally would very much appreciate it, and I suspect I'm not the only person in the world who would! 😅
@Nxck24402 жыл бұрын
Gamma is defined as an integral, gamma(x) = integral from 0 to infinity: t^(x - 1) * e^(-t) dt You can use a substitution to make these bounds finite, e.g. let t = -ln u: gamma(x) = integral from 0 to 1: (-ln u)^(x - 1) du Now you can use numerical integration. You have to be a bit careful though since the lower bound is improper. A good strategy might be to start at u = 1 and integrate backwards, taking smaller and smaller steps as you get to u --> 0. Writing this as a summation is possible but not very useful as you'd want to program it, and at that point why not just use the black-box function anyway?
@LSC692 жыл бұрын
Very good video. Did a much better explanation than my statistics professor. One tiny suggestion though, at 11:16, I think it would be more intuitive to the viewers if you didn't vertically scale each probability graph but instead maintained the same scale. That way it is easier to see how a more spread-out distribution results in less probability density around the mode of 0.7.
@tanim980 Жыл бұрын
Please make a video about Upper confidence bound in reinforcement learning ,you teach so well
@user-wr4yl7tx3w Жыл бұрын
I thought data was incorporated into the likelihood. But in your last example, with larger sample, the beta prior reflects the data increase. I’m not clear on that part.
@NaZhao-r1f8 ай бұрын
Thank you so much for the video, best beta distribution ever seen. I wonder if there would be a gemma distribution introduction video planned?
@anttwo6 ай бұрын
I don't understand something. Why do we multiply the probability of heads to the probability of tails? Eg: coin 3 of the second example has P(H)=0.3, why do we multiply it with P(T)=0.7? Edit: I also didn't understand why is it (1-p) still
@Tyokok Жыл бұрын
Incredible explain!
@vivekgandhi8891 Жыл бұрын
why did you multiply the probabilities on 3 heads and 2 tails
@calluma8472 Жыл бұрын
Best video I have found on this topic - I have been waiting for 3b1b to finish the binomial topic by talking about using the beta. One question - let's say I have a coin and have done 10 throws and so I use beta distribution where a=8 and b=4. Can I then say something concrete like p(h) is between 0.6 and 0.8 with confidence of 54% (54% is based on cumulative dist at 0.8 minus cumulative dist at 0.6)? And with a=71 b=31 confidence would be more like 77% for the same range?
@felipec2 жыл бұрын
Excellent explanation, one minor comment though. At the end you present 3 graphs with the beta distribution at different values, and it's clear the one with a=701, b=301 is the more likely one to land close to 0.7, but you didn't show the *height* which I believe is the maximum likelihood estimator and it's much higher in the 3rd one.
@Имя-к1ю8 ай бұрын
But this is a probability density function, f(x)=PDF, not the probability of p, so how we know the real probability of p?
@BetoAlvesRocha2 жыл бұрын
Hi, mate! Thank you so much for the very clear and kind explanation. By the way, love your accent. Cheers from Brazil! ;)
@BetoAlvesRocha2 жыл бұрын
Ahhh man! Now I know where I know you. It's from Udacity, I can remember some Machine Learning classes taught by you =)
@lactobacillus1286 ай бұрын
Why the probability of Head is started 0.4? not 0.5 each?
@nitinkapoor4752 Жыл бұрын
Finally… I have a better understanding of Beta distribution
@kylepalmer69363 жыл бұрын
This is really quite good; very clear explanation of a complex concept. Please follow through with a video on the gamma function.
@user-wr4yl7tx3w Жыл бұрын
Not sure why the binomial coefficient term would go away.
@omarmohy39753 жыл бұрын
Luis, really great video as always. I would like to ask to make sure I understood, If I have a problem where I want to get a likelihood score for 3/5 and 60/100, and I want the second one to yield a higher score then I use the Beta Distribution right? The second question will the probability which is are under curve will differ a lot from f(x) from a=7, b=3 and a=700, b=301
@michaeldouglas76413 жыл бұрын
Hi Luis. Great video. Have you since made a video regarding the Gamma function/distribution as you mentioned you might at (9:08) mins?
@kenkinyua70362 жыл бұрын
watching from kenya this was amazing thanks
@SerranoAcademy2 жыл бұрын
Yeahhh!!! Greetings to Kenya! :)
@ukjoeee3 жыл бұрын
I am looking forward to seeing next video
@cernejr3 жыл бұрын
What is the intuitive explanation of the asymmetry of the curve? And why is the curve getting more symmetric as the number of coin flips rises? I would be nice to see these discussed/explained.
@SerranoAcademy3 жыл бұрын
that's a great question, I hadn't thought about the symmetry... I don't know if the one with more flips looks more symmetric simply because it's skinnier, or because it's actually more symmetric for a combinatorial reason. I'll give it more thought to see if it means something, keep me posted if anything comes to mind!
@Lsazeh2 жыл бұрын
Super clear explanation, thank you!
@bestoftheinternet34215 күн бұрын
wow this is interesting. thanks sir!
@rajatsharma61373 жыл бұрын
please make more probability related videos...its really helpful..
@nanu-Nina2 жыл бұрын
Thank you so much. Now I got it!
@emanalsuradi49693 жыл бұрын
superb!!! The best explanation ever!
@jbtechcon74343 жыл бұрын
Another great video and clear explanation.
@AmitGuptaGwl2 жыл бұрын
Sorry, I couldn't understand why we divided with the sum?
@SerranoAcademy2 жыл бұрын
Hi Amit! It's so that the probabilities add to 1, since they always have to add to 1, as we're considering all the possible cases.
@InglesConConfianza Жыл бұрын
THANK YOU!!!!!!!
@tithisarkar29873 жыл бұрын
It's so much helpful Thank you so much sir
@thomasward71963 жыл бұрын
I had a ohhhhhhhhg moment, while watching this. Thanks for the amazing explanation, I'll make sure to sub. Cheers
@maxyen98922 жыл бұрын
fantastic video!
@gergerger533 жыл бұрын
Another great video!
@ytseberle2 жыл бұрын
Excellent video. Thanks so much. One picky note: sometimes you pronounce it "beta" and sometimes "bee". The Roman letter B (bee) and the Greek letter B (beta) look alike, but aren't pronounced the same.
@mahnazakbari25042 жыл бұрын
*B* is the area under the curve. *Beta* distribution is the *density* divided by *B* .
@jackpot7041 Жыл бұрын
very nice video, thanks
@scottfan50793 жыл бұрын
Very useful, thank you very much!
@angelsabillon932 жыл бұрын
I wish my statistics professor explained like this
@tejask54173 жыл бұрын
You are a genius :) Thank you!
@samirelzein19783 жыл бұрын
Awesome as usual
@maxpaju3 жыл бұрын
Why are they not called meta-distributions?
@SerranoAcademy3 жыл бұрын
Ohh that’s a very good name!
@offswitcher31592 жыл бұрын
Great video
@venready2839 Жыл бұрын
The link to your book is broken.
@SerranoAcademy Жыл бұрын
Thank you so much! Fixed. :)
@pradiptapattanayak80853 жыл бұрын
Presentation is too good.
@suslamo3 жыл бұрын
thank you!
@RajdeepBorgohainRajdeep3 жыл бұрын
Hello, Sir please make a video on Eigenvectors :)
@SerranoAcademy3 жыл бұрын
Thanks! THere are some eigenvectors in this video: kzbin.info/www/bejne/nV6rk2Vslsx1fMk But soon there'll be a video on generalized eigenspaces, stay tuned!
@RajdeepBorgohainRajdeep3 жыл бұрын
@@SerranoAcademy Sir, I have seen the above mentioned lesson. Thank you and waiting for the new one :)
@md.abdurrahman70598 ай бұрын
Good video❤
@奶盖生煎包 Жыл бұрын
LOOOOOVE YOOUUUUU❤
@rhuanbarros Жыл бұрын
thank youuuuuu
@tianyiluo29912 жыл бұрын
nice video
@tormentacristal2 жыл бұрын
Great!😍
@franard45472 жыл бұрын
nice exp.
@johnokon-c2i Жыл бұрын
Bruh!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! May your days be long and as easy as you just made my life!!!
@antonioruotolo60148 ай бұрын
too many leaps to be easily undertandable
@gauravms66813 жыл бұрын
❤️
@Coughi3 Жыл бұрын
thank you for the video that was very well explained