Why A/B tests and randomized controlled trials work

[@very-normal]

To try Shortform for a free trial, visit shortform.com/verynormal, and you'll receive an additional 20% discounted annual subscription.

[@Moe5Tavern]

Somehow your videos are so well structured and therefore good to follow, the red line throughout is very clear. Thank you!

[@olipito]

Your videos are amazing, please keep going!

[@MrUCTeja]

Amazing explanation..! Thanks a lot..!

[@anthonymoore3246]

Lovely video as always

[@gonzalodiazamor5494]

after a clinical trial is great to use propensity score to match the patients. great video! thank you very much! Cheers and thanks for the content! PS. Here I am too with my 'Ventolin

[@very-normal]

inhaler bros

[@wanfuse]

don't many confounders, confound the relationships? That is if there is enough confounders with overlapping effects, doesn't this break the statistics?

[@very-normal]

That’s the great thing about randomization! When it works, it doesn’t care about the number of confounders or how these confounders interrelate, the cause-effect relationship gets isolated

[@theraizor1629]

Amazing as always, keep going

[@Another_option]

Great video!

[@yashagrahari]

3:58 Lol! you got me.

[@lorenzoplaserrano8734]

love love your channel ❤

[@chemistrycapital]

Great content!

[@robertwilsoniii2048]

I didn't know randomization breaks confounders. I'm skeptical of that... how do we know the samples themselves are good enough? I guess it's "unlikely" to get a sample that isn't good enough. I'd feel more comfortable first prooortionately stratifying samples, and then randomly sampling them while holding the stratification sizes proportional to get a proportionately allocated stratified simple random sample. I also don't see the difference between statistical controls applied to simple random samples and experimental trials. They seem to be logically equivalent.

[@very-normal]

Yes! Stratified randomization is definitely another common strategy. I didn’t cover it here, but you’re right

[@guitarflori]

There is one difference. If I use statistical controls on a simple random sample, I rely on measuring all disjunctive pre-treatment causes+Proxies of Confounders (VanderWeele 2019). Some of those variables might not be measurable, or might be unknown and are therefore not measured. We can only find the exact effect if it is true that all necessary variables (according to above criterion) are measured. Randomized Controlled Trials do not rely on measuring all the necessary variables for random assigment, because the assignment to the Treatment is being done by the researchers directly in the simple random sample. They do(x) on the subjects of the study. Edit note: Of course both have the common problem of selection bias.

[@joelbeeby866]

Great vid!!

[@galenseilis5971]

I've half of Taleb's Incerto. So far so interesting!

[@AustinFragomen-wy8sy]

Check out Daniel khaneman he presents taleb’s idea but somehow better

[@very-normal]

Which ones have you read so far?

[@AustinFragomen-wy8sy]

@@very-normalBlack swan and fooled by randomness

[@galenseilis5971]

@@very-normal I've read The Black Swan, Fooled by Randomness, and I am partway through Antifragile. I've also read his "technical incerto": Statistical Consequences of Fat Tails. I actually got interested in the technical analysis of extreme value theory and some of his other technical work before moving onto the pop' books.

[@galenseilis5971]

@@AustinFragomen-wy8sy I've read Thinking Fast and Slow, and also his book Noise. I really enjoyed the former when I read it back in summer 2018. I could see Noise being a good book for someone that really has never thought about the statistical concepts like the variance-bias tradeoff, but I'll confess I found it repetitive. His books aside, I felt some sadness when I heard he passed away.

[@orangedrink-r6f]

Great vid🎉🎉🎉❤❤❤😊😊😊

[@youteubakount4449]

Yeah chapter 2 deserves more than 1 minute bro.

[@synchro-dentally1965]

Do you have seasonal allergies? Consider consuming more vitamin C if you haven't already. It is a natural anti-histamine.

[@very-normal]

lol yeah sometimes my allergies get bad and it comes through on voiceovers unfortunately. I’ll try to add some more vitamin C in my routine

[@synchro-dentally1965]

@@very-normal If they're particularly bad there was also a 2020 study from Thailand on Ginger extract versus Loratadine in the treatment of allergic rhinitis. The only difference found were the side effects from taking the Loratadine.

[@thomasconnor8117]

😮

[@matteogirelli1023]

Econometrics people likes here😏 ⬇️

[@DanielLancet]

Gotta get that ATE