What is A/B Testing? | Data Science in Minutes

[@kingofthedong3908]

im a graphic designer with no idea what i am doing other than design beautifully, and i was tasked on learning how to do a/b testing for my first job. this is very helpful for me to understand the basic, thank you !

[@Datasciencedojo]

Keep following us for more content, Irfan!

[@veej_77]

I'm a data science student and found this brief video informative, especially if you land a job in marketing research, etc. We didn't cover this in school and I wondered why that was because I see it everywhere on job searches. What specific tools are used for this?

[@analisamelojete1966]

Basically, this is hypothesis testing but with a fancy name. Things like means difference, T tests, F tests, etc. Just pure statistical inference.

[@lucasl1047]

Yep, data science just like BI relabeled a bunch of well known statistical techniques with more fancy, gimmicky, names lol

[@analisamelojete1966]

@@lucasl1047 Agreed!

[@lucasl1047]

@@analisamelojete1966 Gracias Ana :P

[@Datasciencedojo]

@Ana Lisa You are correct. At its core, A/B testing is design of experiments (hypothesis testing, t-tests, confidence intervals, p-values etc.). Now add a lot of business understanding (seasonality, customers), UX design (colors, buttons, novelty), engineering (cookies, coding, servers/clients) and this becomes A/B testing or simply online experimentation :)

[@zxvbhvxz]

This was super clear, thank you so much

[@Datasciencedojo]

Thanks, Brian. Glad you liked it!

[@relital3362]

Short and sweet. Thanks!

[@canaykoseoglu4766]

Hello, this is extremely useful information. I'm running AB tests with WASK. I can run A/B tests between my Facebook and Instagram ads and my Google ads. Furthermore, based on the results of my AB tests, I can disable inefficient ads and continue with my efficient ads.

[@Datasciencedojo]

Great, Canay.

[@willzo4026]

I love this teacher.

[@AnonyMous-vt3qy]

thank you unknown girl 🙏😉

[@jchenmason]

Thank you, Aubrey Plaza!

[@vf6373]

i fell in love with A/B Testing within a few seconds watching this.

[@sionmarak1916]

There's an underlying A/B meaning on that sentence :3

[@050138]

Me too! And today is Valentine's Day! 😍

[@rushabhgada]

As simple as it can get. Thank you!

[@awb19892]

excellent video

[@jarombray6226]

Super helpful! I loved the visualization. It helped me internalize the information.

[@Datasciencedojo]

Keep following us for more tutorials, Jarom.

[@Gibson-xn8xk]

Thank you so much. Extremely helpful information!)

[@SK-yc8lz]

You are working with data?

[@AL-pj7jg]

good job. simple and easy way of explaining.

[@Datasciencedojo]

Glad you liked it. Keep following us for more content.

[@TheIronhideChronicles]

Thank you very much for explaining this in simple terms

[@Datasciencedojo]

Glad you liked it!

[@LILY-os1vo]

very helpful! thank you

[@Datasciencedojo]

Stay tuned with us for more tutorials.

[@brajeshprajapat1590]

thanks to give the information on a/b testing it helped me alot.

[@Datasciencedojo]

Keep following for more content!

[@michaeljordan49]

This is excellent!!

[@palashmyaccount]

Great video. Keep up the good work!

[@kailashharisn2250]

Palash Arora

[@hemantsharma5385]

How can i find web log dataset on healthcare website for a/b testing

[@Datasciencedojo]

Hi Hemant, please forward your query to our site chatbot & email id: datasciencedojo.com/

[@Tahoza]

So... t-tests/ANOVA?

[@muneebbolo]

tysm

[@rajgurrala6228]

The presenter is Amazing. But I felt she is a bit nervous, But your nervousness is pretty attractive. Come on. you are the best and you will look great being more confident. Very informative 3mins.

[@azizmamoughli267]

Who Does A/B test ? ( Job/Career) ?

[@NMLeepsa]

I am curious to know how you had that background with graphs. anybody who can help? I want to make my own videos for my channel with such visuals in the background. Is there any software for that? any youtube video to explain how such video is edited

[@VVV-wx3ui]

Am still not clear on A/B Test in DataScience. While I understand that this video is made to educate folks, but the message and the education part seem missing as I did not get anything from this video. Probably, the host is reading it out from the Tele-prompter and did not explain the need, approach and the conclusion. @"Data Science Dojo" -- pls pay attention and post right videos.

[@somanshusharma6525]

The fact that its required item on job posting is absurd! If you can't trust your candidates to learn this then you should not be hiring them in the first place

[@antwanwimberly1729]

USA 🇺🇸 #lanetix taught me

[@gouthamrajesh2745]

[@whatisahandle221]

Question to users: For HR/benefits (Eg health insurance) and work intranet tools, is it just me, or are websites getting more and more clunky, click & menu happy, cumbersome, and poor in their search capabilities? All the new web tools my (large) company or new benefits groups have put out in the last ~3 years have seemed more and more like a Lego video game: you’ve got to click all the text bc the hyperlinks aren’t obvious, look carefully and explore all the text because of fancy picture & explanations vs simple titles or obvious organization, scroll way down on ever page, and explore all the hidden menus, because nothing is simply presented, and everything requires multiple clicks, even common actions.

[@topspeed8832]

Power

[@sinan_islam]

You did not explain what is A/B test.

[@davidfitcher2953]

why don't we just call it Version Testing?

[@Datasciencedojo]

Hello David, version testing is mainly used when our main focus is to keep track of and see the histories of different versions of a test case. Whereas in A/B testing we compare two hypothetical versions of a webpage or app against each other to determine which one performs better.

[@sachinbabup]

Lindsay Lohan, is that you?

[@vivekjoshi3769]

Sorry but really not clear. I watched this twice & still not clear. Can anybody explain me ?

[@VikramSingh-qg3nh]

It is just like comparing 2 different ui versions

[@howdontanalytics6158]

I mean....this video is not that helpful....? why everybody here is praising? I don't know man..

[@HotShots00]

she looks baked

[@divertechnology]

nice woman, she makes this less boring

[@pbanikk]

You're so beautiful!

[@ayushkr.sharma2303]

😍😍😍

[@ayushkr.sharma2303]

😍😍😘😘

[@maamriabassem3818]

Amazing explanation, though you ought to smile a bit more honey 😂😂😊😊

[@WackyMe4eva]

Would you make the same comment if it's a dude??

[@maamriabassem3818]

WackyMe4eva I’m a teacher too, it had nothing to do with sex, just a piece of advice

[@WackyMe4eva]

@@maamriabassem3818 what has that got to do with you being a teacher?

[@ZanetDesign]

Hi Here is a question that I just can't find an answer to regarding thumbnail split testing. when is the best time to split test thumbnails? I use Tubebuddy for split testing my thumbnails right from day one. But im worried im doing something wrong and getting unreliable results. here is my process... 1. I design 2 thumbnails that I think will work. 2. I release the video to the public with my thumbnail A 3. I now splittest to thumbnail B and rotate daily 4. I let it run until a winner produces a statistical significance here is the 2 questions no one seems to consider or answer A) Isn't the first few days an unrealistic test as the first 24 hours the CTR is not relevent to the thumbnail but is more due to alerts and subscribers seeing you have a new video out. This is almost impossible fairness as a split test goes, so my gut feeling is don't split test in the first week to avoid this. B) the fact that a thumbnail has potentially 2 very different audiences also makes split testing irrelevant. if my video is for search, the audience AND CTR is totally different to the suggested video audience. Question how do you deal with A and B? so what and how is this meant to be handled, what do you do to allow for and address both these realistic scientific approaches to CTR? any response would be appreciated Your biggest fan Zane Zanet Design kzbin.info