A favorite quote of mine "Science does not lie, but scientists do."
@Jacob-iv7qg3 жыл бұрын
very true, I love it too
@taramarissaalmarri3 жыл бұрын
Now my favorite quote 😄
@asdmax63233 жыл бұрын
Some scientists *
@suidafriekaanseboere50593 жыл бұрын
I mean if they are calling shots 50 billion years in the future they are
@humeanrgmnt73672 жыл бұрын
Science like religion is based on faith and belief- not certainty.
@ohno74548 жыл бұрын
More reliable than a 5000 year old story book
@narwhalgamingd7188 жыл бұрын
looool
@billythekidd45718 жыл бұрын
I'm not even sure if literature existed in 3000 BC, and if it did, it must have been too primitive to write a "story book."
@JohnSmith-pt4kn8 жыл бұрын
just so you know that book us very reliable. you can use it for a small height boost, to hit friends and to learn some choice things. pretty damn reliable that book is.
@GrimrDirge8 жыл бұрын
Funny, but irrelevant.
@gaberodriguez37328 жыл бұрын
+John Smith your hilarious
@Imagine-Baggins8 жыл бұрын
Sounds to me like money is at the root of most of these problems...
@ruddthree81058 жыл бұрын
Isn't it always?
@LelouchOfBritannia8 жыл бұрын
Well they need to audit their work I guess.
@lazyboy10608 жыл бұрын
The Venus Project.
@TheStarSquid8 жыл бұрын
People say religion is, but I think money and greed is the real problem.
@alveolate8 жыл бұрын
capitalism works in most industries but can distort the function of key institutions like education and news media. profit as a motive can drive leaders to make decisions which do not always square with the purpose of their organisation. this is why independent regulation is necessary to help correct the course of capitalism-driven institutions.
@EpicB8 жыл бұрын
I wonder how many people will interpret this video wrong.
@stardreamer89968 жыл бұрын
How did you interpret the video?
@nvrguru228 жыл бұрын
The [number] is too damn high!
@user-gv3cc5gv2b8 жыл бұрын
35 so far. Or they think what they read in really old fairytale books is true.
@user-gv3cc5gv2b8 жыл бұрын
KK426LH You should google "joke" and maybe "humor", they are some pretty interesting concepts, especially if you are new to the concept or maybe just not take things so literally.
@TheBOSS67158 жыл бұрын
+Zoltan slayer of trolls and lost sheeple there was no comedy in your comment, and that guy had no miserable tone, just stating a correction
@Skywalker-zu7od8 жыл бұрын
This is a sentinel episode of SciShow. THANK YOU FOR THIS. IT IS INCREDIBLY IMORTANT. BEST EPISODE YET.
@Skywalker-zu7od8 жыл бұрын
A video on John Ioannidis paper in PLoS Medicine would round out this concept in a nice way.
@rydaddy28678 жыл бұрын
This video should be required viewing for every non-science media person prior to being allow to report on anything science-related.
@sagedo87198 жыл бұрын
Don't you mean seminal
@sagedo87198 жыл бұрын
***** I see what you mean but if you replace sentinel with guard or another synonym it wouldn't make sense since its not an adjective. It's just semantics anyway
@MattRieckman8 жыл бұрын
I am actually absolutely shocked you are being so open about this. Skeptics have been pointing out the exact problems described in this video for years and only got mocked and ridiculed in response. Fanatical, dogmatic belief in the infallibility of the current publishing and peer review system has been so pervasive that I was not expecting open honesty from any science educators within my lifetime.
@Entropic_Alloy8 жыл бұрын
Within the community, most agree that the publishing system is broken, but there is little we can do to fix it because of lack of funding and how the community follows the highest impact journals with little regard to the science itself.
@michaelwinter7428 жыл бұрын
You're both right. It's very complicated and goes beyond the depth of what most uninterested people are willing to invest themselves in.
@TheHenryFilms8 жыл бұрын
However, a scientific study being false doesn't mean its opposite conclusion is correct. Being a skeptic means being critical of the METHOD not the conclusions.
@michaelwinter7428 жыл бұрын
Being a skeptic is different from being logical. It is annoying, elitist, and alienating. I have seen skeptics shut down good participants who just didn't have the energy to explain every tiny detail. Skeptics make good lawyers, if they're willing to put in the effort. I'm glad they are bringing the aforementioned errors in the science process to light so they may be addressed.
@plastic144078 жыл бұрын
John Oliver just did a piece on this like a month ago
@1BlueYoshi8 жыл бұрын
A phrase I heard thrown around in my Biomedical Research class is "publish or perish", and I think that's a pretty accurate summary of what you were describing from 5:24 to 6:34. It's definitely a real issue
@HappyHusbandnWife8 жыл бұрын
Finally SciShow address the underline problem of "the scientific publishing industry". I do agree with everything were mention in this vid, such as: + The inconsistenc of those study + Human factor/errors + Lack of knowledge in math( which is being introduced/integrated to others field now) , + Pressure to public "positive" result. + And the culprit MONEY, that's right MONEY Well done on none bias report SciShow !!!
@alexwillenbrink80698 жыл бұрын
I work in a biological sciences lab and holy crap THIS IS TOTALLY A THING AND ANNOYS THE BAGIZASS OUT OF ME. Not being able to publish results because lack of significance becomes extremely frustrating because nobody wants to admit they've wasted a ungodly amount of time on something they thought would pan out. Changing the way you interpret the results can easily make data that shows little or no significance look very nice and very significant. Unfortunately, that's not proper science...but it happens a lot.
@jasondashney6 жыл бұрын
That sucks so much. We learn as much from our failures as successes as individuals so it's sad this doesn't apply to the scientific community as a whole.
@wakeupnawaf8 жыл бұрын
Science is reliable, except if you're taking a science test.
@kawaiivegan23258 жыл бұрын
true
@Oxytocin_8 жыл бұрын
Science is definitely not reliable...
@r3d0c8 жыл бұрын
it is, just saying it isn't prove that it isn't, most often people who's personal views are refuted by science make these claims
@merikmalhads16768 жыл бұрын
Well then I guess u won't mind if we take away ur unreliable internet, computer, phone, medicine....I could go on for months
@AnimalAce8 жыл бұрын
Science is reliable....just that people sometimes aren't.....and money.
@spliTFT8 жыл бұрын
Last time I was this early... Science was actually reliable
@spliTFT8 жыл бұрын
God lol
@iprimoonanollie25988 жыл бұрын
lol
@jeremyj.56878 жыл бұрын
Thank you very much for highlighting this! I feel like the worst factor is that replication studies are often considered "not worth the time" because, well, that thing has already been done and it wouldn´t be as exciting for the publishing journals or even simply the scientists themselves.
@DustinRodriguez1_08 жыл бұрын
The beautiful thing about science is that when we are wrong, it's not because there was a flaw in science, it's because there was a flaw in the PEOPLE doing it. We _CAN_ examine our beliefs and identify exactly where flaws might lie. It makes things more complicated, sure, but reality is complicated. It's a personal choice if someone, for instance, chooses to trust something radically flawed such as psychology. But we know it's flawed, and that performing legitimate scientific studies in that field is impossible (in the few cases where it IS possible, it turns out to be neuroscience, not psychology). If a subject is very important, and people care very strongly about it, we can go to the absolute limits of our willingness to tolerate error and ability to investigate the matter. But in every single case where a thing previously held up as scientifically valid is found to be untrue, we can show exactly where prior scientists failed to meet the standards set by science itself. We believed leaded gasoline was safe because the standard of proof was stupendously bad, those doing the research did only a couple horribly flawed studies that no one in their right mind should have trusted, but a few people cut corners to make their careers look better. And they're personally responsible for the deaths of millions of people, disease in many more, and an unknowable amount of human suffering as a result. They absolutely should have known better, and their names should really be more widely known so that people can spit when they think of them. And we should definitely remember them any time someone studies a handful of WEIRD (western, educated, industrialized, rich, democractic) undergrads and claims to have made a finding about the entire human race. And if those studies are used to back some side (regardless of whether it's "your" side or not) of an argument influencing public policy, they should be called out and the people suggesting we affect peoples lives based on them should be seen as the dangerous, shortsighted, biased, malicious people they are. A real scientific study makes findings which are parsimonious - they are restricted to only the group from which their subjects were drawn (randomly). Any wider applicability of their findings may be reasoned about, and even conjectured, but only with ample warning to the reader that they are exactly that - mere conjecture. If a psychology study were to do this, and do it with integrity, the paper would end up being laughable. There would be 60 pages of irrelevant-sounding criteria that they didn't control for (doing a study on the effects of violent media on the youth? Did you take care to examine the diet of your subjects to ensure there was not a statistically abnormal amount of vegetarians or junk-food-eaters or high-carb or high-fat or low-fiber people present? No? Then you have to explain that. I've never even seen a study on media effects on a population that even controlled for consumption of the EXACT media they are claiming to have drawn conclusions about! Not once! 90% of their study participants could have just gotten off a weekend-long Halo LAN party binge and they would not have a clue because they don't even care enough to ASK. The vast majority of studies also totally conflate witnessing actual violence in person and watching violence on a screen, making the completely baseless assumption that all of the brain processing involved in taking a flat image at the wrong proportions while every single other sense is feeding completely contradictory sensory information and figuring out that it's supposed to represent a scene with human beings has zero effect upon the brains ability to process it differently from in-person experience of actual violence which puts them in real danger. That, not violent media, makes me want to slap somebody.) The terrible truth that most people don't want to realize is that there is no free lunch, and no simple answers. Even things which appear simple are complex. The desire for simplicity is understandable, an outgrowth of the base structure of the human brain, universal, and utterly wrong. Like most of our traits that came from long evolution, it is perfectly honed to make humans into survival machines - on an African savannah with no language skills and in a small tribe surrounded by abundant food and predatory animals where 'survival' meant making it a little past puberty and producing at least 1 child as young as possible. For a situation where we have language, complex social structures, no danger from predatory animals, and advanced stores of knowledge, everything that comes from that evolutionary development is misleading at best, and most often dangerously destructive. It's what enables a few researchers to trick themselves into thinking that cutting a few corners and not "being a hardass" about scientific rigor will be harmless, so that before they know it millions of people are profoundly and negatively affected by those little errors.
@jordan30120008 жыл бұрын
ikr
@crazy808ish8 жыл бұрын
People on youtube don't really come for such long essays.
@DustinRodriguez1_08 жыл бұрын
crazy808ish Many don't, but some are interested. Luckily the interface makes it super easy to skip over anything of substance if you're not one for reading.
@Geoffronn8 жыл бұрын
Good thoughts. You raised leaded gasoline and media studies as examples, but my mind immediately went to Zimbardo's prison experiment. Wildly unethical, poorly designed, and its questionable findings are still thought to apply universally to all of humanity.
@DustinRodriguez1_08 жыл бұрын
Geoff Ronan I'd say that some of the findings do, but only because they're backed by many other studies... and also cross species boundaries and have plausible neurological basis. But yes, there were serious problems with that experiment. I'm not sure they could have known that it was going to be unethical before the study was performed, though, most people would have assumed it was obvious that environment could not possibly change ethical, reasonable people into either overbearing or submissive animals.
@notlun8 жыл бұрын
You can't expect serious comments in less then 15 minutes after the initial upload time, comment section is literally only shitposters
@loli_shizuku8 жыл бұрын
Like your comment? _-_
@acdc31858 жыл бұрын
I hope you and your family get cancer
@AnimalAce8 жыл бұрын
so creative.....uhhhh.
@Tytoalba7778 жыл бұрын
+Elephant Warrior interesting study indeed. We should officially research this phenomena and see if it is in fact true or if it's just purely coincidental
@twentylush8 жыл бұрын
the fact that anyone expects serious comments at all in this cesspool is blowing my mind.
@NarekGaming8 жыл бұрын
I'm in college and I had to do educational research. The one major problem I came up with is that most research journals, magazines and more all require some sort of fee to access articles. The reason why I am bringing this up was if a free online journal were to come out which allows research articles to be published, it could get out to more people and allow for more researchers to test other team's work and would also allow for negative results to be published as well.
@WesternLatino18 жыл бұрын
I'm glad someone beat me to this type of comment. You are completely right in that authors have to pay journals money in order to access journals, and they are not cheap. But one thing that would surprise you is that in those pay-to-access journals, if the author wants to make his/her work free to the public, he must pay the journal a fee to do so. However, there are "open access journals" that may, but usually do not require their authors to pay in order to make their papers free. However, the consequence is that open access journals are currently perceived as "not prestigious" so high ranking scientist tend not to publish in them in order to maintain funding and reputation. You should check out this database of open access journals here: doaj.org/
@NarekGaming8 жыл бұрын
Thank you very much! I will head there right now.
@ReidarWasenius7 жыл бұрын
Very important topic!! Thanks for highlighting these issues.
@Remlap12238 жыл бұрын
Oh God, P-Values are my trigger words. I'm getting horrible flashbacks to my advanced statistics class. If this gets any worse, I'm going to have to create a Patreon.
@SuperSMT8 жыл бұрын
_p-values_ , _p-values_
@TheHenryFilms8 жыл бұрын
But what if the p value that those flashbacks aren't happening because of the mention of p values?
@JackSparrow-tn6ic8 жыл бұрын
TRIGGERED
@rydaddy28678 жыл бұрын
Yep, when I heard "P-values" I broke out in a cold sweat and a shiver ran down my spine...
@megasonicgeo8 жыл бұрын
I'll support your patreon bbygrl , you are a special snowflake don't ever let no one tell you youre a -rabidfeminist- p-value
@0CityHusky08 жыл бұрын
Science is the most reliable thing we got, so I guess I'll take my chances.
@leshiro55743 жыл бұрын
Sir would you like to ride in my rocket ship? I promise it's safe 😏
@7head7metal78 жыл бұрын
This is why our research group uses online databases to publish our raw measurement data. We do electrical engineering, especially in wireless communications technology, so we have been trained to do statistics appropriately . But writing a paper to publish results is still hard, sometimes reviewers just don't have any expertise in the field and totally misinterpret it.
@nathantron8 жыл бұрын
I wish I could work for SciShow... I would love to do research for their shows, it's amazing, and I can't learn enough!
@General12th8 жыл бұрын
The scientific method is always reliable. But sometimes, mistakes happen.
@don_chanGD8 жыл бұрын
Like your birth OHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
@General12th8 жыл бұрын
n
@davylyntravylyn44648 жыл бұрын
+Jordan Shank you realized that you just contradicted yourself, right? the method ALWAYS work but MISTAKES happen.
@Chocl82158 жыл бұрын
The point of the original comment was "The method is not the problem; it is the mechanism by which the method is utilized that is prone to failure." Though, yes, the original comment does explicitly say something else.
@Nitsugalego8 жыл бұрын
Wrong. The scientific method suffers from a lot of problems in the social sciences. And you can't scientifically test math, or logic.
@rebelbeammasterx84728 жыл бұрын
The science of science should be called, wait for it, "Scientology" wait, that's not right.
@eryntey8 жыл бұрын
Such an important topic! Thanks for covering it!
@PineSG8 жыл бұрын
Probably one of the MOST significant videos done to date. This is a VERY REAL and troubling issue, and it goes beyond just replication issue. Many medical researchers are NOT even doing studies on NEW or ALTERNATIVE drugs/treatments/ect.. in favor of doing a study on an OLD drug but used for a different treatment or used in a different way. This goes back to the search for positive results, versus search for NEW results. The entire function of publishing/review and MONEY is in (or should be) crisis. Hats off for bringing this topic to light... hopefully a broad knowledge of how poor the situation is, will encourage those in power to make positive changes... even if it means publishing NEGATIVE results. ( gasp!)
@Aziraphale6867 жыл бұрын
I find it interesting that many religious believers see the built-in error correction of the scientific method as a flaw, rather than a feature.
@flszen8 жыл бұрын
So the answer to the question in the title is, "Not all the time, but scientists are trying to improve"?
@nvrguru228 жыл бұрын
Basically
@Slimm22408 жыл бұрын
I agree
@brod2man8 жыл бұрын
The scientific method is 100% reliable if followed properly. Human's are not reliable. If I do a test to see if the light in the fridge goes off when I close the door. I could put a camera inside and open and close the door 300 times to see if the light goes off. But if the person watching the camera lies to me then I'll get incorrect results. Otherwise there is no fault in the method.
@musicmanafm8 жыл бұрын
No, the scientific method is never 100%. There will always be anomalies and artifacts in results that can be misinterpreted as false positives and negatives. The methods are designed by humans so to say one is reliable when the other isn't is just wrong - perhaps you mean the scientific principle/ theory behind a method, which yes in theory is 100%, but again this is model based on human interpretation of results - you are assuming from the evidence collected that a method behaves in a certain way. Basically the entire video is about how the methods of confirming antibody interaction is flawed.
@bbruinenberg8 жыл бұрын
Well, that is pretty much how science has always worked. Science isn't 100% accurate but it is self-correcting.
@treverbostelaar24528 жыл бұрын
So glad you guys made this video. I'm an undergraduate researcher and my PI and postdocs have been complaining about this for a while now.
@Xeno4268 жыл бұрын
It's a real shame that negative results never get published. Even learning that a method *doesn't* work can be important.
@ixyzyxi8 жыл бұрын
I liked the one of John Oliver more though :-p
@typemoon48948 жыл бұрын
[CURRENT YEAR]
@mykeprior34367 жыл бұрын
How data is interpreted is 100% of the issues....the truth could stare you in the face, but after enough rigorous data treatment a result could end up as nothing. Nothing could end up as something, with bias mixing it up further (whether with intent or not). peer-reviewed articles are good in theory, but in practice, as Einstein noted, Doing the same thing expecting different results is insanity.
@SuperToFue8 жыл бұрын
Thank you! *Finally* someone is addressing this to the public - Keep up the good work!
@HoldenGatsby8 жыл бұрын
I did a research project to complete my degree this year, and it really raised these issues to the forefront for me. We were testing whether or not arousal changed in people who played a game we had created. To do this we separated the subjects into two groups, and tested their arousal levels before and after they each played the game. The version of the game which each group played was also slightly different, to allow us to compare which factors of the game could change arousal in what way. After we got the results, we compared them in the appropriate way first, and it came back that it was not significant. I then noticed that if we compared the data in a totally different way, a way which was somewhat irrelevant to what we were actually looking for, we found a significant result. The latter result was that which we ended up presenting. The entire situation made me really uncomfortable, as I felt I was lying about the results of our research, but after talking to other members of my university (including someone who previously worked at a pharmaceutical company), I found out that it was a somewhat common practice. It just all seems dishonest to me.
@kevinlobo26958 жыл бұрын
creationist are gonna use this argument xd
@daviddavis39398 жыл бұрын
Dufuq is a cracionist? I know what a creationist is, but a cracionist?
@kevinlobo26958 жыл бұрын
Joe Sunder sorry I am learning english xd
@typemoon48948 жыл бұрын
**tips fedora**
@gamesman01188 жыл бұрын
Better than some who have spoken it all their life.
@sean35338 жыл бұрын
creationism isn't anti science.
@MatthaeusEbonah6 жыл бұрын
Title is a little misleading. Sounds like science is reliable. But scientific research and publications are not.
@lhcphysicfreak8 жыл бұрын
Being a scientist myself, I can really relate to the frustration of erroneous results in published journals and the heap of bad results hidden underneath the veneer of a few good ones. Scientists don't publish negative results because it makes their work look bad and people wouldn't read it. Less readers mean less citations, therefore less impact factor(the metric to see how good the work is). It's sort of like a marketing strategy to only publish the best results, like how a shampoo company will advertise on the benefits of using their shampoo and not the fact that it basically does nothing extraordinary. Not to mention that some researchers prefer to keep the methodology extremely brief. Almost as if they were trying to prevent the technique from being copied.
@leshiro55743 жыл бұрын
This is like finding out that the measuring tapes at a construction site are not all the same...
@GarrettRobinson8 жыл бұрын
This is crazy. I had no idea this was going on, to be honest.
@rickydas.8 жыл бұрын
I feel ya brother.
@stardreamer89968 жыл бұрын
Should watch the show adam ruins everything. He tells you alot of stuff you didn't know was going on...
@DistortedV128 жыл бұрын
Maybe not as crazy as it's put here read my post
@crazy808ish8 жыл бұрын
Good. Next time someone arguing with you, think carefully and research the subject. Don't just mindlessly demand sources.
@David_Last_Name8 жыл бұрын
+Garrett Robinson Actually the video title was a bit misleading. Did you notice how all of Hanks examples come from the medical community? I wish they had title this video "is MEDICINE reliable" instead, because this does not apply to all of science as a whole. It's because medicine is more complex then any other science, simply because it deals with humans. Whether it's humans physical health or mental health, humans are INCREDIBLY complex and very difficult, expensive, and time consuming to study, and so repeat studies are rare. But it's only rare in medicine. The problems Hank discussed here really don't apply much to other branches of science, and certainly not to this degree.
@mattomanx778 жыл бұрын
All the "S"s in his speech are sharp and louder compared to everything else, anyone know why? Is it just me?
@wadatamana5 жыл бұрын
Profit-oriented organizations disguised as scientific communities are worst of the problems. Always be skeptical about the results. Greed is the ultimate motivation for such organizations/companies.
@jjohansen868 жыл бұрын
One thing he didn't point out: Even if everyone is acting honestly and knows what they're doing (with statistical analysis, etc.), the fact that you can't publish negative results contributes massively to the replication crisis. It's not just the pressure to get a positive result leading to bad actors that leads to issues, but... let's say that ten different research groups all go after an extremely promising result. If p
@blub2323248 жыл бұрын
The problem is: You can either do good science - or have a job.
@ChronitonMechanics8 жыл бұрын
Another problem then, reform the teaching of maths, a lot of students are disgusted by mathematic, mostly because of competition (very elitist class, progression based ont the few best people) ,humiliation (like we should have the right and the time to fail and try, until we understand instead of using memory only), lack of pedaogy and money to be able to help everyone...maths are difficult, and often not intuitive. I'm doing geology studies, and yep, maths and physics teaching is awfull...
@animo0058 жыл бұрын
I think you can apply that to all the educative system. It seems that most of the kids end hating most that is taught in school.
@amandadube1568 жыл бұрын
Math, unlike art and english and many other subjects, (don't stab me liberal arts people, I'm sure they're challenging in their own ways) simply requires you to get frustrated and deal with being lost and confused until things "click." Many people are not used to this hurtle, and assume they're just "bad" at math. But they're not: math really is just that hard for 99% of people. But since a solid grasp on mathematics is required for a vast majority of the best, most reliable job markets out there, kids should just be made to suck it up and get used to it. Sorry, but it's true. Life sucks, at least you're not in a slave state or being mauled to death by a tiger. I'm not saying it couldn't be taught better: there's always room for improvement. But I know so many parents who blame their kids' poor math grades on everything but their kid's lack of motivation. Gimme a break, people!!!
@animo0058 жыл бұрын
I disagree. I have seen several cases of kids that were completely failure at Math or science. One of them were considered borderline. Until they found a good teacher that motivate them until they began to study by themselves. The one that people thought he was borderline, last time I met him he had a Marie Curie grant. So maybe sit a lot of kids for ours in a class with a teacher that may be or not motivated just telling them the class, may not be a good method Also English is not so easy when you are not native XD
@amandadube1568 жыл бұрын
animo005 True, true. Can't deny that the teacher makes a big difference. But you could have the best teacher in the world: the students STILL have to deal with being frustrated and confused while mastering new topics. & that's the point at which many parents start with their winging... Oh, and--all due respect for anyone who has to learn english as their second language. It's a bastard of a language...
@amandadube1568 жыл бұрын
dev02ify lol... and for all I know, you're being completely serious! :-P
@tangleknotlightstep8 жыл бұрын
I'm about to spend the entire day running stepwise regression for the first time to build a best fit model for my data... This video just sapped all my confidence in myself... Thanks Hank :?
@ryanhines80808 жыл бұрын
I am a high school science teacher and this is one of the best/most succinct videos I have ever watched on scientific studies and publishing. I will definitely be showing this to my AP classes.
@Singularity246018 жыл бұрын
Unfortunately, Hank repeats a common misconception when he states that "a p-value tells you the probability that the [positive] results of an experiment were a total coincidence," in other words the probability of the null hypothesis n given the positive result p, P(n|p). In fact, p-value is the probability of the positive result p given a null hypothesis n, P(p|n). These two concepts are mathematically different. Past conflation of P(n|p) with P(p|n) has resulted in false conviction and loss of life. With a proper understanding of p-value and Bayesian probability, one should actually not be surprised that significantly more than 5% of studies with p ≤ 0.05 could not be replicated.
@DrScrubbington8 жыл бұрын
Science is reliable, it's just very unpredictable sometimes, such as in the case of psychology studies where every human's life is different, so you can never really expect to get the same results as before unless it's the same people being tested. And even then, things might have happened in their life that changed how they feel anyway.
@NotaWalrus18 жыл бұрын
That's why law of big numbers is a thing, same applies to all branches of science, that's why big sample sizes should be the standard.
@helidodge8 жыл бұрын
What is the definition of the scientific method?
@Paulthored8 жыл бұрын
+helidodge observe... describe what you observed... think about how what you observed came to be... tell others about what you think happened... repeat until accepted... if accepted/confirmed independently, then what you think happened to cause your observations becomes accepted Theory
@NotaWalrus18 жыл бұрын
helidodge Observe a phenomenon, postulate a hypothesis about the phenomenon, try to disprove it via experiment. If enough people can't do it it becomes a theory.
@georgebond77778 жыл бұрын
The scientific method :- 1. observable 2. measurable 3. repeatable 4. predictable if any of these fails then it's not science.
@danielpray60498 жыл бұрын
Its a good thing Hank is doing the Philosophy series on crash course. Hopefully after they finish the series, scientists can use what they've learned to fix the problem with scientific studies.
@dotdotppl8 жыл бұрын
I am a science student and this video do point out the concern while being told to use "prepared" materials that buy in batches like antibodies.
@gurumage95558 жыл бұрын
Well I mean , Science never fits in with my ancient book of fairy tales inspired by DA LAWD GAWD . So how can it be reliable ?
@SuperSMT8 жыл бұрын
But it does...
@orekihoutarou61078 жыл бұрын
+SuperSMT Law of Conservation of Mass and Energy...
@tylershelton60488 жыл бұрын
Big Bang theory and Dark Energy seem to violate the Law of Conservation of Mass and Energy. Can you reconcile these for me?
@orekihoutarou61078 жыл бұрын
***** Sujay seems to have summed up the Big Bang quite nicely, and Dark Energy isn't something taught in elementary school unlike the Big Bang, so I will assume that you are just strawmanning Dark Energy as well as the Big Bang, It can't be helped as an assumption when you misinterpreted a much simpler theory.
@tylershelton60488 жыл бұрын
Oreki Houtarou If all of Energy was contained in a near infinitely dense point, than what caused the expansion? Since energy likes to remain in a stable state, What caused it to expand in the first place? How About this an object at rest will stay at rest unless acted on by an outside force. What was the outside force that kicked off the big bang? Sorry guys I was thinking a step further than the Theory of the big bang. I admit I am no expert in astrophysics (or the other two branches). It only seems to me that something or someone kicked off the big bang. Now Dark energy definitely isn't for grade school. So let NASA give a description "One explanation for dark energy is that it is a property of space. Albert Einstein was the first person to realize that empty space is not nothing. Space has amazing properties, many of which are just beginning to be understood. The first property that Einstein discovered is that it is possible for more space to come into existence. Then one version of Einstein's gravity theory, the version that contains a cosmological constant, makes a second prediction: "empty space" can possess its own energy. Because this energy is a property of space itself, it would not be diluted as space expands. As more space comes into existence, more of this energy-of-space would appear. As a result, this form of energy would cause the Universe to expand faster and faster. Unfortunately, no one understands why the cosmological constant should even be there, much less why it would have exactly the right value to cause the observed acceleration of the Universe." Go ahead and argue with Einstein. :D
@thomasrichardson54258 жыл бұрын
The statistical knowledge of Psychologists is really bad. Source: i'm a psychologist.
@anuzis8 жыл бұрын
Superb video. Thanks for the great work!
@robind63007 жыл бұрын
In dietetics research, reputable research labs will have all those working on the experiment complete research ethics training courses. The employee or volunteer then has quizzes they have taken indicating that they understood the modules. That way, if there is any infraction, that person can be held accountable for their actions because they knew it was wrong to alter the findings, tamper with data, etc. Some universities are also now offering at least a 1 credit hour course in research, teaching students how to recognize flaws in research, where to find reputable research, and to always have their research peer reviewed by other reputable researchers.
@hellblaze108 жыл бұрын
So in short its not science thats un reliable its the people doing them?
@AfterLifeGuru8 жыл бұрын
Are we all pretending psychology isnt pseudo-science?
@kimberlyadams20788 жыл бұрын
Well, a good amount of it is rooted in fact (measures of chemicals and activity in the brain, etc. etc.) A good amount of psychology is also true, just not necessarily rooted in concrete fact. It's a slippery slope.
@NotaWalrus18 жыл бұрын
+Kimberly Adams that's neurology and psychiatry, psychology doesn't deal in chemicals, it's borderline a pseudoscience.
@AfterLifeGuru8 жыл бұрын
Kimberly Adams Like my nautical chum below you said, neuroscience is rooted in empirical facts/evidence/observation, psychology is a mistake. Its no more a science than homeopathy or astrology.
@DrgnZip8 жыл бұрын
No, it's a science, it's just that explaining people is fucking hard.
@jackwilliams45708 жыл бұрын
By defining science as a system that builds knowledge based upon testable explanations and predictions through the use of a particular methodology (the scientific method), then the field of psychology qualifies as a scientific subfield. It's frustrating that many psychological studies have reproducibility errors, but there are many psychological theories that have been examined rigorously, some of the few being the bystander effect (the phenomenon where a greater number of bystanders correlates to a decreased likelihood in helping someone in need), as well as the relationship between trauma in early childhood and the onset of mental disorders in adulthood. There are robust theories in psychology, they just underlie many of the "pop psychology" facts that make some argue that the entire field's a pseudoscience. It's the greatest pet peeve of a psychology major (defending the field as a science). To any biology or chemistry majors out there, what's your least favorite question to hear someone ask? :)
@ammaralnaaimi51508 жыл бұрын
Thank you
@macsnafu8 жыл бұрын
A dangerous, but important video, and published on my birthday! Good job.
@MrSharkBait5618 жыл бұрын
is science reliable? ...no it is not do we need science? ...yes we do can we live without it? ...yes we can how important is science? ...very very important do i like tacos? ...hell to the yes how are tacos made? ...science why am i asking these questions? i do not know study science stuff, kids.
@MrSharkBait5618 жыл бұрын
the most pointless comment ever^
@johannthemoose60408 жыл бұрын
first... oh god kill me.
@FrostByteAirsoft8 жыл бұрын
Why would you want that?
@armvex8 жыл бұрын
you don't have too
@ruddthree81058 жыл бұрын
*slow clap*
@cremist79218 жыл бұрын
Ok.
@openyoureyes33088 жыл бұрын
no I'm busy
@Centuries_of_Nope8 жыл бұрын
As an electronics engineer, calculations will only get you so far.
@enjoying288 жыл бұрын
My favorite story from a Ph.D doing a study on bats where the grantee was a environmental group want to prove that the agriculture practice by the local fruit farmers was effecting their food supply. When he did the study he found their main food source came from local store dumpsters. He went to the grantees they increase the grant to remove "human influence". So they did the study again this time making sure the dumpster were seal or emptied daily. This caused the bat to go back the the food farms show that the farmer practice will effect the food supply of the bats. So if you don't get the outcome you want change the conditions to get the outcome you need.
@croatiansciencestudio73738 жыл бұрын
It's hard to confirm a cancer study. Every cancer is completely different. Some medicine can work extremely well on one patient and have no effect on some other patient.
@LightningSe7en8 жыл бұрын
Science isn't to be put in question. It's our methodology that is in flaw - whether singular or collaborative.
@joaum20098 жыл бұрын
First step to solve a problem is to acknowledge it. It's a good thing that science does introspection from time to time.
@95CARMEN8 жыл бұрын
I am a scientist in training and this is a very interesting video. Thank you for making it! I am on school to be a microbiologist and it is very eye opening to know that some of the primers I've been using might not be exact. maybe this is why my protein gel is not working! lol keep up the good work!
@malignor90358 жыл бұрын
Ah, greed. The ultimate motivator. If only we could get its dosage correct; side effects include dishonesty.
@Ex-P.F.C_Wintergreen8 жыл бұрын
I'm glad this is being addressed, I feel like conflicting studies about the same subject are coming out every week
@therasheck8 жыл бұрын
This is why when some one says " The science is in amd the debate is over" Just keeps the debate alive for me. My favorite science teacher and public speakers say things like "This is what we think is going on" Or other non definitive statements.
@Tntpker8 жыл бұрын
It amazes me how scishow always uploads a video of the subjects of my exam 1 day before my exams.
@chepperino8 жыл бұрын
This is melting my brain ......ahhhh......
@LongLongLists8 жыл бұрын
This is worrying, I've always believed in the scientific community for being a pillar of reliability and honesty, if this apparent problem isn't resolved then...damn :/ hope steps are made the make studies more reliable and accurate!
@DistortedV128 жыл бұрын
PLEASE READ: So a few things that were right about this video. It provided a comprehensive assessment of the reproducibility crisis taking information from different fields. It also looked at the problem from different perspectives (researchers, publishing standards, statistics, etc.). What I didn't like is perhaps the perceived mischaracterization of psychology people could glean from it due to some missing info. In the Open Science project (the one with the 100 studies), many psychologists (Daniel Gilbert, TedTalk guy, and colleagues) analyzed the methods of the project and found that several of the replications were poorly done (one for example was a study supposed to analyze americans views on issues, but italians were used instead). Plenty were more or less extreme than that. In addition, Gilbert had shown that due to sampling errors and not enough replications, the statistic of replications from the large project is probably heavily underestimated & definitely can't be generalized to all of psychology. In other words, 39% of studies replicating doesn't mean at all that 39% of psychology is correct. Also, replications have been used in the past and are still being used in psychology. There are many classic studies that are supported just fine, especially with distinguished researchers like Khaneman, Shelley Taylor, etc. (so no with the whole pseudoscience idea). In fact, Behavioral genetics and cancer biology have it worse than psychology. Lastly psychologists are probably more concerned than the public about this (and have known about it for 4 years now), they are devising new ways to accept new studies such as preregistering the studies to prevent experimenters from manipulating the results after analyzing the data, etc. Keep in mind science is about constantly improving its findings and human error sometimes inevitably can happen. But this is really a celebration for psychology research as bad research practices are making their way out and more robust and stable knowledge is being cultivated. More info go to the apa website.
@mikepaquette1538 жыл бұрын
I yawned the other night in a movie theater. I made sure I could be seen. No one else yawned.
@deep_fried_analysis8 жыл бұрын
As a Warhammer 40k player, as 1in 20 chance is pretty high, considering how often you can get a double value on 2 simultaneously thrown dice, on some days
@oscarr18998 жыл бұрын
NOW this is a good video. Hank. you have done it again.
@urmorph8 жыл бұрын
Good show, thanks. Thanks also for saying "data are". Has anyone ever published a study showing the relative frequency of "data is" in scientific papers that are not actually referring to Brent Spiner's iconic Star Trek character?
@Bestoftherest2228 жыл бұрын
Title should be "Is Social Science Reliable." Most psychical science is spot on.
@nemodot8 жыл бұрын
Nonspecific binding of antibodies is someting I worry too. We study a couple of genes in the lab and we have different antobodies aim to their protein products. For a couple of them we have knockout animal models for controling nonspecific signals, but for the rest of them we just speculate with the result.
@rvc65068 жыл бұрын
70 some years ago my father told me to beware of studies & statistics. The people conducting such things don't always have your best interests in mind. & then there was Mark Twain's famous dictum.
@kinn40868 жыл бұрын
HAHAH, I conducted some research in a laboratory at Mt. Sinai and actually we experienced similar trouble with a really simple ooligo sample that was NOT of the sequence we'd ordered. Wasted a lot of time and PCR reagents trying to get our SDS PAGE bands to actually show, and after trying everything under the sun we'd run out of our ooligo and the first try with the new solution worked like the a charm. Really difficult to pin-point problems like that when 10 different things and proportions could be the issue, or even someone's technique.
@kinn40868 жыл бұрын
To add, replicating studies is also not considered worthwhile, and researchers are often pressured to conduct research that will receive more funding, as opposed to research on topics which interest them. Of course choosing to research a topic which is more likely to have profound [positive] impact is commendable, but in trying to publish "novel" research to avoid being a replication study, some topics are unreasonably inapplicable.
@YB-lv6ks7 жыл бұрын
It's probably your best video so far! great work!
@sampathxyz8 жыл бұрын
thanks for these awesome videos scishow!!
@jhh-jiynks65688 жыл бұрын
wheeeww.. its sooo refreshing to find an unbias well put together content. great job guys.. love it
@sciencenerd88798 жыл бұрын
Research can be so frustrating at times. I'm starting to rethink this whole career decision.
@gerriefarman31748 жыл бұрын
A lot of the problem with the reproducibility problem is that academic science is force to publish as many papers as they can on a "NEW" finding in order to get and keep funding. There is no drive to check these results as secondary papers (checking the reproducibility) are not considered "important" and thus get shuttled to minor journals where the grant offering departments will ignore them in favor of higher tier papers. This culture of get more money has permeated the academic community so much that now professors will often publish a paper if it has "new" results without really checking the work leading to this problem. What needs to be explained and understood is that science is a meticulous process that requires the people doing the experiment to understand "ALL" the variables involved and to be able to account for them. Hopefully in the future we can pull some of the pressure of the academic science community to "publish or perish" and let them investigate the problem they are looking at with adequate time and resources. Well that is my hope anyway.
@KnyfFite8 жыл бұрын
Incorrect sample sizes is a significant factor as well. Also driven by money concerns.
@DistortedV128 жыл бұрын
PLEASE READ: So a few things I liked about this video. It provided a comprehensive assessment of the reproducibility crisis taking information from different fields. It also looked at the problem from different perspectives (researchers, publishing standards, statistics, etc.). What I didn't like is perhaps the perceived mischaracterization of psychology people could glean from it due to some missing info. In the Open Science project (the one with the 100 studies), many psychologists (Daniel Gilbert, TedTalk guy, and colleagues) analyzed the methods of the project and found that several of the replications were poorly done (one for example was a study supposed to analyze americans views on issues, but italians were used instead). Plenty were more or less extreme than that. In addition, Gilbert had shown that due to sampling errors and not enough replications, the statistic of replications from the large project is probably heavily underestimated & definitely can't be generalized to all of psychology. In other words, 39% of studies replicating doesn't mean at all that 39% of psychology is correct. Also, replications have been used in the past and are still being used in psychology. There are many classic studies that are supported just fine, especially with distinguished researchers like Khaneman, Shelley Taylor, etc. (so no with the whole pseudoscience idea). In fact, Behavioral genetics and cancer biology have it worse than psychology. Lastly psychologists are probably more concerned than the public about this (and have known about it for 4 years now), they are devising new ways to accept new studies such as preregistering the studies to prevent experimenters from manipulating the results after analyzing the data, etc. Keep in mind science is a process and an art where flawed practices are eventually replaced with better ones. So yeah, this is a celebration for psychology research as bad research practices are making their way out and more robust and stable knowledge is being cultivated. More info go to the apa website.
@lcmiracle8 жыл бұрын
Yes, I've seen too many junior Stat major students argue from a low p-value as proof that "something is wrong". I've taken 1 200-level course in stat (as a elective minor for engineering degree) and at least in my course, it's explicitly stated that p-value is no proof, it's just a metric from which we make educated assumptions (not the exact quote from my lecture notes; it's been some time since I was in UNI).
@eurodraco8 жыл бұрын
As a scientist, the best answer you should have for questions is "I don't know."
@Asrahn8 жыл бұрын
It is, by far, the best and only thing we've got to build a functioning society upon.
@nixdorfbrazil8 жыл бұрын
Why I can just like this video just once? I want to improve it's positive results! Dam-it!
@deankhan11748 жыл бұрын
Why is religion even mentioned it has nothing to do with this?
@deankhan11748 жыл бұрын
Im talking about the comment section not the actual video.
@truboo42688 жыл бұрын
Because creationists, who are likely going to use this video as an argument against science.
@calumbrehony80678 жыл бұрын
+Bryan Cotto science and religion work together
@kimberlyadams20788 жыл бұрын
I know, right? I guess people find any excuse to be bitter when they want to be. Gosh, where had respect for others' opinions gone?
@AJ213Probably8 жыл бұрын
+Calum Brehony religion says that and than goes ahead and says evolution is false
@jtbrad8 жыл бұрын
And this is why everybody should be skeptical of every time a news report on tv starts with the phrase, "A new study was published."
@ItsZorroDood8 жыл бұрын
That's why we have quality assurance and goods inward inspections.
@thomasdrinkmoore98277 жыл бұрын
I have an idea: If you want a study to be published you need to register it somewhere. Like a worldwide list. When you finished the study you HAVE to publish it there. If you make a study and didn't register beforehand you cannot publish it.
@DistortedV128 жыл бұрын
PLEASE READ. So a few things that were right about this video. It provided a comprehensive assessment of the reproducibility crisis taking information from different fields. It also looked at the problem from different perspectives (researchers, publishing standards, statistics, etc.). What I didn't like is perhaps the perceived mischaracterization of psychology people could glean from it due to some missing info. In the Open Science project (the one with the 100 studies), many psychologists (Daniel Gilbert, TedTalk guy, and colleagues) analyzed the methods of the project and found that several of the replications were poorly done (one for example was a study supposed to analyze americans views on issues, but italians were used instead). Plenty were more or less extreme than that. In addition, Gilbert had shown that due to sampling errors and not enough replications, the statistic of replications from the large project is probably heavily underestimated & definitely can't be generalized to all of psychology. In other words, 39% of studies replicating doesn't mean at all that 39% of psychology is correct. Also, replications have been used in the past and are still being used in psychology. There are many classic studies that are supported just fine, especially with distinguished researchers like Khaneman, Shelley Taylor, etc. (so no with the whole pseudoscience idea). In fact, Behavioral genetics and cancer biology have it worse than psychology. Lastly psychologists are probably more concerned than the public about this (and have known about it for 4 years now), they are devising new ways to accept new studies such as preregistering the studies to prevent experimenters from manipulating the results after analyzing the data, etc. Keep in mind science is about constantly improving its findings and human error sometimes inevitably can happen. But this is really a celebration for psychology research as bad research practices are making their way out and more robust and stable knowledge is being cultivated. More info go to the apa website.
@joelights64767 жыл бұрын
You're thinking too hard about this. It's point was very basic: there is pressure to get papers published, and positive findings are more likely to be published and humans being humans will skew things to get that positive result (even if only subconsciously). This doesn't need to be analyzed as if it were a study.
@jesthered79668 жыл бұрын
I can't speak to elsewhere but in Canada to get your Advanced Bachelors degree in Psychology, and your Masters you have to take a lot of statistics courses and advanced statistic courses. Most Psych and Social science researchers in Universities collaborate with a Statistician now to reduce those errors and handle the data properly despite that, because the more you know about a subject the more you know you don't know.
@okiwangko8 жыл бұрын
Having done several studies in Linguistics, I have to say these problems are universal and not just related to Science alone. Much of the problem mention, such as the inclusion of p-values, is something I had experienced firsthand and that even my supervisor said that "it is something that you need to know and need to include in an academic paper, but have no significant value in the paper what so ever". Going back to publishing studies, I firmly believe that pushing out papers out in large quantities can damage the reputation of certain individual, though it should be stated that I do hastily push out papers as I do have multiple papers in queue to send to supervisors and most of which have datelines that need to be met.
@WarpScanner8 жыл бұрын
Few solutions: Do not allow people to fund studies at their own flawed human will. Make funding selected by a different measure that explicitly does not incentivise bad behavior. This could be done at a university level. Make getting replication a requirement to get published. For Psychology studies, assign a specialized auditor of some sort that notes every minute detail of the study that they can. Create a standardized set of P-Values for all the most commonly studied things, based on scientific consensus rather than committee.
@serge2638 жыл бұрын
I believe everyone is forgetting the very basis of science and the scientific method. You're not supposed to try and replicate the results, but study the results.