The Case for Sticking with the Null Hypothesis

Jesse Singal writes,

As things continue to unfold, there will be at least some correlation between which areas of research get hit the hardest by replication issues and which areas of research offer the most optimistic accounts of human nature, potential, and malleability.

Pointer from Tyler Cowen.

Studies that show significant effects of educational interventions are right in this wheelhouse. That is why until they are scaled, replicated, and shown to have durable effects, you should view accounts of such studies with skepticism.

2 thoughts on “The Case for Sticking with the Null Hypothesis

  1. Results: Study participants that hold a pencil between their teeth rank their feelings of happiness after reading a cartoon 8% higher than the control group.

    If the basic assumptions underlying an experiment don’t pass the giggle test I’m not sure it’s worth debating study replication or the null hypothesis.

  2. “That is why until they are scaled, replicated, and shown to have durable effects, you should view accounts of such studies with skepticism.”

    *raises eyebrow*

    You’re making a blanket statement about a whole lot of research which you don’t specialize in. Your claim that there are no studies which fit your criteria is way off base.

    http://pages.uoregon.edu/adiep/ft/151toc.htm

Comments are closed.