Tuesday, February 21, 2017

The Null Hypothesis in Education, Restated

In other words, there isn't a single piece of education "research" out there that is worth reading. None.

Arnold Kling

"Consider an education intervention and a set of tests that it must pass. The intervention could be “more spending” or “method X used in the classroom” or “longer school days” or “charter schools” or what have you.
1. It should show a meaningful difference under experimental conditions, meaning that selection bias is eliminated.
2. The difference should persist, rather than fade out. If you show a difference in first grade but by third grade or fifth grade the experimental group is on on the same level as the control group, then there is fade-out.
3. The results should be replicated. One experiment that works one time does not count.
4. The intervention should be scalable. The intervention does not depend on a uniquely gifted teacher.
The Null Hypothesis is that no intervention passes all four tests."

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.