Yesterday I wrote about bottlenecks to learning. I wanted to discuss the effectiveness of homework. If it works well, that would suggest students are bottlenecked on examples and repetition. If it works poorly, it would have to be something else.
Unfortunately, all the research on this (showcased in eg Cooper 2006) is terrible.
Most studies cited by both sides use “time spent doing homework” as the independent variable, then correlate it with test scores or grades. If students who do more time on homework get better test scores, they conclude homework works; otherwise, that it doesn’t.
One minor complaint about this methodology is that we don’t really know if anyone is reporting time spent on homework accurately. Cooper cites some studies showing that student-reported time-spent-on-homework correlates with test scores at a respectable r = 0.25. But in the same sample, parent-reported time-spent-on-homework correlates at close to zero. Cooper speculates that the students’ estimates are better than the parents’, and I think this makes sense — it’s easier to reduce a correlation by adding noise than to increase it — but in the end we don’t know. According to a Washington Post article, students in two very similar datasets reported very different amounts of time spent on homework — maybe because of the way they asked the question? I don’t know, self-report from schoolchildren seems fraught.
But this is the least of our problems. This methodology assumes that time spent on homework is a safe proxy for amount of homework. It isn’t. Students may spend less time on homework because they’re smart, find it easy, and can finish it very quickly. Or they might spend more time on homework because they love learning and care about the subject matter a lot. Or they might spend more time because they’re second-generation Asian immigrants with taskmaster parents who insist on it being perfect. Or they might spend less time because they’re in some kind of horrible living environment not conducive to sitting at a desk quietly. All of these make “time spent doing homework” a poor proxy for “amount of homework that teacher assigned” in a way that directly confounds a homework-test scores correlation. Most studies don’t bother to adjust for these factors. The ones that do choose a few of them haphazardly, make wild guesses about what model to use, and then come up with basically random results.
Both homework proponents (Harris Cooper) and opponents (Alfie Kohn) briefly nod to this problem, then take these studies seriously anyway. If you do that, you find that probably homework isn’t helpful in elementary school, but might be helpful during high school (though some people disagree with either half of that statement). But why would you take these seriously?
Scott Alexander, “Nobody Knows How Well Homework Works”, Astral Codex Ten, 2022-07-07.
October 8, 2022
QotD: Does homework, well, work? ¯\_(ツ)_/¯
Comments Off on QotD: Does homework, well, work? ¯\_(ツ)_/¯
No Comments
No comments yet.
RSS feed for comments on this post.
Sorry, the comment form is closed at this time.
