{"id":6856,"date":"2022-12-11T13:00:22","date_gmt":"2022-12-11T18:00:22","guid":{"rendered":"https:\/\/braindevs.net\/blog\/blog\/?p=6856"},"modified":"2022-12-11T11:11:47","modified_gmt":"2022-12-11T16:11:47","slug":"upsides-always-have-downsides-side-effects-in-education-research","status":"publish","type":"post","link":"https:\/\/www.braindevs.net\/blog\/upsides-always-have-downsides-side-effects-in-education-research\/","title":{"rendered":"Upsides Always Have Downsides: “Side Effects” in Education Research"},"content":{"rendered":"

Here at Learning and the Brain, we believe that research can improve education.<\/p>\n

\"Young<\/a><\/p>\n

Specifically, research into psychology (“how the mind<\/em> works”) and neuroscience (“how the brain<\/em> works”) can help teachers and schools. After all, we spend all day working with students’ minds and brains!<\/p>\n

Every now and then, we should stop and look for flaws in our assumptions.<\/p>\n

Are there ways that research might not<\/em> help learning? Might it actually limit<\/em> learning?<\/p>\n

A recent article<\/a> by Yong Zhao explores this important — and troubling — question.<\/p>\n

The Medical Model<\/h2>\n

Doctors have long relied on research to test their hypotheses.<\/p>\n

Does this<\/strong> treatment work better than that<\/strong> treatment? Let’s run a “randomized control trial<\/a>” to find out.<\/p>\n

Notably, medical research always includes this important question:\u00a0what side effects* does a treatment produce?<\/em><\/p>\n

That is:<\/p>\n

Any treatment might produce specific benefits.<\/em><\/p>\n

And, it might also produce specific harms.<\/em><\/p>\n

Medical research looks for and reports on BOTH.<\/p>\n

Sadly — and this is Zhao’s key point — education research tends to\u00a0skip the second question<\/em>.<\/p>\n

Researchers look for benefits:<\/p>\n

Does mindfulness reduce stress?<\/p>\n

Can retrieval practice enhance learning?<\/p>\n

Should students exercise mid-class?<\/p>\n

When they measure the potential upsides of those “treatments,” they don’t always look equally scrupulously for downsides.<\/p>\n

And yet: almost everything has downsides.<\/p>\n

What to Measure, and When?<\/h2>\n

Why do we overlook the downsides?<\/p>\n

Zhao offers two hypotheses.<\/p>\n

First,<\/strong> we all agree that education is good.<\/p>\n

If doing X helps students learn, then X is good! Its obvious goodness makes potential badness invisible.<\/p>\n

Second,<\/strong> downsides take time — and alternative methods — to discover.<\/p>\n

An example. I hypothesize a particular method will help students sing better.\u00a0So, I test my method in a randomized control trial.<\/p>\n

Sure enough, students with the new method\u00a0sang better<\/em>! My method worked!<\/p>\n

However, my new teaching method just might make students hate singing.<\/p>\n

To discover this “side effect,” I have to measure different variables. That is:<\/p>\n

I need to check how well they sing<\/strong> (one set of measurements),<\/p>\n

AND how much they like singing<\/strong> (a\u00a0different<\/em> set of measurements).<\/p>\n

It’s also possible that the downside takes longer to arise. The improvement (right now) results in less enjoyment of singing (later on). If I don’t keep measuring, I’ll miss this “side effect.”<\/p>\n

New Habits<\/h2>\n

As Zhao argues, our habit of overlooking potential downsides creates real problems.<\/p>\n

For instance, Zhao takes the example of Direct Instruction<\/strong>.<\/p>\n

Its proponents can show lots of research suggesting its strengths. Its detractors likewise.<\/p>\n

How can these contradictory realities exist? <\/em><\/p>\n

Well, any complex teaching method will have benefits and detriments. If we focus only on one — if we measure<\/em> only one —\u00a0we’ll necessarily miss the other.<\/p>\n

Instead, Zhao argues, we should develop the rigorous habit of looking for both: the benefits of any teaching strategy, and also its downsides.<\/p>\n

This realisic, complex reality will allow us to make better decisions in classroom and schools.<\/p>\n

One More Step<\/h2>\n

Although Zhao doesn’t mention “opportunity costs,” I think they’re an important part of this conceptual re-think.<\/p>\n

That is:<\/p>\n

Every time I\u00a0do <\/em>use a particular teaching strategy, I\u00a0don’t<\/em> use the other one.<\/p>\n

If I take time for this<\/em> stress-reducing technique, I don’t have time for\u00a0that<\/em> stress-reducing technique.<\/p>\n

Even if a strategy has good research behind it, even if it has relatively few “side effects,” I always want to know: have I given up a better strategy to make time for this merely good strategy?<\/em><\/p>\n

For example, this point often comes up in discussion of Learning Styles Theory.<\/p>\n

If you’ve spent any time in this field, you know: Learning Styles Theory simply doesn’t have good research support<\/a> behind it.<\/p>\n

Alas: it has LOTS of popular support, even among teachers.<\/p>\n

When I show teachers the comprehensive research reviews contradicting the theory, they occasionally respond this way:<\/p>\n

“Okay, but what harm<\/strong> is it doing? It might be true, so why not teach to my students’ learning style?”<\/p><\/blockquote>\n

For me, the clear answer is\u00a0opportunity cost<\/em>.<\/p>\n

If we teachers ARE spending time on teaching methods that have no research support, we ARE NOT spending time on those that do.<\/p>\n

If students ARE studying on the treadmill because they’re “kinesthetic learners,” they ARE NOT using study strategies with research support behind them.<\/p>\n

Measuring opportunity cost requires subtle and humble calculations. We just might have to give up a long-prized approach to make time for an even better one.<\/p>\n

If our students learn more, that sacrifice will have been worth it.<\/p>\n

TL;DR<\/h2>\n

Like medical researchers, we should look both for benefits and for potential harms of any teaching suggestion.<\/p>\n

This balanced perspective might take additional time, and might require consideration of\u00a0 opportunity costs.<\/p>\n

It will, however, result in a more realistic and useful understanding of teaching and learning.<\/p>\n

\n

*\u00a0 Many years ago, I read that the phrase “side effects” is misleading. It makes unwanted<\/em> effects seem unlikely, even though they’re just as likely as the wanted effects.<\/p>\n

For that reason, I’m putting the words “side effects” in quotations throughout this post.<\/p>\n

I believe it was Oliver Sacks who made this point, but I can’t find the citation so I’m not sure.<\/p>\n

If you know the correct source of this insight, please let me know!<\/p>\n

\n

Zhao, Y. (2017). What works may hurt: Side effects in education.\u00a0Journal of Educational Change<\/i>,\u00a018<\/i>(1), 1-19.<\/p>\n","protected":false},"excerpt":{"rendered":"

Here at Learning and the Brain, we believe that research can improve education. Specifically, research into psychology (“how the mind works”) and neuroscience (“how the brain works”) can help teachers and schools. After all, we spend all day working with students’ minds and brains! Every now and then, we should stop and look for flaws […]<\/p>\n","protected":false},"author":18,"featured_media":6860,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[28],"class_list":["post-6856","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lb-blog","tag-methodology"],"_links":{"self":[{"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/posts\/6856","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/comments?post=6856"}],"version-history":[{"count":6,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/posts\/6856\/revisions"}],"predecessor-version":[{"id":6858,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/posts\/6856\/revisions\/6858"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/media\/6860"}],"wp:attachment":[{"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/media?parent=6856"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/categories?post=6856"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/tags?post=6856"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}