{"id":4235,"date":"2019-02-21T08:00:17","date_gmt":"2019-02-21T13:00:17","guid":{"rendered":"https:\/\/braindevs.net\/blog\/blog\/?p=4235"},"modified":"2019-02-07T14:11:25","modified_gmt":"2019-02-07T19:11:25","slug":"good-news-contradictory-research-on-desirable-difficulties","status":"publish","type":"post","link":"https:\/\/www.braindevs.net\/blog\/good-news-contradictory-research-on-desirable-difficulties\/","title":{"rendered":"Good News! Contradictory Research on Desirable Difficulties\u2026"},"content":{"rendered":"

As we regularly emphasize here on the blog, attempts to recall information benefit learning.<\/p>\n

\"\"<\/a><\/p>\n

That is: students might study by reviewing material<\/em>. Or, they might study with practice tests<\/em>. (Or flashcards<\/em>. Perhaps Quizlet.)<\/p>\n

Researchers call this technique \u201cretrieval practice,\u201d and we\u2019ve got piles of research<\/a> showing its effectiveness.<\/p>\n

Learning Untested Material?<\/h2>\n

How far do the benefits of this technique go?<\/p>\n

For instance, let\u2019s imagine my students read a passage on famous author friendships during the Harlem Renaissance. Then they take a test on its key names, dates, and concepts.<\/p>\n

We know that retrieval practice helps with facts (names and dates) and<\/em> concepts.<\/p>\n

But: does retrieval practice help with the names, dates, and concepts that didn\u2019t appear on the practice test<\/em>?<\/p>\n

For instance, my practice test on Harlem Renaissance literature might include this question: \u201cZora Neale Hurston befriended which famous Harlem poet?\u201d<\/p>\n

That practice question will (probably) help my students do well on this test question: \u201cLangston Hughes often corresponded with which well-known HR novelist?\u201d<\/p>\n

After all, the friendship between Hurston and Hughes was retrieved on the practice test, and therefore specifically<\/em> recalled.<\/p>\n

But: will that question help students remember that\u2026say\u2026Carl van Vechten took famous photos of poet and novelist Countee Cullen?<\/p>\n

After all, that<\/em> relationship was in the unit, but NOT specifically<\/em> tested.<\/p>\n

So, what are the limits of retrieval practice benefits?<\/p>\n

Everything You Wanted to Know about Acid Reflux<\/h2>\n

Kevin Eva and Co. have explored this question, and found encouraging results<\/a>.<\/p>\n

In his study, Eva asked pharmacology students to study a PowerPoint deck about acid reflux and peptic ulcers: just the sort of information pharmacists need to know. In fact, this PPT deck would be taught later in the course \u2013 so students were getting a useful head start.<\/p>\n

Half of them spent 30 minutes reviewing<\/em> the deck. The other half spent 20 minutes reviewing, and 10 minutes taking a practice test<\/em>.<\/p>\n

Who remembered the information better 2 weeks later?<\/p>\n

Sure enough: the students who took the practice test<\/strong>. And, crucially, they remembered more information on which they had been tested AND other information from the PPT that hadn\u2019t been specifically tested<\/em>.<\/p>\n

That it, they would be likelier to remember information about Zora Hurston and Langton Hughes (the tested info) AND about van Vechten and Cullen (the UNtested info).<\/p>\n

However, Eva\u2019s tested students did NOT remember more general pharmacology info than their untested peers. In other words: retrieval practice helped with locally related<\/em> information, but not with the entire<\/em> discipline.<\/p>\n

But Wait! There\u2019s More! (Or, Less\u2026)<\/h2>\n

About 2 month ago, I posted on the same topic \u2013 looking at a study by Cindy Nebel<\/a> (nee Wooldridge) and Co.<\/p>\n

You may recall that they reached the opposite finding<\/strong>. That is, in their research paradigm, retrieval practice helped students remember the information they retrieved, and only<\/em> the information they retrieved.<\/p>\n

Whereas retrieval practice helped students on later tests if the questions were basically the same, it didn\u2019t have that effect if the questions were merely \u201ctopically related.\u201d<\/p>\n

For instance, a biology quiz question about \u201cthe fossil record\u201d didn\u2019t help students learn about \u201cgenetic differences,\u201d even though both questions focus on the topic of \u201cevolution.\u201d<\/p>\n

What Went Wrong?<\/h2>\n

If two psychology studies looked at (basically) the same question and got (basically) opposite answers, what went wrong?<\/p>\n

Here\u2019s a potentially surprising answer: nothing<\/em>.<\/p>\n

In science research, we often find contradictory results when we first start looking at questions.<\/p>\n

We make progress in this field NOT by doing one study and concluding we know the answer, but by doing multiple (slightly different) studies and seeing what patterns emerge.<\/p>\n

Only after we\u2019ve got many data points can we draw strong conclusions.<\/p>\n

In other words: the fact that we\u2019ve got conflicting evidence isn\u2019t bad news. It shows that the system is working as it should.<\/p>\n

OK, but What Should Teachers Do?<\/h2>\n

Until we get those many data points, how should teachers use retrieval practice most effectively?<\/p>\n

As is so often the case, we have to adapt research to our own teaching context.<\/p>\n

If we want to ensure that our students learn a particular fact or concept or process, we should be sure to include it directly <\/em>in our retrieval practice. In this case, we do have lots (and LOTS) of data points showing that this approach works. We can use this technique with great confidence.<\/p>\n

Depending on how adventurous we feel, we might also use retrieval practice to enhance learning of topically related material. We\u2019re on thinner ice here, so we shouldn\u2019t do it with core content.<\/p>\n

But, our own experiments\u00a0 might lead us to useful conclusions.\u00a0Perhaps we\u2019ll find that…<\/p>\n

Older students can use RP this way better than younger students, or<\/p>\n

The technique works for factual learning better than procedural learning, or<\/p>\n

Math yes, history no.<\/p>\n

In brief: we can both follow retrieval practice research and contribute to it.<\/p>\n","protected":false},"excerpt":{"rendered":"

As we regularly emphasize here on the blog, attempts to recall information benefit learning. That is: students might study by reviewing material. Or, they might study with practice tests. (Or flashcards. Perhaps Quizlet.) Researchers call this technique \u201cretrieval practice,\u201d and we\u2019ve got piles of research showing its effectiveness. Learning Untested Material? How far do the […]<\/p>\n","protected":false},"author":18,"featured_media":4248,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[27,12],"class_list":["post-4235","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lb-blog","tag-boundary-conditions","tag-retrieval-practice"],"_links":{"self":[{"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/posts\/4235","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/comments?post=4235"}],"version-history":[{"count":5,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/posts\/4235\/revisions"}],"predecessor-version":[{"id":4251,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/posts\/4235\/revisions\/4251"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/media\/4248"}],"wp:attachment":[{"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/media?parent=4235"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/categories?post=4235"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/tags?post=4235"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}