{"id":7675,"date":"2024-06-30T08:00:57","date_gmt":"2024-06-30T13:00:57","guid":{"rendered":"https:\/\/braindevs.net\/blog\/blog\/?p=7675"},"modified":"2025-02-24T04:52:07","modified_gmt":"2025-02-24T09:52:07","slug":"should-students-annotate-their-texts-a-research-perspective","status":"publish","type":"post","link":"https:\/\/www.braindevs.net\/blog\/should-students-annotate-their-texts-a-research-perspective\/","title":{"rendered":"Should Students Annotate Their Texts? A Research Perspective"},"content":{"rendered":"<p>A few years ago, I visited an English Department meeting at a well-known high school. The topic under discussion: a recently published &#8220;English Department Guide to Annotation.&#8221;<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-7686 size-full\" src=\"https:\/\/www.braindevs.net\/blog\/wp-content\/uploads\/2024\/06\/AdobeStock_804550174.jpeg\" alt=\"A highlighter pen poised above a textbook, ready to emphasize key points in a vibrant splash of color\" width=\"4032\" height=\"1152\" srcset=\"https:\/\/www.braindevs.net\/blog\/wp-content\/uploads\/2024\/06\/AdobeStock_804550174.jpeg 4032w, https:\/\/www.braindevs.net\/blog\/wp-content\/uploads\/2024\/06\/AdobeStock_804550174-300x86.jpeg 300w, https:\/\/www.braindevs.net\/blog\/wp-content\/uploads\/2024\/06\/AdobeStock_804550174-1024x293.jpeg 1024w\" sizes=\"auto, (max-width: 4032px) 100vw, 4032px\" \/><\/p>\n<p>After the meeting, one of the authors asked me what I thought of the guide and the research behind it.<\/p>\n<p style=\"padding-left: 30px;\">I asked: &#8220;Well, what IS the research behind it?&#8221;<\/p>\n<p style=\"padding-left: 30px;\">The teacher answered: &#8220;Oh, ALL the research says this.&#8221;<\/p>\n<p>Although this answer (&#8220;ALL the research shows&#8230;&#8221;) is quite common, it always makes me nervous.<\/p>\n<p style=\"padding-left: 30px;\"><em>In the first place<\/em>, it sounds like a dodge, doesn&#8217;t it? It&#8217;s the sort of answer I might give\u00a0<em>if I didn&#8217;t actually know much about the research<\/em>.<\/p>\n<p style=\"padding-left: 30px;\"><em>In the second place:\u00a0<\/em><strong>it&#8217;s never true<\/strong>. Because teaching and psychology and research are all so complicated, researchers NEVER get the precisely same answer when they study interesting, complex, and important questions about teaching.<\/p>\n<p style=\"padding-left: 30px;\">Even retrieval practice &#8212; one of the most research-supported teaching strategies we have! &#8212; doesn&#8217;t have unanimous support in the research literature.<\/p>\n<p>So: what does research say about annotating texts? I recently stumbled across a study that explores this question&#8230;<\/p>\n<h2>A Promising Start<\/h2>\n<p>A <a href=\"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/JRIT-09-2021-0065\/full\/pdf?title=using-the-annotating-strategy-to-improve-students-academic-achievement-in-social-studies\" target=\"_blank\" rel=\"noopener\">recently published study<\/a> looks quite specifically at the benefits of teaching annotation. In this study,\u00a0125\u00a08th grade students in a social studies class learned a specific method for annotation; another 125 served as the control group.<\/p>\n<figure id=\"attachment_7679\" aria-describedby=\"caption-attachment-7679\" style=\"width: 300px\" class=\"wp-caption alignright\"><a href=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2024\/06\/Annotation.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-7679 size-medium\" src=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2024\/06\/Annotation-300x222.png\" alt=\"4 annotated paragraphs, with notes written in the margins, highlighted passages, and additional notes on a sticky note.\" width=\"300\" height=\"222\" srcset=\"https:\/\/www.braindevs.net\/blog\/wp-content\/uploads\/2024\/06\/Annotation-300x222.png 300w, https:\/\/www.braindevs.net\/blog\/wp-content\/uploads\/2024\/06\/Annotation-1024x759.png 1024w, https:\/\/www.braindevs.net\/blog\/wp-content\/uploads\/2024\/06\/Annotation.png 1424w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><figcaption id=\"caption-attachment-7679\" class=\"wp-caption-text\">Example of annotation from Lloyd, Z. T., Kim, D., Cox, J. T., Doepker, G. M., &amp; Downey, S. E. (2022). Using the annotating strategy to improve students&#8217; academic achievement in social studies. Journal of Research in Innovative Teaching &amp; Learning, 15(2), 218-231.<\/figcaption><\/figure>\n<p>The students who learned this new method got LOTS of practice: at least 100 minutes over 6 weeks. The study used a &#8220;business as usual&#8221; control group, which means that the teachers just taught as they usually do for the students who didn&#8217;t learn about annotation.<\/p>\n<p>The result: impressive!<\/p>\n<p>In brief, the students who annotated thought the method was relatively easy to use. And, they scored higher on a reading-comprehension test.<\/p>\n<p>If you speak stats, you&#8217;ll be impressed to see that the Cohen&#8217;s d was 0.46: an attention-getting number for a 6-week intervention.<\/p>\n<p>So far, this study gives us reason to focus on teaching annotation.<\/p>\n<h2>Subsequent Concerns<\/h2>\n<p>And yet, I do have concerns: some <strong>specific<\/strong> to this study, and some <strong>more generally<\/strong> about applying research to classrooms.<\/p>\n<p>SPECIFIC concern:<\/p>\n<p>As you can see in the image above, the annotating method includes <em>highlighting<\/em>. Alas,\u00a0researchers have looked at highlighting specifically, and found it to be largely unhelpful.<\/p>\n<p>For instance, when John Dunlosky et al. <a href=\"https:\/\/journals.sagepub.com\/doi\/abs\/10.1177\/1529100612453266\" target=\"_blank\" rel=\"noopener\">evaluated the efficacy of various study strategies<\/a>, they didn&#8217;t find much to recommend highlighting:<\/p>\n<blockquote><p>On\u00a0the basis of the available evidence, we rate highlighting and\u00a0underlining as having <strong>low utility<\/strong>. In most situations that have\u00a0been examined and with most participants, highlighting does\u00a0little to boost performance.<\/p>\n<p>It <strong>may help<\/strong> when students have the\u00a0knowledge needed to highlight more effectively, or when texts\u00a0are difficult, but <strong>it may actually hurt performance<\/strong> on higher level\u00a0tasks that require inference making. (Emphasis added.)<\/p><\/blockquote>\n<p>If this annotating method includes a widely-discredited strategy, I worry about the research behind it.<\/p>\n<p>GENERAL concerns<\/p>\n<p><a href=\"https:\/\/braindevs.net\/blog\/\/getting-bossy-about-jigsaws-dont-fence-us-in\/\" target=\"_blank\" rel=\"noopener\">As I&#8217;ve written before<\/a>, I want to offer &#8220;research based teaching advice&#8221; only if LOTS of research supports the advice. You know your school, curriculum, and students better than I do &#8212; so I need SUBSTANTIAL reason to say &#8220;do this, not that.&#8221;<\/p>\n<p>Alas, we have <em>precious little research<\/em> into the question of annotation.<\/p>\n<p>I&#8217;ve used my go-to resources (scite.ai, connectedpapers.com, elicit.org), and found almost no research pointing one way or the other. (The study described above does mention other experiments &#8230; but as far as I can discover none of them focuses precisely on annotation.)<\/p>\n<p>So, yes: we have ONE study saying that this annotation method helped 8th graders learn more in a social studies class. But I don&#8217;t think we should be very sure of that narrow finding&#8230;much less confident about extrapolating.<\/p>\n<p>That is: do these results tell us anything about annotating in a high-school English class? I don&#8217;t think so.<\/p>\n<h2>Niche-y, But Important<\/h2>\n<p>A final concern merits a brief discussion here.<\/p>\n<p>As noted above, the study uses a &#8220;business as usual&#8221; control group. That is: some students got A SHINY NEW THING (for 100 minutes!). And some students got &#8230; nothing special.<\/p>\n<p>As you can imagine, we might easily conclude that the\u00a0SHINY NOVELTY &#8212; not the annotation specifics &#8212; helped the students.<\/p>\n<p>The study would have been more persuasive if the control group had learned\u00a0<em>a different reading comprehension strategy<\/em> instead of annotation. In this case, we would have more confidence about the benefits (or lack of benefits) of annotation.<\/p>\n<p>Generally speaking: when a\u00a0study compares Something to Something Else, not Something to Nothing, it gives us greater reason to rely on its findings.<\/p>\n<h2>In Brief<\/h2>\n<p>When our students read, we want them to\u00a0<em>think about<\/em>\u00a0the text they&#8217;re reading.<\/p>\n<p>We want them to &#8230;<\/p>\n<p style=\"padding-left: 30px;\">&#8230; learn the ideas in the text,<\/p>\n<p style=\"padding-left: 30px;\">&#8230; associate it with their prior knowledege,<\/p>\n<p style=\"padding-left: 30px;\">&#8230; update their schema on the topic,<\/p>\n<p style=\"padding-left: 30px;\">&#8230; consider weaknesses, questions, and omissions,<\/p>\n<p>and so forth.<\/p>\n<p>Is\u00a0<em>annotating<\/em> the best way to ensure they do so? I&#8217;m not yet persuaded.<\/p>\n<p>If you know of good research on the topic, I hope you&#8217;ll let me know!<\/p>\n<hr \/>\n<p>Lloyd, Z. T., Kim, D., Cox, J. T., Doepker, G. M., &amp; Downey, S. E. (2022). Using the annotating strategy to improve students&#8217; academic achievement in social studies.\u00a0<i>Journal of Research in Innovative Teaching &amp; Learning<\/i>,\u00a0<i>15<\/i>(2), 218-231.<\/p>\n<p>Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., &amp; Willingham, D. T. (2013). Improving students\u2019 learning with effective learning techniques: Promising directions from cognitive and educational psychology.\u00a0<i>Psychological Science in the Public interest<\/i>,\u00a0<i>14<\/i>(1), 4-58.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A few years ago, I visited an English Department meeting at a well-known high school. The topic under discussion: a recently published &#8220;English Department Guide to Annotation.&#8221; After the meeting, one of the authors asked me what I thought of the guide and the research behind it. I asked: &#8220;Well, what IS the research behind [&hellip;]<\/p>\n","protected":false},"author":18,"featured_media":7686,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-7675","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lb-blog"],"_links":{"self":[{"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/posts\/7675","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/comments?post=7675"}],"version-history":[{"count":12,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/posts\/7675\/revisions"}],"predecessor-version":[{"id":310204,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/posts\/7675\/revisions\/310204"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/media\/7686"}],"wp:attachment":[{"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/media?parent=7675"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/categories?post=7675"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.braindevs.net\/blog\/wp-json\/wp\/v2\/tags?post=7675"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}