Sorry, you need to enable JavaScript to visit this website.

Site-wide links

RIT Ready: Moving Forward Into Fall
Faculty Course Technology Support
Blog » Faculty Stories Update: Kate Wright and Online Annotation for Class Assessment

Rebecca Johnson--What is a Faculty Stories Update? Over time, digital tools change or are subsumed by other platforms. Sometimes tools disappear entirely. We are updating the Faculty Stories from our website to describe new tools, or categories of tools, that can be used in place of those that are no longer available. Please be aware that your use of technologies not included on the list of ILI-supported technologies (listed on that page as "TLS-supported technologies") carries a level of risk.* (See the bottom of this post for more information.)

Key pedagogical concept: Learning is social. Students can benefit from opportunities to work through concepts and difficult content together. This social annotating exercise facilitates online exchange of ideas about course readings and topics.

Key technology features: Kate tells us that she now uses Perusall when she has her students read papers to prepare for in-class discussions. Perusall is a free social annotating platform developed by Gary King, Brian Lukoff, Eric Mazur, and Kelly Miller. You can find research on Perusall on their site. The key features of this technology are an interface that facilitates collaborative annotation of a PDF file. Students can "upvote" comments or questions and search the readings and comments.

Enterprise technology equivalent: Though Perusall has features that do not have an equivalent in enterprise supported tools, some functions of this tool could be achieved in a shared Google Drive. Here is more information on the Google Suite for Education at RIT.


Marybeth Koon--When Kate Wright of RIT’s College of Science heard about the web-based program Nota Bene, she thought it could be a good tool to help her have a better understanding of her students’ learning and also increase peer interaction in a large lecture class. Through Nota Bene, Kate’s students can read and annotate PDF documents that she posts to the application website. Based on the comments and discussions among students, she can gauge their grasp of the material and modify her classes as needed to ensure that students are learning the content. [Click on Kate's picture to watch a brief video of her talking about her use of the Nota Bene tool.] In smaller classes, she's been able to see not only what students think is confusing about an article, but also what students think is interesting.

picture of Dr. Kate Wright

Annotated Reading with Nota Bene

Since it can be a challenge to know where students are with course concepts in large classes, Kate uses reading assignments to get a better idea of what students do and don’t understand. This enables her to adjust class plans to make sure she is using class time effectively.  In Nota Bene, Kate posts articles, papers, and other readings. Students can comment or ask questions about the content, as well as respond to each other to start a conversation.

According to Kate: “The nice thing about the Nota Bene format is that unlike a discussion board or some other online forum, in Nota Bene the reading material is always on the screen… and when someone comments on a student post, they get an email [like Facebook] saying that someone has responded to your question or your comment and in the body of the email is a link that takes you right back to the reading material.”  By reviewing students’ annotations to the Nota Bene readings, Kate can identify vocabulary words that are misunderstood or being misused by students and find out what concepts are giving them trouble.

Structuring Assignments

Finding appropriate readings was the first challenge. While Kate can use primary sources, such as journal articles, with her upper level students, it has been a little tougher finding the right material for her introductory-level classes. She didn’t want to use selections that merely repeated the material in the main textbook, so she looks for complementary articles that illustrate the concepts she teaches in class.

Kate makes effective use of Nota Bene by structuring assignments and giving students particular questions about the readings to respond to, rather than simply posting readings. She also uses the application’s ability to break the class into groups. She has divded large classes into groups of about 15 students, so that discussions are more manageable and it’s easier for all students to contribute. It has also been important to make sure that the Nota Bene assignments are graded. While students recognize the value of the activities, unless it has an impact on their grade, they tend not to reliably follow through.

Kate shares:
“One time I put practice exam questions on Nota Bene… it wasn’t a graded assignment, [but] I was hoping that students would comment on them and discuss back and forth like they’d been doing with the assignments… [Only] 5 percent of the students commented on anything. It told me that if it’s graded and they get a little encouragement to do it, they’ll do it—and as the quarter went on, usage went up, comments got better. If there were no points attached… students aren’t going to do it.”

Kate uses a simple three-point scale for each assignment based on the effort students put into their responses. One tool feature in Nota Bene that she appreciates is the ability to click on a student's name and see all of their posts and comments. Once she could gauge student’s understanding of concepts through their comments and questions on the readings, she was able to use that information to modify her classes, if needed. For example, if students are having trouble with a concept, she can allot extra time to it; if they seem to have a good grasp of a learning point, she can check with some quick iClicker questions, and then move on.

Instructor and Student Experiences

Students took to using Nota Bene quickly since the commenting and discussion format is similar to Facebook.  Kate especially likes how Nota Bene brings in many of the elements of Universal Design and enables her deaf and hard-of-hearing (D/HH) and English Language Learner (ELL) students to contribute at the same level as others in the class, where they might be reluctant to do so in the classroom. This format also encourages shy or introverted students to participate. Finally, Nota Bene also provides data that Kate uses to assess student engagement, such as how many and which comments lead to longer discussions, especially in the upper-level course, where typically 60 to 75 percent of comments receive peer responses.  Kate has one caution for faculty who want to try Nota Bene or a similar application: while these activities are resource-neutral for students, they require a substantial commitment from instructors, who need to select readings, read and respond to student comments, and modify class plans.


*The use of third-party tools or LMS integrations that are not supported by ILI is at the discretion of the instructor with the understanding that many of these of these tools have support and documentation provided by their publisher, not RIT's Academic Technology Support. Most third-party integrations are not actively monitored by RIT's Academic Technology Support and may be subject to unexpected changes or service interruptions from their publishers.


The Wallace Library
Room A-650
90 Lomb Memorial Drive
Rochester, NY 14623



© Copyright Rochester Institute of Technology. All Rights Reserved | Disclaimer | Copyright Infringement