Using Peer Review/Peer Review/Using Software/Calibrated Peer Review Software Systems

From UBC Wiki

Using Software or Calibrated Peer Review Software Systems

What follows is a brief overview of software systems you may want to consider. The benefit of using a software program to handle peer evaluation is that they can simplify the logistics of assigning, collecting, and returning grades, and providing feedback. Using these systems requires a considerable initial time commitment to set up the assignment and grading rubric(s), but the time savings come later when they construct grades for you and provide feedback directly to students. It is also very important to ensure you make it clear to your students that any software systems used for peer review offer learning benefits to them 9, as well as smoothing the assignment logistics for you.

  1. Calibrated Peer Review. The CPR software was created at UCLA and takes users through a sequence of submitting their own work, training on grading other’s work (“calibration”) and grading their peer’s work. There is a bank of assignments and it is easy to create your own. Check out the extensive list of publications on the CPR website.
  2. iPeer (UBC). iPeer is an open-source web-based software application that allows instructors to create assignments and rubrics, send reminders to students, and provide feedback. Evaluations can be based on rubrics, and the system can be used for evaluating the contributions of group members in team projects.
  3. PeerMark (Turnitin). This component of Turnitin distributes student work for peer grading according to instructor-given criteria. Reviewers may comment and add editing remarks. Your institution may have a license with Turnitin, and it may be integrated with your learning management system (LMS). At UBC, Turnitin is not integrated with the LMS because Turnitin stores the data in the United States. Be sure only anonymous student work is uploaded to Turnitin if your institution is in Canada.
  4. MyWritingLab (Pearson). This proprietary software allows for “facilitated peer review”, which means that students may provide comments on other students’ work, as well as grade it using an instructor-provided rubric.
  5. Peerceptiv (formerly SWoRD Peer Assessment). Peerceptiv engages students in double-blind reviews using instructor-created rubrics. This system claims to motivate students, eliminate bias, and generate useful analytics for instructors. Student work is graded by three to six peers and students have the opportunity to “back evaluate” to rate the helpfulness and specificity of the review. SWoRD has been heavily researched by the University of Pittsburgh and is offered by Panther Learning.

Do you have other examples of peer evaluation software that you have had success with? Please contact us here if so.

Retrieved from "https://wiki.ubc.ca/index.php?title=Using_Peer_Review/Peer_Review/Using_Software/Calibrated_Peer_Review_Software_Systems&oldid=404288"