To get review quality scores, the reflection rubric needs to have at least one evaluation criteria that is either Yes/No or Scale.

After each peer review session (submission, peer review activity, reflection) every student receives a 'Review quality score' between 0% and 100%. This score is an indication of how good the student is at giving feedback to other students.

Together with the submission quality score, the review quality score is counted in the total score for a student.

How the review quality score is calculated

The review score for a reviewer is based on the review reflections they receive according to the reflection rubric (see here which questions we ask by default). When students receive a review, they can be asked to react to it using a scale ranging from 'Not useful at all' to 'Extremely useful'.

These ratings each correspond to a score between 0% and 100%. The review score is the average of the reflection scores.

Example

Imagine that a student has completed 4 of 5 reviews and received review reflections to 3 of those 4 reviews. Then we consider the reflection to each of the reviews:

Review 1 4/5 (75%)
Review 2: No reflection received for this review
Review 3: 1/5 (0%)
Review 4: 5/5 (100%)
Review 5: Did not complete this review (0%)
Review score: (75% + 0% + 100% + 0%) / 4 = 43,75%

Note here, that since no reflection was given to the second review, we do not take this one into account for the review quality score. This also means, that if a reviewer does not receive any review reflections, then they don't receive a review quality score.

Did this answer your question?