To get review quality scores, the reflection rubric needs to have at least one evaluation criteria that is either Yes/No or Scale.

After each peer review session (submission, peer review activity, reflection) every learner receives a 'Review quality score' between 0% and 100%. This score is an indication of how good the learner is at giving feedback to other learners.

Together with the submission quality score, the review quality score is counted in the total score for a learner.

How the review quality score is calculated

The review score for a reviewer is based on the review reflections they receive according to the reflection rubric (see here which questions we ask by default). When learners receive a review, they can be asked to react to it using a scale ranging from 'Not useful at all' to 'Extremely useful'.

These ratings each correspond to a score between 0% and 100%. The review score is the average of the reflection scores.

Example

Imagine that a learner has completed 4 of 5 reviews and received review reflections to 3 of those 4 reviews. Then we consider the reflection to each of the reviews:

Review 1 4/5 (75%)
Review 2: No reflection received for this review
Review 3: 1/5 (0%)
Review 4: 5/5 (100%)
Review 5: Did not complete this review (0%)
Review score: (75% + 0% + 100% + 0%) / 4 = 43,75%

Note here, that since no reflection was given to the second review, we do not take this one into account for the review quality score. This also means, that if a reviewer does not receive any review reflections, then they don't receive a review quality score.

Did this answer your question?