I have used workshop in the past, but it has been awhile. Given that, I wanted to renew some questions to see if this has changed before I use it again.
In the past, I wanted to have each student submission sent to three reviewers. I would add myself as a reviewer, giving myself a very large weight. This would do two things: first, it would mean that the grade is largely determined by me (and I could be explicit about that weight). Second, the grade on the feedback for those providing feedback would be heavily influenced by my grade, since the feedback grade is a function of deviation from the aggregate grade. The further off the reviewer is, the lower score they receive.
In the past, this seemed to be true, but it was not at all transparent how this reviewer grade came out. Is there any clear explanation of how those grades are computed as a function of the aggregate score? It is hard to explain the credibility of that mark to a student if the method by which it is computed is not clear.
Finally, while the final grade is clear to the reviewer and the submitter of the work, is there any way to reveal the comments that I as a teacher have for the submitted work, so those who have done reviews (and not scored highly) can see where their evaluations may have deviated from mine?
I want feedback to be anonymous, but I also want reviewers to learn how to do good reviews. I think this is a great way to wring more learning out of assignments, but I want to make sure that activity works like I'd like it to.