Peer review of group work

Peer review of group work

by Iain McAlpine -
Number of replies: 6

Hi All

I am interested in a form of online support for student peer review of individual contribution to a group task by other members of the group.

We have been looking at the Moodle 2.0 Workshop module but this seems to be set up for a different purpose.

Has anybody been developing anything in Moodle to support peer review within small groups?  If so I'd love to hear from you, and to hear any suggestions for doing this in Moodle.

Iain

 

Average of ratings: Useful (1)
In reply to Iain McAlpine

Re: Peer review of group work

by Chad Outten -

Hi Iain,

I suggest you check out the 'Database' module. This activity is very flexible and can be setup for groups. It doesn't have the stepwise approach you get with Workshop.

Cheers, Chad.

In reply to Chad Outten

Re: Peer review of group work

by Iain McAlpine -

Thanks Chad

I'll check that out.  Somebody at this university has tried the database module.  I'm not sure that it can be set up in advance with all of the data on the groups, but I'll follow that up to see if there is a way.

Regards - Iain

In reply to Iain McAlpine

Re: Peer review of group work

by Peter Ruthven-Stuart -
Picture of Plugin developers

Hello Iain,

"I am interested in a form of online support for student peer review of individual contribution to a group task by other members of the group."

I think I am looking for a very similar ‘feature’.

I administer a course in which 250 students in groups of 3 (so 84 groups) create ‘compositions’ using the moodle Wiki module. A teacher gives grades and feedback for these compositions via the standard ‘Assignments-offline activity” module. Students in the same group get the same grade and feedback. The only exception to this is if students in a group report that one of their members did not make any contribution. If this is confirmed, the non-contributing student gets a zero.

Although students appreciate this collaborative work, there is some concern that ‘free-riders’ and minimally contributing students are being unfairly rewarded.

A possible solution to this problem is to allow groups members to evaluate each other’s contribution.

Certainly, there are ‘peer review’ modules already out there, and modules that could be used for peer review:

The problem with these existing ‘peer review’ solutions is that they require the students to submit something. e.g. with the Workshop module, if students don’t upload / submit something, they can’t be evaluated, The same with the Database module solution. With the questionnaire and Feedback modules, the teacher has to list all of the students in the course, and then ‘trust’ the students to evaluate only those students who were in their group. Also, it is not possible for this evaluation of peers in a questionnaire or feedback activity (a grade) to be carried over to the gradebook.

Another issue with the existing solutions is that they are designed for evaluation of the quality of content. What I (and I think Iain) are after is something that will allow students to evaluate the level of contribution made to a group task by individual group members (i.e. quality of contribution).

At its simplest, students would be asked to evaluate the contribution of their group members (and perhaps themselves too) by checking one of the following or similar statements about each student:

  • This student made no contribution
  • This student made a minimal contribution (less than the other two)
  • This students did as much as the other group members
  • This student did more that the other group members

The wording and number of statements would be set up by the teacher, who would also assign a numerical value to each statement. For example, 0% for "no contribution", and 130% for "contributing more than the others". This grade could be used in one of two ways:

  1. This “raw” grade could be recorded into the grade book and used to adjust another grade in the gradebook using a simple equation: e.g. if group X was given 60% for their composition, but student B was judged by her group members to have contributed more that the other group members, she would get an adjusted score of 78% (60 x 130%).
  2. Alternatively, the calculation could be done within this ‘module’, so that students accessing this activity after the evaluation process would see their ‘average’ contribution score and the adjusted score of the group task.

So is there already a way to do this, either with standard or contributed modules?

Or, perhaps it might be possible to adjust an existing module; e.g. the “Peer review assignment type” could be changed to allow students to evaluate ‘offline’ activities, and so students would not be required to upload something before evaluating other students or being evaluated.

Or, is there a need for a new feature that will:

  1. allow students to evaluate the level of contribution to group tasks by other group members
  2. not require submission or uploading in order to evaluate or be evaluated
  3. support the groups and groupings feature so that students will be automatically faced with only their group members to evaluate
  4. report the ‘average’ (or perhaps max) contribution grade to the gradebook.
  5. make it possible to give a grade to students who evaluate other students' contributions (i.e. an incentive for doing this evaluation task)

Any ideas or suggestions will be most welcome.

In reply to Peter Ruthven-Stuart

Re: Peer review of group work

by Michael de Raadt -

Hi, All.

I'm the author of the Peer Review assignment type. I believe individual peer assessment and team-based peer assessment are quite different.

Perhaps what you are after already exists in the Team Assignment assignment type from Massey...

http://lightwork.massey.ac.nz/projects/show/moodle-teams

It's not in the Modules and Plugins DB (hopefully it will be in future), but judging from this group's past work on LightWork, it's likely this assignment type will be useful.

Michael;

In reply to Michael de Raadt

Re: Peer review of group work

by Peter Ruthven-Stuart -
Picture of Plugin developers

Hello Michael,

Thanks for posting.

"Team Assignment assignment type" looks good. It looks great for allowing teachers to grade group / team work, but judging from their Wiki page, it seems that it is not designed to allow students to grade team members' levels of contribution to a team task.

In reply to Peter Ruthven-Stuart

Re: Peer review of group work

by Kevin Ryan -

If you are still using 1.9, you may be interested in the Module named Rubric, which has some of the things you are looking for. I've not used it, so can't attest to its stability (it is a Core module), and am not sure if it works in 2.0 or later.