OU multiple response

Question types ::: qtype_oumultiresponse
Maintained by Tim at Lone Pine Koala SanctuaryTim Hunt, Picture of Phil ButcherPhil Butcher, at the OU (Perry building)Mahmoud Kassaei
The main difference from the standard Moodle multiple choice question type is in the way that grading works. When creating the question, the teacher just indicates which choices are correct. If there are n correct choices, then the student scores 1/n for each correct choice. If they select too many choices, then incorrect choices outweigh correct ones.
Latest release:
1542 sites
311 downloads
27 fans

There are working examples in eAssessment with Moodle on our OpenLearn site.

The documentation is in How to create questions in Moodle on that site.

And example of how the grading works, using an example with 5 options, 3 correct and 2 incorrect:

  • If the student selects the right number of choices (3) then their score is the fraction that are correct (0/3, 1/3, 2/3 or 3/3).
  • If the student selects too few choices, add incorrect choices to make the number exactly 3, then score as above. For example, 1 right and 1 wrong is the same as 1 right and 2 wrong = 1/3; or 2 right => 2 right 1 wrong = 2/3.
  • If the student selects too many choices, then remove correct choices to make the number exactly 3. So, 2 right and 2 wrong => 1 right and 2 wrong = 1/3.
This logic is extended to compute a fair grade when interactive with mulitple tries behaviour is used.

Sets

This plugin is part of set Open University.

Screenshots

Screenshot #0

Contributors

Tim at Lone Pine Koala Sanctuary
Tim Hunt (Lead maintainer)
Picture of Phil Butcher
Phil Butcher: Question type design
at the OU (Perry building)
Mahmoud Kassaei: Developer
Picture of Colin Chambers
Colin Chambers: Developer
Picture of Chris Nelson
Chris Nelson: Product owner
Please login to view contributors details and/or to contact them

Comments RSS

Show comments
  • Tim at Lone Pine Koala Sanctuary
    Fri, Jan 18, 2019, 2:18 AM
    This plugin inherits that behaviour from the standard Moodle question type. So, this is really MDL-43174.
  • Picture of Philipp Coufal
    Wed, Aug 21, 2019, 3:09 PM
    Hi, quick question. When there are more right answers than wrong answers and a student selects everything, he still gets more than 0 points. Could there be an option to automatically give 0 points when a student selects everything?
  • at the OU (Perry building)
    Wed, Aug 21, 2019, 4:02 PM
    Thanks Philip! I think, this is a bug and should be fixed.
  • Tim at Lone Pine Koala Sanctuary
    Wed, Aug 21, 2019, 5:11 PM
    I think I take the opposite view. This question type has a simple scoring system: +1/n for each right choice selected, -1/n for each wrong choice. If you want the score for selecting everything to be 0, then make sure you have at least as many distractors as right choices.

    (I am now imaging a question with choices like "This is a wrong option. Don't select it. Are you event paying attention?" smile Is that as pedagogically invalid as it at first seems?)
  • Peter Jonker
    Tue, Aug 18, 2020, 1:49 AM
    Hello we are upgrading a site from 3.5 to 3.9 and the display of your question type is not correct anymore. We tested in different 3.9 sites without any theming but the result is the same. The tickboxes and answer options are not outlined. The text for the answer is one line lower than the tickbox. Please advise! I could not sent a screenshot here but please let me know when you need any. Thanks Peter Jonker
  • Tim at Lone Pine Koala Sanctuary
    Tue, Aug 18, 2020, 5:44 PM
    There were changes to core multiple-choice question type in Moodle 3.9, with ongoing bug fixes in 3.9.1 and 3.9.2 to sort out some issues.

    I guess that in time we will need to make simiilar changes to this plugin, to match what is done in the core question types, but I will wait for the core code to finalise before i do anything.
  • Peter Jonker
    Tue, Aug 18, 2020, 5:51 PM
    Hi Tim, thanks for your prompt reply. I will watch for updates.
  • Picture of Vera Trendafilova
    Sun, Dec 6, 2020, 8:38 PM
    Hi, are there any news on the update of the plugin. I would like to use the combined question plugin but the tickboxes and the answer options continue to not be aligned. The answers go to the next line.
  • Tim at Lone Pine Koala Sanctuary
    Mon, Dec 7, 2020, 5:50 PM
    I am afraid the answer is "When I get time". That might be this weeek, but it might not.
  • Picture of Rachel Martin
    Mon, Dec 7, 2020, 10:57 PM
    I had to fix the alignment issue for our Moodle 3.9. Since the renderer looked to be based off of multichoice questions, I found that updating the following two classes in styles.css to match multichoice worked.
    .que.oumultiresponse .answer div.r1 {
    /* padding: 0.3em 0 0.3em 25px;
    text-indent: -25px; */
    display: flex;
    margin: 0.25rem 0;
    align-items: flex-start;
    }
    .que.oumultiresponse .answer div.r1 input {
    /* margin: 0 5px;
    padding: 0;
    width: 15px; */
    margin: 0.3rem 0.5rem;
    width: 14px;
    }
  • Tim at Lone Pine Koala Sanctuary
    Mon, Dec 7, 2020, 10:59 PM
    Yes. that is the right general approach. However, the styles in Moodle core for this keep changing. We did a fix like this in our theme for Modoel 3.9.2, and then it broke again for 3.9.3.
  • Picture of Jean-Roch Meurisse
    Mon, Jan 4, 2021, 8:08 PM
    Hi there,
    We are testing this very valuable plugin but are facing difficulties in grading. It is said that the student scores 1/n for each correct choice, and loses 1/n for each incorrect choice and here is what we get for a question with 5 options (3 correct and 2 incorrect)

    1 correct 0 incorrect -> 33%
    2 correct 0 incorrect -> 66%
    3 correct 0 incorrect -> 100%
    1 correct 1 incorrect -> 33%
    2 correct 1 incorrect -> 66%
    3 correct 1 incorrect -> 66%
    1 correct 2 incorrect -> 33%
    2 correct 2 incorrect -> 33%
    3 correct 2 incorrect -> 33%
    0 correct 1 incorrect -> 0%
    0 correct 2 incorrect -> 0%

    Any help?
    Thanks in advance


  • Tim at Lone Pine Koala Sanctuary
    Mon, Jan 4, 2021, 8:25 PM
    I guess the simple description is too simple! Let me try a fuller description, using your sepecific example 5 options (3 correct and 2 incorrect).

    If the student has selected the right number of choices (3) then their score is the fraction that are correct (0/3, 1/3, 2/3 or 3/3).

    If the student has selected too few choices, then add more incorrect choices to make the number exactly 3, then score as above. For example, 1 right and 1 wrong is the same as 1 right and 2 wrong = 33%; or 2 right == 2 right 1 wrong = 67%

    If the student has selected too many choices, then remove correct choices, to make the number exactly 3. So, 2 right and 2 wrong == 1 right and 2 wrong = 33%.

    (The last point is the only sense in which the student "loses 1/n for each incorrect choice".)

    I hope that makes sense. We think this scoring scheme is fair: rewarding students for what they know, and without generating false incetives that help students game the system.

  • Picture of Dave Foord
    Mon, Jan 4, 2021, 8:29 PM
    I agree with Tim that the scoring mechanism for this plugin is much fairer than using the built-in Multiple Choice question type, which is a) harder to use with multiple response type options, and b) very easy to create warped data where students are over penalised for choosing too many options.
  • Picture of Jean-Roch Meurisse
    Mon, Jan 4, 2021, 9:14 PM
    Thanks Tim for your prompt and very clear answer. It makes sense now and I totally agree with your arguments.
    This being said, IMHO, the plugin description should mention this so that users are aware of it
    Cheers
1 2
Please login to post comments