OU multiple response

Question types ::: qtype_oumultiresponse
Maintained by TimTim Hunt, at the OU (Perry building)Mahmoud Kassaei, Anupama Sarjoshi
Part of set Open University.
The main difference from the standard Moodle multiple choice question type is in the way that grading works. When creating the question, the teacher just indicates which choices are correct. If there are n correct choices, then the student scores 1/n for each correct choice. If they select too many choices, then incorrect choices outweigh correct ones.
Latest release:
1550 sites
549 downloads
32 fans
Current versions available: 9

There are working examples in eAssessment with Moodle on our OpenLearn site.

The documentation is in How to create questions in Moodle on that site.

And example of how the grading works, using an example with 5 options, 3 correct and 2 incorrect:

  • If the student selects the right number of choices (3) then their score is the fraction that are correct (0/3, 1/3, 2/3 or 3/3).
  • If the student selects too few choices, add incorrect choices to make the number exactly 3, then score as above. For example, 1 right and 1 wrong is the same as 1 right and 2 wrong = 1/3; or 2 right => 2 right 1 wrong = 2/3.
  • If the student selects too many choices, then remove correct choices to make the number exactly 3. So, 2 right and 2 wrong => 1 right and 2 wrong = 1/3.
This logic is extended to compute a fair grade when interactive with mulitple tries behaviour is used.

Screenshots

Screenshot #0

Contributors

Tim
Tim Hunt (Lead maintainer)
at the OU (Perry building)
Mahmoud Kassaei: Developer
Anupama Sarjoshi: Tester & Developer
Phil Butcher: Question type design
Colin Chambers: Developer
Chris Nelson: Product owner
Please login to view contributors details and/or to contact them

Comments RSS

Visa kommentarer
  • Valérie Baty
    tis, 10 aug. 2021, 07:59
    To Tim Hunt : Thank you for your answer. I would like to configure questions type "OU multiple response" in an offline quiz in order to apply the scale of the plugin "OU multiple response" in this offline quiz
  • Naaima Fisher
    ons, 22 feb. 2023, 16:01
    Hi, Please advise if the plugin will be upgraded to be compatible with version 4.1. Thank you!
  • Tim
    ons, 22 feb. 2023, 16:05
    Pretty sure the latest should just work with Moodle 4.1. I just have not had the time to prove it. If you are able to test yourself please report back.
  • Zabelle Motte
    ons, 22 mars 2023, 21:13
    I confirm this plugin works fine on Moodle 4.1 while applying the css tweak proposed by Dave !
  • Zabelle Motte
    mån, 8 maj 2023, 17:24
    We have been testing this very interresting plugin in our university, hoping to have a better and easier option to configure the mcq questions for exams.

    But the scoring computation is very complicated and may be difficult to explain to students. Students appeals are very frequent in out institution especially about mcq scoring.

    My collegues of the pedagogical team that study evaluation and scoring questions find the "Every Decision Counts" scoring system implemented in openedx much more clear and much more fair :
    https://edx.readthedocs.io/projects/edx-partner-course-staff/en/latest/exercises_tools/multi_select.html#id40

    In this system, every correct check or correct uncheck generates a partial note. It is much easier to explain this scoring to students.

    I would like to know if other institutions reflect on mcq scoring, and if other scoring systems may be considered.

    It could be interresting to make the plugin evolve to be able to implement different types of scoring if justified (and avoid question type plugin multiplication).

    With great thanks fot this simplified plugin and for discussion.

    Kisses,

    Zabelle
  • Dave Foord
    mån, 8 maj 2023, 17:32
    @Zabelle - I expect that Tim Hunt will chip in with a response at some point but personally, I think that the scoring system that this plugin uses is actually very simple, and is at least consistent.

    If people want different or more complicated scoring systems, then the standard multiple choice question should be used - but whoever is creating the questions, needs to understand what they are doing. I have seen a lot of people create multiple response type questions, where students get positive marks for all the correct selections, but don't lose marks for the incorrect ones. the consequence of this, is if a student works this out, and doesn't know the answer, they just select all the options, and even though their response is wrong, they end up getting 100% scored. I believe this plugin was created to remove that situation, and make it easier for an average teacher to create multiple response system without having to worry about the scoring methodoligy.
  • Chris Nelson
    tis, 9 maj 2023, 15:25
    @Zabelle and Dave, thank you for the comments.

    Indeed, our plugin exists is because we did not feel the Moodle Core 'multiple choice' question type scored multiple response questions fairly (excellent for single choice questions, though).

    I just checked with a colleague and we don't appear to have any problems with students appealing this question type in our formative/summative tests using Moodle Quiz. But we do generally offer diagnostic/consolidative quizzes and explain the marking and feedback fairly well. Maybe it is more a question of improving the scaffolding before and after the learning activity?
  • Zabelle Motte
    tis, 9 maj 2023, 20:45
    Thanks for answer Dave and Chris,

    We all know the problem of the default MCQ question. And it is difficult to configure penalities for exans.

    If you have a support that explains clearly how the ou_multiresponse questions are scored, I am interrested because my evaluation colleages are reluctant about the way to communicate how the scoring works.

    Kisses,

    Zabelle
  • Tim
    tis, 9 maj 2023, 20:54
    With the exception of 'Interactive with multiple tries' behaviour, the scoring is quite simple.

    If the question has 4 correct choices, then each correct choice which the student selects scores 25%, and any incorrect which the student selects loses 25% (but the total score can never go below zero).

    So, if the student selects all 4 correct choices, and nothing else, they score 100%.

    So, if the student selects 3 correct choices, and nothing else, they score 75%.

    So, if the student selects 4 correct choices and one wrong choice, they score 75%.

    So, if the student selects 3 correct choices, 2 wrong choices, they score 25%.

    So, if the student selects 2 correct choices, 5 wrong choices, they score 0%.

    Does that make sense?
  • Zabelle Motte
    fre, 2 juni 2023, 16:09
    Great thanks for this answer Tim.

    While reflecting with my collegue, we succeded to explain our difficulties with the ou multi response scoring.

    When a student does not check one option that has not to be checked, he is not paid for it.

    Is it fair ?

    With great thanks to those who follow this puzzle discussion,

    Kisses

    Zabelle
  • Dave Foord
    fre, 9 juni 2023, 15:26
    I know it has been asked before, and apologies for asking again, but is there a plan to make this question type work within the mobile app?

    I love this question type, and have created thousands of questions over the years that use it - and would love it if they worked on the mobile app.
  • Chris Nelson
    fre, 9 juni 2023, 16:16
    We'd like to, but we have our own custom app theme that complicates things, and our IT equipment is so locked down that testing on mobile devices is pretty impossible. We're looking into VM'ing mobile devices instead, but that's a whole long-term process. It would probably be far easier for someone else to contribute to the qtype to get it working in the app! Which would be very gratefully received, if any such developer is reading this leende
  • Dave Foord
    fre, 9 juni 2023, 16:33
    If there is a developer reading this - interested in taking this on, I would be happy to make a modest financial contribution to them for this.
  • Sven Ceglarek
    mån, 21 aug. 2023, 17:47
    Hey,

    can anyone confirm, if this plugins works with Moodle 4.2?

    Thank you in advance leende
  • Chris Nelson
    mån, 21 aug. 2023, 17:56
    Hi Sven,

    We're just upgraded our test server to M4.2 ahead of our next system release, and have seen that lots of quiz class names have changed.

    Once the August summer holidays are over, we will work through our OU question types and release updates for our plug-ins as soon as we're able.
1 2 3 4
Please login to post comments