CBM Grade Summary

Quiz reports ::: quiz_cbmgrades
Maintained by argmTony Gardner-Medwin
Quiz Report Plugin for Staff to see proper Reports for quizzes using CBM Behaviour. Essential with use of CBM in core Moodle unless you opt to install separate "CBM plus" code modifications.
Latest release:
241 sites
119 downloads
19 fans
Current versions available: 4

Basic documentation on Certainty-Based Marking (CBM) is at https://docs.moodle.org/en/Using_certainty-based_marking.

This plugin is required to display Staff Reports that properly summarise student performance in quiz attempts using CBM behaviour. It is essential if staff are to see clear reports for quizzes that use CBM. The plugin should really be in core Moodle, since CBM is an option in core Moodle, which enables students to see full reviews when CBM is in use, even without the plugin. 

The plugin allows staff to opt whether or not to see student scores on individual questions. Percentage scores are calculated on the basis of either just those questions for which a student has entered a response, or the whole quiz. For example, 100% correct on half of the questions - those which the student has chosen to work on - can be shown as 100% rather than 50% correct. This is appropriate when a student uses the quiz for self-testing, choosing just questions relevant to current learning or self-assessment needs. 

Core Moodle (and this plugin) use the average CBM mark (max=3) to generate Grades up to 300% if all answers are both correct and given with high confidence.  An alternative grading scheme is available with "CBM plus" code downloadable from https://tmedwin.net/cbm . This gives grades that are more directly comparable with conventional accuracy.  CB  Accuracy  =  Accuracy + a  CB Bonus  (typically 0-5%) that rewards students who correctly distinguish sound and unreliable answers. The issues are discussed both in Moodle at Using certainty-based marking,  and at the download site.

Please report any issues to me: Tony Gardner-Medwin (a.gardner-medwin@ucl.ac.uk)

Screenshots

Screenshot #0

Contributors

argm
Tony Gardner-Medwin (Lead maintainer)
Please login to view contributors details and/or to contact them

Comments RSS

Comments

  • argm
    Tue, 25 Nov 2014, 3:49 PM
    Turns out there is a serious problem here. 'Download' gives you the correct plugin version, but 'Install now' always gives the version for Moodle 2.5.
  • argm
    Wed, 26 Nov 2014, 12:48 AM
    Problem solved with new releases (r3) for 2.6,2.7 with amended version.php files and version numbers.
  • Stella Elphick
    Wed, 28 Oct 2015, 5:48 PM
    Hi Tony,

    I used to use the "plus" version of your plugin, but since I upgraded to Moodle 2.9 I cannot find a version that is compatible. Is this in development?

    Many thanks, greatly appreciated.

    Stella
  • argm
    Fri, 30 Oct 2015, 7:09 PM
    I've added the 'plus' files for 2.88 and 2.9.1-2 at http://tmedwin.net/cbm/moodle/download/ (calculating Moodle grades based on CBM Accuracy). Tony
  • Christopher Blake
    Tue, 28 June 2016, 7:42 PM
    I've installed this plugin on a 3.0.4+ instance of moodle and I'm getting the following errors on the feedback page at the end of the quiz:

    "Exception - Call to undefined method quiz_attempt::fire_attempt_reviewed_event()
    Coding error detected, it must be fixed by a programmer: Invalid state passed to moodle_page::set_state. We are in state 3 and state 3 was requested. "

    I followed the instructions for setting up the calculation of CBM; http://tmedwin.net/cbm/moodle/download/

    Other than overwrifgting the modified php files and uninstalling the plug-in how do I fix this?

    ,Thanks
  • argm
    Tue, 28 June 2016, 10:42 PM
    It looks to me as if you used one of the downloads from http://www.tmedwin.net/cbm/moodle/download/ intended for 3.1 rather than for 3.04. Get the right one and replace cbmversion.txt and mod/quiz/review.php . The CBMgrades plugin is not I think the problem.
  • Riaan Aspeling
    Sat, 26 Jan 2019, 6:52 PM
    Hi Tony,

    I was asked to install this plugin on a moodle v3.5 site, and did so. I'm not a moodle expert in any way, but believe I should find the report under the Grades section when selecting a course. Is this assumption correct? If so, then I'm lost, because the report is nowhere to be found on the site.

    Is it possible for you to explain where I could find the report?

    Kind regards,
    Riaan
  • argm
    Tue, 29 Jan 2019, 2:26 AM
    Riaan - This plugin is to enhance the Quiz Reports visible to staff, not the Summary Grade reports for a whole course. Say if this doesn't solve your problem. Tony G-M
  • Peter G
    Sun, 26 May 2019, 11:17 PM
    Reading your site, I've come to greatly appreciate certainty based marking, and I am eager to deploy it and evangelize it in my teaching. My institution, however, is not willing to incorporate manual patches to the moodle core source code. Is there any way to get 0%-100% marking (accuracy + bonus) without patching?

    Also, any idea if the code distributed at TMedwin.net compatible with 3.7, or will adjustments be needed?

    Thank you for everything you have put into this. You've made moodle a better and more dynamic tool!
  • argm
    Tue, 28 May 2019, 5:10 PM
    (1) The latest standard plugin, essential for staff viewing of CBM grades, should work without changes for 3.7, and this should now be clear on the plugin site.
    (2) The preferred (but more complex, non-linear) grading scheme (0-100%) unfortunately does still require patches to the core code. There have been no reported problems with these patches, but I would need help to get them incorporated into core. Anyone interested? An alternative for student selftests is to use my (non-Moodle) site for CBM selftests: https://tmedwin.net/cbm .
  • Peter G
    Wed, 5 June 2019, 6:52 PM
    I can confirm that both the plugin and the "plus" patched code work well on 3.7.

    Though I certainly see the value in a 0%-300% scoring scale, the accuracy+bonus (0-100%) model is going to be an easier transition for many where I work. If there's ever anything I can do to help get the core patched to support both options at the user level, please let me know what I can do to help!
  • Joseph Liaw
    Sat, 10 Apr 2021, 4:43 AM
    Just wanted to share feedback that Tony's brilliant CBM work, and specifically the CBM "plus" works brilliantly--tried it out for the first time with my students reviewing for the AP Exams in May and it brings up some really good discussions during class and small group conversations!

    I am running it on 3.8--it's a little tricky to install since you have to change the Moodle core files and need some good admin / Linux skills, which I am no expert but with persistence I finally got it working!

    If there is anyway to make the "plus" code a plugin, or even better make it a part of the Moodle core since CBM is already included in the core, then I think CBM will really take off and more teachers will be willing to try it with their students.

    The feedback and CBM report students get is extremely helpful, and the "plus" code that scales the score based on accuracy and CB bonus is genius!

    Was wondering if the CBM code could also be applied to the adaptive and interactive with multiple tries modes--that would be an extremely powerful 1-2 punch of formative assessment & reflection with real-time instructor delivered hints for the "teachable moment" when students make mistakes as part of the natural learning process!

    I'm seeing students making much better observations and reflections on what they understand--thank you again Tony for sharing your brilliant work with the world!
  • argm
    Wed, 14 Apr 2021, 6:57 PM
    Thanks Joseph! I'm interested in hearing how CBM can best work with school learning, which I don't have experience of. I'm glad it seems to be going well for you.

    Inserting the code mods should be simply a matter of copying all the new files in one operation onto the server, overwriting the standard ones. Backups of the original files are provided in case you want to go back. [I haven't ever used Linux!] But I would be really glad if someone could help get these mods into core Moodle code. I'm not familiar with the protocols, or the (new?) Moodle quiz modes you talk about, since I don't use Moodle myself.
  • Beth Benhart
    Fri, 9 Feb 2024, 5:31 AM
    This plugin looks amazing! This is probably a dumb question, but I can't find a way to add confidence assessments for each question in a quiz. There doesn't seem to be any documentation on that! Any suggestions you have would be greatly appreciated!
  • argm
    Sun, 11 Feb 2024, 4:23 AM
    This shouldn't be a problem, but I haven't looked at the code for some time or for the latest Moodle versions. So let me know what Moodle version you are using, and what kind of questions you want to use, and what doesn't seem to work. Have you looked at https://tmedwin.net/cbm and https://docs.moodle.org/403/en/Using_certainty-based_marking ? You can contact me directly at a.gardner-medwin@ucl.ac.uk .
Please login to post comments