Moodle 4.0 question bank project - heading into testing

Moodle 4.0 question bank project - heading into testing

by Tim Hunt -
Number of replies: 9
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

It seemed like time to give an update on this project especially since Monday of this week was Code Freeze for Moodle 4.0. The existing thread was getting extremely long, so I decided to start a new one.

Current state of play

In summary, a huge amount has been done. Most of that is already integrated into the 4.0-development version, and the remaining items are going through the various stages of review. More on that below. This is still being tracked through the project Epic MDL-70329, and either already is on https://qa.moodledemo.net/ or will be arriving there in the next few weeks.

If you want to see where we have got to, this project will be the summary of the Moodle developer meeting next week. Obviously, that is aimed at developers, so will include some technical information about the new plugin type, etc. However, it will also include a bit of a demo. (And MUA members are getting a demo in the current round of town hall meetings.)

The bad news is that not everything we hoped to achieve was completed in time. From the original plan, two things will have to wait for Moodle 4.1:

  • New filtering API for searching in the question bank (and associated enhancement to the flexibility of random questions in the quiz).
  • Question banks as a type of activity, where you can control which instances exist (and hence the more flexible sharing system).

That work is being tracked through MDL-72752, and the plan is to continue working on this, and get the code written now, and integrated as soon as development for 4.1 opens (which will be around the end of this calendar year.)

What is included in 4.0 (or should be soon)

The real focus of this email is everything that has been done for Moodle 4.0. The following summary is by Antonia, and I am just re-using it.

Question usage

In the question bank users can see, how many times a question (or a specific version) was used in a quiz, in which quizzes and which courses it was used. It is possible to change directly from the usage window to a specific quiz or course. This makes cleaning up old versions and quizzes much easier.

Aggregated statistics

Moodle 4.0 introduces a new statistics page for the question bank. On this page well known quiz statistics (e.g. mean, standard deviation, facility index) are aggregated for a specific question over all question versions in all quizzes. On the versions page (see below) you may also have a look into aggregated statistics for a specific question version.

Plugin structure

The whole quiz and question bank will be based on plugins. This gives everyone (well, everyone able to code PHP) the possibility to write their own question bank plugin adding new and specific features.

Comments

It will be possible to add comments to a question. Comments are displayed in the question preview and users can see if, and if how many, comments have been made on a specific question directly in the question bank. This feature facilitates reviewing and refining questions.

Custom fields

The idea of custom fields is known from Moodle activities, where additional information of all kinds may be added to an activity. This possibility will be added for questions, too.

Question versioning

Moodle 4.0 will probably introduce a versioning of questions. As each edit of a question leads to a new version, changes to a question become transparent.

The version of a question can be changed on the quiz edit page and quizzes can be configured to always use the latest version. Once an attempt is started by a student, the version for this attempt does not change, however. In the question preview one can click trough the versions of a questions and on the brand new version page one can see all the details of all versions of a specific question (including statistics).

Several nice, tiny bits
  • Question get statuses that define where questions are visible and usable. So a draft for example cannot be used in a quiz, whereas a ready question can.
  • Category management is improved in such a way that categories can be moved by drag-and-drop and collapsed/expanded.
  • Improved bulk action UI
One of the motivations for starting a new thread for this was that it that if you get a chance to look and the few features, it would be good to get your feedback, and you can use this thread for comments.
Average of ratings: Useful (7)
In reply to Tim Hunt

Re: Moodle 4.0 question bank project - heading into testing

by Joseph Rézeau -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers Picture of Translators

Tim wrote "Moodle 4.0 introduces a new statistics page for the question bank. On this page well known quiz statistics (e.g. mean, standard deviation, facility index) are aggregated for a specific question over all question versions in all quizzes. On the versions page (see below) you may also have a look into aggregated statistics for a specific question version."

I am currently testing Moodle 4.0dev+ (Build: 20211102). How do I get to see those aggregated statistics in the Questions bank?

And where is the Versions page?

EDIT.- Just updated my moodle site to Moodle 4.0dev+ (Build: 20211201) and ... the aggregated stats are there!

But... what does "Need for revision  = very likely " mean?

Average of ratings: Useful (3)
In reply to Tim Hunt

Re: Moodle 4.0 question bank project - heading into testing

by Chris Kenniburg -
Picture of Particularly helpful Moodlers Picture of Plugin developers
Thanks Tim! This is great news. I am really looking forward to the Question bank as an activity. I really want to know about how this will help us share banks and work towards common assessments in Moodle for our teachers.
In reply to Chris Kenniburg

Re: Moodle 4.0 question bank project - heading into testing

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers
Unfortunately, the question bank activity is one of the bits that did not make it into 4.0. You will have to wait for 4.1 for that part. But, there is lots of good stuff that is in 4.0, and the final bits of that are still going through integration.
In reply to Tim Hunt

Re: Moodle 4.0 question bank project - heading into testing

by Joseph Rézeau -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers Picture of Translators

Hi Tim,

Just a little reminder of the question in my previous post in this discussion: wink

What does "Need for revision  = very likely" mean?

In reply to Joseph Rézeau

Re: Moodle 4.0 question bank project - heading into testing

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers
That is related to the quiz statistics, some of which are now shown in the question bank. A question probably needs revision if the 'Discrimination index' is on average very low. The plan is to add some help icons here, but that is a small, low-risk change, so it will be done once the current focus on getting the remaining new features integrated is past.
Average of ratings: Useful (1)
In reply to Tim Hunt

Re: Moodle 4.0 question bank project - heading into testing

by Joseph Rézeau -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers Picture of Translators
Thanks, Tim.
What I find rather disconcerting is that this "Need for revision" message appears on a newly created question, not yet inserted inside a quiz yet! The wording of the message probably needs re-writing.
In reply to Joseph Rézeau

Re: Moodle 4.0 question bank project - heading into testing

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers
Right. That is a bug. I made MDL-73350 to track it.
In reply to Tim Hunt

Re: Moodle 4.0 question bank project - heading into testing

by Laurent Berger -
Hi Tim,
Is it possible to disable versionning in moodle 4?
Average of ratings: Useful (1)