New question types

New question types

by Tim Hunt -
Number of replies: 68
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

As many people here know, during the last year, we developed a lot of new question types for Moodle 2.1+. We, in this case, is mainly Phil Butcher at the Open University who designed how the question types should work from a student and teacher's point of view, and Jamie Pratt, who we employed as a contractor, who wrote the code.

You can download these question types from the Plugins database. Here is a summary of the types:

Text input

  1. Pattern match - provides sophisticated response matching features. Pattern match is a Moodle implementation of the OpenMark PMatch() function the roots of which in turn can be traced back to Leeds Author Language of the early 1970s

Numeric input

  1. Variable numeric - supports the use of random numbers, variables and expressions within questions
  2. Variable numeric sets - supports variables with sets of pre-defined values

Selection

  1. Drag and drop into text - drag words into sentences, lists and tables
  2. Drag and drop onto images - both text and smaller images can be dragged
  3. Select missing word - very similar to Drag and drop into text but utilises drop down lists. More flexible than Matching.
  4. OU multiple response - with an OU defined scoring algorithm that we have used offline for 40 years.

2D

  1. Marker - place a marker or markers on an image
  2. Pattern match with JME - combines the Pattern match question type with Peter Ertl's Java Molecular Editor to support the automatic marking of drawn chemical structures of organic compounds.

External question engines

  1. Opaque - used on this site with our OpenMark system. See iCMA04 and iCMA05 below.

There is more information about these question types on our OpenLearn site about eAssessment. That includes a screen-case demonstrating the questions. Sadly we don't have a publicly accessible Moodle 2.x installation where you can try these, but Jamie has set one up: demo site where you can try these questions types.

Average of ratings: Useful (9)
In reply to Tim Hunt

This forum post has been removed

The content of this forum post has been removed and can no longer be accessed.
In reply to Tim Hunt

Re: New question types

by Nitin Parmar -

This is great news Tim. I'm looking forward to learning more about the 'drag and drop' question types especially.

On a related note, are there any plans to integrate all of the aforementioned into the existing Quiz activity, and as part of the Moodle 2.x core code distribution?


Nitin

In reply to Nitin Parmar

Re: New question types

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

I don't think there is any urgency to add these to Moodle core. That is a committment for me, or whoever succeeds me as quiz maintainer, to maintain them essentially forever.

Before taking that step, we need lots of pople to download and install them and try them out, and to prove that they work in all circumstances and don't have any significant bugs.

Many other key modules (certificate, book, ouwiki, forumng, ...) have 'cooked' in contrib for many years, and proved their popularity, before there was serious talk of adding them to core.

Also, David Mudrak is currently working on some admin interfaces to make it easier for admins to manage the plugins they have installed from contrib. That is another important development, that reduces the pressure to add things to the standard Moodle release prematurely.

Average of ratings: Useful (3)
In reply to Tim Hunt

Re: New question types

by Przemyslaw Stencel -

Also, David Mudrak is currently working on some admin interfaces to make it easier for admins to manage the plugins they have installed from contrib.

A suggestion: maybe there should be an option for the admin to configure some kind of message to teachers in the plugins installed from config. For example, when a teacher is adding a book to her course, she should see a message saying e.g. "Please be advised that the book module is not a standard part moodle. Use at your own risk" or someting along these lines. This message should be displayed at the top of the form with the module settings and it should be styled to stand out. The admin could configure each contributed module to display (or not) the message and he could also specify the warning text for each contributed module.

What do think?

In reply to Tim Hunt

Re: New question types

by Joseph Rézeau -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers Picture of Translators

Tim,

I am quite wiling to thoroughly test all of those question types (except for the Numeric oneswink), on my Moodle 2.2 local test site.

Where would be the best place to post my test reports: in this forum, in separate threads for each question type? in the documentation wiki (but some of those question types do not have a Moodle wiki documentation page) or somewhere else?

Joseph

In reply to Tim Hunt

Re: New question types

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

Just to add that Jamie's demo site now has some sample quizzes that show the new question types in action. They are about half-way-down the front page. You will need to create yourself a log-in to be able to try them.

In reply to Tim Hunt

Re: New question types

by Ray Lawrence -

Working through these and they look v. good.

I noticed that it's possible to vary the number of attempts possible on a question by question basis in the sample quiz. I've missed that option, can someone point me to it? Thanks.

In reply to Ray Lawrence

Re: New question types

by Jean-Michel Védrine -

Hello Ray,

With "interactive with may trials" behaviour, the number of attempts is given by the number of hints + 1 so it is possible to have a different number of attempts on each question.

In reply to Jean-Michel Védrine

Re: New question types

by Ray Lawrence -

Ah, that's great. I hadn't made that connection.

Thanks.

In reply to Tim Hunt

Re: New question types

by Guido Gautsch -

Fanstastic work, Tim and team! Just what I was after...we're about to start developing a massive course on Monday and these will come in very handy! approve

In reply to Tim Hunt

Re: New question types

by Nancy K Hoke -

this sounds excellent and we could really make use of the new questions for our Engineering program.  I do not wish to assume so I will ask - do the new questions types work in 1.9?

My fingers are crossed - Nancy K. Hoke

In reply to Tim Hunt

Re: New question types

by Samuel Witzig -

This summer, we'll move from Moodle 1.9 to Moodle 2.2. Currently, we use the question type "imagetarget" on 1.9. We'll replace imagetarget in 2.2 by the (dd)marker question. Since our teachers don't want to reprogram all the questions, Jamie Pratt develops a converting-script from imagetarget to (dd)marker for us.

How the script will work: After installing ddmarker on a Moodle-installation, the script will automatically detect any “imagetarget”-questions, convert them into a ddmarker-question including user(student)-data, and delete the “imagetarget”-questions afterwards.

The resulting script will be for everyone to use and should be ready this spring.

@ Tim: You and Jamie might want to check whether to include the script into the ddmarker code or not.

In reply to Samuel Witzig

Re: New question types

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

Jamie already talked to me about this, and I am very happy to see other people adding to the question types we released so soon.

We will include the new code in the ddmarker release.

In reply to Tim Hunt

Re: New question types

by Jamie Pratt -

Code that I added to the drag and drop marker(s) onto image question type that automatically convert imagetarget question types to be ddmarker questions has just been code reviewed and added to the Moodle OU code repository on github. There are extensive instructions on the github page on how to convert your questions to the new question type.


New 2.3 versions of all of these question types I recently created for the OU, code that fixes a few bugs in some of the question types and code that introduces some improvement in how unwanted units are handled in the variable numeric and variable numeric set question types has also just landed in the OU github repository.

It seems like the download packages in the plugins database have not been updated yet though.

In reply to Jamie Pratt

Re: New question types

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

I have not updated the database entries yet. Updating the entiries for 8 plugins, for three branches, is a pain, and I don't want to do it twice, so I was planning to wait until we have tested these changes at the OU, to make sure there weren't going to be more changes soon, before updating the DB entries.

Hopefully it is not too hard for people to get the latest version using the download links on github.

In reply to Tim Hunt

Re: New question types

by Jamie Pratt -

Yes, testing is still ongoing and so there will be more bug fixes and small improvements. We just found another issue we want to address in the varnumeric and varnumericset questions.

And we are going to make some further small addition to the pmatch jme question type.


So it would be premature to set up the new download packages for a new version now.

In reply to Tim Hunt

Re: New question types

by Ali Hastie -
Loving the new question types. We are currently testing the DDMarkers question type and was wondering if there are plans to allow to drag and drop zones onto the image while setting up the question? Similar to the Drag and drop onto image qtype. We could then alter the dimensions for the drop zones within the drop zone fields if needed. I am sure this was the case before official release. Cheers Ali
In reply to Ali Hastie

Re: New question types

by Joseph Rézeau -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers Picture of Translators

Hi Ali,

In reply to my query re where to post bug reports, improvements, etc. about the "new OU question types", On Tuesday, 14 February 2012, 12:13 PM, Tim Hunt replied:

"In the Tracker in the contrib project. There aren't separate components for each type yet, but you can use Question type: {none of the above}, since those come to me by default."

May I suggest you post your request re the "drag and drop markers" question type in the Tracker.

Joseph

PS.- By the way, Tim, I have had no reaction so far to my reports about the new quesiton types in the tracker.

In reply to Joseph Rézeau

Re: New question types

by Jean-Michel Védrine -

Hello Joseph,

Maybe you had no reaction because they were assigned to Anthony by default and not Tim contrary to what Tim said ("since those come to me by default").

In reply to Joseph Rézeau

Re: New question types

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

Jean-Michel is right. They are not coming to me. I wonder why not. I am listed as 'Lead' on http://tracker.moodle.org/browse/CONTRIB/component/10211. I will look now.

In reply to Tim Hunt

Re: New question types

by Joseph Rézeau -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers Picture of Translators

Thanks for answering, Tim. But I had added you (and the other contributors to the OU question types) as watchers to my reports, so why did you not get a message in that quality?

Joseph

In reply to Joseph Rézeau

Re: New question types

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

You don't get a message when you are just added as a watcher of a bug. Watchers only get a message when some other aspect of the bug changes.

So, if you want to add watchers and notify them, then you need to add them as watchers, and then make a comment like "Adding Tim and Phil as watchers to get their input."

Anyway, Anthony has now fixed that category in the tracker so that they come to me.

Average of ratings: Useful (1)
In reply to Ali Hastie

Re: New question types

by Rob Johnson -

I too would be interested in adding drag/drop zones to the set up for DDmarker.  I see Ali has this in the tracker as CONTRIB-3502.  My teachers tried out the question at a recent workshop, and adding the coordinates was difficult for them.

Rob

In reply to Tim Hunt

Re: New question types

by jeremy chen -

Hi, I just started to use these new question types and they are really powerful. Good job.

Here I want to report a possible bug. Not sure if I do it correctly. http://tracker.moodle.org/browse/MDL-32196

I have a quick look at the source code. It's not something I can fix. smile

 

In reply to jeremy chen

Re: New question types

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

Bugs in these third-party question types need to be moved to the CONTRIB area in the tracker. I moved that bug report to CONTRIB-3551

In reply to Tim Hunt

Re: New question types

by Bill Dika -

Sorry if this is an elementary question but I can't seem to find a "howto" for the "variable numeric" and the "variable numeric set" questions. I have successfully installed them in my Moodle 2.2.1+ installation but am not sure how to go about implementing them. I looked at OpenLearn site link referred to above but could not find a detailed explanation on how to go about creating these questions.

Any help would be much appreciated.

Bill Dika

In reply to Tim Hunt

Re: New question types

by Guido Gautsch -

Tim (or anyone else for that matter),

A quick qestion for this question type:

I'm trying to write a question where students drag words into the correct column in a table. (see attachment). The problem I'm having is that each word can only go to an area the same size as the word itself, but I'd like the whole column to be a designated dropzone. Is this possible?

Cheers,

Guido

Attachment word class.png
In reply to Guido Gautsch

Re: New question types

by Guido Gautsch -

In case there isn't a solution for this problem, I've figured out a workaround. Just ask learners to order the words alphabetically. That way, They should all go to the desginated zones.

In reply to Guido Gautsch

Re: New question types

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

Which particular question type are you using here?

I think the answer is that you cannot do what you want with ddimageortext. You can do something close to, but not exactly, what you want with ddmarker.

You could just make the table smaller, so it is only high enough for one word!

Average of ratings: Useful (1)
In reply to Tim Hunt

Re: New question types

by Guido Gautsch -

It's ddimage, Tim.

Basically, I'd like to have an area, into which I can drag more than one option.

For example (see attached graphic), I'd like to be able to drag butter or cheese into either fields 1 or 2...I just want the 'Dairy products' field to not care which comes first or second.

I guess that that's not possible with the current question types?

 

Attachment areas.GIF
In reply to Tim Hunt

Re: New question types

by Guido Gautsch -

Here's the completed task as a screenshot, including instructions.

Field A here is pronouns. I'd like to be able to drag all pronouns into any field in A. The current workaround is in the IMPORTANT box. It works, but it could be smoother.

Can I make a request for such a question type? tongueout

Attachment screenie.png
In reply to Guido Gautsch

Re: New question types

by Jamie Pratt -

Hi Guido,

What you can do which may work better for your purposes is to use the 'groups' feature of this question type. In your example above you could use 4 separate groups. And in each box in your diagram your drag items would be in different groups. Since each drag can only be physically dropped on a drop zone of the same group, for each drag there will be only one possible place to drop each item in the box.

Ie. in your example box 'teacher' 'apple' would be group 1 and could only be dragged to the top drop zone in the box or the top zone of another box. Banana would be group 2 and must be dropped on a second drop zone in a box, plane would be group 3, tea group 4.

The drop zones and borders or backgrounds of each drag will be colour coded to give a visual hint to show where each item can be dragged to.

Jamie 

In reply to Jamie Pratt

Re: New question types

by Guido Gautsch -
I'm a bit late to the party here, thanks for everyone's replies! Jamie, The colour idea would work, but it makes this particular exercise too easy. I want them to figure out which words belong to the same group..if they're colour-coded, the exercise is already completed for them.
In reply to Guido Gautsch

Re: New question types

by Jamie Pratt -

Hi Guido,

Was thinking not that you have a group for each category but say you have 4 categories with up to 5 items in each category then you have 5 groups. So in each category you have first a group 1 drop area, then a group 2, group 3, group 4...

And then say for an item in drag group 1 the student can see that this item must be dragged to the first drop box in one category, they must still choose which category it needs to be in. For an item in group 2 then they must drag it to one of the second drag boxes, etc.

Jamie

In reply to Guido Gautsch

Re: New question types

by Jamie Pratt -

Hi Guido,

Your idea to make a variation on this question type is quite interesting. Possibly we could add an option to this question type as to what the groups feature does, either :

  • groups affect where drags can be dragged to. Drags are physically constrained so they can only be dragged to a drop zone of the same group
  • groups affect how the question is graded, drags are not physically constrained as to where they can be dragged to. A drag item dragged to any drop zone in the same group is marked as correct.

It might be better to separate this off as a separate question type if someone wants to develope it, to try to avoid complicating the concept and editing form of one question type too much.

As Tim said the drag and drop marker question type could be used to designate zones to which you can drag items to.

 

Jamie

In reply to Jamie Pratt

Re: New question types

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

I think the best idea would be a new question type ddclassify, where you have a set of words that you need to drag into different areas to classify them, and the order they are within each category does not matter.

I think the cleanest way to implement this is as a separate question type (although obviously sharing code with the other dd qtypes). There are enough differences in what you would want on the editing form and during the runtime UI that it really needs to be separate.

Average of ratings: Useful (2)
In reply to Tim Hunt

Re: New question types

by Jamie Pratt -

I would imagine that the user interaction involved dragging words or images to different areas would be quite effective pedagogically, helping the student make associations between things in their minds. A custom question type could deal with generating the UI with colored areas to drag the items to rather than the teacher having to produce their own image which can be quite time consuming.

I am available to hire and I would be happy to work on more question types.

In reply to Jamie Pratt

This forum post has been removed

The content of this forum post has been removed and can no longer be accessed.
In reply to Tim Hunt

Re: New question types

by Franck PETIT -

Hello, Has anyone tried the following question types on a tablet or on an other touch screen device?:

I tried a drag and drop into text question on an Iphone2 and it didn't seem to work (all the tags looked collapsed, nothing could be selected nor dragged). Mobile devices are coming and I hope we'll be able to use those fantastic new question types on them.

Cheers, Franck

 

Average of ratings: Useful (1)
In reply to Franck PETIT

Re: New question types

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

We know they don't work, and it is on our todo list.

Actually, we tried to fix it before, quite a while ago, but at the time, browser's handling of 'touch' events was not reliable. We think it will now be possible to make this work if we get time to try again, but I don't know when that will be.

In reply to Tim Hunt

Re: New question types

by Franck PETIT -

Hi,

Do you think possible that in the future Drag and drop onto images  and Marker could include the address of an audio file in the labels, address filtered by the multimedia filter to appear as a player. That would be a great feature for language teachers.

Cheers, Franck

In reply to Franck PETIT

Re: New question types

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

I would not try to put multimedia in the drag boxes. Instead, I suggest writing questin text like:

Clip 1: [ media player here ]

Clip 2: [ media player here ]

Clip 3: [ media player here ]

And then making drag boxes with the words Clip 1, Clip 2, etc.

Average of ratings: Useful (1)
In reply to Tim Hunt

Re: New question types

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

I just wanted to point out that Sally Jordan, who is probabl one of the most experience users of the Pmatch question type, has been writing some blog posts about it: http://www.open.ac.uk/blogs/SallyJordan/

In reply to Tim Hunt

Re: New question types

by Glenn Sisson -

Do these new question types work with 2.3.1?

Tried but had issue with the version requirements.

In reply to Glenn Sisson

Re: New question types

by Jamie Pratt -

Hi,

Yes, these question types all work with Moodle 2.3.

If you are using them with Moodle 2.3 then you want to get the latest version of the code as we just fixed a number of issues with the question types with 2.3 particularly :

  • problems with drag and drop in drag and drop image or text and word to sentence question types because of the change to a newer version of YUI library included in Moodle
  • some notices because of the change to show PHP strict notices.

The latest code is available from the moodlou github repo (linked to from plug in db as 'alternative download url') and I think that Tim will soon make new 1.1 packages and add them to the plug ins db.

Jamie

In reply to Jamie Pratt

Re: New question types

by Glenn Sisson -

Thanks Jamie.

I still though the older one's should work though. Do I need to change anthing in the version requirements version.php?

In reply to Glenn Sisson

Re: New question types

by Jamie Pratt -

Hi Glenn,

 

You should not have any problem with the version requirements. Are you getting some kind of error message when you try to install or upgrade?

 

I went through and checked all the version time stamps just recently and they seem fine. Some timestamps have been changed since the last version was released. I would recommend getting the latest code.

In reply to Jamie Pratt

Re: New question types

by Glenn Sisson -

Hi Jamie,

Now working with master branch files.

PS. I suggest making the requirment of gapselect in order to use other selection question types more clear. This is only found under the learn more link with the download. It may be better to have it as a note in the description or under requirements (but this seems for moodle releases only). I only realised once I tried to install the other q types.

Thanks

In reply to Tim Hunt

Re: New question types

by Alaa Elkholy -

Hi Tim,

I was wondering if any od the new question types can do the following:

I need to be able to compose a question like this:

What is the amount of loading dose (LD)? _____________. What is the amount of the maintenance dose (MD)? _______________

The examinee will enter a value for LD and another for MD. The correctness of the answer will depend on the relation between LD and MD. For example if the ration of LD/MD is greater than 2 then the answer is correct.

I am using Moodle 2.3.1

Any help will be appreciated.

Al

In reply to Alaa Elkholy

Re: New question types

by Joseph Rézeau -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers Picture of Translators

Hi Alaa,

You have posted exactly the same question in two different discussion threads on the Quiz forum. This goes against the netiquette rules, and is totally unproductive.

No cross-posting, please!

Joseph

In reply to Tim Hunt

Re: New question types

by Lauren Panton -

These new question types are terrific! We are currently testing several, however I have a faculty member who wants to create a question where the students have to "draw a straight line" across an image to answer the question. If possible, I would appreciate any suggestions on how to go about doing this with these new question types.


Thanks, Lauren

In reply to Lauren Panton

Re: New question types

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

Doing that would require a new question type. It is certainly possible to do. We have had it in another system at the OU for years: http://www.open.ac.uk/openmarkexamples/p5_3.shtml. These days, using HTML 5, you could probably do even better than that.

But, someone would have to take up the challenge and make the question type.

In reply to Tim Hunt

Re: New question types - ADA compliant?

by Kimberly King -

With the legal issues and lawsuits on the rise in connection with web accessibility and ADA compliance, can you tell us whether these question types are ADA compliant?

In reply to Kimberly King

Re: New question types - ADA compliant?

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

The answer is "mostly yes".

The question types have been developed following the best practices. E.g. labels for input elements, keyboard equivalents for anything you can do with the mouse. They have been tested with screen-readers, screen magnifiers, voice recognition input, etc.

The mostly is because:

  • some of these question types involve tasks that are inherently visual. E.g. draw a molecule or place a marker to identify a key feature on an image. Here the skill being assess is inherently visual, so it cannot be accessible to blind users.
  • the testing identified some minor accessibility bugs, and we have not fixed all of them yet. The remaining issues are on our backlog, so they will get fixed when we get time.

Average of ratings: Useful (1)
In reply to Tim Hunt

Re: New question types

by Ralf Hilgenstock -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Translators

Hello Tim

some time ago there was a plan to integrate some the question  types in core. Can you give us an update about the progress for this issue.

Ralf

In reply to Ralf Hilgenstock

Re: New question types

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

I have been busy on other work. I think the only way this might get into 2.9 is if I spend my long Easter weekend working on it, which I have considered. It may come down to whether we get typical rainy English bank-holiday* weather.

Anyway, MDL-47494 is the issue to watch.


* Your fact for they day: Why are British public holidays called "Bank Holidays"?

Well, the person who got the law passed really wanted to have public holidays for the majority of labourers. However, he knew that his fellow members of parliament would not have much sympathy for the working classes, so instead he wrote the law as if the main goal as to give poor over-worked bankers a well-deserved break, and the MPs voted it in! 

In reply to Tim Hunt

Re: New question types

by Marcus Green -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers

Interesting bank holiday information. Sounds like the modern "hard working familys" trope which makes me grind  my teeth when I hear it. Perhaps there are some important cricket matches on, that usually coincides with heavy rain doesn't it?