Most wanted features in quiz module

Most wanted features in quiz module

by Martin Dougiamas -
Number of replies: 143
Immàgine de Core developers Immàgine de Documentation writers Immàgine de Moodle HQ Immàgine de Particularly helpful Moodlers Immàgine de Plugin developers Immàgine de Testers
I've been meaning to do this for a while. Could everyone please post their top quiz issues here in this discussion, one per line. A quick example (your lists don't need to be this long!):
  • support for importing QTI format questions
  • support for importing WebCT questions
  • paragraph questions (long answers)
  • time-restricted attempts
  • submit questions one at a time
  • javascript tricks to prevent copying
  • GUI for embedded answer questions
  • more options for displaying multimedia
  • more options per question
  • "survey" mode

I'll look through everything in a few days and try to make a list of the six most-wanted options in a choice activity that we can vote on to determine a final priority list. I'll use this list to guide development, looking to connect sponsors with programmers.  Hopefully this will help everyone to know where we're at and where we're going.
Average of ratings: -
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Alvin Shaffer -
activity locking based on quiz score
In reply to Alvin Shaffer

Re: Most wanted features in quiz module

by Richard Watkins -

activity locking based on quiz score

Another vote for this.

In reply to Richard Watkins

Re: Most wanted features in quiz module

by Teri DeFilippo -
activity locking based on quiz score too.
In reply to Teri DeFilippo

Re: Most wanted features in quiz module (password / key variable quizzes)

by Jason Hollowell -
I skimmed through this forum that spans a little over 3 years and didn't see anything like what I am about to propose but if I missed it (very possible) I apologize.

It would be very nice and cool if Moodle allowed for a quiz pool (I did see this mentioned in a few places) that could contain mulitple quizzes.  Additionally it would be great if each of those quizzes could be consructed such that they were generated randomly from a bank of questions that were 'located' within that particular quiz.  (it looks like this is, to some degree, currently possible) 

Then, this is probably the hard part, if the quizzes could be presented such that when a student clicks on a link in the front course menu they get a message asking them to enter a password or key.  The password or key would be linked to a specific quiz located in the pool that (as I mentioned in the previous paragraph) would be generated from a 'sub-pool' of questions.

What I am getting at is a system that could be constructed whereby (based on feedback built into each quiz) students would receive a password/key that would govern which quiz (or lesson for that matter) that they are allowed to (or prompted to) work on next.  I am envisioning something like those books that were popular in the early 80's in the States (at least popular in my area smile )  where you would read a few pages and then be presented with a choice.  Your selection governed which page you went to and thereby also allowed you to alter the story (interact with the story).  The idea I'm trying to suggest here (maybe not so clearly) would be a variation of that but with the choice being one that is determined by a password or key.  In my case I would design quizzes such that the passkey was generated through the quiz feedback but it could be presented to students in other fashions as well.  The main idea is that the password or key (passkey) determines which quiz is presented to the student.

This is either something that is already possible and I have just overlooked it or it's something that would involve an enourmous amount of programming, reworking etc.  I'm afraid that it may be the latter....?

Jason
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Mike Jackson -

ability to import LXR test questions
essay mode
multimedia display options
anti copying tricks

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Dave Richards -

Long-answer/essay questions (or just the ability to manually adjust the scoring, then you could use the short answer type question that is already there and not worry about the "right" wording in the answer).

Thomas Robb has already made the survey mode quite easy with his detailed report options.

In reply to Dave Richards

Re: Most wanted features in quiz module

by Jason Barnett -
I'd also like this.  I could really use a long-answer/essay question type, with a larger text area.
In reply to Dave Richards

Re: Most wanted features in quiz module

by Ed Main -
Another yes to long-answer/essay questions.
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Joseph Vargas -

Ability to email test taker a certificate as a PDF file. 

Perhaps a field could be added that allows the user to specify the name to be printed on the certificate. This way I can keep my name as Joe Vargas in my profile, but when I print a certificate it could say Joseph J. Vargas, M.D.

I have other thoughts on this should you be interested

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Siegwart Mayr -

These are some of the features we need:

  • paragraph questions (long answers).
  • quiz preview button.  This could include a non-recorded quiz attempt, so that quiz feedback can be tested as well.
  • time-restricted attempts (including the displaying of a javascript clock/timer on the screen, so that people know the time left!  Many students do not have the correct time or don't have a watch!).
  • submit questions one at a time.
  • activity locking based on quiz score.
  • javascript tricks to prevent copying (saving to file, printing, copy to clipboard).  Allow these options to be switched on/off independently in each quiz, since some assignments are given in the form of quiz, but do not need all the restrictions.  This would allow some quiz-type assignment to be copied or printed as required).
  • GUI for embedded answer questions.
  • "survey" mode.
In reply to Siegwart Mayr

Re: Most wanted features in quiz module

by Alvin Shaffer -
Don't forget the certificate idea presented by Vargas
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by koen roggemans -
Immàgine de Core developers Immàgine de Documentation writers Immàgine de Moodle HQ Immàgine de Particularly helpful Moodlers Immàgine de Plugin developers Immàgine de Translators
  • long answers, manualy graded
  • preview-button for questions to test them (whole test is not nescessary since you can try it and delete the attempt thanks to Robb)
In reply to koen roggemans

Re: Most wanted features in quiz module

by Ger Tielemans -

If you create an essay question then something like:


Create - lets say - 5 scales, then you could design a form like this one with the essay on the right and the five scales on the left: scoring line by line
(or even better: paragraph by paragraph: scales and paragraphs should stay on the same height of lines.. )

You then can give a grade on that scale or choose from a drop-down-box on that position for that scale.

So you see here five vertical scales for one essay, not a set of horizontal scales. 

  • You could decide to score plus minus and zero for every column-scale, summarized at the top, or create your own scales. I accpet that I can summarize here several ordinal scles of the same scale type, "swoit"
  • On the top right you could write your final ordial, taking the summaries of the 5 scales on the to of the rows in account (not just summarize here also, it are 5 ordinal scales)
  • SO, low tech, just an organiser & feedback sheet?

ScreenShot011.png


Of topic High Tech: In the Netherlands there is a company that sells a tool you can feed 10 good essays and after that it can compare good and bad ones comparing it to the internal build reference. (Hidden, fuzzzy logic, no understanding.)

Would be nice to have this tool but is for us to expensive:

Dream: students could feed their trial essays to the machine until it is passed and then send it to the teacher... Moodlian smile 

(the "machine" must be trained for every exercise again: machine does not understand language, so it is not only for Dutch.)

Product is called CODAS, I like it, but I do not have shares

 adress: http://www.eduactief.nl/IVIO/index_IVIO.htm   sorry in Dutch but ask for a trial-CD-demo at <font face="Arial" size="2">info@edu-actief.nl</font>

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Rob Butner -
We would like to see the following:paragraph questions (long answers) essay typetime-restricted attempts submit questions one at a time (extremely important for quiz security issues)javascript tricks to prevent copying more options for displaying multimedia "survey" mode (we have currently modified the survey module to support our course evaluation requirements) The ability to identify a minimum passing grade. SO if the student successfully passes the test above the minimum requirement, they are taken to a "certificate page" that they can print out to identify completion.Possibility to embed sound files within questions.
In reply to Rob Butner

Re: Most wanted features in quiz module

by Dave Richards -
How have you "modified" the survey module?  Is the process simple?  Would you be willing to share your modified files or instructions to complete said modification?
In reply to Dave Richards

Re: Most wanted features in quiz module

by Rob Butner -
We modified the survey module because our need for course evaluations was a requirement of accreditation, besides we really had no use for the ATTLS or COLLES canned surveys------The graphical representation of the results and ability of instructors to appen comments has been very well recieved here---
 
If you want to have a look at how it works----click on the link below:
Then use, username: test    password: test
In reply to Rob Butner

Re: Most wanted features in quiz module

by Ger Tielemans -

I took a look at your very nice website. I came on the page where your students can check the plugins they need and download them on the spot as well. Cool!

(I saw the copyright © 2002 Pearson Education Is it for others allowed to use this checkpoint?)

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Bernard Boucher -
And the winners are:smile

  1. activity locking based on quiz score
  2. "survey" mode ( with very usefull existing reports )
  3. submit questions one or grouped as we want at a time
  4. javascript tricks to prevent copying
  5. quiz preview button. ( quiz feedback can be tested as well. )
  6. time-restricted attempts

blush Sorry I am not the only one to propose!

Thanks Martin for the opportunity.

P.S. activity locking based on quiz score is also very usefull to give the opportunity to students to take a reflexion break on a section of a laboratory before attempting the other section.
That give also to the teacher a good idea of the time required for each section. ( to make adjustements )
More I use it more I find applications!
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Brent Morrison -
  • time-restricted attempts
  • more options for displaying multimedia
  • activity locking based on quiz score

I'm not sure about the "submit questions one at a time" option.  Does that mean the student receives all the questions upon starting a quiz and can then submit them one or more at a time, or does that mean that the quiz is delivered to the student one at a time?  If it's the latter, put me down for a vote on that also.

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Paul Norrod -

The "security" related items are of high importance to me:

time-restricted attempts (with a countdown clock approve)submit questions one at a time (or in groups) javascript tricks to prevent copying (with javascript detection - don't allow quiz to be taken if javascript is turned off)
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Paul Shew -
1. activity locking based on quiz score
2. long answers (manually graded)

There’s already a work-around for long answers, so that's why it's number 2 on my list. But it would be better to have it incorporated into the quiz module, even if that means making a dedicated type of quiz for long-answer and other questions that require manual grading.

Activity locking would be a great way to motivate my students to master preliminaries before moving on to more advanced material. It also creates a reward-system because students would be "rewarded" for getting a good quiz score, by immediately being able to see the other sections. I wonder if there’s a way to implement it so that until they earn the required score on a quiz, all of the following sections are invisible. So for example, until they take the quiz in Week 1 (and earn at least 90% for example), then the following weeks would all be invisible. Then another quiz in Week 2 would be set up similarly, so that they gradually uncover all of the course materials by successfully taking a quiz every week. I can imagine that some students would be so motivated by curiosity that they would work ahead of the class just to gain access to all of the course materials. It would make a game of it.
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Paul Nijbakker -

Hello Martin,

Our Christmas list would look something like this:

  1. Paragraph writing questions, manually graded and commented
  2. Timed quizzes with visible timer
  3. Any additional security tricks that do not pose obstacles to students taking the test. The most useful elements in our eyes would be:
    • an option that would block access to the rest of the course environment until the quiz is submitted
    • a standard script blocking copying and viewing the source of the quiz.
  4. And finally, regulating access on the basis of quiz (and/or assignment) scores can be useful, though we do not consider it essential.

With warm greetings from Finnish Lapland (Now that I think of it: Does Santa moodle too? thoughtful)

Paul.

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Vijay Kumar Adhikari -
In the following order, please!!!!!!!!

1. submit questions one at a time
2. paragraph questions (long answers)
3. time-restricted attempts
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Frederic Triquet -
Hi,
  • preview quiz
  • time-restricted attemps
  • activity (un)locking based on scores
  • all the tricks that can make things harder to cheaters
Thanks
Fred
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Kristian Nielsen -
  • Hi I would find it nice if the following was possible

  • long answers i quiz, manually gradeable.
  • A nice thing (but obviusly very deficult) a computeractivity logger during test, What browsers do they have open, what URL are else open and what programs is running in the backgound?
  • The abillity to create pages and group questions in the quiz, eksample 5 questions in one page, go back and forth between the pages and submit when done.
  • Preview questions and jump between the full quiz and edit question.
  • A simple help for cloze questions, simple because a full GUI whould often be wery cumbersome, and slow compared to manually typeing. A short helptext/javascripsinserts, and a autorefreshing preview would do for me.

Best Regards Kristian Nielsen

In reply to Kristian Nielsen

Re: Most wanted features in quiz module

by Martin Dougiamas -
Immàgine de Core developers Immàgine de Documentation writers Immàgine de Moodle HQ Immàgine de Particularly helpful Moodlers Immàgine de Plugin developers Immàgine de Testers
I can tell you right now that browser spying as you've described will never be in Moodle, even if it were technically possible.

For the cloze questions, the GUI you've described is pretty much the same as the ideas that were floating around.
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Henrik Kaipe -
A popup preview simular to the one described in
http://moodle.org/mod/forum/discuss.php?d=2983
would probably help a lot.

I also have some ideas for how to construct an applet that would look very much like the HP cloze editor. However, it will be difficult to keep all of the powerful rich text editor features.
In reply to Henrik Kaipe

Re: Most wanted features in quiz module

by Rick Barnes -

Long answer questions with teacher marking

(A simple way for the teacher to access these questions to mark them)

The ability to use a header for questions about the same information (sub questions)

example

1

This is part of the spreadsheet.

(a) (i) The cells in the spreadsheet contain different types of information.

Using words from the list, complete the sentences below.

text

a formula

a model

a menu

a number

a date

Cell A3 contains ....................................................................................................................

Cell C4 contains ....................................................................................................................

Cell D3 contains ....................................................................................................................

An Asian restaurant uses a spreadsheet to record sales.

(3 marks)

the test in blue needs to be visable and followed by 3 separate questions before moving on the the next new question.

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by luciano biondo -
 In the following order
1. submit questions one at a time - one question for page, with chance to ask very long (more than one paragraph) questions
2. chain the tests (no chance to do test 2 if test 1 is not overcome)
3. chance to have a question n if question (n-1) obtained any right answer and a different question if question (n-1) obtained any wrong answer

Luciano
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Przemyslaw Stencel -
Here's my ¢10:
  1. more options per question
  2. feedback in embedded answers type
  3. activity locking based on quiz score
  4. grouping questions into pages and a possibility to save answers after each group
  5. Long-answer question type, manually graded and commented
  6. survey mode
  7. GUI for embedded answers type
  8. preview button for questions
  9. embedding sound
  10. bulk-delete of questions from quiz and category
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Jean-François Nadeau -
  • long answer question type
  • in the matching question type, to have more answers (in the list) than answer
  • in the matching question type, to be able to put easily images for each  answers
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Scott Elliott -
  • Password protected quizzes (would allow a student to take a quiz after a deadline had passed)
  • Images allowed in multiple choice answers
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Ger Tielemans -

Support for QTI would be a jump forward!

I can see it..or is it to far ahead of the herd?
I create a map of the Netherlands in another QTI-tool and you can point with your mouse in Mootle at the capital Amsterdam if you are asked to do that. On  problem I have to find that other FREE QTI-tool first.

(NO seriuos, the world to other products that will support QTI in the future would open up, in our case this would be that Dutch Wintoets program, used by secondary school mucisians.)


My other wish is to have more layout control on the question page: where should the image go without my workaround-trics? etc..

But also more control in the m.c-answer-boxes: I can embed a sound in the question-page that is forced to be played with a minimal controlbar, and forcing to use my plugin, not some of the other installed players, like that agressive Player One.

But if I try to do that in the answerbox: after offering a "sounding"question and then let them choose between different answer-sounds (my language teachers would love it!) I have not enough room to type that script in the answerboxes...

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Paul Wentholt -
We would lile to plug in our "wintoets" quizes into Moodle
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Martin Dougiamas -
Immàgine de Core developers Immàgine de Documentation writers Immàgine de Moodle HQ Immàgine de Particularly helpful Moodlers Immàgine de Plugin developers Immàgine de Testers
Thanks for the excellent answers everyone.  I've made a choice activity here - please vote!

   http://moodle.org/mod/choice/view.php?id=1268 

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Timothy Takemoto -

Probably everyone knows, but before you vote please be aware that
Chris U (now no longer with us) has made a timer for moodle, which I use.
http://moodle.org/mod/forum/discuss.php?d=3982
Rob
Butner has made some anti cheating javascript functions
http://moodle.org/mod/forum/discuss.php?d=3982
And Bernard has made activitities linking based on a 100% score.
http://moodle.org/mod/forum/discuss.php?d=3725&parent=16707
Christmas Cheer
Tim

In reply to Timothy Takemoto

Re: Most wanted features in quiz module

by Bernard Boucher -
Hi Timothy,

                   fisrt good christmas to you and all the Moodle community. ( Is christmas an holliday  in Japan? )

 A small precision to thirth item of your post. Since november Alvin find a good trick
permitting to link activities on less than 100% score.

Bye,

Bernard

In reply to Bernard Boucher

Re: Most wanted features in quiz module

by Timothy Takemoto -
Hi Bernard,

Joyeux Noel and Akemashite Omedetou Gozaimasu!

Christmas is a holiday here in Japan but it pales in comparison to the significance of the New Year celebrations. There were quite a lot of people here in University on Christmas day, but very few are here today on January the 2nd.

I eventually got around to donating to Martin the $100 that I pledged to you for creating the activities linking add on. Really I need all the features mentioned here, and should be donating the $1000 plus (see below) to Martin, but this is all I can afford for the time being.

I did not see the less than 100% trick at first. Interesting idea. Thanks Alvin!

here is a link to the post where he/you suggest it.
http://moodle.org/mod/forum/discuss.php?d=2948&parent=15145

 While it would be nice, I do not have a need to be able to "depend" upon non-quiz and non-resource activities since I hardly use them! I suppose that it would be nice to depend upon forum postings and excercises but, if only it became standard, Bernard's code as it stands would do the trick.
Thank you Bernard and Martin,

Tim
In reply to Timothy Takemoto

Re: Most wanted features in quiz module

by Bernard Boucher -
Hi Tim,
Bonne Année.

I know that you and many more need all the features mentioned here and activity linking is just a small part of them. Thanks for your donation to Moodle.

I will be very busy next 10 weeks at work. I choosed compressed courses ( 10 weeks instead of 15 to permit stages for the students. ) After that period I will have 5 weeks relatively free to work mainly on Moodle "stuffing" the quiz module.

I will try to add some sort of automatic adaptive feedback to the questions that may be usefull for language teaching also.

Moodle quiz database will be feed directly with a lot of feedback mini quiz and ressources, A function will replace static feedback linking with a dynamic one.

And for the teacher's side knowledge input will be inspired by the work of a moodler Christian Barrette who had produced 10 years ago a very good research and a software name Copilote:

http://pages.infinit.net/magnon/Copilote/ ( It is your turn to translate wink )

At that time your contribution and others will be welcome to find good english vocabulary for verbs, synonyms antonyms, reciproque,...

That part will be directly usable for language teaching.

That way it will be possible to complement teacher's work with an adaptive lms.

The work required to create all feedback and sub-questions will be smaller than now to create normal questions.

Cheating will be minized because questions will be adapted to students and presented with differents word and/or formulations.

Questions will appears one or few at a time to permit feedback.


Have a good year,

Bernard

In reply to Bernard Boucher

Re: Most wanted features in quiz module

by Timothy Takemoto -

Dear Bernard,

Thanks for the links. My French is of insufficient power to allow me to read
the copilote explanation in any detail but I get the general drift.

There is an English language page here
http://users.edte.utwente.nl/lanzing/cm_home.htm
which explains the formal / symbolic system upon which copilote was based
(I believe).

I think that Copilote is not going to be terribly high on Martin's wish list but as
far as I am concerned it looks very useful.

I have still to make enough feedbackless quizes (I try to include feedback)
I think it will be some time before I manage to include more complex feedback.

But this is something that would be shareable and reusable. I am sure that there are
going to be more and more systems like this and that they will be very useful especially
in language education -- or the study of large formal systems with a fairly
universally accepted system of rules, also physics as you pointed out.

This is such a big area, involving a lot of work, but with so much future growth
and co-operation potential that I guess it is important to pick a good standard.

Is Copilote the best, most universal standard?
Does "SCORM" have this sort of adaptive functionality? Martin introduces simple introductions here.

This is the realm of artificial intelligence. So perhaps the programming languages (e.g. AIML) used to program chat bots might be of relevance? 

Another relevent thread on Re-usable Adaptive Educational e-Content,
mentioning AIML and Martin's reaction can be seen at
http://moodle.org/mod/forum/discuss.php?d=1235#4995

Anyway, good luck over the next ten weeks.

Tim
Timothy Takemoto

In reply to Timothy Takemoto

Re: Most wanted features in quiz module

by Bernard Boucher -

Hi Timothy,

                  thanks for the detailled answer.

Here are some comments that may precise things and maybe "reconciliate" some point of vue:

First I don't want to redo Copilote in PHP.  I will only use some parts of it internal knowledge representation to support students learning. More on that later.

Thanks for the links. My French is of insufficient power to allow me to read
the copilote explanation in any detail but I get the general drift.

There is an English language page here
http://users.edte.utwente.nl/lanzing/cm_home.htm
which explains the formal / symbolic system upon which copilote was based
(I believe).

Concept mapping was studied by copilote authors but they retains 3 others visual knowledge representations for 3 differents levels of knowledge.( empirical, hiearchical and actantial )

I think that Copilote is not going to be terribly high on Martin's wish list but as
far as I am concerned it looks very useful.

Martin's wish list and mine are not so divergents: we want, and you also I am sure, to give to the learners the best of each teacher capabilities and to support them with an excellent improving tool: Moodle. 

IMS QTI is the way  vs adaptive feedback

It is sure that my post can sustain a comparision with IMS document.

But these items correspond to that:

     2.7 Reduce Content in Learning Path Based upon Learner Profile
     2.8 Using Virtual Labs 
     2.10 Adaptive Learning Delivery

If we want to offer theses additionnal services to the learners then we must do:

1 - Create some import scripts that read xml existing content and that feed Moodle database with that content.

2 - Modify and/or add to Moodle modules to support IMS functionnalities.( linking things, learner profile, ... )

Items 1 and 2 must fit together and may take a long time to develop.

It look like  Chicken and the Egg Dilemma

If we start by #1 then the learners will have access to many more imported questions without adaptive feedback. And it will be correct to claim that Moodle is IMS compatible.  

If we start by #2 then th learners will have access to some form of adaptive feedback but with only the few questions that the teacher will create.

At the end, after the chicken sit enough long time over the egg, we will have 2 chicken abilited to live togetherwink

On my side I don't have any stuff to import from IMS or any other format. If I have some time for work I will choose #2.

But someome migrating from WebCT or Blackboard or any other will appreciate some importing even if all the functionnalities are not supported. Here #1 is the best choice.

I have still to make enough feedbackless quizes (I try to include feedback)
I think it will be some time before I manage to include more complex feedback.

Here you abord the worst side of LMS or IMS or Moodle. More you add fucntionnalities to your system more it is complex and time consuming for the teacher. The f=ma example with only 5 choices will require 25 other choices if we give 1 level adaptive feedback and 125 choices for 2 levels adaptive feedback. If you use 10 randoms questions then 1250 choices. Crazy with currents authoring tools!

Here come the reason for my reference to Copilote. To simplify it, Copilote internal knowledge representation ( not it visual presentation ) is base on some form of Bloom's Taxonomy  with about 11 levels. Copilote software only store these levels. It is not capable to shift from one level to the other alone. My contribution will be to program interlevel correspondance to support students.

Here is an simplified example: suppose that a student have some problem to sort somethings. Maybe he don't know on what propriety to sort, what are theses things or what is sorting! The system will be able to downshift one level from sorting and with generated adapted choices will try to evaluate what the student is missing. After the software will try to give simple examples of what the student is missing. If the software reach the lowest level that the teacher has entered, then it will refer the student to the teacher for an intelligent action. My 200 english words vocabulary are not sufficients to explain that clearly but I hope that 2 or 3 weeks of work later will make a working prototype that will permit to experiment that with some ( not all ) levels programmed. 

But this is something that would be shareable and reusable. I am sure that there are
going to be more and more systems like this and that they will be very useful especially
in language education -- or the study of large formal systems with a fairly
universally accepted system of rules, also physics as you pointed out.
Another relevent thread on Re-usable Adaptive Educational e-Content,
mentioning AIML and Martin's reaction can be seen at
http://moodle.org/mod/forum/discuss.php?d=1235#4995

For the shareable and reusable sides, from the precedent example, suppose that an mathematic teacher do some work on numbers system, then his work may be linked to the missing level of the example above. ( suppose that you whant that your students sort Austria, Japan and Quebec by population and by superficies. In your feedback you don't have to explain what is a superficie. If someone is ok for population but bad for superficies the system will refer it to you. If you find a good link of a math teacher about superficies in the system, you will link it in your feedback. )  


Thanks for your feedback,

Bernard

In reply to Timothy Takemoto

Re: Most wanted features in quiz module

by Martin Dougiamas -
Immàgine de Core developers Immàgine de Documentation writers Immàgine de Moodle HQ Immàgine de Particularly helpful Moodlers Immàgine de Plugin developers Immàgine de Testers
Bernard's code does the job well, yes, but with an official version (which is looking likely to be the first project) I would really want it to be designed in a more general way so that ANY activity can unlock any other activity (or section).
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Grant McWilliams -
Looks like I'll be creating one question per page test myself! wink Currently I'm doing it with javascript but would like to see it in moodle.

Grant
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Jim FULLER -

EXTENDED ANSWER Quiz questions please. Multiple Choice formats have questionable educational validy as an **assessment tool** and "Short Answer" (ie one, or two words) is too limiting.

Initially, all that is needed is to increase the dimensions of the Input Box for the Short Answer type. All the other 'fancies' and Menu listing can come later.

My suggestion is the full width of the page and perhaps 3 to five lines high.

(I don't know enough about PHP to make the change. Is this something the Site Administrator could do?)

Merry Christmas and Thankyou for your efforts.

Jim Fuller
Secondary Computing Teacher
ECAWA Member
Western Australia

In reply to Jim FULLER

Re: Most wanted features in quiz module

by Martin Dougiamas -
Immàgine de Core developers Immàgine de Documentation writers Immàgine de Moodle HQ Immàgine de Particularly helpful Moodlers Immàgine de Plugin developers Immàgine de Testers
Hi, Jim.

Just changing the size of the box is the easy part.  The hard bit is making the interface so teachers can manually grade just these questions, and then making sure all the display of grades is modified to make it clear whether the manual parts have been graded yet, etc.
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Henrik Kaipe -
I vote for
"support for importing WebCT questions"

Together with SCORM compability I think this is one of the big drawbacks that stops people from switching to Moodle. (Yes, my greatest concern here is to gain market shares.)

---

As a developer - I would also want to object to
"javascript tricks to prevent copying"
Javascripts are run on the client computer (i.e. the student computer). So if you have your students take the quiz from home, remember that their computers can be equipped with any kind of browser. There are several browsers out there that are equipped with features that let the user temporarily switch off javascripts.
Introducing this in Moodle would only give examinators an illusion of a cheat-safe system.
If you wish to use Moodle quizes as examination, then accept cheating or have the students take the quizes on restricted school computers. Copying would not help them then as there would be nowhere to copy from.
Another possibility would be to use INDIVIDUAL questions as I have outlined at
http://moodle.org/mod/forum/discuss.php?d=1945
However, INDIVIDUAL questions cannot be properly implemented until we have a PLUGIN-STRUCTURE FOR QUESTION TYPES, which I also would like to vote for.
In reply to Henrik Kaipe

Re: Most wanted features in quiz module

by Martin Dougiamas -
Immàgine de Core developers Immàgine de Documentation writers Immàgine de Moodle HQ Immàgine de Particularly helpful Moodlers Immàgine de Plugin developers Immàgine de Testers
I completely agree with you approve but I don't think these are the popular choices (at this time). mixed
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Дмитрий Герасименко -
Hi! ... from Russia with love! smile I'm a realy "kid" in the moodle, but I think that quiz-module may be change: for example, I'm input 50 questions in the question's database, but in the test I want to see a random 10 questions... May be I don't undestand some? In second, may be create a Word-document import? P.S - Sorry, for my BAD English, just Russian forum be quiet... There is the Russian support? smile
In reply to Дмитрий Герасименко

Re: Most wanted features in quiz module

by Marc Fotheringham -

(am new here so forgive me if I am daft)

Is there a select and 'randomize' function for the quiz module? I have a need for a bank of around 300 questions, separated into 10 topics (30 questions each). I would like a module to select 10 questions from each section at random, as well as scramble the answers in a multiple choice question. If I enter my question as

"What is ...." and the answers as

a. Correct Answer
b. incorrect 1
c. incorrect 2
d. incorrect 3

I would like the module to scramble the answers around, maybe coming out with this:

a. incorrect 3
b. incorrect 2
c. Correct Answer
d. incorrect 1

Any feedback on this? Is it already possible? I'm not yet at the point of having a successful Moodle installation (see 'need installation buddy!' in the installation problem forum), but this feature would be very useful, especially if the bank of questions could be increased to 1000 or whatever, but still choosing 10 of each section (say tten questions, defined when question is input).

I welcome any discussion on this - hope I'm in the correct forum!

In reply to Marc Fotheringham

Re: Most wanted features in quiz module

by koen roggemans -
Immàgine de Core developers Immàgine de Documentation writers Immàgine de Moodle HQ Immàgine de Particularly helpful Moodlers Immàgine de Plugin developers Immàgine de Translators

Yes it is possible and it is even verry easy glimlach. When you design a new quiz, the option to scramble answers and even questions is one of the settings. When you edit the quiz afterwards, you'll be brought to the same page where you can make this setting.

Making a quiz with random questions out of different categories is also not difficult. This option is in the page where you have access to the questions and categories (to make them or to use them) All over the pages are yellow questionmarks with content-sensitive help. They'll prove you a lot of help. You can access all the helpfiles by clicking on "hel'p.." in the administrationmenu of a course. At the bottom of that file you'll find an index of all helpfiles(in 1.2 dev or 1.1.1 with new en-languagepack installed).

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Thomas Bray -
I could use

*The long essay question

I also need the ability to add a graphic in the answer feedback. Since just writing in the html code to an image file messes up the text tables in the quiz (sometimes the image just covers it up) it would be nice to be able to have a java pop up screen that will come up when clicked on.

I have problems with adding graphics in general on quiz questions, and have often added my own popup code so a student could see the image on a different screen. I can't do this in the feedback, however, and it would be useful to me.

smile

TB
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Michael Penney -
Shuffle within a question: ie I set three variations of a question with 3 potential right answers and 8 potential wrong ones, and these are shuffled each time a student takes the quiz. We do this in Flash now, but it is a pain to editsad.

Anonymous mode, for practice quizes (real anon. mode so you can link to a quiz that allows it witthout logging in).

Showing/hiding activities/assignments based on scores.

Essays with definable rubrics, scored manually but lumped automatically into the final score.

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by rick shepherd -
More options for displaying multimedia
In reply to rick shepherd

Re: Most wanted features in quiz module

by Genner Cerna -

TOP 2:

  • Paragraph questions - long anwers with manual marking (essay type of quiz)
  • Javascript security - lock down browser to prevent cheating/copying
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by jean hardy -

I hope voting is still on. We have a kernal group of Moodle advocates at our college, but with enhanced quiz and grade book features, we would see a steady flow of converts (from the Bb seasons of discontent) into the arms of the Moodle VLE.

  • javascript tricks to prevent copying
  • time-restricted attempts
  • paragraph questions (long/short answers  that can be manually graded)
  • submit questions one at a time

jeansmile

In reply to jean hardy

Re: Most wanted features in quiz module

by Timothy Takemoto -

Dear Jean,

Time restricted attempts will be with us soon. Martin is paying a php programmer to create a timer, and get it to work in a variety of browsers. I think it will be with us soon.

This Javascript to prevent copying works VERY well. It does not do it in the conventional way, by blocking the buttons, but by a more radical way of interfering with the cliboard. It purges the clipboard at a rate of knots. Sadly I don't think that Martin will find it to his taste to add it to the official release but it is easily possible to add this hack into your themes folder.

Submitting paragraph questions can be done with the journal module, I believe, or at the very least with the embrionic lecture module.

The lesson module can do questions one at a time. It will even allow you to import GIFT format files.

If you can think of a way of setting up a fund for this type of work, then I would join.

Tim

In reply to Timothy Takemoto

Re: Most wanted features in quiz module

by alisa hylton -

I am one of the new moodle experimenters working with Jean's group. Using the journal option is not the issue that is making life miserable at the momentsad.The journal option has many posibilities that are on my list to explore as I get a better handle on the system. In making a quiz, I am limited to extremely inflexible questions and no way (that I have found yet) to change a grade in the gradebook if the grade to reflect an appropriate answer that the key could not handle. I would like to have assessments that can be a bit more flexible. Of course there are many great things I am just now learning how to do do, the quizzing glitch just gets frustratingmixed

Alisa Hylton

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Ian Ellis -
Whereas randomizing the order of answer choices is most often desireable, for occasional questions it would be better to leave the order intact.
Example:
Q: Which item labelled in the photo as A, B, C, D, is.... Answer choices would be A, B, C, D
Q: About how many? ...   A: 100   B: 500   C: 1,000   D: 2,500

A check-box with the question for simply "Never randomize answer choices" would possibly be a simple update? (Am I reinventing earlier discussion?)
In reply to Ian Ellis

Re: Most wanted features in quiz module

by Timothy Takemoto -

Dear Ian Ellis,

I agree that a "never randomize answer choices" would be nice for occasional lickert type questions too such as
Q: About how often? ...   A: rarely  B: sometimes    C: often  D: very often
and questions which contain "all of the above" such as
Which of the following is a moodle module? ...A. The Lesson Module. B. The Forum Module. C. The Quiz Module. D. All of the above.
which are in among a larger number of questions that need to have their answers randomized. As well as a checkbox, it would be nice if it were possible to program this using some options in GIFT files too. Linuxly perhaps using "-nr" after the final "}". I guess that "-ar" always random might be handy too.

I have not seen your suggestion in an earlier discussion. Relatedly I mentioned a way of getting the order of one or more *questions'* order not to be randomised among a list of questions with random order by setting the randomize order setting to off, and using the random questions funtionality. But, thinking about it, it would be nice to have box to affect this too. I think a check box would cause problems so a Xoops2-block-weighting-type ability to give questions weight, or boyancy such that they would be likely to sink to the bottom or float to the top. E.g. perhaps "} -w0" or "} -w10." As well as wanting some questions to float to the top/sink to the bottom, sometimes I do wish that too questions could come in definable order. 

Tim

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Girts Ozolins -

I'm trying to resolve a problem. Maybe this could be new feature or something like that...

I have topic based course. After each topic I have quiz. And after final topic I have final quiz. How can I make that all other quizes must be done before final quiz for every user or group?

In reply to Girts Ozolins

Re: Most wanted features in quiz module

by Don Hinkelman -
Immàgine de Particularly helpful Moodlers Immàgine de Plugin developers
Right now only the Lesson Module can do something like what you describe.  Have you tried that?
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Gerrie Welch -

Essay Question within the quiz

Time controlled

Ability to print quiz questions and answers.

In reply to Gerrie Welch

Re: Most wanted features in quiz module

by sonny boy -

Does anyone here knows "QuizFaber" ? A software that can create a web based quiz that can be configured just as wanted your quiz should be (also smile). Having said that, (duh not promoting this software here wink) , I like the way it was implemented and its features. But the problem, it was written in java script. blush I know "they" don't like to use it... hehe

How about give it a try and you'll see what am I trying to say. Could it be possible to "mimic" it and have it translated to moodle?

That's all and regards all!

In reply to Gerrie Welch

Re: Most wanted features in quiz module

by Brian Mulligan -
I would like to put in my little bit of support for 'time control'. My start in e-learning technologies was probably using Question Mark in the early nineties. I've used it extensively over 10 years. Since I've had to move to VLE's and stop using it it has been a bit disappointing - WebCT is quite powerful, but missing things like picking at random from libraries/pools/categories, Blackboard is very weak. I'm currently planning to use Moodle experimentally for a year, but one feature I can't live without is timed quizzes.
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Sue Phares -

Open-ended questions (essay/paragraph/long answer) that are manually graded.

Thanks!!

Sue

In reply to Sue Phares

Re: Most wanted features in quiz module

by Jaime Alamo -

and also, Open-ended questions (numerical/short answer) that are manually graded, and have moodle to gather them all together and build in a report.



In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Brian Ollom -

Has anything happened with this module?  Is it in the latest Moodle release?

Thanks!
-Brian

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Brian Mulligan -
Password access to quiz.

This is available in both WebCt and Blackboard. It is extremely useful for giving access to supervised quizzes.
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Brian Mulligan -
Random selection of questions.

This has several benefits: One is that students get a different quiz each time they take it, so it is more difficult to narrow their learning to suit the questions. The other is that adjacent students in a classroom situation get different versions of the quiz (which minimises copying).

It can be done simply - eg. a specific number taken at random from a category, or more useful a specific number taken at random from a specified subset of a category or even worse: a specific number taken at random from aany specified group of questions.
In reply to Brian Mulligan

Re: Most wanted features in quiz module

by Martin Dougiamas -
Immàgine de Core developers Immàgine de Documentation writers Immàgine de Moodle HQ Immàgine de Particularly helpful Moodlers Immàgine de Plugin developers Immàgine de Testers
Brian, random selection as you describe is already supported in all versions of Moodle (you add a Random question to a category, then include that where you want it in the quiz).

Password AND IP access restrictions are in the current development version.
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Anthony Birch -

Show test takers the (rolling) average grade of all persons who have taken the quiz

Show the total number of persons who have taken the quiz

Report to instructor: average, mean, standard deviation, percent of test takers who missed each question

Allow student to MARK questions for review before submission

Allow student to send comments on MARKED questions to instructor

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Cosmin HERMAN -
Immàgine de Plugin developers
Random question aded to a quiz
In reply to Cosmin HERMAN

Re: Most wanted features in quiz module

by Rich Schumaker -

  • support for importing WebCT questions
  • time-restricted attempts
  • submit questions one at a time
  • javascript tricks to prevent copying
  • "survey" mode that can be used for course evaluations that will provide stat analysis

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Jaime Alamo -
When you "add a module" to a course you usually get it ready, easily, by the way.

But, before you can "add a quiz", you must have it already built. In fact, it is exploided that any quiz can be reused. Can this idea be extended to other modules?

Could quizzes be duplicated or have templates in the editor tu save typing?

So, it would be good to have the editor or creator aside i.e. have the button "create quizzes"

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Wen Hao Chuang -
  • Smart Quiz

What I meant by "Smart Quiz" is that with every "multiple choice" quiz questions, the student will get three extra choices (other than the regular choice items): A green light button (means that the student is TOTALLY confident with his/her answer is correct), a yellow light button (means that the student is SOMEWHAT confident but not 100% sure about the answer), and a red light button (means that the student is totally NOT SURE about the answer and could only "guess)...Then these choices will be also measured and weighted so that the next round of the quiz test (or if the student is to retake the quiz again), all those red light questions (and the wrong answers questions) will pop up again to strengthen the students' memory...

If somehow this could be implemented, I think this would be great for language teachers.

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Chris Wroth -

I'm now to Moodle, so apologies if this already exists and I don't know how to do these.

1. I want to produce low level picture vocabulary tests in different foreign languages so I would like to up load the pictures once into a test and then copy the test and just change the word. e.g. The first test in English would have picture 1. a cat , 2. a dog etc. and the pupil would just have to type in the corresponding word cat, dog etc. I would then copy this keep the pictures and just change the answers for another foreign language: 1. gatto, 2. cane etc.

2. An easy way to put foreign accents in at the moment I am copying and pasting from Word

3. Something to stop autofill. At the moment the pupil just types the first letter and then sees the rest of the answer.

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Chris Jeffries -

I'd vote for QTI (both import AND export). It will very rapidly provide access to a wide range of assessment material as well as providing people with a way to migrate more easily.

At the same time, it will provide a good basis for the development of question structures, learning from the wider community (ie not just Moodlers)

In the UK, the TOIA project has just delivered its first iteration of a QTI based Assessment Management System. This is free to all HE/FE establishments, and I think it will make a real difference to the way people do assessements. Being able to trnsport question sets to and from the VLE will be an important part of this.

VLEs that can do it will have a big advantage.

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Colin Girard -

Is there a way to make to produce a result based on score at end of Quiz?

I.e. a 70% result redirects them to a passing certificate.

In reply to Colin Girard

Re: Most wanted features in quiz module

by Timothy Takemoto -

Dear Colin Girard,
The only way to do that is by using Bernard Bouchier's "Activity Linking" hack.
Hopefully a generalised, official version will arrive one day, but I think that we may have to pay. Do you want to start a kitty (a pool, or fund, not a cat)?
Tim 

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by James Jones -

I'm relatively new to moodle, but I'm a php mysql developer and an educator and would like to contribute since I really need the following quiz features for an Internet based class: 

  • time-restricted attempts (with a countdown clock)
  • submit questions one at a time
  • javascript tricks to prevent copying (with javascript detection - don't allow quiz to be taken if javascript is turned off)

Please let me know if anyone else is already working on these features so I don't duplicate effort.

In reply to James Jones

Re: Most wanted features in quiz module

by Michael Penney -
Hi James, we implemented the first two in the lesson module (well, of course lesson was always one at a timesmile. Its making it's way into CVS, but you can download a zip here, back up everything first, of course.

Javascript hacks, we investigated, but decided against: the best of them are easily circumvented (with javascript on), and of course you can't prevent print screen.

Here is a website debunking the idea that one can protect an html page with javascript: How to prevent theft of your source code!

IMO, a better use of time is to develop multiple versions of each question and use the clustering code we wrote for lesson to ensure that your students each get different versions of the test.

If you really want to prevent copying of questions, forget javascript and write code for delivering your questions via streaming quicktime, which will even prevent copying via print screensmile.
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Stuart Young -

Hi,

firstly, now that you have done two of the options in the quiz poll, couldn't you remove those options and add two more?

my wishlist...

Ability to add more than 10 answers - one of my course creators wanted a 15 option multiple choice. Perhaps a button at the bottom to add new answer.

Rating/ranking questions - presented with a list of options and asked to rank them.

Description-only quiz - did you know that if you create a quiz that only contains a description, you get an error when you submit - it says no answers submitted or something. What we wanted was a "think about this issue" question - once the students have thought about it they click submit to see our answer - we wanted our answer hidden until they had thought about it - so I guess we were after the ability to add feedback to a description question.

cheers

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by TomᚠJunek -
Hi,
    I have a multiple choice quiz where I need give points when students don't mark wrong answer. So it will be cool create some tool where I can chose if correct is when I mark an answer or I don't mark an answer.  Thanks

In reply to TomᚠJunek

Re: Most wanted features in quiz module

by Timothy Takemoto -

Dear Tomas Junek,

I am sorry but I don't understant your desire.

The quiz module aallows you to set the points for each answer.

Please give us an example.

Tim

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by TomᚠJunek -
Forbid students to copy quiz question using clipboard etc......
In reply to TomᚠJunek

Re: Most wanted features in quiz module

by Timothy Takemoto -

Dear Tomas Junek,

Forbidding students to copy quiz questions is available as a hack. The below may not quite work but it is nearly there. It works on my moodle like a dream.

http://moodle.org/mod/forum/discuss.php?d=12821&parent=62986

I am going to attach my header to this post and the other essential file to the next. The need to go in your themes folder. Of course you will need to edit out the japanese.

Hot damn. I should produce this for a standard theme.

Tim

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Andy Evans -
Issue / Request:
Creation of 'Matching Quizes' - Allow a dynamic number of sub questions (greater than 10), rather than the upper limitation of 10. 

Cause:
A single quiz with 50 questions had to be broken up in 5 sub sets og 10 where the drop-down choice 'answer lists' were not related between the 5 sub sets of questions.

Solution:
Maybe provide an initial form/query as to how many sub questions will be entered (n number of questions), so that the subsequent question entry page (now only allowing 10 sub questions) would already contain the 'Editing a Matching Question' format with n  number of 'sub question' blocks:

'Question 1:', 'Question 2:', . . . 'Question n:'

The expected test taking activity would involve a dynamic (perhaps scrollable) drop-down list of choices (greater than 10), when a student takes this test.
approve

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Didier RAMBEAU -

My needs about the quiz module are by priority (decreasing order)

  • support for importing QTI format questions (because I use Questionmark Perception and I would like to migrate my  work of 2 years to moodle)
  • time-restricted attempts

It needs explainations : having a time limit for a test is not satisfying, because if you use random questions with several level of difficulty questions might not have the same time limit. So the teacher could choose a time limit long enougth to include the case when a majority of difficult's questions are given to the (unlucky ?) student. But in this situation a student with a majority easy questions would have a too long time. So in my modest opinion the best way to choose a time limit for a test should be calculated (dynamically for random questions) by adding each question's time and with a possible  multiplicator coefficient (range 0.8 to 1.2 by exemple) for the resulting time

  • submit questions one at a time
  • javascript tricks to prevent copying
  • GUI for embedded answer questions

  • "survey" mode ???? What is it supposed to be ???

Congratulations to the community for this nice tools that is Moodle, and it might become better and better day by day

Sorry for my poor english

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Teresa Gibbison -
Hi there

Our team would like to see the following:
  • Paragraph questions - essay format answers that the tutor can manually grade

  • Selective Release - will have a go using Bernard's Activity Linking but would like to make any activity/quiz available using set parameters such as "Test n score => 80" and/or "after Date a" and/or "until Date b"

  • Random quiz questions grouped by Category, then by subcategory for each Question - We have used this in WebCT where each topic has a quiz with random questions. 

    Each Quiz Question has several possible questions eg for Question One there would be "question1_1", "question1_2", "question1_3" etc and each time a student took the quiz there would be several different (random) versions of the quiz.

  • Short Answer Questions where you can have more than one answer eg. A question displaying a block of text with four different spelling mistakes then four different short answer boxes for the student to list the mistakes.  Each answer would have a grade attached, eg 5 correct answers would have 20% of the grade.
Thanks and keep up the great work.

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by jim bullard -

* Essay questions which the instructor can grade in some reasonable way.

This may exists in some fashion or another, but what I am looking to do is test users on SQL. I want to ask them a question like:

what query returns you all of the patients who are older than 20 but less than 30?

Then they will test their SQL against a database and then input their final query into the quiz. I want to add to the quiz module my own predicates for testing equality as string equality will not do in this case. I guess my questions are:

1.) has this been done?
2.) Where do I find information on how to do it the moodle way if not?
3.) And can anyone think of a better way of comparing equality than running the correct query storing the results and then comparing the results of each student's query to mine.

Thanks in advance, I am new to moodle, so be gentle.

jim
In reply to jim bullard

Re: Most wanted features in quiz module

by Timothy Takemoto -
The essay question in the quiz module is still not with us I fear. But I hear that Michael Penney and associates have achieved a sort of essay question in the lesson module. I think.

Tim
In reply to Timothy Takemoto

Re: Most wanted features in quiz module

by Darren Smith -

Yes, this is the case.

Simply 'lifting' this from the lesson module and putting it into the quiz module would be a huge step forward ofr assessment and would answer the needs of many teachers. However, dunno how easy that would be thoughtful

Darren

In reply to Darren Smith

Re: Most wanted features in quiz module

by Genner Cerna -
Essay in quiz module is most wanted at this time...
In reply to Darren Smith

Re: Most wanted features in quiz module

by Michael Penney -
Hi Darren, Mark is almost done with it, should be ready for testing by next week or so.

In reply to Michael Penney

Re: Most wanted features in quiz module

by Ben Hardyk -
I'm just curious if this long answer feature to quiz questions is completed.  It would help us out quite a bit.  Thanks.
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Sarah Porter -

Hi All,

I'm relatively new to moodling as I term it.  I teach maths in high school with some students that have poor literacy skills.  When using the quiz module and the short answer questions, I receive many and varied spelling errors, too many for simply including the spelling mistakes in the answer list.

Is there any way I can edit the students responses to correct their spelling mistakes, as they get very discouraged when they get 5% on a test when all that it wrong with their answers is a typing or spelling mistake.

I have searched the internet and this moodle site but have not found anything relevant other than a similar query posted in 2003.

Sarah 

In reply to Sarah Porter

Re: Most wanted features in quiz module

by John Blake -
Sarah,

I understand your concern with spelling. I too teach kids that have poor literacy skills. My suggestion- multiple choice questions. Moodle's question generator is very powerful. Could you tell me what textbook you use in your math class? I use Glencoe/McGraw-Hill. We bought their ExamView Pro testbank generator program. This program has a testbank with multiple choice, true-false, and matching questions that can be uploaded to Moodle. I just learned how to use it recently and my students like to use it.

We have to pick our battles wink sometimes and spelling mistakes are important to note, however, in my class, if they have to spell something, I give them a word bank to use.
In reply to John Blake

Re: Most wanted features in quiz module

by Sarah Porter -

While I am concerned about their spelling, I correct it when asking for written work. I'm more concerned that Moodle is marking their maths answers wrong because of spelling mistakes, and that I cannot make Moodle mark them correctly because there are too many different versions of the spelling errors.

Students are getting discouraged in maths for receiving 5-10% in the quizzes when their real marks if not for spelling mistakes is between 80-90%.

I use multiple choice questions too, but find my students seem to race through these.  The students seem to put more thought into the short answer questions...which hopefully means they are better engaged in thinking about maths. big grin

I teach what we term a laptop class, that is all the students have their own laptop so the 'recommended' text book is Heinmanns Emaths8 book. However I'm not overly rapt with it and I'm currently using a variety of text books from which I scan/type questions and examples from and post them on to Moodle using the resource module for examples, and the quiz modules (a mixture of multiple choice and short answer) for the questions.

I also use the short answers for skill and drill work for multiplication, division, subtraction and addition of postive and negative integers.

Having a ready made test bank of questions sound wonderful (sigh)

For the short answer questions I currently type the equations out in word, save the word file in a 'rich text fromat' and then import them into moodle.

In reply to Sarah Porter

Re: Most wanted features in quiz module

by Miles Berry -
...
I teach what we term a laptop class, that is all the students have their own laptop so the 'recommended' text book is Heinmanns Emaths8 book. However I'm not overly rapt with it and I'm currently using a variety of text books from which I scan/type questions and examples from and post them on to Moodle
...
You might be interested in the interactive tutorials and pdf files of text book chapters available (for free) as part of Exeter university's Mathematics Enhancement Programme. The address is http://www.ex.ac.uk/cimt/mep/

I agree with much of what you've said above, ready-made sets of questions would be so useful. We also have an interactive voting system, and having to write the multichoice questions for this is such a chore.

I'd be interested to know how easy it is to get Moodle to cope with algebraic equivalents: eg if I'm expecting the answer 2x+3, at the moment I need to allow for x+x+3, 3+2x, 2 x + 3 and so on in Short Answer, or go for multichoice. I know some work's been done on this in HE, but has anyone got this working in a school setting.
In reply to Miles Berry

Re: Most wanted features in quiz module

by Val Brooks -
I'm with you all on this - I've only just started to develop some quizzes in Maths and am trying out various ways to cover answers. I have been using the Short Answer questions and as one of the responses, told the students to write 'HINT' if they are not sure of an answer so that I can give them a hint. That is working well but the trouble I find, which you might also Sarah, is that if students leave an answer blank, then there seems no possibility of giving any feedback other than they got it wrong. Is there any way of doing this?
Although the 'HINT' bit works well, as does trying to predict wrong answers/bad spellings which could also provide feedback, it is very time consuming to write out all the different possible answers and then of course not every answer can be covered.
If there are a few Maths teachers out there, maybe we could work together a bit and share some of the things we have developed?
I'd also like someone to try out some of my quizzes and give me feedback as to how they could be improved. I'm pretty new to this too and have NO programming skills!


In reply to Val Brooks

Re: Most wanted features in quiz module

by Breanndan O'Cinneide -
Student at our college have weak spelling skills. We have a custom rolled quiz assessment tool which allows for a phonetic question type. This uses the Soundex algorithm to match answers phonetically... for English words anyway.. , so that "Elephant" would be matched correctly by "Elifunt" "Oliphant" etc. (The algorithm has its origins on Ellis Island dealing with immigrant family names..). We plan to use Moodle extensively in the future and I've been dabbling with the source code. I created a soundexquestiontype based on the standard shortanswer... no database changes needed... I'm including the questiotype.php associated with this that has an English variant soundex algorithm included in case the design folks might like to add it in for 1.5 . 
   On the algebraic type answer, I'd be interested to see sample questions and answers... The issue would seem to be how to constrain the answer... For example, "Multiply x+1 by x-1"  could get answers like "x^2-1" or "-1+x^2" or "(x+1)*(x-1)" . They are equivalent but the last one might not be desired wink
bocinneide@it-tallaght.ie
Average of ratings:Useful (1)
In reply to Breanndan O'Cinneide

Re: Most wanted features in quiz module

by Sarah Porter -

Thank you for all the feedback, I'll certainly try out your ideas, and the soundex algorithm sounds great. 

However I assume that the answer to my original query is NO....there is no way of editing a students response to a question either by logging in as the teacher or as the student, to correct spelling and typing errors. So that students can receive their appropriate maths mark regardless of their english and typing skills.

Sarah

I do like the idea of sharing questions/quizzes smile

In reply to Sarah Porter

Re: Most wanted features in quiz module

by Miles Berry -
Hi Sarah,
It can be done. As administrator one can login as a strudent (there's a button at the bottom of each strudent's profile page), then re-attempt the quiz and submit the answers again. This will show up as another attempt of course, so you'd probably want unlimited attempts set for the quiz, grade by highest or latest mark, and use 'each attempt builds on the last'. Not an elegant, or indeed efficient, solution, but it should work.
Somewhat disturbingly, this didn't seem to show up at all in the log view, nor make it into the mdl_log database table when I tested it. Perhaps someone else could check this and I'll post a bug report if this isn't merely a problem with my setup; I assume it's not a design feature.
In reply to Breanndan O'Cinneide

Soundex Function for Short Answer Type in Quiz

by Gabriel Aquino -

Hi... My name is Gabriel. I am using Moodle for our college in Oman but I am not proficient in using PHP. So I was wondering if you could help me where I should save the questiontype.php file you shared in order for us to take advantage of this function. Our students are Arab and they are not good spellers of the English language so it would really help a lot if on certain questions, we would allow them to slip up on the spellinga s long they got the word right.

Thanks a lot... Any other form of assistance is welcome!

In reply to Miles Berry

Re: Most wanted features in quiz module

by Gustav W Delius -
As part of the "Serving Mathematics" project we have extended the Moodle quiz module so that it can handle mathematical questions and check for algebraic equivalence. I am planning to set up a test site so that you can all play with this.
In reply to John Blake

Re: Most wanted features in quiz module

by Kathy Keleshian -

I am very interested in your comment about the Glencoe/McGraw Hill test generator.  I have been struggling with the problem of having to re-create quizzes/tests when we have a test generator also.  We use McDougal Littell math texts.  Their test generator creates a document with a .wss extension.  I have not yet been able to import this into Moodle's quiz generator.  Any help will be appreciated.

In reply to Kathy Keleshian

Re: Most wanted features in quiz module

by Timothy Takemoto -

Dear Kathy Keleshian,

First of all what you need to do is open your .wss files to see if there is anyway of getting them into a format supported by moodle. Try opening them with a text editor such as

http://www.notetab.com/ntl.php
(thanks Paul)

and see if you can read it. You may find that by using search and replace, or a macro, you may be able to change the .wss format into something more like GIFT or AON formats. Also, you might post a sample here.
But there is no magic solution, unless you pay someone to create a converter.
Timothy

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Jeanie Michaelis -
1.  Can I add more than 10 matching questions in a quiz?
2.  Why can't my students see the correct answer after they submit their quiz.  Questions on the quiz are multiple choice and matching, and I have checked the boxes for "Students may review immediately after the attempt: Responses, Scores, Feedback, Answers."

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Bill Click -

Martin, one of the items that has just came up is the need for us to have available in the excel downloads of the quiz results, the student login and maybe even the password.  We are a middle school (grades 6-8) and if I can download test results into excel and then link them using the login id (which is assigned to individual students) to our actual student id's then this would allow us to simplify some of our district reporting which we now do on scantrons.  And our teachers take hours to correct errors and scan then into the sytem.  Our teachers would probably build you a monument.

Bill Click, Modesto, CA.

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Daniele Cordella -
Immàgine de Core developers Immàgine de Plugin developers
I would have the possibility to create a standard Multiple Choice question with 5 answers (with the option "select more than one answer per each question" on) and the following property: it doesn't exists the "partially correct" answer.
What I would ask to the question is to grant the score = 1 ONLY to students selecting all the five correct answers.
For example:
What is needed to make a nice coffee?
1) water
2) coffee machine
3) oil
4) fire
5) coffee
I need to get score = 1 ONLY if the answer is yes, yes, no, yes, yes.

The problem today is that if I assign the following percentage of score to each answer:
25%, 25%, -100%, 25%, 25% and a student answers with
yes, yes, no, no, yes
(that is incorrect (I would give him 0))
he gets 25% + 25% + 0% + 0% + 25% = 75%
assigning him score = 0.75*1 = that is still 1 when approximated to the integer.

This is my problem.
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Daniele Cordella -
Immàgine de Core developers Immàgine de Plugin developers
It would be useful to set the "number of attempt permitted" to "until passed"
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by R G -

SI unit compliance. As engineering Circuit Theory Spanish equivalent to "associate professor" I would like to enforce the International System of units or SI. This means that in a numerical question a student asked to answer for the value of, lets say, an electrical charge, must supply the numerical value and the SI symbol. The absence of symbol, an incorrect symbol or bad use must imply a wrong answer. For instance, an electrical charge of two coulomb must be answered as: 2 C. (number, one character blank space and capital character C).

The correct number of significant digits is also important from the engineering point of view, providing as an answer: 2 C; 2,0 C; 2,00 C or 2,000 C have not the same "correctness". Note that in some countries the comma is the decimal separator (check your bank account or your bills to see if this is the same in your country wink )

When speaking of integers, if the significant digits are not important, numbers in the [0, 999] range are preferred in the SI, the SI prefixes should be only used, for instance, as follows:

··· 1 nC ··· 999 nC, 1 µC ··· 999 µC, 1 mC ·· 999 mC, 1 C ··· 999 C, 1 kC ··· 999 kC, 1 MC ··· 999 MC, 1 GC ···, 999 GC, 1 TC ··· 999 TC, 1 PT ···

I think it is so complex that a SI compliance module would be of maximum interest.

http://physics.nist.gov/cuu/Units/index.html

http://www1.bipm.org/en/si/

Average of ratings:Useful (1)
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Manish Verma -
Provision for negative marking in multiple choice questions having only one answer correct.
Average of ratings:Useful (1)
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by David Mott -
A true item-banking system, although maybe this should be in a separate module.
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Orestes Mas -
Immàgine de Translators
The origin of this thread is very old, but as it's still alive here are my suggestions:

  • Extension to "Calculated" question type that allows grading in a more flexible way than a simple PHP formula. For example, grading could be accomplished by calling a gnu-octave's script/function, which may return a number between some range (0 and 1?) depending on question's parameters and student's answer.


In fact, I've a student working on this for his M.S. degree. I hope this development would be useful to all moodle users.
In reply to Orestes Mas

Re: Most wanted features in quiz module

by Deleted user -

-For Multiple-Choice type questions with Multiple-Answers, do not allow the student to check all answers, but only allow the student to check a certain number of answers.

EXAMPLE  (student should only be allowed to select any one or two of the four answers, assuming Red & Purple have a percentage score greater than zero, and assuming Fushia & Grey have a percentage score less than or equal to zero):

Pick 2 colors that appear in a rainbow:

      [] a. Red

      [] b. Purple

      [] c. Fushia

      [] d. Grey

In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Sanjay P. K. -
I am suggesting here some desirable features that I did not see in Moodle 1.6
1. Option to give feedback to any wrong answer in Calculated question, Numerical question and Matching Question
2.More functions in calculated question; Eg: the factorial
3. At present random questions can be added by selecting the option to "Add n random question from this category". If all questions are random( to prevent copying) this forces the teacher to create many categories; for each quiz. It would be desirable if you can just check ( select) a few questions and instruct to add n random questions from this selection.

In reply to Sanjay P. K.

Re: Most wanted features in quiz module

by Tim Hunt -
Immàgine de Core developers Immàgine de Documentation writers Immàgine de Particularly helpful Moodlers Immàgine de Peer reviewers Immàgine de Plugin developers
You can do feedback to any wrong answer in numerical. Just use * as an answer like in shortanswer.

3. is a major change. Don't hold your breath.
In reply to Sanjay P. K.

This forum post has been removed

The content of this forum post has been removed and can no longer be accessed.
In reply to Deleted user

This forum post has been removed

The content of this forum post has been removed and can no longer be accessed.
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Mark Miller -
I've got a capability I'd like to see. I posted a question about it last week, but no answers. I'm presuming that means it can't be done.

I'd like to use the quiz module to generate a paper copy of a quiz with an answer key. I have students who miss the "open" time for the quiz (I'm a high school). I don't want to reopen the quiz as that allows students who missed it without an excuse to take it. I'm also asked by other teachers if they can get a test from me.

I'd appreciate adding it to the "want it" list.

tnx

mark miller
In reply to Mark Miller

Re: Most wanted features in quiz module

by Tim Hunt -
Immàgine de Core developers Immàgine de Documentation writers Immàgine de Particularly helpful Moodlers Immàgine de Peer reviewers Immàgine de Plugin developers
What do you mean by an answer key? Can you give us some sample questions and what the answer key would look like. Just a rough mock-up would be fine.
In reply to Tim Hunt

Re: Most wanted features in quiz module

by Mark Miller -
it would look something like this:

A Sample Quiz


1. The opposite of dark is:

 a. light

 b. brown

 c. opaque

 d. white

and then as many questions from the bank as I would care to choose.

After the test is printed, a second page would print containing the answers to the questions (answer key).

Answers to A Sample Quiz

1. a.

and so on for all the questions


tnx



mark miller


In reply to Mark Miller

Re: Most wanted features in quiz module

by Tim Hunt -
Immàgine de Core developers Immàgine de Documentation writers Immàgine de Particularly helpful Moodlers Immàgine de Peer reviewers Immàgine de Plugin developers
I wonder if the HTML export format does any of that?
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Tim Florian -
I would like to see Certainty Based Marking/Confidence Marking in the quiz module.
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Pankaj Pankaj -
One of the features that I have frequently used in WebCT and find useful is, to open the quiz only for a few students after the quiz is over. This helps in case there are students who could not take the quiz for some reason. The same selective release could be extended to assignments.

What I would prefer is that the notification appears only for student(s) who is (are) supposed to take the quiz and does not for others. The quiz results may be locked for students who have already taken the quiz and that would not be an issue. In my experience WebCT does that in a fairly easy and fashion.

Based on my search the only solution (which appears more like a workaround) is that set a password and set it to individual students so that only they can take the quiz. While this may work but still does not appear to be an elegant solution and may cause confusion for others (some students are easily confused).
In reply to Pankaj Pankaj

Re: Most wanted features in quiz module

by Itamar Tzadok -
Actually it should be much simpler to use groupings for this purpose. You create a designated group, (e.g. 'Later') and a grouping (e.g. 'That day') and assign 'Later' to 'That day'. Then you add these few students to Later (group) and set the quiz to That day (grouping) and tick the 'Available to group members only'. Only the Later students will be able to access the quiz until further notice. The only drawback (if matters) is that as long as the quiz is open to Later That day, other students won't be able to review their work (but they should still have the grade in the gradebook). smile
Average of ratings:Useful (3)
In reply to Itamar Tzadok

Re: Most wanted features in quiz module

by Pankaj Pankaj -
Thanks a ton. Will try that right away. Really appreciate your taking time and helping me out.
In reply to Pankaj Pankaj

Re: Most wanted features in quiz module

by Tim Hunt -
Immàgine de Core developers Immàgine de Documentation writers Immàgine de Particularly helpful Moodlers Immàgine de Peer reviewers Immàgine de Plugin developers
Matt Petro has been working on a patch for Moodle 2.0 that would implement what you want. Details in MDL-16478. With any luck, he can finish polishing that patch, and we can get it added before Moodle 2.0 is released.
In reply to Martin Dougiamas

Re: Most wanted features in quiz module

by Lynne Bayley -
Some extra flexibility in CLOZE questions would be good.

I'm a chemistry teacher so I want to be able to put word and symbol reaction equations into CLOZE questions.

I want to be able to make one answer conditional on another
i.e. you can put answer a in box a or box b and answer b in box a or box b which is currently fine. But I also want it to ONLY score both marks if you put a in one of the boxes and b in the other box not if you put a in both boxes.

I want to be able to make an entire CLOZE question worth 1 mark and each question inside the CLOZE be worth a percentage of 1 mark
ie I have 4 shortanswer questions in a CLOZE question and I want each part to be worth 25% of the overall mark.
In reply to Lynne Bayley

Re: Most wanted features in quiz module

by Daniel McCloy -
I think your last request is already implemented in 1.9.x: you make the entire question worth 1 point by changing its point value on the quiz editing page, and you control relative values of the sub-questions by changing the number at the start of the cloze code. For example:

{1:MULTICHOICE:=answer A~answer B} {3:MULTICHOICE:answer C~=answer D}

would yield a two-part question where the first part is worth 1/4 and the second part is worth 3/4
In reply to Lynne Bayley

Re: Most wanted features in quiz module

by Stefan Eberhard -
you can put answer a in box a or box b and answer b in box a or box b which is currently fine. But I also want it to ONLY score both marks if you put a in one of the boxes and b in the other box not if you put a in both boxes

I think there is no chance to find a solution before Moodle 2.1 as Tim Hunt will try to allow negative marks in Cloze question with 2.1.
We need a similar feature for bookeeping questions.

Our solution now is to include an extern Javascript page within the cloze-question. I works fine, but it ist not the "ideal" way