Time Taken by student to answer each question in quiz

Time Taken by student to answer each question in quiz

by Vickey Chavan -
Number of replies: 17

In Quiz, There are 5 questions we created and set the timer for Entire quiz.

When Students attempt the quiz, after student answered the first question and click on "Next question", we want to track the "How much time student took to answer that particular question" and we want to see that in Quiz Reports.

Please tell me how to implement this ?

Average of ratings: -
In reply to Vickey Chavan

Re: Time Taken by student to answer each question in quiz

by Rick Jerz -
Picture of Particularly helpful Moodlers Picture of Testers
As far as I know, you cannot get "time on question." However, out of curiosity, why do you want to know this?
In reply to Rick Jerz

Re: Time Taken by student to answer each question in quiz

by Vickey Chavan -

Hi, Our client want this feature. We need to display the time taken per question in Reports. please tell me what code changes / plugin i need to make for this?

In reply to Vickey Chavan

Re: Time Taken by student to answer each question in quiz

by Marcus Green -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers
A web search indicates this has been asked about quite a few times over the last two decades and there is no single simple answer. Here is a response from 2010 which addresses some of the issues if not offering an answer

https://moodle.org/mod/forum/discuss.php?d=147702


Average of ratings: Useful (3)
In reply to Vickey Chavan

Re: Time Taken by student to answer each question in quiz

by Rick Jerz -
Picture of Particularly helpful Moodlers Picture of Testers

Why does your client want this feature?

Consider this scenario.  Your very best student (based on their score) finishes each question in 10 minutes.  Your second-best student finishes each question in 5 minutes.  Your worst student finishes each question in 1 minute.  Your second-worst student finishes each question in 10 minutes.  What does this tell you?

In reply to Rick Jerz

Re: Time Taken by student to answer each question in quiz

by Vickey Chavan -

hi, client is telling like, if someone finishes it in less time, he is having more knowledge on the subject. so we have no option left now other than implementing time taken per question. is there any plugin that ll help us? or how tough is to implement this ?

In reply to Vickey Chavan

Re: Time Taken by student to answer each question in quiz

by Rick Jerz -
Picture of Particularly helpful Moodlers Picture of Testers
Perhaps. (Visvanath, thanks for pointing to Vickey's scanned paper). I would expect the last question to take the longest because by then, the student knows they might have a lot more time left. So, a person can have more knowledge and take less time yet still get the question wrong.

As you can see, I am simply exploring the logic, which I believe is perhaps faulty. But you and your client can continue with the logic.

Getting back to your real question, "Is there a plugin?" I know of none. This is not to say there might not be one; I just don't know of any. Marcus has pointed out that this question has been frequently asked for many years.

I know of no major LMS that can do this either, so it is not just a Moodle problem.

To provide some technical context, Moodle does have a database table, logstore_standard_log, that keeps track of student's clicks. It is frequently the biggest table, so big that there is a Moodle setting to get rid of old clicks. If Moodle were to try to keep track of every click in quiz questions, this table would grow in size enormously. Plus, there could be a performance hit. Others here on Moodle.org might explain some of this better than I do.

As an idea, you might want to add one more question to the quiz, asking students, "Which question did you find to be the hardest, and why?" Or, "If you had a choice, which question would you remove from this quiz." Or, "Tell me which question you do not want to be included in your quiz score. You can only select one. All quiz questions will be included if you choose not to answer this question."
In reply to Rick Jerz

Re: Time Taken by student to answer each question in quiz

by Visvanath Ratnaweera -
Picture of Particularly helpful Moodlers Picture of Translators

@all

I don't know why this discussion gets longer and longer. The answer is pretty simple:

  1. Moodle (as of today) doesn't have solution.

Source: Re: Time taken for each question

(@Marcus, thanks for the link.)

Well, it was said 14 years ago. @Tim, could you confirm that it is still true?

2. Feature request

So, what we are discussing is a feature request.

@Vikey, This is how I understand your sketch.

  • Let's say the candidate scored x marks in a question. x = 0..1.
    Note that it is not 0 or 1. Moodle gives all kinds of fractional marks, for example in a multiple-choice question, x could only be any real number between 0 and 1.

  • Let's say the candidate took a time of t seconds, 0 < t <= T to answer the question. Both t and T are an integers.

Now, given x, t and T, we need a formula for the measure of "combined goodness" of the candidate.

We know:

x : higher, the better

t : lower the better

T : higher the better

That's all we know. @Vikey, what is the formula you have in your design?

In reply to Visvanath Ratnaweera

Re: Time Taken by student to answer each question in quiz

by Vickey Chavan -
@Rick @Visvanath Thankyou so much for your inputs. We can see Student's log activity when we click on Quiz Results Page.  We are planning to use below formula. For Example : 
 

First question :

 Quiz Start : 12 : 10 : 05

1st   question’s answer saved  :  12 : 10 : 25

TIME TAKEN =  00 : 00 : 20

Second question :

Quiz start : 12 : 10 : 05

2nd question end : 12 : 10 : 55

TIME TAKEN =  [  12 : 10 : 55  - 12 : 10 : 25  ]  = 00 : 00 : 30

Formula –  [ current question’s Answer saved   -  previous question answer saved  ]

saved

Average of ratings: Useful (1)
In reply to Rick Jerz

Re: Time Taken by student to answer each question in quiz

by AL Rachels -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers

Seems to me, they might be able to get more, "meaningful information," by using, Degrees of Certainty with student feedback (deferred), or something similar.

.

Average of ratings: Useful (1)
In reply to AL Rachels

Re: Time Taken by student to answer each question in quiz

by Visvanath Ratnaweera -
Picture of Particularly helpful Moodlers Picture of Translators
Hi AL

I'm aware that if one takes the thick book on computer-marked quizzes out, it'll have a couple of dozens strategies (with meanings), half of them are implemented in Moodle. I was wondering how Vickey's strategy goes, how could one mix grades and time, and was just asking how.

Here is a simple formula:
Corrected mark y = x * (1 + log(T/t))

So the multiplication factor will go like:

    t/T | 1 + log(T/t)
    ------------------
    1.0 |         1.00
    0.5 |         1.30
    0.2 |         1.70
    0.1 |         2.00
So, done in half-time gets 30% bonus, in one fifth of time 70%, in one tenth of time gets 100% bonus!
In reply to Visvanath Ratnaweera

Re: Time Taken by student to answer each question in quiz

by AL Rachels -
Picture of Core developers Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers

Looks rather interesting, but since I no longer teach, it is just too much trouble to pretend to be a number of different students, to try and see what results come from trying to test something like your example. When I was teaching, my Advanced Computer Applications students used to love to help me test stuff like this. I remember during a couple of Quality Assurance test cycles they helped me complete over 150 of the tests. Now, by myself, during the recent 4.5 cycle, I logged in and had to quit half way through the first test I attempted, due to my ongoing eye problems.

I have always wondered though, which would you rather have? A doctor who "zoomed" through all their quizzes during training, or one who took their time and made sure their answers were correct, and more importantly, surgeries we done correctly? And being a retired helicopter instructor pilot, same question for the pilot up front doing the driving? I knew too many pilots, that when they were flying in the simulator without an instructor, they would just "play around" instead of doing the required instrument flight training.

Average of ratings: Useful (3)
In reply to AL Rachels

Re: Time Taken by student to answer each question in quiz

by Visvanath Ratnaweera -
Picture of Particularly helpful Moodlers Picture of Translators
Hi AL

Apparently the OP can get the time data he wants: https://moodle.org/mod/forum/discuss.php?d=463122#p1859856. But doesn't say what he is going to do with the times spent in each question. So, forget my "logarithmic" bonus system. wink

I know the trouble of pretending to be a number of users when I don't have enough real students. I envied the lecturer who devised an ad-hoc crash test for a VPL Jail server and ran it. He had a lab class with 59 students. Gave them a simple VPL programming activity and as they were working on it, provided the sample solution and asked them to run it a couple of times and submit the solution as fast as possible! Yeah, that sent the VPL Jail server spiraling. Still, apart from everybody feeling that the server is sluggish only about 10 couldn't submit in the first try.
 
About the "zooming" doctors, there are all kinds of doctors. What you'd rather have is irrelevant, whom you get is that matters. Just yesterday I expressed my dismay here: Re: How to embed a pdf file and disable download.
In reply to Vickey Chavan

Re: Time Taken by student to answer each question in quiz

by Dominique Bauer -
Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Plugin developers

Hello Vickey,

There are cases where it's irrelevant—and therefore unnecessary—to record the time spent on each question, let alone assign a bonus for it. However, there may be instances where this is useful, and I imagine this is the case for you.

Writing a plugin to account for all the possible parameters a quiz might have would likely be a significant undertaking. However, a client-side solution for specific parameters is feasible.

Let's assume that security isn't a primary concern. Since time is being tracked, students probably won't waste time trying to alter the JavaScript.

Let's also assume that each question appears on a separate page, which simplifies the process as we only need to monitor page progress. Recording the time spent on each question would be challenging if multiple questions were on the same page.

Additionally, assume for now the quiz navigation is sequential, meaning students cannot go back. This simplifies the code.

Finally, suppose we want to award a bonus for each question if it’s completed quickly.

With these assumptions, writing a simple script to handle this seems like a straightforward task—a tailored solution for a specific need. It may not be perfect, but it’s better than nothing.

Average of ratings: Useful (1)
In reply to Dominique Bauer

Re: Time Taken by student to answer each question in quiz

by Rick Jerz -
Picture of Particularly helpful Moodlers Picture of Testers
I don't believe that Vickey has mentioned what kind of questions these are, such as True/False, Multiple choice, etc.
Dominique, your thoughts are interesting. However, it seems to combine some set-up requirements at the quiz level (i.e., sequential navigation) and the question-type level (i.e., adding a "time" variable). I wonder how simple this really is.

I would describe Vickey's need as being a "game-playing" scenario, where both time and correctness are combined. Of course, students would have to be told this ahead of time. Perhaps Vickey has a valid case, as you have mentioned, but I don't see it in my environment (higher education), and I like what Al has offered. His "doctor" scenario also came to my mind. Do you want to visit a hospital that says to their doctors, "You must treat patients quickly." or "Take your time and ensure you have treated patients correctly?"

Also, remember that this "time" issue complicates "accessibility." Already, some students get more time for quizzes due to their disability. Look at the effort involved in allowing students to hide the timer on quizzes because some students are "distracted" by seeing a timer. If each question is timed, should Moodle show a timer?

So I still wonder about the need, but I also recognize that there might be a real need for this feature.
In reply to Vickey Chavan

Re: Time Taken by student to answer each question in quiz

by Emma Richardson -
Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Plugin developers
This is simply wrong - amount of time has little to do with knowledge. A student might be more thorough and take more time..I know for a fact that if I do not know the answer to certain questions, I will not waste time on them - I will submit my best guess and move on. Sometimes we need to educate our clients!
Average of ratings: Useful (2)
In reply to Emma Richardson

Re: Time Taken by student to answer each question in quiz

by Visvanath Ratnaweera -
Picture of Particularly helpful Moodlers Picture of Translators
But there are things like competitions. The quiz is a versatile instrument, we can't draw a line between correct and wrong applications. I mean, if quizzes are not designed for that, then stand for it. Telling others what they are doing is wrong is the wrong approach.