Puzzling variations in the 'Responses' reports

Puzzling variations in the 'Responses' reports

Josep M. Fontana -
回帖数:6

In order to do some further analysis I usually download the reports of the quiz results as csv files. Today I noticed something that strikes me as odd. In the column for the questions one would expect that the text will be the same for each one of the questions. I found the  variations that you can see below, however.  This concerns the report for the option 'Responses'.

If you notice, the questions seem to be the same but, right after "} ->" the order of the following elements (corresponding to the options in the multiple choice menu in a 'Matching' type quiz) is shuffled. I don't know why this is the case since when I created the quiz I didn't activate the 'suffle' option.  

This is annoying because it makes it difficult for me to process the csv file and establish correlations between different questions and scores. I use 'Random' to assign different versions of the question in some tests. I wanted to see if some versions of the question might pose more difficulties than others. 

Question 1, Row 1:

What is the grammatical category of the underlined expressions? Select the best option from the menu in each case.       * There is enough work to keep us all pretty busy.                      1                                             2         * It will look real nice when it is finished.                      3                                 4       * The rather gangly old man ran away frantically but he kept looking back at us.                         5                               6                                                           7       {Word #1   ; Word #2      ; Word #3   ; Word #4   ; Word #5      ; Word #6      ; Word #7      } -> {adjective; clause; adjunct; particle; adverbial phrase; preposition; adverb; verb; modifier; complement; adjective phrase}


Question 1, Row 2:

What is the grammatical category of the underlined expressions? Select the best option from the menu in each case.       * There is enough work to keep us all pretty busy.                      1                                             2         * It will look real nice when it is finished.                      3                                 4       * The rather gangly old man ran away frantically but he kept looking back at us.                         5                               6                                                           7       {Word #1   ; Word #2      ; Word #3   ; Word #4   ; Word #5      ; Word #6      ; Word #7      } -> {adverb; verb; complement; clause; adjunct; preposition; adjective phrase; adjective; adverbial phrase; modifier; particle}
 
Question 1, Row 3:

What is the grammatical category of the underlined expressions? Select the best option from the menu in each case.       * There is enough work to keep us all pretty busy.                      1                                             2         * It will look real nice when it is finished.                      3                                 4       * The rather gangly old man ran away frantically but he kept looking back at us.                         5                               6                                                           7       {Word #1   ; Word #2      ; Word #3   ; Word #4   ; Word #5      ; Word #6      ; Word #7      } -> {adjective; adjective phrase; clause; complement; verb; adjunct; particle; adverb; preposition; adverbial phrase; modifier}

 
回复Josep M. Fontana

Re: Puzzling variations in the 'Responses' reports

Brett Dalton -
Moodle HQ的头像 Particularly helpful Moodlers的头像

Has the question been edited at some point?  It's likely that this is due to question versioning

回复Brett Dalton

Re: Puzzling variations in the 'Responses' reports

Josep M. Fontana -

Thanks Brett. 

I don't know. Maybe. I don't think this is the reason, though. I only copied a sample of three rows but practically every row was different. It is as if the order of the elements in the last component is randomized but I don't understand why it should. These are the elements (possible answers) that appear in the dropdown menu (see screenshot below). 

I only have one version of this question. Even if I had edited it at some point (I don't remember doing it, though) you would then expect a two or three versions of the question. I certainly didn't change the order of the answers that appear in the menu because the question involves always the same items in the same order. I include a screenshot so that you can have a better idea of what's involved. 

image.png

The part that changes in the 'Responses' report is:

 {Word #1   ; Word #2      ; Word #3   ; Word #4   ; Word #5      ; Word #6      ; Word #7      } -> {adverb; verb; complement; clause; adjunct; preposition; adjective phrase; adjective; adverbial phrase; modifier; particle}


 {Word #1   ; Word #2      ; Word #3   ; Word #4   ; Word #5      ; Word #6      ; Word #7      } -> {adjective; clause; adjunct; particle; adverbial phrase; preposition; adverb; verb; modifier; complement; adjective phrase}

etc. etc. with almost as many possible sequential combinations of the elements after ->
There are no different versions of this question, though. What all the students see is what you see in the screenshot and the answers considered correct are the same for everybody. 

回复Josep M. Fontana

Re: Puzzling variations in the 'Responses' reports

Brett Dalton -
Moodle HQ的头像 Particularly helpful Moodlers的头像
I'd need to check but if this has been converted to a report builder report it could be something subtle about the way its retrieving the data from the data base. If thats the case its definetly a problem.
回复Josep M. Fontana

Re: Puzzling variations in the 'Responses' reports

Tim Hunt -
Core developers的头像 Documentation writers的头像 Particularly helpful Moodlers的头像 Peer reviewers的头像 Plugin developers的头像
This bug is a regression caused by MDL-72058. There are various reports in the tracker about various aspects of this, e.g. MDL-78342 to MDL-78343.
回复Tim Hunt

Re: Puzzling variations in the 'Responses' reports

Josep M. Fontana -

OK. Thanks. I thought I was doing something wrong but I was going crazy trying to figure out what it was.