Improving the quiz settings page

Improving the quiz settings page

napisao/la Tim Hunt -
Broj odgovora: 34
Slika Core developers Slika Documentation writers Slika Particularly helpful Moodlers Slika Peer reviewers Slika Plugin developers

Have you looked at the way Moodle 2.5 is heading yet? Good things have been happening to the settings forms. If you have not see it yet, you may wish to head over to http://qa.moodle.net/ and have a look. Actually, let me make it easy for you, here is a screen grab:

Screen grab of the quiz settings form

So, the basic point is that sections of the form start off collapsed, and you just click the heading to expand that section. (There will be an expand/collapse all button before 2.5 is released: MDL-38044.)

The question is, should we change anything else. Now this has been implemented, there is a big effort to look at all the forms in Moodle, and decide whether they should be re-designed to work better with this new functionality. (MDL-38012). For example, it might make sense to split the form into more or fewer sections; or it may no longer be necessary to have show/hide advanced fields (which now also work slightly differently).

So, specifically (MDL-38600) should we make any changes to the quiz settings form now we have these collapsible sections. I was just looking at it, and my feeling is that we should leave it alone. The settings are currently grouped into logical sections with clear names. But then, I would think that, I made up the current arrangement, so of course it makes sense to me.

What do you think?

(I would particluarly like to hear from people who have to train beginners to use the quiz.)

Prosjek ocjena:Useful (1)
Odgovor na Tim Hunt

Re: Improving the quiz settings page

napisao/la Joseph Rézeau -
Slika Core developers Slika Particularly helpful Moodlers Slika Plugin developers Slika Testers Slika Translators

At long last, the user-friendly interface we have dreamed of, with all those "useless" (to me) sections collapsed away.slaže se

Joseph

Odgovor na Joseph Rézeau

Re: Improving the quiz settings page

napisao/la Emma Richardson -
Slika Documentation writers Slika Particularly helpful Moodlers Slika Plugin developers

Not only a cleaner interface but I love the fact that it is now clearer what each section is and what those settings affect.  This will be so much easier to teach the teachers to use!  Thanks to the Moodle team for all their work!!

Odgovor na Tim Hunt

Re: Improving the quiz settings page

napisao/la Joshua Bragg -

I think that the "Review Options" section needs to go back to looking like the old column format (2.4).  It is much harder to look at all those check boxes and how they change as you progress through the options now.  That will cause confusion on when things are visible and when they aren't.

I would vote to remove the idea of advanced options entirely.  It seems very silly to have a "show more"  that shows only 1 or 2 more options.  Now that the form isn't that long in the first place it makes sense to me to just dump them all out there.

EDIT:  I just read through some of Tim's comments in MDL-38600 and had forgotten that the advanced settings are customizable.  How much does this get used?

Overall this is a phenomenal improvement that will really help with training.  I think everything is organized and named well.  The collapsed sections make it easy to see the organization that has been there all along.

Odgovor na Joshua Bragg

Re: Improving the quiz settings page

napisao/la Joseph Rézeau -
Slika Core developers Slika Particularly helpful Moodlers Slika Plugin developers Slika Testers Slika Translators

Joshua "I think that the "Review Options" section needs to go back to looking like the old column format (2.4).  It is much harder to look at all those check boxes and how they change as you progress through the options now.  That will cause confusion on when things are visible and when they aren't."

+1

Odgovor na Joshua Bragg

Re: Improving the quiz settings page

napisao/la Tim Hunt -
Slika Core developers Slika Documentation writers Slika Particularly helpful Moodlers Slika Peer reviewers Slika Plugin developers

The advanced field things gets used here at the OU, and we are relucant to lose it. Given sufficiently compelling arguments, or weight of consensus, you might change my mind, but I really think the more we can hide, even after you have expanded a section, the better.

If the review options are not currently in column format, then that is a bug. MDL-38651. Thanks for noticing.

Odgovor na Tim Hunt

Re: Improving the quiz settings page

napisao/la Paula Clough -

We use those advanced features quite a bit as well. It's a way of keeping the most often used features out front, but not confusing our less sauvy users with the more advanced features that they might not use very often. Having control over which features are advanced and which are part of the default has been very helpful.

 

Odgovor na Tim Hunt

Re: Improving the quiz settings page

napisao/la Rick Jerz -
Slika Particularly helpful Moodlers Slika Testers

I notice that some sections that have a "show more" link, that only about one more item is added when you click on this link.  This being the case, and with the collapsed sections feature, I would suggest that the "show more" link be eliminated and simply show all the items in each section as the default.

Odgovor na Rick Jerz

Re: Improving the quiz settings page

napisao/la Joseph Rézeau -
Slika Core developers Slika Particularly helpful Moodlers Slika Plugin developers Slika Testers Slika Translators

Totally agree with Rick here. Those "Show more/Show less" links are useless. They add to the complexity of the interface, contrary to the present trend to simplification.

Joseph

Odgovor na Joseph Rézeau

Re: Improving the quiz settings page

napisao/la Ralf Hilgenstock -
Slika Core developers Slika Particularly helpful Moodlers Slika Translators

Hi Joseph

I disagree with you in this point.  Show more gives admin to hide completely features that should't be used by institutional concept if the feature is defined as advanced and the 'more' link is hidden by CSS.

Ralf

Odgovor na Ralf Hilgenstock

Re: Improving the quiz settings page

napisao/la Joseph Rézeau -
Slika Core developers Slika Particularly helpful Moodlers Slika Plugin developers Slika Testers Slika Translators

Hi Ralf,

Well, in an educational context such as a big university (where I used to work) I don't like admins to have too much power, for the simple reason that end-users (teachers) will have widely differing needs and must be granted a maximum of liberty.

Things may be different in a corporate context, of course.

"Show more gives admin to hide completely features..." Actually, I do not see this setting in the moodle 2.5 dev version. Maybe it has not been implemented yet?

Joseph

Odgovor na Joseph Rézeau

Re: Improving the quiz settings page

napisao/la Ralf Hilgenstock -
Slika Core developers Slika Particularly helpful Moodlers Slika Translators

Hello Joseph,

we have checked it and it will work.  You can hide the 'Show more...' link via CSS in your theme. In consequence the advanced settings are invisible for teachers.

In this way its an option to reduce complexity for several scenarios.

Ralf

Odgovor na Ralf Hilgenstock

Re: Improving the quiz settings page

napisao/la Tim Hunt -
Slika Core developers Slika Documentation writers Slika Particularly helpful Moodlers Slika Peer reviewers Slika Plugin developers

Note that Damyon from HQ is planning to implement similar preferences for the new Assignment module. See MDL-37621and MDL-37459. Note that he is also adding a 'locked' state which I think is what you are asking for here. Then there is MDL-37914 for applying this to all the other activity types. Hopefuly Damyon will get time to finish that soon.

Odgovor na Tim Hunt

Re: Improving the quiz settings page

napisao/la Ralf Hilgenstock -
Slika Core developers Slika Particularly helpful Moodlers Slika Translators

Thanks for the link. If thelocked feature will be implemented it makes fully sense forme to hide optionally the locked settings for teachers.

Odgovor na Ralf Hilgenstock

Re: Improving the quiz settings page

napisao/la Tim Hunt -
Slika Core developers Slika Documentation writers Slika Particularly helpful Moodlers Slika Peer reviewers Slika Plugin developers

The argument for keeping them visible is: what about staff who search on the internet to learn how to do X in Moodle, and find an answer, but then they go to their Moodle and things look very different. It is less confusing if the locked options are visible.

Odgovor na Tim Hunt

Re: Improving the quiz settings page

napisao/la Ralf Hilgenstock -
Slika Core developers Slika Particularly helpful Moodlers Slika Translators

I agree to this argumentation. My idea is to make invisibility optional for administrational settings.

Configuration of Moodle systems is a must today. Features are disabled and Third-Party Add ons are added. So the system will look different everywhere. This happens also if Designs use only columns left or right.

 

Odgovor na Tim Hunt

Re: Improving the quiz settings page

napisao/la Douglas Broad -

While I like the potential idea of fast scrolling or elminating some scrolling, most of those rolled up options are important to me when I create a quiz.  I don't think it will save much work to have to manually open the section in order to be able to see what the current setting is.  Quiz creators shouldn't be ignorant of the actual settings.

At the very minimum, some abbreviated form of the current setting should be viewable without uncollapsing the section.

An expand-all button might also be helpful.

I've found CTRL+END to be a good pop-to-the bottom tool.

Might be worthwhile to consider a behavior of first time through or second time through.  Quiz setting templates might save some time as well.

Odgovor na Douglas Broad

Re: Improving the quiz settings page

napisao/la Rick Jerz -
Slika Particularly helpful Moodlers Slika Testers

I think Douglas makes some very good points.  I have never minded scrolling past the settings that were not of interest, so if we go back to not having collapsed sections, it would not bother me at all.

Additionally, Douglas makes a good point about "an expand-all" button.  Quite honestly, I used Gareth's Collapsed Topics add-in, and I was surprised how similar the new quiz collapsed sections behaved like collapsed topics.  However, Gareth's add-in does have a "Open all" and "Close All" feature (see figure). 

I have made the point elsewhere that the Collapsed Topics add-in should become part of Moodle's core features.  If collapsed sections is provided in 2.5's quizzes, then I think my point about Collapsed Topics becoming part of core is even more important, for consistency.

Privitak Collapsed.jpg
Odgovor na Tim Hunt

Re: Improving the quiz settings page

napisao/la Ralf Hilgenstock -
Slika Core developers Slika Particularly helpful Moodlers Slika Translators

Hello Tim,

thanks for advice to this discussion. We are very happy about the collapsed sections in activity settings pages in 2.5. Yesterday we made a general check about this for all activities and found that some terms in section names are confusing. We made the check mainly to change German  language pack.

The names of sections are the main orientation for teachers to select  a section for settings. So the naming has to be very clear and the diffferences between the names have to make a difference. Even for non-native english speaking teachers  or teachers that are beginning to use Moodle. Problem in quiz is 'Display' and 'Layout'.

But more generally.

I liked very much the concept in quiz module settings page to hide settings as advanved for teachers. My suggestion is sinsce long time to add this consequent to all activties. Some of the settings are very seldom used and should be hidden (advanced setting) normally. The quiz usage concepts in institutions are very different and I would opt for all solutions that admins can define default settings and hide each and every setting as advanced that is not a mandatory setting per instance like title and description for quiz.

The idea is

  • reduce complexity to a minimum. Quizzes are complex by definition and teacher should concentrate to the main aspects.
  • reduce number of sections and rename them
  • make use of standard settings as quick as possible for teachers. Define titele and description and go to the question editing process
  • give access to additional basic settings if required by opening sections
  • give access to advanced settings if required by clicking to 'more' link
  • disable some settings fully if required by hiding 'more'/'less' link through CSS definition in design (invisible)

The problem generally is that we can't predefine which setting is part of a standard configuration for a quiz, which is basic and which is advanced. Specially for quizzes we've seen lots of different concepts in institutions: secondary schools different than vocational schools than universities than corporate.

My suggestion now:

  1. Go forward with adding default settings for all features in quiz module in plugin settings
  2. Same for advanced settings.
  3. Hide advanced setting in sections behind 'more' link.
  4. Show only Title and Description in standard view  for activity instance settings in courses.
  5. Re-sort order of sections and settings to sections
  6. Check if all titles of sections are seperate and can be renamed individually by language strings.
  7. Add help information to all sections

Some suggestions

  • new order of section by teacher workflow process and user process through quiz
    Quiz Access -> Question presenttaion -> Grade and Feedback
  • Reduce number of sections. No section with less than three settings. Otherwise it makes no sense to use more/less definition.
    • Rename Timing to 'Quiz access'
    • Add settings from 'Extra restrictions ...' to 'Quiz access'. Delete section 'extra restrictions'. Extra settings can be defined as advanced.
    • Add Review options and General Feedback settings to Grade section. Grade section is a default setting for graded activities. So it makes sense to collect all grade related settings here.
      Alternative: Add 'Decimal places in grades' and 'Decimal places in question grades' to 'grade'-section. Leave Review options as seperate section.
    • Add 'show users picture' from display to 'Layout' section. Elimate 'Display' section
    • Add overall feedback to 'Review options' or 'Grade' section.
    • Move 'Shuffle within question' and 'How question behave'to 'Layout'. Rename layout to 'Question presentation' or something similar.

Suggestion for renaming of sections. We found that section titles with two or three words gives better orientation than one word titles.

Ralf

 

Odgovor na Tim Hunt

Re: Improving the quiz settings page

napisao/la Douglas Broad -

Apologies for twice replying:

Quote Tim: "There will be an expand/collapse all button before 2.5 is released:"

Agree 100%

Quote Tim: "might make sense to split the form into more or fewer sections;"

Reorganize so that related settings are together. Though current grouping is logical, Timing settings are related to: number of attempts, review options, and extra restrictions on attempts. Dispay grade setting is related to grade. Groups is related to grade. Restrict access is related to timing. Either that or unhiding a category that is related to another category should unhide those as well.

Quote Tim: "it may no longer be necessary to have show/hide advanced fields (which now also work slightly differently)."

Definitely not necessary for separate unhide buttons if unhiding by category. Asterisks should be enough.

Quote Tim: "should we make any changes to the quiz settings form ...? ... the settings are currently grouped into logical sections with clear names."

Agree names are clear. Relationships between sections however take time to learn. Any behavior or grouping that would enhance the understanding of setting relationships would help.

Wordy additional responses below:
---------------------------

Timing: I use this every time and would need it open almost every time. Unfortunately the review options depend on enabling the close quiz setting. Unrolling timing without unrolling review options might be problematic. Gets complicated when a checkbox on one form changes visibilty on another.
Grade: Must set category every time at minimum. Am still experimenting with number of attempts and grading method as alternative learning tools.
Layout: Almost never used. Default to as shown on edit screen 99%.
Question behavior: I am still experimenting here, even after 1.5 years of using Moodle. These settings are extremely related to review options and should probably be together. How questions behave should at minimum be visible from the main screen.
Review options: If roll-up behavior is used, this must unroll with Question behavior. Otherwise big mistakes might occur in quiz design.
Display: I agree that this should either be with Layout or should be split up. It is debateable whether grading under display should be separate from the "Grading" category.
Extra restrictions: I often use the password for in-class testing to control start time. Since this is an access limitation, it could be combined with the timing provisions and renamed "access".
Overall feedback: This group should always be rolled up since it is rarely used and takes the most space. A template should be accessible with commonly use atta-boys. This is the major problem when scrolling to the save button.

Common module settings: It is unclear what the relationships are between these. If all of them relate to groups, then the category should be "groups".

General strategy:
1) Add templates which aggregate commonly used settings. Display the template name at roll-up. Templates could greatly reduce the need to view and tweak the settigns.
2) Aggregate related categories so that it is difficult to overlook when a related setting change affects a hidden category.
3) Naming of categories should accurately reflect its contents but using 2 words always is not necessary. There is no advantage of "Quiz access" over "Access" since the context is "Quiz". Current naming is fine but if content is reorganized it should change to indicate the newness of the organization.
4) Show/hide all

 

 

 

Odgovor na Douglas Broad

Re: Improving the quiz settings page

napisao/la Matt Fedorko -

I love everything that has come out of this discussion, and am looking forward to 2.5.

I did want to throw another vote towards some sort of quiz settings template, either at the course level ("All quizzes in this course will default to this set of settings") or at the quiz level ("This quiz will use this template") or, ideally, both.

I think a standard use case is argument enough for this feature, where an instructor makes 5 quizzes all exactly the same, with the same type of grading, belonging to the same grade category, with the same type of information given after an attempt or when the quiz is closed, etc. It would be much faster to set up a template so that all quizzes default to that when created, OR so that the template can be chosen inside the quiz settings after the quiz is created.

Anyway, all these other discussions are great. 

Odgovor na Matt Fedorko

Re: Improving the quiz settings page

napisao/la Joseph Rézeau -
Slika Core developers Slika Particularly helpful Moodlers Slika Plugin developers Slika Testers Slika Translators

@Matt, until templates become available, you can always create a quiz, keep it empty of questions, name it "Template01", "Template02" (or a more significant name to you), ready for use later on.

Odgovor na Joseph Rézeau

Re: Improving the quiz settings page

napisao/la Matt Fedorko -

Very smart. However, I have a possibly somewhat unique situation where I'm using identical quizzes in credit and non-credit classes where the settings are different between the two categories. And I mean many of the settings -- number of tries, grade category, how the quiz is delivered, what feedback is given and when, etc. Not a big deal for one quiz or two, but now whenever I change a quiz (add/remove a question, for instance), and reimport it into the non-credit class or vice versa, I have to remember which settings are which for that class. I wouldn't complain if I hadn't missed some tiny setting a time or two too many to the disappointment of the students. 

Where if I had a "Non-credit" template and a "Credit" template, I could 'set it and forget it' in the words of Ron Popeil...

But you're right, when building a class and quizzes from scratch, your method would work great.

 

 

Odgovor na Tim Hunt

Re: Improving the quiz settings page

napisao/la Rick Jerz -
Slika Particularly helpful Moodlers Slika Testers

Tim, this suggestion may not be directly related to what you are doing with quiz settings, but I thought that I would mention it to you here.

Has there been any work towards moving quiz statistics from the Navigation Block to the Quiz Settings Block?  I have noticed that others have made this suggestion, and thought that I would bring it up again here.

The concept would be that all quiz related items should be in the same block.  It could look something like my graphic below.

 

Privitak NewBlock.jpg
Odgovor na Tim Hunt

Re: Improving the quiz settings page

napisao/la Guido Hornig -
Slika Plugin developers

very good approach.

1) please add the collapse/expand feature like Rick esplained here: Re: Improving the quiz settings page

2) add a "save all"  buttons in each section - this will reduce scrolling a lot and is well known from many other web applications.

3) add a tag like in wordpress for "more" in the description part. This makes it easyier to give one line explaination on the course page and show the full description  when the activity is open.

Odgovor na Guido Hornig

Re: Improving the quiz settings page

napisao/la Ralf Hilgenstock -
Slika Core developers Slika Particularly helpful Moodlers Slika Translators

Hi Guido

issue 2
I assume that a 'safe all' button in each section has to be discussed more in detail. What happens if all sections are open?  Teacher will see up to 8 'save all' buttons. Much to much. What happens if 'save all' is clicked? Stay the form at the same place, did it jump to the top or is the page closed. If there are several 'safe all' buttons and they close the settings page most teacher  will click them for each section settings without checking other sections and have to go back to the settings page again.
Scrolling is reduced to a minimum in sections are collapsed by default.

issue 3I'm not quite sure that I understood your suggestion. Is your idea to hide the description field and to open it only with a seperate click?
The title and descritption area is a general setting for all activities. It should be used in the same way for all modules. Some modules like assignment are using the description field as mandatory. My expectation is that in practical use most teacher will leave the description empty and students have to start the activities without any advices. The visible description field is always a reminder to teacher: Did my students need a description to start the activity? I suggest to keep it as it is now.

Ralf

 

 

Odgovor na Tim Hunt

Re: Improving the quiz settings page

napisao/la Colin Chambers -

Hi guys,

We’ve made some improvements to the question editing forms. They’re now part of Moodle 2.5 so you should see them pretty soon. Highlights are:

  • Grouping the answer/choices fields so they’re more logical and need less scrolling to view

  • Hide editor tools: Hide the html editor toolbars by default on most fields with a show/hide button to reveal the toolbars. Saves a lot of screen space.

  • Pre fill combined feedback fields: Less fields to fill out.

Hope this makes your lives easier. I've attached a screenshot showing most of the improvments. You can even see the expand all/ collapse all buttons you requested.

If you have any comments or suggestions we’d like to hear them.

Privitak choices_grouped.jpg
Odgovor na Colin Chambers

Re: Improving the quiz settings page

napisao/la Tim Hunt -
Slika Core developers Slika Documentation writers Slika Particularly helpful Moodlers Slika Peer reviewers Slika Plugin developers

Just to add that if you want to try this out, you don't have to wait very long. You can head over to http://qa.moodle.net/ and try it now.

Odgovor na Colin Chambers

Re: Improving the quiz settings page

napisao/la Joseph Rézeau -
Slika Core developers Slika Particularly helpful Moodlers Slika Plugin developers Slika Testers Slika Translators

@Colin,

Looks good, thanks for all the effort towards simplification.

I have only one regret, the General feedback field is still not considered an "Advanced feature". I never ever use it and would have liked to see it collapsed by default. Plus I maintain that it is illogical to have a "Feedback" feature preceding the actual questions, its logical place is right at the end of the form.

Joseph

PS I know Tim will disagree.

Odgovor na Joseph Rézeau

Re: Improving the quiz settings page

napisao/la Tim Hunt -
Slika Core developers Slika Documentation writers Slika Particularly helpful Moodlers Slika Peer reviewers Slika Plugin developers

Joseph, I would have thought you are more than capable of adding

div#fitem_id_generalfeedback {
    display: none;
}

Somewhere.

div#fitem_id_generalfeedback {
display: none;
}
Odgovor na Colin Chambers

Re: Improving the quiz settings page

napisao/la Joseph Rézeau -
Slika Core developers Slika Particularly helpful Moodlers Slika Plugin developers Slika Testers Slika Translators

@Colin,

Actually, I have one minor grievance about the "Collapse all" feature. It does collapse All sections. I would have expected "Collapse all" to collapse all sections except those sections which are default-expanded when entering the form.

What do other users think?

Joseph