Collecting usability problems in Moodle

Collecting usability problems in Moodle

дэргэд Ralf Hilgenstock -
Хариу нийтлэлийн тоо: 13
Core developers зураг Particularly helpful Moodlers зураг Translators зураг
During the last months I saw several usability problems while observing users with moodle and supporting lots of clients.

Searching for usability in the forum search I saw that most of the postings relates to single features. But there are also problems I saw with users caused by different use of functions at several places

I know this is not exactly the correct forum to discuss this topic, but I didn't find a better one. I would like to know more about other observations of usability problems. If we have a collection of such topics we can check how to change features and to discuss it with the developers.


In most cases users (students and teachers) can use basic functions of Moodle without additional explanations if they know something about the standard processes. But we can make Moodle better over the next time.

Some basic rules for usability I can define from my observations:
  • Use same desription for same or similiar functions at several places
  • Place similar functions at the same places
  • Use same basic functions at all places
  • Use logical ways and directions


Some examples:
  • File handling in Moodle file system
    Most users click at the field on the left side of the line to mark a file or click at the file name. The correct use to choose a file is to click at "Choose" in the column action.
  • Users don't understand that they have to click the boxes to delete, move or zip files.
  • File handling in the editor works in an other way like in the moodle file system. Here you have to click on the files name to mark the file for use.
  • Editing quizzes and questions.
    The work process is from top right (editing categories), middle right (creating questions), right side down (selecting questions for quizzes) to left column (final design of the quiz design). Normally we use a process from left-to-right and top-down. Here is the way top-right to down-right to left side. This direction is not very intuitiv to use. I know left-to-right is only normally in western culture. In arabic countries right-to-left is normally used.
  • Editing quiz questions.
    The quiz questions have an excellent feedback system. But the number of feedback options are also a problem. Most users can't see on the first view which field are for answers an which are for feedback. That confuses them. Editing quiz questions in an LMS is a difficult situations for most teacher. They have to do explicit what they mostly do intuitive while creating quizzes. I saw that they normally only define questions in standard teaching situations without an LMS. Now they have to do lots of things while creating the quiz they normally do while grading on paper. This are defining the correct, partially correct and incorrect answers, defining the grades and points and the feedback text. Moodle offers now three different feedback types for a single MC questions. The functions and features of quizzes are excellent, but we need a better visual orientation. Moving the general feedback field after the definition of answers could be a first step. From a teachers point of view the answering options after more important than the feedback texts. The feedbacks texts are bigger than the answering fields. So it seems that they are more important. That confuses and don't support the orientation.
  • Default settings for activities and blocks
    In website administration we can set defaults for lots of functions on the settings pages of activities and blocks, but not for all
  • Hiding advanced features on activity setting pages
    This feature is only available for quizzes. Why not for all modules.
  • Handling of passwords or keywords at several places
    There are several places we define password or keywords (profile, quiz settings, lesson settings, course settings). But not at all places it works in the same way. In lesson you can't see a formerly defined password if you update the settings, the field is empty. At most of the other fields you can choose to show a hidden key-/password or the exact entry.
Do you think this are usability problems or are there other oberservations?
What are other usability problems students, teacher and admins have`?



Үнэлгээний дундаж: -
Ralf Hilgenstock-н хариуд

Re: Collecting usability problems in Moodle

дэргэд A. T. Wyatt -
I think your list is very good!

Another problem we have is with the essay question. In a previous version, you could put the right answer as feedback and it would display while you were grading. This helped you a lot when you were grading a set of answers. Now it does not show. You have to edit the question to open it up and find the feedback. This is a problem, particularly if the question is very complex or needs a number of items for 100% credit.

On our server, although we do not use manual authentication, we cannot get rid of the "forgot password?" or "change password" links in the profiles and on the front page (short of editing the code itself). My recollection is that these prompts used to disappear if you set your authentication to external DB, IMAP, or LDAP (etc). We are getting a lot of messages every day generated from these links by students who have lost their passwords, and the students are getting frustrated because this is not a possible way to change passwords with LDAP. I believe I have filed an issue in the tracker on this already, but it remains as a usability problem.

I will keep thinking about this. I might come up with some other examples!

atw
A. T. Wyatt-н хариуд

Re: Collecting usability problems in Moodle

дэргэд A. T. Wyatt -
I am trying to reply to myself, but am not sure where this post will wind up!

With respect to the quiz (and I am going to say right now that the quiz module does tons more than formerly, so I deeply appreciate all the work Tim and maybe others have done on it!)--my comments above on not having the correct answer show when grading the essays only happens when you grade the questions as a set. The feedback DOES show when you grade each student's test separately.

In this view (grading each test separately), I kept looking for a dropdown box because I am used to using the drop down box when grading in assignment view. So I wanted to use that same behavior in quiz mode. HOWEVER, if we could just type in our own number in assignment grading view (which would mean we had the long-awaited decimal capability) this problem would be completely solved in (to my mind) a far better direction!

I think that we get some inconsistent breadcrumb trails (I am not sure that all of these have to do with third party blocks; I know many of them do). I get aggravated frequently when off doing something and then suddenly find no way to get back to my course. Back button on browser having its own vagaries!

I think that we get returned to the top of the screen when committing a change that affects a field some distance down a page. For example, when grading a student quiz, everytime I entered an override (necessary on essays), I was returned to the top of the screen. I spent more time scrolling down to find the next question than grading!

Ralf, are these the kinds of things you were talking about? I recognize that when you have a modded system, it is difficult to keep separate issues to do with moodle core and issues from third party add-ons. Maybe some of this will eventually find its way into the guidance docs for block and module developers also.

atw

A. T. Wyatt-н хариуд

Re: Collecting usability problems in Moodle

дэргэд Ralf Hilgenstock -
Core developers зураг Particularly helpful Moodlers зураг Translators зураг
Hi atw,

a usibility problem is for me if there is a difference between expected behaviour and the behaviour a system asks me to use. On the other side we have a usability problem if the user doesn't know what s/he should do or a process is more complicate than it must be.

What you desrcibe is that you expected a special behaviour and saw that it didn't work in this way. We should check if other people expect it in the same way. (What is the behaviour most people expect.) Than we should to discuss if it is a new feature or a bug. (What is the best way it should work for users. And that can be that it works best after they have learned a new behaviour. But definitely not the best way a programmer can programm a feature. )

On the topic is if the grading strategy is working in the same way in essay questions or similiar situations in different activities. How did it work in lessons essay question or in online assignments. They all have a grading process based on individual answers of students.

Inconsequent use of breadcrumb navigation is an interesting point. Im wondering often where I'am if I use the Peoples block. The breadcrumb navigations doesnt show the shortname of the course. What are your findings in this poin?


Ralf Hilgenstock-н хариуд

Re: Collecting usability problems in Moodle

дэргэд Carlos Guerrero -
I agree with both of you. All the usability "bugs" you mention should be solved ASAP (I'm afraid I can't help on that). It is also a good idea to share your concern with us.

However, I think the only way to have these bugs solved (or new features implemented) is to report them on the Moodle Tracker.

Kind regards,

Carlos
Carlos Guerrero-н хариуд

Re: Collecting usability problems in Moodle

дэргэд Ralf Hilgenstock -
Core developers зураг Particularly helpful Moodlers зураг Translators зураг
Hi Carlos, thanks for your answer.

Some of the topics are in the bug tracker and you are right that the bug tracker is the correct place to report it to the developers.
In the first step I 'll discuss it with users, admins and teachers. And most of them don't use the bug tracker.

I don't think that the points can be solved ASAP. Example: file handling. There is an ongoing discussion to use an other editor. Today Moodle uses HTMLarea. TinyCMS is an other editor. It is part of Moodle packages but not integrated very well.

Lets first collect and discuss criteria for more and better usability here and concret points we see problems.

Ralf Hilgenstock-н хариуд

Re: Collecting usability problems in Moodle

дэргэд Mauno Korpelainen -

Hi Ralf,

really interesting topic and worth of larger discussion. I have some small things to add:

- Help buttons are fine but advanced editable wizards could be even better
- Buttons to change style and scale font (larger/smaller) - a small javascript to add to theme and buttons to the top of the page

All basic things of usability for adults are well discribed in
http://usability.gov/pdfs/guidelines.html

but usability has a different meaning when you ask from young kids. Read for example

http://www.useit.com/alertbox/children.html
http://www.stcsig.org/usability/newsletter/0201_testingeducational.html
http://www.stcsig.org/usability/newsletter/0201_whatchildrenwant.html

or teens:

http://www.useit.com/alertbox/teenagers.html

The same page that is clear and simple for adults can be most boring for kids and the same animations that are fun for kids are most irritating for adults...smile

Mauno Korpelainen-н хариуд

Re: Collecting usability problems in Moodle

дэргэд Ray Lawrence -
This looks like it could develop into a really useful list of enhancements to Moodle.

To make the list an action list not a wish list may I propose that each suggestion for improvement is accompanied by a donation to fund the development work.
Ray Lawrence-н хариуд

Re: Collecting usability problems in Moodle

дэргэд Mauno Korpelainen -

Ray,
donating is recommendable but this is not really either new or difficult thing, read for example the study
"Designing Web Sites for Older Adults:
Expert Review of Usability for Older Adults
at 50 Web Sites"
http://assets.aarp.org/www.aarp.org_/articles/research/oww/AARP-50Sites.pdf

Failures


Maybe I should not have used word "wizard" - help, guiding, assistance...would have been better words. Some assistance may be given with help buttons (editing language), giving longer alt tags or titles to images, auto-links to glossary and by creating new content with links inside the course, for example:

Assistance

I miss a possibility to add direct editable help straight to any content using event handlers. For example http://tracker.moodle.org/browse/MDL-9963 makes this difficult but even more difficult it is for teachers who can't use javascript. You must also have seen buttons like Larger font or Smaller font or Print
Patrick has used one javascript in http://www.newschoollearning.com/moodle/?&theme=envy

Ralf Hilgenstock-н хариуд

Re: Collecting usability problems in Moodle

дэргэд Joseph Rézeau -
Core developers зураг Particularly helpful Moodlers зураг Plugin developers зураг Testers зураг Translators зураг

Hi Ralf,

Thank you for a most interesting post. It's a pity, as you say, that there is no moodle forum dedicated to usability. Would it fit in the accessibility forum (I do appreciate that it's not quite the same)?

I will comment on the Editing quiz question section of your post.

When I use the current interface (1.8 or 1.9) for editing my quiz questions I keep pestering against a number of "screen objects" which get in my way rather than help me doing an efficient job. I agree with you that it does not make sense for the Feedback field to come before the questions & answers fields. I also dislike the fact that there are so many unnecessary vertical spacings which mean that a simple question edit screen can never fit on one screen but is spread out and necessitates scrolling down (see this post). By the way, this is a constant feature of moodle screens, where many could easily fit on a "standard" 1280 x 1024 screen but, because of "fancy" vertical spacing, boxes, lines, etc. you have to scroll...

Of course screen design is both a matter of taste, "design" and usability, and one man's meat is another man's poison, etc. but surely there are some basic usability facts on which most people would agree, no?

Joseph

Joseph Rézeau-н хариуд

Re: Collecting usability problems in Moodle

дэргэд Ralf Hilgenstock -
Core developers зураг Particularly helpful Moodlers зураг Translators зураг
Hi Joseph,

an idea for better usability of feedback in quiz questions.
In MC-questions we can add additional answering options with a button. In the same way we could use a pull down menu to choose a feedback option.
a) no feedback
b) general feedback (same for all answers)
c) categorized feedback (all correct, all wrong,..)
d) individual feedback (for each answers)

After choosing one of the options the fields open on the screen.
Ralf Hilgenstock-н хариуд

Re: Collecting usability problems in Moodle

дэргэд Ralf Hilgenstock -
Core developers зураг Particularly helpful Moodlers зураг Translators зураг
Addition:

  • On top of the forum messages (rught side) are some options for settings relating mail notification. You have to click on the link to change the settings in the way the link describes. On surface of a course the groupssettings allows also the change of settings, but if you move about the sign with the mouse you see the description of the actual status.
    This are similar functions but different behaviour.