Moodle Official Test

Moodle Official Test

by Christian Lebe -
Number of replies: 8
Hiya Moodlers,

Martin and Shane from Moodle HQ have decided to develop an official test plan that can be use each time a new Moodle version is released. I have started bit by bit and put it on Moodle docs .

So basically this is what's happening:
1. We have some scenarios/cases in Moodle Docs
2. I modified the Moodle Demo Features course and this can be used to go through the test plan. The course file can be downloaded here.
3. Moodle Community could contribute taking part of the test and report any bug (we are still thinking what's the best way to report a bug).

At the moment, the Test plan is far away from perfect. I would like to ask some feedback so that we can make it happen. Please feel free to modify the documentation page as well (add more questions or modify or anything).
I will also continue putting more pages there.

Allright. That's all from me, thanks for participating big grin

Chris

(Edited by Martin Dougiamas - Thursday, 16 March 2006, 04:46 PM)

Average of ratings: -
In reply to Christian Lebe

Re: Moodle Official Test

by Ludo (Marc Alier) -
Hi Christian,
do this testing involves wiki? The new wiki performs a migration of old wiki's and dfwikis when is installed. Could you include this process into the testing ?
Thank you.
Marc
ps. the new wiki is in cvs contrib/dfwiki/mod/wiki but you can find a bundle called "wiki crash version" here http://appserv.lsi.upc.es/palangana/moodle/course/view.php?id=15




Average of ratings: -
In reply to Ludo (Marc Alier)

Re: Moodle Official Test

by Martin Dougiamas -
Picture of Core developers Picture of Documentation writers Picture of Moodle HQ Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers
Bit early for that, Ludo ... right now this testing is only for what will be in the Moodle 1.6 release.
Average of ratings: -
In reply to Christian Lebe

Re: Moodle Official Test

by Vu Hung -
Thanks Moodle.com for this effort. I believe it will improve Moodle significantly.
Average of ratings: -
In reply to Christian Lebe

Re: Moodle Official Test

by David Scotson -

Hi, I'd seen these test scripts added to the wiki and been intrigued. I think having community created test scripts is a great idea, but one that could be taken further with automated testing tools.

The tool I have most interest in is Watir. I'm so excited about the possibilities of this tool that after months of waiting for the promised cross-platform, cross-browser version 2.0, I've finally caved and overcame my revulsion to install and use Windows XP on my main work machine to explore its potential.

I've not yet had the chance to dig into it fully but believe that the tool is simple enough for ordinary Moodle users to contribute and run automated test scripts, while allowing more advanced users and developers to do very interesting things.

In fact I was often reminded of Moodle when reading the testimonials of testing professionals who use this tool. It seems to open up this world to a whole new audience by massively lowering the technical expertise required and working in a way that fits their existing mental models.

If anyone else has been looking into this or other similar/complimentary tools (e.g. Selenium) I'd love to hear about it.

Average of ratings: Useful (1)
In reply to David Scotson

Re: Moodle Official Test

by Martin Dougiamas -
Picture of Core developers Picture of Documentation writers Picture of Moodle HQ Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers
This system looks very cool at a first glance ... it seems likely that the work Christian's already done could be easily converted to use a framework like this.

I can probably imagine some scenarios where simple text matching would not be able to pick up a GUI bug (eg missing one quote in a link) but perhaps these would not actually be a problem with some careful thinking.
Average of ratings: -
In reply to Martin Dougiamas

Re: Moodle Official Test

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers
Who cares if an antomatic test script does not catch 100% or errors. If all it costs setting a script running then going for a cup of coffee, and if catches some classes of errors, then it is almost certainly a win.

And it frees up human testers to do more intellegent testing.
Average of ratings: -
In reply to Tim Hunt

Re: Moodle Official Test

by Martin Dougiamas -
Picture of Core developers Picture of Documentation writers Picture of Moodle HQ Picture of Particularly helpful Moodlers Picture of Plugin developers Picture of Testers
Sure, I agree!   It's always good to be aware of limitations, though, particularly when we might have a choice of tools.

Christian will be looking into this next week unless anyone comes up with a better tool.
Average of ratings: -