Testing and QA

Help needed with Moodle 3.4 QA testing

 
Picture of Helen Foster
Help needed with Moodle 3.4 QA testing
Core developersDocumentation writersMoodle HQParticularly helpful MoodlersPlugin developersTestersTranslators

Moodle 3.4 is due for release in four weeks from now, so we're running another Quality Assurance (QA) testing cycle, starting today: Moodle 3.4 QA. The list of over 570 tests includes tests covering new features and improvements in Moodle 3.4.

If you'd like to have a play with Moodle 3.4 on our QA testing site and at the same time help with QA testing, please read the QA testing guide and send me a message if you'd like to be added to the testers group in the Moodle Tracker. New testers are always welcome. smile

We're aiming for a 100% pass rate of QA tests within the next three weeks, so all help is much appreciated!

 
Average of ratings: Useful (2)
C'est moi :-)
Re: Help needed with Moodle 3.4 QA testing
Documentation writersParticularly helpful MoodlersTestersTranslators

Hi Helen,

Not sure to have lot of time for it, but i'll try to do some tests.

Séverin

PS : site news on qa.moodle.net is "talking" about Moodle 3.3 ! Should be 3.4 wink

 
Average of ratings: -
Picture of Helen Foster
Re: Help needed with Moodle 3.4 QA testing
Core developersDocumentation writersMoodle HQParticularly helpful MoodlersPlugin developersTestersTranslators

Thanks Séverin, and well spotted regarding the QA testing site news. You're clearly a great QA tester! smile

For those of you who have helped with previous QA testing cycles, you may notice a small change in the test workflow - you are prompted to add a comment when passing or failing a test (MDLSITE-5242). Hopefully this will encourage testers to give feedback about new features and improvements, rather than simply passing the test.

 
Average of ratings: -
C'est moi :-)
Re: Help needed with Moodle 3.4 QA testing
Documentation writersParticularly helpful MoodlersTestersTranslators

I see that the version has been amended in site news text, but not in the title.

 
Average of ratings: -
Picture of Sasikala P A
Re: Help needed with Moodle 3.4 QA testing
Translators

Hi Helen,

I also wanted to participate in QA testing.  i will try my best. Please count me in


regards

Sasikala

 
Average of ratings: -
Picture of Nicolas Martignoni
Re: Help needed with Moodle 3.4 QA testing
Core developersDocumentation writersParticularly helpful MoodlersPlugin developersTestersTranslators

Hi Helen,

I'm in as usual smile

Cheers and good luck to Moodle 3.4!

 
Average of ratings: -
Picture of Luiggi Sansonetti
Re: Help needed with Moodle 3.4 QA testing
Moodle Course Creator Certificate holdersParticularly helpful MoodlersPlugin developersTesters

Hello

As usual you can count me !

 
Average of ratings: -
Picture of Jean-Roch Meurisse
Re: Help needed with Moodle 3.4 QA testing
Core developersTesters

Hi Helen

I'll try to as well

Regards

Jean-Roch

 
Average of ratings: -
Picture of Olga Kasatkina
Re: Help needed with Moodle 3.4 QA testing
Testers

Hi Helen,

I'm starting my first testing cycle with Moodle. Excited! 

 
Average of ratings: -
Yoruba Mask
Re: Help needed with Moodle 3.4 QA testing
Testers

Hi, 

I will assist in testing.


Thanks

Lisa

 
Average of ratings: -
Picture of Germán Valero
Re: Help needed with Moodle 3.4 QA testing
Documentation writersParticularly helpful MoodlersPlugin developersTestersTranslators

Hi Helen,

I'm in.
I will start doing some tests as soon as I get home smile

 
Average of ratings: -
Picture of Vicke Denniston
Re: Help needed with Moodle 3.4 QA testing
Testers

I'd love to help out!

 
Average of ratings: -
Picture of Sharon Strauss
Re: Help needed with Moodle 3.4 QA testing
Testers

I'll pitch in and so some testing.

 
Average of ratings: -
Picture of Jean-Marc Doucet
Re: Help needed with Moodle 3.4 QA testing
Moodle Course Creator Certificate holdersTesters

Hi Helen

Ok for me wink

 
Average of ratings: -
Picture of Dag Klimas
Re: Help needed with Moodle 3.4 QA testing
Moodle Course Creator Certificate holdersParticularly helpful MoodlersTesters

Let's have a Moodle 3.4 QA Party wink

I am on board ...

Dag

 
Average of ratings: -
Picture of Rafael Buciotti
Re: Help needed with Moodle 3.4 QA testing
 

Hi Helen,


I've never done this before but I want to try.


Regards
Rafael (São Paulo, Brazil)

 
Average of ratings: -
Picture of Victoria Piseghelli
Re: Help needed with Moodle 3.4 QA testing
 
Hi! Love to help, just let me know how!
 
Average of ratings: -
Picture of Trevor Johnson
Re: Help needed with Moodle 3.4 QA testing
 

Hi Helen

I'd like to help if I can, what is required?

Regards
Trevor

 
Average of ratings: -
Picture of Helen Foster
Re: Help needed with Moodle 3.4 QA testing
Core developersDocumentation writersMoodle HQParticularly helpful MoodlersPlugin developersTestersTranslators

Wow, many thanks to Jean-Roch, Olga, Vicke, Sharon, Rafael, Victoria, Trevor and to Aurelie, Jamie, Ronil, Beauty, Asif, David, Vanessa, Francisco, Bryan and Ivica who messaged me offering to help with QA testing.

As mentioned in the QA testing guide, if you'd like to help with QA testing then you just need to create an account in the Moodle Tracker and let me know your Tracker username so I can add you to the testers group.

Many thanks also to our experienced QA testers - Séverin (hopefully the QA testing site news is correct now?), Nicolas, Luiggi, Lisa, Germán, Jean-Marc, and Dag for helping with another QA cycle.

All help is much appreciated, as we have a lot of tests to run in the next 3 weeks. Also, the perspectives of many different people - new and experienced - help ensure that the next version of Moodle is top quality! smile

 
Average of ratings: -
Picture of Eduardo Kraus
Re: Help needed with Moodle 3.4 QA testing
Plugin developersTesters

Hello helen

I have Moodle 3.4 and much more to help. I often test several features and see if it works right.

 
Average of ratings: -
Picture of Chad Outten
Re: Help needed with Moodle 3.4 QA testing
Moodle Course Creator Certificate holdersTesters

G'day Helen! Count me in

 
Average of ratings: -
Picture of Eduardo Antonio Navas Flores
Re: Help needed with Moodle 3.4 QA testing
 

Hi! 

I would like to be part of this group!

give me a chance.



 
Average of ratings: -
Picture of S. kavita
Re: Help needed with Moodle 3.4 QA testing
Particularly helpful MoodlersTesters

Hi Helen,

I also wanted to do, i will try my best. Please count me in

Thanks,

S.Kavita

 
Average of ratings: -
Picture of Helen Foster
Re: Moodle 3.4 QA testing - 11% passed after 24 hours
Core developersDocumentation writersMoodle HQParticularly helpful MoodlersPlugin developersTestersTranslators

Many thanks also to Eduardo, Chad, Eduardo Antonio, S.Kavita and Oliver for offering to help too.

After just 24 hours, we already have 67 tests (11%) passed and 14 (2%) failed and awaiting investigation by developers (source: QA testing dashboard). Great work everybody! Thanks also for all your feedback. smile

As always, new testers are welcome! Please read the QA testing guide and send me a message if you'd like to be added to the testers group.

 
Average of ratings: -
Picture of Germán Valero
Re: Moodle 3.4 QA testing - 11% passed after 24 hours
Documentation writersParticularly helpful MoodlersPlugin developersTestersTranslators

While the response for Moodle 3.4 QA has been fantastic, it seems that some people did not read the instructions where it says:

Please assign issues to yourself which no one else is testing (Assignee = Unassigned) and only assign one issue at a time. Some over-enthusiastic Moodlers have grabbed several issues at once  ;(

Otherwise, QA testing for 3.4 seems to be running pretty fast smile

Congratulations to all the participating Moodlers.

 
Average of ratings: -
Picture of Helen Foster
Re: Moodle 3.4 QA testing - assigning issues
Core developersDocumentation writersMoodle HQParticularly helpful MoodlersPlugin developersTestersTranslators

Thanks Germán for highlighting the point only assign one issue at a time. This was added to the QA testing guide to ensure that the QA cycle runs efficiently without delays.

Thus, if you've assigned several tests to yourself, please change any that you're not currently running back to Assignee = Unassigned.

From the QA testing dashboard I see we're now up to 98 (17%) passed and 12 (2%) failed. Please keep up the good work everybody! smile

 
Average of ratings: -
Picture of Luiggi Sansonetti
Re: Moodle 3.4 QA testing - assigning issues
Moodle Course Creator Certificate holdersParticularly helpful MoodlersPlugin developersTesters

Hi

I would like to do my mea culpa mixed

Because I am one of those enthusiasts who assign several issues at the same time.

I can explain my way of doing things :

Some tests are very similar and concern the same fields of actions (message between users, backup and restoration of course files ...).

So I reserve the set to work at the same time the elements. It's for me a little bit faster.

Some tasks performed for a test are sometimes the same for another test. And that's why, sometimes, I make links between the tests that I do. As here.

But I understand totally your comment.

I hope not to have harmed other motivated mooders too much, I will pay more attention to my approach afterwards.

Thank you for your understanding.

 
Average of ratings: Useful (3)
C'est moi :-)
Re: Moodle 3.4 QA testing - assigning issues
Documentation writersParticularly helpful MoodlersTestersTranslators

Hi,

I have to say that i understand Luiggi's way of thinking, and doing things, and must admit i would certainly do the same.

I my opinion, what is a problem is when people assign several issues, and don't work on them for several days.

If someone assigns several issues, but is working on it in the minutes (or hours) coming, i don't really see it as a real problem.

Séverin

 
Average of ratings: Useful (4)
Picture of Helen Foster
Re: Moodle 3.4 QA testing - assigning issues
Core developersDocumentation writersMoodle HQParticularly helpful MoodlersPlugin developersTestersTranslators

Well said Séverin - you're right, it's only a problem if someone assigns themselves a number of issues and then does nothing for several days.

It makes sense, especially for related issues which require a particular set-up as Luiggi describes, to be done by one tester, and for them to assign themselves more than one issue, as long as they intend to run the tests fairly promptly.

Thus, I have amended the QA testing guide to include:

Only assign one issue at a time unless you plan to test a number of related issues within the next 24 hours. In other words, don't assign several issues to yourself then do nothing for several days.

I hope it is OK now?

 
Average of ratings: Useful (5)
C'est moi :-)
Re: Moodle 3.4 QA testing - assigning issues
Documentation writersParticularly helpful MoodlersTestersTranslators

Thanks Helen!

I think it's really OK this way.

 
Average of ratings: -
Picture of Luiggi Sansonetti
Re: Moodle 3.4 QA testing - assigning issues
Moodle Course Creator Certificate holdersParticularly helpful MoodlersPlugin developersTesters

Thanks too big grin

(testing 5 issues at the same time tongueout)

 
Average of ratings: -
Picture of Fernando Acedo
Re: Moodle 3.4 QA testing - assigning issues
Particularly helpful MoodlersPlugin developersTesters

I'm guilty too  

I admit to assign several test scripts (TS) to myself. But all require a external test server and and all are related to site administration (mainly installation and configuration that are not possible in the QA server)

It means I need to set up a new server and then create an environment to test. And some of the TS need to install moodle (even 3 times) so it could take several hours to execute the test script. Once set up the server then some of the TS can be executed easily in a few minutes.

But I know that some users assign many TS and if not enough they even steal (yes, steal) the assigned TS to get more number of passed TS. That happened in the past and was solved so I hope not repeated again.

Not all the TS can be executed in a few minutes. Some need time and preparation before start.

 

 

 

 
Average of ratings: Useful (1)
Picture of Eduardo Kraus
Re: Moodle 3.4 QA testing - assigning issues
Plugin developersTesters

When I need new installations I execute like this:

git clone https://github.com/moodle/moodle/ moodletest

cd moodletest/

/usr/bin/php admin/cli/install.php --lang=pt_br --wwwroot=http://localhost/moodletest --dataroot=/var/moodletest-data --dbname=tes_moodle --dbuser=tes --dbpass=wS8KMu4 --fullname=Moodle --shortname=moodle --adminpass=1234Asdf## --adminemail=kraus@kraus.com --non-interactive=1 --agree-license=1 --allow-unstable=1

Or:

Command line Moodle installer, creates config.php and initializes database.
Please note you must execute this script with the same uid as apache
or use chmod/chown after installation.

Site defaults may be changed via local/defaults.php.

Options:
--chmod=OCTAL-MODE    Permissions of new directories created within dataroot.
                      Default is 2777. You may want to change it to 2770
                      or 2750 or 750. See chmod man page for details.
--lang=CODE           Installation and default site language.
--wwwroot=URL         Web address for the Moodle site,
                      required in non-interactive mode.
--dataroot=DIR        Location of the moodle data folder,
                      must not be web accessible. Default is moodledata
                      in the parent directory.
--dbtype=TYPE         Database type. Default is mysqli
--dbhost=HOST         Database host. Default is localhost
--dbname=NAME         Database name. Default is moodle
--dbuser=USERNAME     Database user. Default is root
--dbpass=PASSWORD     Database password. Default is blank
--dbport=NUMBER       Use database port.
--dbsocket=PATH       Use database socket, 1 means default. Available for some databases only.
--prefix=STRING       Table prefix for above database tables. Default is mdl_
--fullname=STRING     The fullname of the site
--shortname=STRING    The shortname of the site
--summary=STRING      The summary to be displayed on the front page
--adminuser=USERNAME  Username for the moodle admin account. Default is admin
--adminpass=PASSWORD  Password for the moodle admin account,
                      required in non-interactive mode.
--adminemail=STRING   Email address for the moodle admin account.
--upgradekey=STRING   The upgrade key to be set in the config.php, leave empty to not set it.
--non-interactive     No interactive questions, installation fails if any
                      problem encountered.
--agree-license       Indicates agreement with software license,
                      required in non-interactive mode.
--allow-unstable      Install even if the version is not marked as stable yet,
                      required in non-interactive mode.
--skip-database       Stop the installation before installing the database.
-h, --help            Print out this help

Example:
$sudo -u www-data /usr/bin/php admin/cli/install.php --lang=cs
 
Average of ratings: Useful (1)
Picture of Fernando Acedo
Re: Moodle 3.4 QA testing - assigning issues
Particularly helpful MoodlersPlugin developersTesters

How to install moodle is not the question. The test script says how to test the installation process and you MUST follow all the steps and test it in all the required ways.

And yes, cloning the repo is one of them but not the only.

 
Average of ratings: -
Picture of Helen Foster
Re: Moodle 3.4 QA testing - assigning issues
Core developersDocumentation writersMoodle HQParticularly helpful MoodlersPlugin developersTestersTranslators

Thanks Séverin, Luiggi and Fernando. Your feedback and points of view as experienced testers are most valuable. If the QA testing process can be improved further, please let us know.

Thanks also Fernando and anyone else who picks up tests requiring an external test server, as these do indeed generally require a lot more time to run.

 
Average of ratings: Useful (1)
Picture of Kahraman Bulut
Re: Moodle 3.4 QA testing - 11% passed after 24 hours
Testers

 Hi Helen, 

Another Moodler is here waiting to be added in the Testers list.

Looking forward to contribute to the community!

Thanks!

 
Average of ratings: -
Picture of Varun Richharia
Re: Help needed with Moodle 3.4 QA testing
 

Can i help? I'm new to this.

 
Average of ratings: -
Picture of Laurence Dumortier
Re: Help needed with Moodle 3.4 QA testing
Testers

Hi Helen,

You can add me if I can help for testing ...


Laurence

 
Average of ratings: -
Picture of Helen Foster
Re: Help needed with Moodle 3.4 QA testing
Core developersDocumentation writersMoodle HQParticularly helpful MoodlersPlugin developersTestersTranslators

Thanks Kahraman, Varun and Laurence. You should have all heard from me via Moodle messaging.

 
Average of ratings: -
Picture of Ankit Sharma
Re: Help needed with Moodle 3.4 QA testing
 

Hi Helen,

I would like to test Moodle 3.4 and was wondering if I could be added to the testers group.


Cheers


Ankit 

 
Average of ratings: -
Picture of Helen Foster
Re: Moodle 3.4 QA testing - almost 50% passed
Core developersDocumentation writersMoodle HQParticularly helpful MoodlersPlugin developersTestersTranslators

Thanks Ankit for volunteering to help, also Zied and Tõnis who messaged me.

From the QA testing dashboard, we're almost up to 50% passed with 22 (3%) failed. Please keep up the good work! smile

 
Average of ratings: -
Picture of Said Gadjibejli
Re: Moodle 3.4 QA testing - almost 50% passed
 

Hi Helen,



I've never done this before but I want to try.



Regards

Said.

 
Average of ratings: -
Picture of Steven Peters
Re: Help needed with Moodle 3.4 QA testing
Testers

Hello Helen,

I am new and would like to offer my help.

Thanks

Steven

 
Average of ratings: Useful (1)
Picture of Ziyad Muslat
Re: Help needed with Moodle 3.4 QA testing
Testers

Hi Helen,

How do I assign my self to a test"Gradebook restore works"?

 
Average of ratings: -
Picture of Ziyad Muslat
Re: Help needed with Moodle 3.4 QA testing
Testers

I don't seem to be able to assign any test.

 
Average of ratings: -
Picture of Helen Foster
Re: Help needed with Moodle 3.4 QA testing - just 97 tests waiting to be run
Core developersDocumentation writersMoodle HQParticularly helpful MoodlersPlugin developersTestersTranslators

Ziyad, you should now be able to pass and fail QA tests. (I have sent you a message about it.)

We currently have just 97 (16%) open Moodle 3.4 QA tests waiting to be run, so don't delay in getting involved!

 
Average of ratings: -