Help needed with Moodle 3.1 QA testing

Help needed with Moodle 3.1 QA testing

von Helen Foster -
Anzahl Antworten: 42
Nutzerbild von Core developers Nutzerbild von Documentation writers Nutzerbild von Moodle HQ Nutzerbild von Particularly helpful Moodlers Nutzerbild von Plugin developers Nutzerbild von Testers Nutzerbild von Translators

Moodle 3.1 is due for release in four weeks from now, so we're running another Quality Assurance (QA) testing cycle, starting today: Moodle 3.1 QA. The list of over 500 tests includes tests covering new features and improvements in Moodle 3.1.

If you'd like to have a play with Moodle 3.1 on our QA testing site and at the same time help with QA testing, please read the QA testing guide and send me a message if you'd like to be added to the testers group in the Moodle Tracker. New testers are always welcome. lächelnd

We're aiming for a 100% pass rate of QA tests within the next three weeks, so all help is much appreciated!

Mittelwert:Useful (1)
Als Antwort auf Helen Foster

Re: Help needed with Moodle 3.1 QA testing

von Luiggi Sansonetti -
Nutzerbild von Particularly helpful Moodlers Nutzerbild von Plugin developers Nutzerbild von Testers

Hi Helen

If you want count me in, i'll take time to test Moodle 3.1 for the community, as I've done for 2.9 and 3.0 

Cheers (and let's gooooooooooooo)

Als Antwort auf Luiggi Sansonetti

Re: Moodle 3.1 QA testing and testers group

von Helen Foster -
Nutzerbild von Core developers Nutzerbild von Documentation writers Nutzerbild von Moodle HQ Nutzerbild von Particularly helpful Moodlers Nutzerbild von Plugin developers Nutzerbild von Testers Nutzerbild von Translators

Thanks Luiggi and everyone who has messaged me for offering to help.

Just noting that for anyone who has helped with a previous QA cycle, you'll still be included in the testers group in the tracker, as we never remove people from the group, only add more!

Als Antwort auf Helen Foster

Re: Help needed with Moodle 3.1 QA testing

von Alistair Spark -
Nutzerbild von Core developers Nutzerbild von Particularly helpful Moodlers Nutzerbild von Plugin developers

Isn't it a bit early to start QA considering the amount of features still pending integration?

Als Antwort auf Alistair Spark

Re: Help needed with Moodle 3.1 QA testing

von Luiggi Sansonetti -
Nutzerbild von Particularly helpful Moodlers Nutzerbild von Plugin developers Nutzerbild von Testers
Als Antwort auf Luiggi Sansonetti

Re: Help needed with Moodle 3.1 QA testing

von Alistair Spark -
Nutzerbild von Core developers Nutzerbild von Particularly helpful Moodlers Nutzerbild von Plugin developers
Als Antwort auf Alistair Spark

Re: Help needed with Moodle 3.1 QA testing

von Eloy Lafuente (stronk7) -
Nutzerbild von Core developers Nutzerbild von Documentation writers Nutzerbild von Moodle HQ Nutzerbild von Particularly helpful Moodlers Nutzerbild von Peer reviewers Nutzerbild von Plugin developers Nutzerbild von Testers

Hi Alistair (et all),

while it's true that still there are a number of issues which code has still not landed, this is something we were discussing/evaluating last week before deciding to proceed with the 3.1 QA round.

Basically what we have done is:

1) Whenever the issues are global (not about a given plugin) (CBE issues are the main ones of this type), we have preventively failed related existing QA tests, so nobody can try them. Once the feature is complete, they will be moved back to available.

2) When the issues are confined within the limits of a plugin (say mod_feedback, or mod_lti as 2 examples of plugins having pending issues), we have allowed related QA tests to be tried. The idea is that old described behaviors should continue working in a BC way. Also, of course, if we have time... the idea is to reset them once we are feature complete, so they are re-run with the final code.

3) Apart from the two points above, that are about existing QA tests... there is a number of new tests that are being created (right now) and have not been still added to the 3.1 QA round. They describe new behaviors/features and only will be tested when we are feature complete.

Basically we were discussing if was better to delay QA start or proceed with it ASAP, knowing that some test will need to be rerun (2) and will be added later (3). And looking forward to get possible problems detected earlier (and have time to fix them), we decided that starting ASAP was the best choice, with the exception of CBE (really transversal) being preventively failed to avoid problems till completed (1).

Let's see how it goes, sure we learn from it, thanks for your collaboration!

Ciao lächelnd

PS: Note I maybe slightly wrong/inaccurate with some of the points above, although I think that was, overall, the spirit of the decision. Sure that if any detail is wrong, somebody from HQ will clarify it soon.

Als Antwort auf Helen Foster

Re: Help needed with Moodle 3.1 QA testing

von Lewis Carr -
Als Antwort auf Lewis Carr

Re: Help needed with Moodle 3.1 QA testing

von Helen Foster -
Nutzerbild von Core developers Nutzerbild von Documentation writers Nutzerbild von Moodle HQ Nutzerbild von Particularly helpful Moodlers Nutzerbild von Plugin developers Nutzerbild von Testers Nutzerbild von Translators

Thanks Nicolas, Richard, Graham, Sasikala, Lewis and everyone who has messaged me. You should all be in the testers group in the tracker and thus see pass and fail buttons in open QA tests.

We're off to a flying start with 32 tests passed already, according to the QA testing dashboard! lächelnd

Als Antwort auf Helen Foster

Re: Help needed with Moodle 3.1 QA testing

von Eduardo Rodrigues -

Hi Helen,

I would like to participate in Q&A testing. Please add me in.

Thanks


Als Antwort auf Eduardo Rodrigues

Re: Help needed with Moodle 3.1 QA testing

von Helen Foster -
Nutzerbild von Core developers Nutzerbild von Documentation writers Nutzerbild von Moodle HQ Nutzerbild von Particularly helpful Moodlers Nutzerbild von Plugin developers Nutzerbild von Testers Nutzerbild von Translators

Thanks Ahmed, Lisa, Eduardo and everyone who has messaged me. You should have all received a message from me confirming that you are in the testers group.

After just 24 hours, we have 20% of tests (107) passed. Please keep up the good work everyone!

Als Antwort auf Helen Foster

Re: Help needed with Moodle 3.1 QA testing

von Sébastien Mehr -

Hello Helen,

I would like to participate too if it's possible.


Seb

Als Antwort auf Sébastien Mehr

Re: 3.1 QA testing - 45% passed in two days

von Helen Foster -
Nutzerbild von Core developers Nutzerbild von Documentation writers Nutzerbild von Moodle HQ Nutzerbild von Particularly helpful Moodlers Nutzerbild von Plugin developers Nutzerbild von Testers Nutzerbild von Translators

According to the QA testing dashboard after two days of QA testing there are now 237 tests (45%) passed! Many thanks everyone for your efforts.

Thanks to Seb for offering to help and to those of you who have messaged me. New testers are always welcome!

Als Antwort auf Helen Foster

Re: Help needed with Moodle 3.1 QA testing

von Antje Ritter -

Hi Helen,

I am new to the group but experienced moodle user and administrator.

Would gladly help out testing.

Kind regards,

Antje

Als Antwort auf Helen Foster

Re: Help needed with Moodle 3.1 QA testing

von Jackie Toledo -

count me in, please. Thanks

Als Antwort auf Jackie Toledo

Re: Help needed with Moodle 3.1 QA testing

von Rajesh Taneja -

Hello Jackie and Dave,


Thanks for offering to help with QA testing. Please create an account in the Moodle Tracker and let me know your Tracker username then I can add you to the testers group.


Als Antwort auf Rajesh Taneja

Re: Help needed with Moodle 3.1 QA testing

von Albert Ramsbottom -

I also would like to be a moodle QA tester and perhaps I could contribute in other ways as well as I have quite a lot of performance testing experience using JMeter, Selenium etc

Username

albertramsbottom


Thanks

Als Antwort auf Helen Foster

Re: Help needed with Moodle 3.1 QA testing

von Germán Valero -
Nutzerbild von Documentation writers Nutzerbild von Particularly helpful Moodlers Nutzerbild von Plugin developers Nutzerbild von Testers Nutzerbild von Translators

Hi Helen,

Somehow I managed to cause a new error (This quiz is not currently available) while testing MDLQA-9469 traurig

I wrote a  Docs page at https://docs.moodle.org/31/en/error/quiz/attempterror .


Als Antwort auf Germán Valero

Re: Help needed with Moodle 3.1 QA testing

von Rajesh Taneja -

Thanks for reporting this German,


I tried to reproduce the problem but it worked fine for me. 

The error message you pointed error/quiz/attempterror happens when attempt is prevented because of some condition. So surely at some point the student has no access to attempt and got the error.





Als Antwort auf Rajesh Taneja

Re: Help needed with Moodle 3.1 QA testing

von Germán Valero -
Nutzerbild von Documentation writers Nutzerbild von Particularly helpful Moodlers Nutzerbild von Plugin developers Nutzerbild von Testers Nutzerbild von Translators

Hi Rajesh,

I'll try to reproduce this error again in a fresh local Windows DEV server and get some screen dumps to illustrate it.

Als Antwort auf Helen Foster

Re: Help needed with Moodle 3.1 QA testing

von Himanshi Bhardwaj -

Please count me as well, I know it's bit late but would like to join in further testing if possible...

Username: himanshi

Thanks

Als Antwort auf Helen Foster

Re: Help needed with Moodle 3.1 QA testing

von Dominique-Alain Jan -
Nutzerbild von Testers

Oops,

I missed the start of QA testing this time. Luigi nudged me but I forgot. Did my bit today among what was still open and under my humble expertise.

3.1 is very soon now, thrilled to put CBT in action.

-dajan

Als Antwort auf Dominique-Alain Jan

Re: Help needed with Moodle 3.1 QA testing

von Séverin TERRIER -
Nutzerbild von Documentation writers Nutzerbild von Particularly helpful Moodlers Nutzerbild von Testers Nutzerbild von Translators

Sorry, no time for Moodle 3.1 QA testing. But i see all goes well lächelnd

I'll certainly take time again for futur versions.

Séverin

Als Antwort auf Helen Foster

Re: Help needed with Moodle 3.1 QA testing

von Avi Levy -
Nutzerbild von Core developers Nutzerbild von Plugin developers Nutzerbild von Testers

Hi Helen,

Do you still needs a testers? if so, let me know how can we help?

Als Antwort auf Avi Levy

Re: Help needed with Moodle 3.1 QA testing

von Rajesh Taneja -

Thanks for offering to help with QA testing Avi,


We are almost finished with the Moodle 3.1 QA cycle. There are currently 2% QA's left

  • 6 Fails
  • 6 Open (Mostly unit and acceptance tests)


Above is mostly being taken care by HQ at the moment, but if you think you can help with any of the left over issues then please feel free to do so.

Can you please message me your tracker id, so I can add you to the testers group.


Als Antwort auf Avi Levy

Re: Help needed with Moodle 3.1 QA testing

von Rajesh Taneja -

Thanks for offering to help with QA testing Avi.

I've added you to the testers group in the tracker, so you can now pass or fail QA tests. Hopefully the process is fully explained in http://docs.moodle.org/dev/QA_testing but if there's anything you're not sure about, please post in the Testing and QA forum.

Als Antwort auf Helen Foster

Re: Help needed with Moodle 3.1 QA testing

von Andy Hoang -

Hi Helen


I'd like to get involved as well! Sign me up

Als Antwort auf Andy Hoang

Re: Help needed with Moodle 3.1 QA testing

von Rajesh Taneja -

Thanks for offering to help with QA testing Andy. 

We recently finished the Moodle 3.1 QA cycle, so our next QA cycle won't be for a while, however you are welcome to try things out on our Moodle QA Testing site http://qa.moodle.net/ and post in the Testing and QA forum http://moodle.org/mod/forum/view.php?id=56 about any issues you come across, or any questions you have. 

If you come across any bugs (obvious problems), please report them in the Moodle tracker.

Als Antwort auf Helen Foster

Re: Help needed with Moodle 3.1 QA testing

von Rajesh Taneja -

Many thanks to our QA testers for helping with the 3.1 QA testing cycle. All 530 tests are now passed! lächelnd

Moodle 3.1rc1 has been already released. If you notice anything, then please let us know by posting in the forum



Als Antwort auf Rajesh Taneja

Re: Help needed with Moodle 3.1 QA testing

von murugan m -

M.Murugan

India.

I also want to involve in QA testing.

Please add my name also.

I have been using moodle for last four years. But I don't know from where I have start QA testing.