Behat test in developing process

Re: Behat test in developing process

by Tim Hunt -
Number of replies: 0
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers

Moodle HQ run all Behat tests each day, and they will now make a release unless all tests pass.

Skipped tests normally relate to features that relate to feature that require a particular thing to be set up. For example the On-screen assignment grading tests can only run if you have unoconv set up on your server. If you don't have that, those tests will be skipped. So, that is probably not a worry.

The failed tests are more interesting. You really need to investigate each failuer and see what went wrong. Our experience is that tests sometimes just fail randomly, so if you are running all the tests, you should use the re-run support (https://docs.moodle.org/dev/Running_acceptance_test#Rerun_failed_scenarios). Also, just differnet environments can cause different tests to fail. That can be worth fixing, because it basically makes Moodle more robust.