"Do not continue automatically" now works fine with my activities.
The "stop button", when activated, takes me back to the beginning of the exercise (entry page, in case there is one, or beginning of the quiz). From Antonio´s post, I assume this is the way it is supposed to be (?).
As a matter of fact, the stop button seems to serve quite well as a "retry"-button, something I always missed in hotpots.