Tim, i realized that i didnt answer your question. No, i did not set the "how questions behave" to manual grading in the quiz setting. It is set for "immediate feedback".
Also, you mentioned that manual grading enables in the site admin is ok but dangerous. How so?
Do you have additional inputs on how i can go around this?