"I would like to simplify the quiz. I want a student to simply click on the quiz button, go to the quiz, answer, get their report and return to the course."
In my Moodle, with quizzes (T/F, MC) this is essentially what happens.
The first button "Finish Attempt" is very important. It allows students to review if they have answered all questions. This seems especially important for those not computer literate. It reminds the student that "this is what you have just done. Are you okay with it?" Without this step, you would have students (especially non-computer literate) saying to you "I didn't know that I forgot to answer question 5."
Next is "Submit all and finish." This button completes the quiz. I see no way to avoid a button that lets a student say "I am done."
Then, there is a confirmation button that is essentially "Are you sure?" This button is very common whenever anything very important is soon to happen. Without this confirmation, the non-computer literate person would complain to you that they were really not ready to finish. The "Are you sure" is a safeguard, and very similar to many systems where something very important is happening (like a student grade, or like transferring $1000 to a person, like submitting your taxes online, etc.)
At this point, the student is provided a review of their results. You seem to agree that this is needed, as I do.
At this point, the student can "Finish the review" which allows them to retake the quiz if multiple attempts are allowed, or they can click back into the main course.
So in four clicks, they are done. I really don't see any way that this can be simplified, especially for the teacher.
I have been using Moodle's quizzes for many years and I do not recall any single complaint by a student about this. However, suggestions like yours are always appreciated.