I did recall this being discussed before. Here is a link to at least one set of discussions.
In my years of using Moodle with many students, and multiple attempts for many quizzes, students have not complained about the current method. The Quiz Navigation block provides features that the other LMS that my school has used (D2L, Blackboard, and Canvas) do not use. In fact, I was once showing my Canvas admin a quiz in Moodle and she said "What is that Navigation block? !!!" (sorry for the question and exclamations combined, but I think you get the message.)
No, I don't agree that the Next/Previous buttons be moved to the Quiz Navigation block. A student can click on any question in this block and be taken to that page. Next/Previous buttons in the Quiz Navigation block would be confusing.
I think that we, so far, have an agreement that if you are already in the Review mode for a quiz, the "Finish Attempt link" in the Quiz Navigation should not show since it (would) takes you to the very same web page.
In the previous discussion about the wording on the button, I suggested "Review Attempt," but Tim provided his view that this kind of wording was used elsewhere, so I am fine with "Finish Attempt..."
I am not sure about Dominique's suggestion to change one of the button's colors. Both buttons seem equally important, so I am fine with the same button color (grey in my Moodle.)
In my Moodle (3.6.4+), the Quiz Navigation block is on the right. This doesn't bother me, nor has any student ever complained about its position. So I am not sure where one would propose to move it.
Since I have never had a student tell me that they "really didn't want to submit," I like the additional confirmation pop-up.
I use quizzes a lot, allow many multiple attempts, and I use primarily multiple choice and T/F questions so that Moodle can automatically grade the quiz without my intervention. The current method has provided me freedom from having to mess with student questions and problems. The only thing that I have encountered is at the beginning of my course, when I give students a "Student Survey" to fill out, which lets them see Moodle's "Quiz Tool," I have maybe 1% of the students who do not click on the "Submit All and Finish" button. I send them an email reminding them to do so, and after that, no more problems. I am teaching college-age students.
It is good to see the process of students taking a Quiz given so much thought. At this point, I am in agreement with Tim's comments on the Tracker, except I don't know where the better location is for the Quiz Navigation block.
I did take a moment to look again at the Canvas quiz tool. They do have a quiz navigation area, but it is not anywhere as extensive as Moodle. However, when a student answers a question, immediately a check shows in the Quiz Navigation area. In Moodle, I think you have to hit a Next/Previous button for the Quiz Navigation to change. The Canvas quiz navigation area is not fixed in position. When the student scrolls down, the quiz navigation area moves out of sight - a problem. Canvas has a button for "Submit Quiz". If the student clicks on it, it is over (meaning submitted.) There is no review. A dialog box "Are you sure" only shows if the student has unanswered questions, with no indication of which questions are unanswered. Canvas relies totally on its navigation area as the only place where students can quickly see which questions are unanswered.
Quite honestly, I have chosen not to use Canvas. So I don't have any student experiences to share. Yes, some might say that Canvas provides a simpler interface than Moodle. Some would say "Simple is better." But not if it causes problems. But maybe a button that says "I'm done" allows an instructor to say to that student "You clicked on I'm Done, if you were not done that is your problem." I am not sure, but I do prefer Moodle's Quiz engine and Quiz Navigation over Canvas'.