Of course, every activity in Moodle has a link back to the main course page as part of the standard navigation. The quiz is no exception.
However, it sounds like you are asking for this change, which was requested long ago: MDL-46095
Quiz
Impossible to get out of the Quiz: infinite loop
This discussion has been locked so you can no longer reply to it.