The problem is that Moodle requires that every activity has a page .../view.php, and the page with the 'Attempt quiz' button is the Quiz's view.php page.
So, it is probably not feasible to remove it. Probably what you can do id to add some JavaScript, which, as soon as the page has loaded, automatically simulates clicking the button.