Hi,
you can disable the quiz in the administration, modules. Further you must delete the quiz folder in your installation.
But think about a lot of other grading options in other activities. You can't disable them all. You can disable the Grades-Link in the administration block of the course in administration - configuration.
Ralf