You only have to do it (more or less) once! How quick do you expect/want it to be? On decent hardware, I wouldn't describe Moodle installation as slow. It has a lot of database tables to set up.
Have you thought about loading a pre-built database image?