I wish I had a solution but I do not. We are struggling with large question bank restores as well -- though not as terrible as 4 hours! We feel your pain though.
We recently found moosh http://moosh-online.com/commands/#course-restore and are interested in testing it to see if it does any better.
-- Scott