On a large site, it can take ages to clear down the caches. Manually clear the cache and delete the cache directory in moodledata before you run the upgrade. It helps a bit.
This seems to have quietly improved in newer versions.
Installing and upgrading help
Slow upgrade from 3.1 to 3.3+
This discussion has been locked so you can no longer reply to it.