Thanks @Ken Task. Going through Apache was giving me nothing at all in the error logs but that was probably due to the debug settings that I was unaware of.
Once they were turned on I had a theme error on the CLI upgrade. It was related to block_overview_course_renderer. I had to add that legacy block module to the site and change to using the namespaced class name to continue.