Hello, I run a self-hosted Moodle at a small University. I took over admin duties last Spring and have spent as much time as I can familiarize myself with the architecture but I did not originally build it out. We are entering the 5th year of running the same instance. It was originally 3.0 or 3.1, upgraded from 3.2->3.4 last year, then I recently upgraded it from 3.4 -> 3.6 a few weeks ago. We run Linux servers on VMWare: three webservers behind a load balancer, data on a shared NTFS mount, a memcached server, and a database with a separate read-only slave db.
Everything has been stable but today on the first day of classes the site is running somewhat sluggishly. Looking at metrics the webservers are fine but the database server is pegged at or near 100% since 9am this morning when usage started really ramping up. Looking at htop on the database server I can see there is one MySQL process that is using almost all of the CPU (see screenshot below)
I restarted the MySQL service and have rebooted the VM, hoping that this was a rogue runaway process, but neither has helped. I have some thoughts but am really hoping those in the community with more technical experience might be able to provide some insights.
- Is there a good way to identify what the MySQL process is? Maybe it's related to a plugin or something specific. I can log-in to the database and do SHOW FULL PROCESSLIST but not sure if I can get more information about that specific process to see what tables it's writing to.
- I admit I don't know much about memcached - is it possible the upgrade broke caching and this is putting extra strain on the DB? Is there an easy way to tell if caching is working or not? I am using the same config.php file after the upgrade. Is there somewhere else in Moodle GUI I should be looking?
- Is it possible something else in the upgrade broke that would cause something like this? Anything I should be looking at?
- Are we crazy for keeping a big Moodle install around for this many years without a fresh install?
Thanks in advance for any advice...if I left out any info that would be useful to know I'm sure I can get it. I've been enjoying learning more about administering Moodle with this community's help over the last year and hope this is a learning moment for me.