I think I solved my own problem... it appears the reason the migration tool doesn't show up, is because everything is already utf8!!!
In the config.php file it says: $CFG->unicodedb = true; // Database is utf8
From what I read in some other forum posts, I think you need to set the above variable back to FALSE if you want the migration tool to show up on your admin menu.
I also checked my db and table structures manually and found this:
DB has collation: utf8_unicode_ci
Almost all tables in DB have collation: utf8_general_ci
All fields in most tables have collation: utf8_general_ci
So it looks like everything in the db is mostly migrated!
There are however 8 tables that have a different collation. The 8 tables all start with the name mdl_pma_xyz. They have a collation of utf8_bin instead of utf8_general_ci.
Do you think I show ALTER the collation of these tables to the utf8_general_ci before proceeding with the upgrade? Or do you think they are okay as is, since they are a utf8 format already?
Thanks for your responses!