I've tried this again and it works if I use the user with the same email account as the Zoom account.
How can I allow my Moodle users to set up the Zoom meetings please?
The plugin uses JWT which requires that the users be members of your account and as you discovered, the user emails are used by default to match to the Zoom user accounts.