Sometimes Moodle will autofill the password field from info saved in your browser. You just need to make sure that the page has loaded completely (no spinning icons anywhere and browser shows refresh/not stop icon) and then make that the password field is fully cleared out before hitting the save button.
If you reload the page, it will autofill that field again but as long as you don't save it, it will not actually stay in there.