A work around I have just found that helps is setting the role on the cohort enrolment instance for the old course to "None". This does mean that the users still get enrolled but since they don't have any role they can't do anything and they don't get the course in their list of courses.
Enrolment
Disable Cohort Sync
This discussion has been locked so you can no longer reply to it.