Hi,
Yes you are right. Cohort is a type of group which can be created Site-wide or Course/Category - wise.
Cohort sync helps you to enroll group of users in any course in a go.
In your case create Cohorts as per department on the site. Then use the cohorts as per the related course.