I also went to:
Course Administration > Users > Permissions
Here I checked to see if non-editing teachers had permissions to "Access all Groups"
The non-editing teacher is not listed as having this access, but when I check the account of a non-editing teacher, they can still see submissions from all people and not just their group.