Hello Sara,
Are you using the Dashboard or Sitehomepage? The setting you refer to is only affecting the Site Homepage.
The Dashboard has it's own sorting rules which are set by the student or teacher to be more personalized.
That could be the issue.
Chris