I see it has been moved since I upgraded my site to 2.8 from 2.6. Go to categories and items and select "Edit settings" for the course (top level) category. On the settings page, click "show more" for the grade category section. Then uncheck "Exclude empty grades." See the image below. In older versions, a box needed to be checked to achieve this.