Gradebook

There are different aggregation options for the course grade. I may be hidden behind a show advanced button, but if you edit the course grade item, you should see a "Aggregate only non-empty grades" option, which it sounds like you want to turn off.