Hi,
I've just stumbled across the same problem.
It seems that once you've added a formula in the "edit calculation" of your "course total", this option becomes unavailable. Try to erase the formula and you'll find that the "exclude empty grades" reappears.
Anyway, I don't know how to make this option work with a custom course total calculation...
