Hi Matthew,
a good question. AFAIK gradebook doesn't filter by group by default. you need to tweak the activity settings for this. you might also wish to try this for groupings.
Common module settings
Group mode: Separate groups
Grouping: None
Visible: Hide