From what I can tell, it has something to do with a restriction. I have a grouping set up so that only students in that grouping can access the topic block, but even though I am a member of both groups, it didn't allow me to view submissions. When I removed the restriction on the grouping and changed it to just restrict access to all of the groups in that grouping then I was able to view them again.