Yes. You need a forum in group mode (click the little icon showing a person next to the forum name on the course home page until you see two persons). Then click on the forum and make sure that everyone is subscribed. Choose the group you want to mail to from the drop-down menu "Visible group". If you then post a message it will only be mailed to members of this group.