The posts (replies) send by email could be authenticated if they carried a "token" linking (joining) the reply to the post it is replying to.
Think about a token computed from the date, from the post id (the post you are replying to). The token is distributed in every email message. Only if the message comes from the right address and carry the right token would be posted to the forum.