You are deleting it, but it gets automatically recreated so that the "latest news" block has something to show.
So do this: before deleting the forum, remove the "Latest News" block (in pre-block versions of Moodle just go into Course Settings and set the number of news items to zero).
Forum
Forum Sticking
This discussion has been locked so you can no longer reply to it.