Apologies for the late reply, however I asked in our developer chat what the point was of the 'Download all' forum attachments button, to which Tim replied "that is a standard feature of the file picker form element."
I hadn't noticed it elsewhere before. I don't know how difficult it would be to remove, as I agee that it doesn't seem to serve any useful purpose.