We are also having this issue as we are just upgrading to 3.4.
To me, what is broken is the display of the file name, or alternately the image alt tag in brackets instead of file name if an alt tag exists. We understand not displaying the image here, but displaying code is not an acceptable alternative.