We are experiencing the same issue but not related to inactive or deleted users.
By example: we have uploaded a PNG file at Course Summary fiiles.
When we deleted the file, it stays on the server files.
We have no idea how to deleted the file from the server.