Actually, the files in the repo must go through: pluginfile.php. This means authentication etc... For example:
/pluginfile.php/3971/mod_book/chapter/2640/bear.mp4
What I'm looking for, as mentioned at the top is to make the repo a web site so that it can be accessed without authentication, for instance:
/repo/videos/bear.mp4