Hi Aoife,
The resource Folder is a Moodle's take on the file folder construct in an operating system. It can contain multiple subfolders and files, but only as files.
If you want to embed them into a page, label or section, or other HTML editable region, you should have a look at:
- resource Page
- resource Book
This way, the videos will only be visible after clicking on the resource's link on the course page.