The Guest Enrolment method is usually added to all courses by default. If you don't want guests to access courses, turn it off. Additionally, you can prevent guest access to your whole site.
- In Administration > Site administration > Plugins > Enrolments > Manage enrol plugins, ensure Guest access is disabled (has its eye closed.)
- In Administration > Site administration > Plugins > Manage authentication set the Guest login button to Hide.