To delete a user, you go to Site Administration -> Users -> Browse list of users, from there you can click on the 'X' at the right end of the line of the user you wish to delete.
You can both un-enrol a participant from a course (while the user keeps access to the site) and delete a user from the site (thus freeing some space in your allocated 50 users quota).