If you forget to set No Grade when adding the attendance activity it does add a grade item and does not remove it if you change the setting. If you select No Grade when adding the activity, it will not create the grade item.
You can simply set the activity to no grade and then manually delete the grade item from the grade book.