"When answered incorrectly it asks them if they want to retry,"
It should not, it should show this message: You have 2 attempt(s) remaining.
I expect you mixed up those Lesson settings:
Allow student review
Provide option to try a question again
Maximum number of attempt
Please post a copy or - better - a screenshot of your Lesson settings, especially the complete Flow control section.
Joseph