Ok- that may mean it's locked - Go to the admin block and click on site administration - plugins - blocks - manage blocks
there will be a lock icon next to each block installed on your site. Ensure the lock is toggled to "unlocked" next to the administration block - then you will be able to delete it and you can relock it after that.
