As others have said, you can't delete the fields, but you can hide them from students under Administration -> Users -> Permissions -> User policies.
If you wanted to stop students entering values in their profiles, you could do a bit of CSS hiding on the profile edit page:
