Change code in print_footer() in ..\lib\weblib.php will surelly work. There is a hard-coded $homelink varible to that icon. The drawback of this solution is that it will make site maintenance hard, especially when moodle upgrades.
I am thinking that there should have other way to remove it. Please let me know if anyone found a better solution.