Have you ever run the MySQL tuner on your DB Server?
It makes excellent recommendations based on your Hardware. Remember to have backups of all configs before making any major changes to production servers!
The tuning primer shellscript is also a great tool.
Hope this helps.