There are alot of images on the course page - this slows things down a bit as folks have to load all the images in the topic summaries to view the page.
Have you tried doing a traceroute to your server to see if the problem is in the network?
Also, if you print the performance info in your footer, that helps find if there is a server load problem. -If Moodle reports that the page took 3 seconds to assemble, but it takes you 10 seconds before you actually see your page, then you know part of the problem is in the network between your server and your machine.
The
firefox plug-in '
firebug' has a network tab that can give more information about what parts of the page are loading at what speed - which can help you discover whether the load problem is server side or client side (sometimes it is both).
By the way, this kind of content rich course is exactly what we built the 'flexpage' Moodle course format for

.
For an example of a content rich course in Flexpage, see here:
http://ciscoinstitute.net/course/view.php?id=76