Hi Nicola
Although this may be too late, if you've gone through the steps of optimising your webserver and database server as in the performance docs and there is no improvement, then try the question in the Flash or Conditional Activities forums. From your description, it looks as if the way that the plugins work may need improving for large numbers of users.
Good luck!
Ken