Thanks Tim,
I agree with your analysis, and we plan to do some work to solve some existing issues and to reduce the amount of "screen scraping" we do.
I'll create a couple of issues in following weeks to start retrieving more structured information about questions (like the question options)