Hi Visvanath,
https://github.com/moodlehq/moodle-performance-comparison was designed to be used in both scenarios, changing hardware, moodle versions or whatever you want, the base is that you will run the same test plan using the same data set as much times as you want, between runs you can change hardware, settings, moodle versions or whatever you want to compare.
The results of the test plan runs can be downloaded and restored (copying back in runs/) in other systems, so users controls all the changes they have done in the system (both hardware and software) and the tool allows you to compare them.