So what features of 4.2 of Moodle exist that you just have to have?
4.1 is long term support - that's an important consideration!
Database requirements for 4.1
MariaDB 10.4 (increased since Moodle 4.0)You have 10.5 of MariaDB which is higher than the min.
Avoid "jumping out of the pan and into the fire" by upgrading to 4.1!
Then shop:
https://www.google.com/search?client=firefox-b-1-d&q=cheapst+VPS
Considerations:
Moodle 4.1 is long term support - no rush to get to 4.2 i there?
Hosting Flexibility to install versions of PHP/MySQL or MariaDB
Space
Considerations:
Moodle 4.1 is long term support - no rush to get to 4.2 i there?
Hosting Flexibility to install versions of PHP/MySQL or MariaDB
Space
Memory
But there is also 'last mile' ... how far away is server (hosting providers data centers) from you and your clients/students?
Sorry ... but ... even if you provide very detailed info about server needs, etc. that's beyond the scope of these forums! 
We could go on forever when it comes to price/cost/features! You have to do the research.
'SoS', Ken