Thanks for the quick reply Matteo. I think I finally figured it out. There are additional settings in IIS that I didn't change, especially the "FastCGI" settings that include the max number of requests, and activity timeout. I increased these numbers and everything is back to normal.
I hope it'll help others you may bump into these issues in the future!