Windows 2008 R2 FASTCGI_RAPID_FAILURE_PROTECTION

Windows 2008 R2 FASTCGI_RAPID_FAILURE_PROTECTION

by David H -
Number of replies: 4

Hello,

We have a set up below serving around 150 concurrent users during peak hours

CPU 6 cores/RAM 24G on VM
Windows 2008 R2
MS SQL 2016
Moodle 3.5
IIS 7.5 + FastCGI
PHP 7.2

While Moodle is running normally most of the time, occasionally we get 500 errors from IIS. After reviewing IIS trace files, we found that most of the errors have the error code FASTCGI_RAPID_FAILURE_PROTECTION (The FastCGI process has failed frequently recently. Try the request again in a while) from FastCGI. There is nothing in PHP error logs or Windows Event logs, which suggests that perhaps php-cgi.exe process is either busy or crashed. The errors also cannot be reproduced and usually happens consecutively within 10-30 requests once.

We have tweaked the settings but there's no luck. Here are the current relevant settings.

InstanceMaxRequests 10000
MaxInstances 0
ActivityTimeout/IdleTimeout/RequestTimeout/MaxExecutionTime 600
RapidFailsPerMinute 5

Also this issue only started to occur after we upgraded Moodle from 3.1 to 3.5

Please advise.


David

Average of ratings: -
In reply to David H

Re: Windows 2008 R2 FASTCGI_RAPID_FAILURE_PROTECTION

by Howard Miller -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers
Rather than leaving your question with no answers... I just wanted to point out that there are very few users around here with that depth of Windows knowledge. I don't want to raise your hopes of an answer.

Nearly everybody who frequents these forums runs Linux.
Average of ratings: -
In reply to David H

Re: Windows 2008 R2 FASTCGI_RAPID_FAILURE_PROTECTION

by Ken Task -
Picture of Particularly helpful Moodlers

Like Howard (Linux person) ... but ...

This past week there was a *critical* update to all of php 7.x series and it had to do with CGI.  Do Windows persons get announcements concerning updates for software that is not native to Windows (like PHP)?

Also ... rapid failure protections sound like server getting hit with request at a rapid rate (duh!) ... so can you check your IIS error logs (uhhhh, events) to see what 'rapid' might look like there?

'SoS', Ken

Average of ratings: -
In reply to David H

Re: Windows 2008 R2 FASTCGI_RAPID_FAILURE_PROTECTION

by Usman Asar -
Picture of Plugin developers Picture of Testers

David, are you using the correct PHP version? i.e. non-thread safe? 

Average of ratings: -
In reply to Usman Asar

Re: Windows 2008 R2 FASTCGI_RAPID_FAILURE_PROTECTION

by David H -
Yes it is NTS. We've been using this for a while and the issue is only happening after we upgraded to Moodle 3.5/PHP 7.2. Even our test instance has this error, which has minimal load (< 5 concurrent users)
Average of ratings: -