Quote:
Originally Posted by Barry-xlovecam
Both are easy to block at the firewall or from server request access  |
Something that Majestic's crawling software does manages to push my httpd process to 100%. This is not a runaway PHP script that gets killed off 60 seconds later - the process stays at 100%, until I manually kill it. Doesn't happen all the time, but when it does, a Majestic user-agent is involved. I still haven't figured out WHAT they're sending that triggers it.
It's a little troubling that a couple of non-malicious fetches from my web server manages to effortlessly DoS it.
