|
Just put this in your htaccess file in the root of each domain:
# Block bad spiders
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Sosospider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Baiduspider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Sogou
RewriteRule ^.* - [F,L]
You can add as many as you want , make sure the lines ends with [NC,OR] and with nothing for the last one
Using it for years and been tested ...
|