|
|
|
|
||||
|
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
 |
|
|||||||
| Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
|
Thread Tools |
09-01-2013, 11:44 PM
|
#1 |
|
So Fucking Banned
Join Date: Jan 2005
Posts: 3,716
|
Does this look ok to you? GWT Question
Why the hell have my blocked by robots.txt pages shot up since the beginning of August?
 No idea if this is also behind the reason traffic has been falling. This is my robots.txt file [CODEUser-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: *?replytocom][/CODE] |
|
|
|
09-01-2013, 11:48 PM
|
#2 |
|
Confirmed User
Industry Role:
Join Date: Feb 2007
Posts: 6,904
|
not sure if I'm understanding your question correctly, but blocked by robots pages are now indexed, with the snippet 'a description of this page is not available because of this sites robot.txt' or smth similar.
|
|
|
|
|
09-01-2013, 11:57 PM
|
#3 |
|
Confirmed User
Industry Role:
Join Date: May 2012
Location: With your mom
Posts: 5,189
|
Go to parameters and disable urls with replytocom. Solved. Bye.
|
|
|
|
