whitelabel with robots.txt WTF? - GoFuckYourself.com

blinki bill · 01-07-2015, 08:58 AM

I was just looking at chaturbate's white labels and it seems they have it set with robots.txt that have disallow all! WTF!!?

I know that whitelabels don't do well with google this days, but while a lot of the programs try to program solutions that allow you to do extra customization to omit penalties, chaturbate seems to go the easy way and disable access to whitelabels to prevent penalties on their own site.

Am I missing something, is this common place these days? Why would you run a whitelabel with robots.txt file set like that?

freecartoonporn · 01-07-2015, 09:14 AM

Quote:

Originally Posted by blinki bill

I was just looking at chaturbate's white labels and it seems they have it set with robots.txt that have disallow all! WTF!!?

I know that whitelabels don't do well with google this days, but while a lot of the programs try to program solutions that allow you to do extra customization to omit penalties, chaturbate seems to go the easy way and disable access to whitelabels to prevent penalties on their own site.

Am I missing something, is this common place these days? Why would you run a whitelabel with robots.txt file set like that?

Quote:

Why would you run a whitelabel with robots.txt file set like that?

lets say you have pretty successful some other site tube/blog/tgp/mgp/tgp2 and you want to add your cam site with your brand to your network so you can send/push traffic from your successful site to wl cam site and make extra money.

nowadays there is no point in doing seo for wl, sooner or later there is google penalty for duplicate/thin content.

anyways thats my thinking. i may be wrong.

01-07-2015, 08:58 AM	#1
blinki bill Confirmed User Join Date: Oct 2006 Location: solar system, earth Posts: 123	whitelabel with robots.txt WTF? I was just looking at chaturbate's white labels and it seems they have it set with robots.txt that have disallow all! WTF!!? I know that whitelabels don't do well with google this days, but while a lot of the programs try to program solutions that allow you to do extra customization to omit penalties, chaturbate seems to go the easy way and disable access to whitelabels to prevent penalties on their own site. Am I missing something, is this common place these days? Why would you run a whitelabel with robots.txt file set like that?