Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact us.

Post New Thread Reply

Register GFY Rules Calendar
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed.

 
Thread Tools
Old 01-07-2015, 08:58 AM   #1
blinki bill
Confirmed User
 
Join Date: Oct 2006
Location: solar system, earth
Posts: 123
whitelabel with robots.txt WTF?

I was just looking at chaturbate's white labels and it seems they have it set with robots.txt that have disallow all! WTF!!?

I know that whitelabels don't do well with google this days, but while a lot of the programs try to program solutions that allow you to do extra customization to omit penalties, chaturbate seems to go the easy way and disable access to whitelabels to prevent penalties on their own site.

Am I missing something, is this common place these days? Why would you run a whitelabel with robots.txt file set like that?
blinki bill is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 01-07-2015, 09:14 AM   #2
freecartoonporn
Confirmed User
 
freecartoonporn's Avatar
 
Industry Role:
Join Date: Jan 2012
Location: NC
Posts: 7,683
Quote:
Originally Posted by blinki bill View Post
I was just looking at chaturbate's white labels and it seems they have it set with robots.txt that have disallow all! WTF!!?

I know that whitelabels don't do well with google this days, but while a lot of the programs try to program solutions that allow you to do extra customization to omit penalties, chaturbate seems to go the easy way and disable access to whitelabels to prevent penalties on their own site.

Am I missing something, is this common place these days? Why would you run a whitelabel with robots.txt file set like that?
Quote:
Why would you run a whitelabel with robots.txt file set like that?
lets say you have pretty successful some other site tube/blog/tgp/mgp/tgp2 and you want to add your cam site with your brand to your network so you can send/push traffic from your successful site to wl cam site and make extra money.

nowadays there is no point in doing seo for wl, sooner or later there is google penalty for duplicate/thin content.

anyways thats my thinking. i may be wrong.
freecartoonporn is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Post New Thread Reply
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >

Bookmarks

Tags
penalties, robots.txt, set, whitelabel, whitelabels



Advertising inquiries - marketing at gfy dot com

Contact Admin - Advertise - GFY Rules - Top

©2000-, AI Media Network Inc



Powered by vBulletin
Copyright © 2000- Jelsoft Enterprises Limited.