Business AWE whitelabel & robots.txt - GoFuckYourself.com

pemevus · 11-08-2018, 08:23 AM

Hi guys,
is anyone here who is still using whitelabel site by AWE?
Now they are blocking googlebot in robots.txt:

Code:

User-agent: Googlebot
Disallow: /

User-agent: *
Allow: /
Crawl-delay: 1

Support doesnt replay me form more than 1 year...

bns666 · 11-08-2018, 08:40 AM

it's like that for a long time.

Denny · 11-08-2018, 08:49 AM

Quote:

Originally Posted by bns666

it's like that for a long time.

sarettah · 11-08-2018, 10:35 AM

Bump for biz

TFCash · 11-08-2018, 10:47 AM

Whitelabels are best used if you have your own source of traffic to send to them. If you want to get SE traffic to a site then your better off using a package that let's you build pages based on the Cam's and then direct traffic into the main sites. User blackmonsters here on gfy makes a WP plugin that pulls from a number of cam shops and let's you create pages for the girls that are online.

EconfirmPro

good luck

Freedoom · 11-08-2018, 10:53 AM

I related this issue to them a long time ago, and they replied to me:

They said they tried to give several options in the past to Webmasters so that we can customize our Whitelabels to have unique content on the site so that Google doesn't consider them as having thin content. Despite the efforts, Google started penalizing the Whitelabels, and they even started to penalize their brand sites.

So to avoid further penalties for the WhiteLabels and their sites alike, they canonicalized them to Livesex.com. They said that this way they are not indexed, but they also avoid being penalized.

Same goes not only for the WhiteLabels but to their sister sites, too (MyCams.com, LivePrivates, etc.).

Having more canonical links to Livesex.com might have been the side effect, but it was not the goal.

This was what they told me

xxx6live · 11-08-2018, 01:10 PM

Yeah,

and exactly therefore (the canonical) you should block it via robots.txt so it at least ranks for its domain name.

If you block it in robots.txt Google does not does not see the canonical. So it will rank for the domain name (but nothing else).

There is a checkbox in the "SEO" section saying "Allow robots" - remove it and it is disallowed via robots.txt.
.

incredibleworkethic · 11-08-2018, 01:27 PM

Quote:

Originally Posted by xxx6live

Yeah,

and exactly therefore (the canonical) you should block it via robots.txt so it at least ranks for its domain name.

If you block it in robots.txt Google does not does not see the canonical. So it will rank for the domain name (but nothing else).

There is a checkbox in the "SEO" section saying "Allow robots" - remove it and it is disallowed via robots.txt.
.

I have clicked allow robots and it was working before. I have been in contact with support they say they are having an issue and are working on it.

Not sure why it's taking so long to remove a line of text but it is.

RyuLion · 11-08-2018, 01:45 PM

Quote:

Originally Posted by TFCash

Whitelabels are best used if you have your own source of traffic to send to them. If you want to get SE traffic to a site then your better off using a package that let's you build pages based on the Cam's and then direct traffic into the main sites. User blackmonsters here on gfy makes a WP plugin that pulls from a number of cam shops and let's you create pages for the girls that are online.

EconfirmPro

good luck

11-08-2018, 08:23 AM	#1
pemevus Confirmed User Join Date: Oct 2002 Posts: 32	AWE whitelabel & robots.txt Hi guys, is anyone here who is still using whitelabel site by AWE? Now they are blocking googlebot in robots.txt: Code: User-agent: Googlebot Disallow: / User-agent: * Allow: / Crawl-delay: 1 Support doesnt replay me form more than 1 year...

11-08-2018, 08:40 AM	#2
bns666 Confirmed Fetishist Industry Role: Join Date: Mar 2005 Location: Fetishland Posts: 11,494	it's like that for a long time. __________________ ⭐ CAM SODA ⭐ STRIPCHAT ⭐ ⭐ CHATURBATE ⭐ SKYPE SEX CAMS ⭐

11-08-2018, 10:47 AM	#5
TFCash Confirmed User Industry Role: Join Date: Apr 2001 Posts: 1,738	Whitelabels are best used if you have your own source of traffic to send to them. If you want to get SE traffic to a site then your better off using a package that let's you build pages based on the Cam's and then direct traffic into the main sites. User blackmonsters here on gfy makes a WP plugin that pulls from a number of cam shops and let's you create pages for the girls that are online. EconfirmPro good luck __________________ TeenFlood.com Online since 1998. TFCash KissMeGirl VirginRiches MondoBucks tim at tfcash.com or submit a ticket at our HelpDesk

11-08-2018, 10:53 AM	#6
Freedoom Confirmed User Industry Role: Join Date: Feb 2006 Posts: 2,768	I related this issue to them a long time ago, and they replied to me: They said they tried to give several options in the past to Webmasters so that we can customize our Whitelabels to have unique content on the site so that Google doesn't consider them as having thin content. Despite the efforts, Google started penalizing the Whitelabels, and they even started to penalize their brand sites. So to avoid further penalties for the WhiteLabels and their sites alike, they canonicalized them to Livesex.com. They said that this way they are not indexed, but they also avoid being penalized. Same goes not only for the WhiteLabels but to their sister sites, too (MyCams.com, LivePrivates, etc.). Having more canonical links to Livesex.com might have been the side effect, but it was not the goal. This was what they told me __________________ List Of Sex Cams

11-08-2018, 01:10 PM	#7
xxx6live Confirmed User Industry Role: Join Date: Dec 2012 Location: Scandinavia Posts: 276	Yeah, and exactly therefore (the canonical) you should block it via robots.txt so it at least ranks for its domain name. If you block it in robots.txt Google does not does not see the canonical. So it will rank for the domain name (but nothing else). There is a checkbox in the "SEO" section saying "Allow robots" - remove it and it is disallowed via robots.txt. . __________________ Ebony Live Cams \| Vivo.cam all online \| Colombian girls

11-08-2018, 10:35 AM	#4
sarettah I'll make you famous Industry Role: Join Date: Oct 2002 Posts: 13,942	Bump for biz