Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact us.

Post New Thread Reply

Register GFY Rules Calendar
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
Chaturbate whitelabels that allow crawlers Chaturbate whitelabels that allow crawlers
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed.

 
Thread Tools
Old 05-15-2020, 06:59 AM   #1
xxify
Confirmed User
 
xxify's Avatar
 
Industry Role:
Join Date: Jun 2019
Posts: 138
Chaturbate whitelabels that allow crawlers
Hey guys,

I noticed there are many Chaturbate whitelabels with non-blocking robots.txt file.
Any idea how is it possible?

Some examples:
https://www.freecams6.com/
https://www.free-cams.ca/
https://www.freecamgirls.ca/
https://www.chaturbately.com/
xxify is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 05-15-2020, 11:33 AM   #2
xxx6live
Confirmed User
 
xxx6live's Avatar
 
Industry Role:
Join Date: Dec 2012
Location: Scandinavia
Posts: 276
Interesting idea for getting it indexed.

Seems like custom coded and hosted sites (using some files from cb).

When you click on login it redirects to my.<site> instead of www.<site> so the whitelabel is on my.<site>, and the whitelabel is robots.txt blocked as normal.

So the www is not whitelabels but self made sites.
xxx6live is online now   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 05-16-2020, 12:41 PM   #3
drexl
Whale Hunter
 
drexl's Avatar
 
Industry Role:
Join Date: Jan 2016
Posts: 931
Quote:
Originally Posted by xxx6live View Post
Interesting idea for getting it indexed.

Seems like custom coded and hosted sites (using some files from cb).

When you click on login it redirects to my.<site> instead of www.<site> so the whitelabel is on my.<site>, and the whitelabel is robots.txt blocked as normal.

So the www is not whitelabels but self made sites.
You're right about the login/register page but I don't see any promo tools that would allow to produce these sites. The code is very similar to whitelabel's, even the SSL cert is from the same authority.
__________________
drexl is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 05-16-2020, 03:11 PM   #4
Goethe
So Fuckin' Bored
 
Industry Role:
Join Date: Nov 2014
Location: Across the Universe
Posts: 1,077
Disclaimer is also Chaturbate whitelabel
__________________
yes
Goethe is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Post New Thread Reply
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
Chaturbate whitelabels that allow crawlers Chaturbate whitelabels that allow crawlers
« Previous Thread | Next Thread »

Bookmarks

Tags
chaturbate, https://www.free-cams.ca, https://www.freecams6.com, idea, whitelabels, crawlers



Advertising inquiries - marketing at gfy dot com

Contact Admin - Advertise - GFY Rules - Top

©2000-, AI Media Network Inc



Powered by vBulletin
Copyright © 2000- Jelsoft Enterprises Limited.