Thread: robots.txt
View Single Post
Old 08-28-2011, 08:36 AM  
AdultKing
Raise Your Weapon
 
AdultKing's Avatar
 
Industry Role:
Join Date: Jun 2003
Location: Outback Australia
Posts: 15,601
Globbing and regular expressions are not supported by robots.txt generally

therefore the * has no effect.
AdultKing is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote