Re: Simple problem (search engine; masking out include files)

by "Gary Krockover" <gary(at)garykrockover.com>

Date:	Fri, 13 Jun 2003 15:16:17 -0500
To:	"HWG" <hwg-techniques(at)mail.hwg.org>
References:	hwg
	todo: View Thread, Original

> I don't know if the robots no follow thing would work.......

Many of the "spam" bots will see a no-follow in a robots.txt and then jump
right in.....

GK

HWG hwg-techniques mailing list archives, maintained by Webmasters @ IWA