Re: robots.txt

by George Bray <listoid(at)linkalarm.com>

 Date:  Tue, 7 Nov 2000 01:33:36 +1100
 To:  "tim booker" <timbooker(at)btinternet.com>,
"wdf" <wdf(at)egroups.com>,
"Hwg-Techniques" <hwg-techniques(at)hwg.org>
 References:  btinternet
  todo: View Thread, Original
At 4:07 PM +0100 24/10/00, tim booker wrote:
>Could someone who is knowledgeable on the subject please take a look at
>http://timbooker.com/robots.txt
>
>I would like to know if I'm using the file correctly and if the syntax is
>correct.

Looks fine (6 Nov)

This tool is great for checking robots.txt syntax:

http://www.tardis.ed.ac.uk/home/sxw/robots/check/

	George

-- 
George Bray
http://www.linkalarm.com
LinkAlarm> Online Web Site Quality Assurance Service

HWG hwg-techniques mailing list archives, maintained by Webmasters @ IWA