Re: robots.txt

by George Bray <listoid(at)linkalarm.com>

Date:	Tue, 7 Nov 2000 01:33:36 +1100
To:	"tim booker" <timbooker(at)btinternet.com>, "wdf" <wdf(at)egroups.com>, "Hwg-Techniques" <hwg-techniques(at)hwg.org>
References:	btinternet
	todo: View Thread, Original

At 4:07 PM +0100 24/10/00, tim booker wrote:
>Could someone who is knowledgeable on the subject please take a look at
>http://timbooker.com/robots.txt
>
>I would like to know if I'm using the file correctly and if the syntax is
>correct.

Looks fine (6 Nov)

This tool is great for checking robots.txt syntax:

http://www.tardis.ed.ac.uk/home/sxw/robots/check/

	George

-- 
George Bray
http://www.linkalarm.com
LinkAlarm> Online Web Site Quality Assurance Service

HWG hwg-techniques mailing list archives, maintained by Webmasters @ IWA