RE: global.asa shows up in search?

by Chuck Evans <Chucke(at)captura.com>

 Date:  Wed, 19 Jan 2000 12:19:15 -0800
 To:  "'Mike Taylor'" <lonewolf(at)one.net>,
hwg-techniques(at)hwg.org
  todo: View Thread, Original
Use a robots.txt file to exclude indexing of the global.asa file.

Create a text file named robots.txt and put it at the root of your server.
Put this in the file (any line starting with a # is a comment and can be
included as you wish):



# Start of robots.txt file

# Name which search spiders to allow or disallow (we're saying to look for
ALL spiders)

User-agent: *

# Disallow just the global.asa file on the root

Disallow: /global.asa

# End of robots.txt file



A disallow statement will work to match exactly what is shown, PLUS
EVERYTHING THAT MAY FOLLOW IT. So if you wanted to exclude your entire site
from indexing, you could put:

Disallow: /

If you wanted to exclude your "oldstuff" directory from searching, you could
put:

Disallow: /oldstuff/

Note that if you wrote Disallow: /oldstuff without the ending /, that if
there was a file called oldstuff.html on your root, it would also not be
indexed.

Hope this helps.

---------------------------------------------------------
Chuck Evans
Web Marketing Manager
Captura Software, Inc.
(425) 424-1155
chucke(at)captura.com
www.captura.com


-----Original Message-----
From: Mike Taylor [mailto:lonewolf(at)one.net]

Is there a way to prevent the global.asa from being indexed by the index
server?  Obviously, meta tags won't work and there doesn't appear to be a
way to prevent the indexing of a specific file --only folders.

HWG hwg-techniques mailing list archives, maintained by Webmasters @ IWA

This page is part of a preserved archive of archives.hwg.org. The site is no longer active and its content is not maintained. For enquiries about this archive, write to archive(at)iwanet.org.