RE: global.asa shows up in search?
by Chuck Evans <Chucke(at)captura.com>
|
| Date: |
Wed, 19 Jan 2000 12:19:15 -0800 |
| To: |
"'Mike Taylor'" <lonewolf(at)one.net>, hwg-techniques(at)hwg.org |
| |
todo: View
Thread,
Original
|
|
Use a robots.txt file to exclude indexing of the global.asa file.
Create a text file named robots.txt and put it at the root of your server.
Put this in the file (any line starting with a # is a comment and can be
included as you wish):
# Start of robots.txt file
# Name which search spiders to allow or disallow (we're saying to look for
ALL spiders)
User-agent: *
# Disallow just the global.asa file on the root
Disallow: /global.asa
# End of robots.txt file
A disallow statement will work to match exactly what is shown, PLUS
EVERYTHING THAT MAY FOLLOW IT. So if you wanted to exclude your entire site
from indexing, you could put:
Disallow: /
If you wanted to exclude your "oldstuff" directory from searching, you could
put:
Disallow: /oldstuff/
Note that if you wrote Disallow: /oldstuff without the ending /, that if
there was a file called oldstuff.html on your root, it would also not be
indexed.
Hope this helps.
---------------------------------------------------------
Chuck Evans
Web Marketing Manager
Captura Software, Inc.
(425) 424-1155
chucke(at)captura.com
www.captura.com
-----Original Message-----
From: Mike Taylor [mailto:lonewolf(at)one.net]
Is there a way to prevent the global.asa from being indexed by the index
server? Obviously, meta tags won't work and there doesn't appear to be a
way to prevent the indexing of a specific file --only folders.
HWG hwg-techniques mailing list archives,
maintained by Webmasters @ IWA
This page is part of a preserved archive of archives.hwg.org. The site is no longer active and its content is not maintained. For enquiries about this archive, write to archive(at)iwanet.org.