Re: search engine question
by "Lois Wakeman" <lois(at)lois.co.uk>
|
| Date: |
Fri, 31 May 2002 10:18:03 +0100 |
| To: |
<hwg-techniques(at)mail.hwg.org>,
<EHDavies(at)West.com> |
| |
todo: View
Thread,
Original
|
|
Elizabeth,
A crawler starts at the page you submit and follows the links it finds. If
there is a robots.txt in the root of a domain, it uses this to see what to
do. If you submit the domain only, it uses the default index page
(obviously, as you hinted in your post).
Some submit pages only take a domain name, so there you are stuck with the
graphics page. Could you add a 1-pixel gif linked to a decent sitemap?
Of course, the algorithms that then determine how high to rank the site may
push this one way down because the first page is not content rich.
Lois Wakeman
------------------------------------------------------
http://lois.co.uk
http://siteusability.com
------------------------------------------------------
HWG hwg-techniques mailing list archives,
maintained by Webmasters @ IWA