Re: Banning Bad Bots by UA
by bobmin(at)nidlink.com
|
| Date: |
Sat, 16 Jun 2001 17:49:20 -0700 |
| To: |
jim <jim(at)newglobal.net>, hwg-servers(at)hwg.org |
| References: |
makura |
| |
todo: View
Thread,
Original
|
|
Jim,
I don't have a solution for you, but I'd love to see that bot list when
you're done, if ever. There are so many bad bots, email extractors
and the like out there and far too many are already coming over as
if they were simply a browser, in effect spoofing the referrer.
Personally I think maintaining that list is going to end up being a full
time occupation.
- Bob Minnick, Northern Webs
On 16 Jun 2001, at 18:55, jim wrote:
> Hi folks,
>
> I was intending to use .htaccess to ban bots based on User Agent being used
> by less than the nicest of Netizens using Spiders and Bots that do not
> follow exclusion protocol. I'm running Apache servers but the build is to
> support Frontpage 2000 and has problems such that mod_rewrite won't compile
> in without going through a lot of pain. Any ideas that won't make me go the
> SSL route?
>
> Thanks,
>
> Jim
>
>
>
Bob Minnick, President, Northern Webs 208.265.0474 |
Mainpage: http://www.northernwebs.com
Meta Medic: http://www.northernwebs.com/set/setsimjr.html
SpiderView LC: http://www.northernwebs.com/set/spider_view.html
SpiderView DA: http://www.northernwebs.com/set/spider_view_da.html
HWG: hwg-servers mailing list archives,
maintained by Webmasters @ IWA
This page is part of a preserved archive of archives.hwg.org. The site is no longer active and its content is not maintained. For enquiries about this archive, write to archive(at)iwanet.org.