Re: Banning Bad Bots by UA

by bobmin(at)nidlink.com

 Date:  Sat, 16 Jun 2001 17:49:20 -0700
 To:  jim <jim(at)newglobal.net>,
hwg-servers(at)hwg.org
 References:  makura
  todo: View Thread, Original
Jim,
 I don't have a solution for you, but I'd love to see that bot list when 
you're done, if ever. There are so many bad bots, email extractors 
and the like out there and far too many are already coming over as 
if they were simply a browser, in effect spoofing the referrer.  
Personally I think maintaining that list is going to end up being a full 
time occupation.

	 - Bob Minnick, Northern Webs

On 16 Jun 2001, at 18:55, jim wrote:

> Hi folks,
> 
> I was intending to use .htaccess to ban bots based on User Agent being used 
> by less than the nicest of Netizens using Spiders and Bots that do not 
> follow exclusion protocol. I'm running Apache servers but the build is to 
> support Frontpage 2000 and has problems such that mod_rewrite won't compile 
> in without going through a lot of pain. Any ideas that won't make me go the 
> SSL route?
> 
> Thanks,
> 
> Jim
> 
>   
> 


Bob Minnick, President, Northern Webs 208.265.0474                                                           |
Mainpage:      http://www.northernwebs.com
Meta Medic:    http://www.northernwebs.com/set/setsimjr.html
SpiderView LC: http://www.northernwebs.com/set/spider_view.html
SpiderView DA: http://www.northernwebs.com/set/spider_view_da.html

HWG: hwg-servers mailing list archives, maintained by Webmasters @ IWA

This page is part of a preserved archive of archives.hwg.org. The site is no longer active and its content is not maintained. For enquiries about this archive, write to archive(at)iwanet.org.