Re: OT Re: Server capacity

This WebDNA talk-list message is from

2003


It keeps the original formatting.
numero = 46653
interpreted = N
texte = Glenn Busbin wrote:> > It sounds like a bot or two was pounding the site.Yes, I guess that's pretty obvious. No human surfer can possibly request documents at that speed.So, some [insert all swearing words you know] idiot has let a badly programmed spider loose on my poor site. :-(If this has happened every night at about the same time for thre weeks. I don't say it has (have to check the log files first), but *if* that's what's happened, how big is the chance it's an accident?> Do you know if a large number of the hits came from the same IP Address?Not yet. I'īm still waiting for the detailed log.> > I hope you have a good robots.txt file. It's not the best protection, but it's better than none. Putting the META tag for Robots may also help if the bot is following links.That would interefere with the legitimate bots visiting the site, and there's not much chance it'll work anyway. The guy behind this bot is clearly way to careless and/or incompetent to program a bot that reads robots.txt files and robot meta tags. Frank Nordberg http://www.musicaviva.com ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
Glenn Busbin wrote:> > It sounds like a bot or two was pounding the site.Yes, I guess that's pretty obvious. No human surfer can possibly request documents at that speed.So, some [insert all swearing words you know] idiot has let a badly programmed spider loose on my poor site. :-(If this has happened every night at about the same time for thre weeks. I don't say it has (have to check the log files first), but *if* that's what's happened, how big is the chance it's an accident?> Do you know if a large number of the hits came from the same IP Address?Not yet. I'īm still waiting for the detailed log.> > I hope you have a good robots.txt file. It's not the best protection, but it's better than none. Putting the META tag for Robots may also help if the bot is following links.That would interefere with the legitimate bots visiting the site, and there's not much chance it'll work anyway. The guy behind this bot is clearly way to careless and/or incompetent to program a bot that reads robots.txt files and robot meta tags. Frank Nordberg http://www.musicaviva.com ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Frank Nordberg

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

Setting up shop (1997) Attention all list readers (1997) New to WebCat, Help. (1998) WebMerchant Only reads 1.4 order files error (1997) Webmerchant quitting (1998) [OT] Happy Turkey Day! (2003) ListWords passing multi values in one form field (2000) [lookup] [search] Issue (2005) [isfile] ? (1997) + character mystery (2003) WebCat2b13MacPlugIn - [showif][search][/showif] (1997) [Case] on OS X (2000) creating a 60 fields database (1997) [shownext max (1997) ShowNext context limited to 500 hits? (2000) Errata: WCS Newbie question (1997) Repost: pulldown menu (2000) Multiple Merchant Accounts? (1997) Field names beginning with Reg.. (2002) Hiding HTML and breaking the page (1997)