Re: SOP for WebDNA talk - MSNBot Crashing

This WebDNA talk-list message is from

2004


It keeps the original formatting.
numero = 57804
interpreted = N
texte = I don't mean to cause trouble here but I can't remember the lsat time I saw WebDNA crash .. not even under heavy load .. The first thing I would look for here is some bad code .. code that expects a cart to be passed, eg - what happens if you call the page with no cart= ? I just don't buy the webDNA crashing line anymore .. Alain On 14/05/2004, at 6:59 AM, Paul Uttermohlen wrote: > Blocking the ranges of IP's used by the MSNBot servers via the > firewall did > the trick.... BUT the client wants the sites indexed by MSN. > > Gotta let them in... Gotta keep webcat from crashing a thousand times > an > hour... > > Paul > > > > > On 5/13/04 2:09 PM, "Gary Krockover" wrote: > >> Can you do a redirect for MSNBots, something like: >> >> [showif [browsername]^MSNBOT] >> [redirect (to a static sitemap that has no links & doesn't carry the >> [cart])] >> [/showif] >> >> Not sure if that would rectify the problem, just thinking out loud.... >> >> GK >> >> At 11:37 AM 5/13/2004, you wrote: >>> Scott, >>> >>> This looks like what I experienced last week. I tracked the cart >>> problems >>> down to MSNBot which was flooding the shopping cart folder with >>> carts. Many >>> of the carts had file names that where hundreds of characters long. >>> That was >>> partly due to the way I handle cart naming for repeat customers. >>> >>> MSNBot is beta. I think it is flawed. MSN insists that it's just >>> sophisticated. And perhaps it is WebDNA that is flawed. >>> >>> There may be some truth to that. Large volumes of carts or long file >>> names >>> for carts should not cause Webcatalog to crash, but it does... And >>> with >>> great frequency and predictability. >>> >>> So Scott, if there is anything that you can do to stop this crashing >>> behavior displayed when MSNBot floods our servers it would be greatly >>> appreciated. >>> >>> Crashes occur on 4.5.1, 5.0.1 and 6 >>> >>> Thanks, Paul >> >> >> ------------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to >> >> Web Archive of this list is at: http://webdna.smithmicro.com/ > > ________________________________________________________ > Paul Uttermohlen > http://www.Anoweb.com/ > http://www.Uttermohlen.com/ > Paul@Anoweb.com > Columbus, Ohio 43026 > 614-529-8963 > _______________________________________________________ > > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
  1. Re: SOP for WebDNA talk - MSNBot Crashing ( Paul Uttermohlen 2004)
  2. Re: SOP for WebDNA talk - MSNBot Crashing ( 2004)
  3. Re: SOP for WebDNA talk - MSNBot Crashing ( "Scott Anderson" 2004)
  4. Re: SOP for WebDNA talk - MSNBot Crashing ( Frank Nordberg 2004)
  5. Re: SOP for WebDNA talk - MSNBot Crashing ( 2004)
  6. Re: SOP for WebDNA talk - MSNBot Crashing ( 2004)
  7. Re: SOP for WebDNA talk - MSNBot Crashing ( Paul Uttermohlen 2004)
  8. Re: SOP for WebDNA talk - MSNBot Crashing ( Donovan Brooke 2004)
  9. Re: SOP for WebDNA talk - MSNBot Crashing ( Donovan Brooke 2004)
  10. Re: SOP for WebDNA talk - MSNBot Crashing ( 2004)
  11. Re: SOP for WebDNA talk - MSNBot Crashing ( Alain Russell 2004)
  12. Re: SOP for WebDNA talk - MSNBot Crashing ( 2004)
  13. Re: SOP for WebDNA talk - MSNBot Crashing ( Alain Russell 2004)
  14. Re: SOP for WebDNA talk - MSNBot Crashing ( Paul Uttermohlen 2004)
  15. Re: SOP for WebDNA talk - MSNBot Crashing ( Gary Krockover 2004)
  16. Re: SOP for WebDNA talk - MSNBot Crashing ( Paul Uttermohlen 2004)
I don't mean to cause trouble here but I can't remember the lsat time I saw WebDNA crash .. not even under heavy load .. The first thing I would look for here is some bad code .. code that expects a cart to be passed, eg - what happens if you call the page with no cart= ? I just don't buy the webDNA crashing line anymore .. Alain On 14/05/2004, at 6:59 AM, Paul Uttermohlen wrote: > Blocking the ranges of IP's used by the MSNBot servers via the > firewall did > the trick.... BUT the client wants the sites indexed by MSN. > > Gotta let them in... Gotta keep webcat from crashing a thousand times > an > hour... > > Paul > > > > > On 5/13/04 2:09 PM, "Gary Krockover" wrote: > >> Can you do a redirect for MSNBots, something like: >> >> [showif [browsername]^MSNBOT] >> [redirect (to a static sitemap that has no links & doesn't carry the >> [cart])] >> [/showif] >> >> Not sure if that would rectify the problem, just thinking out loud.... >> >> GK >> >> At 11:37 AM 5/13/2004, you wrote: >>> Scott, >>> >>> This looks like what I experienced last week. I tracked the cart >>> problems >>> down to MSNBot which was flooding the shopping cart folder with >>> carts. Many >>> of the carts had file names that where hundreds of characters long. >>> That was >>> partly due to the way I handle cart naming for repeat customers. >>> >>> MSNBot is beta. I think it is flawed. MSN insists that it's just >>> sophisticated. And perhaps it is WebDNA that is flawed. >>> >>> There may be some truth to that. Large volumes of carts or long file >>> names >>> for carts should not cause Webcatalog to crash, but it does... And >>> with >>> great frequency and predictability. >>> >>> So Scott, if there is anything that you can do to stop this crashing >>> behavior displayed when MSNBot floods our servers it would be greatly >>> appreciated. >>> >>> Crashes occur on 4.5.1, 5.0.1 and 6 >>> >>> Thanks, Paul >> >> >> ------------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to >> >> Web Archive of this list is at: http://webdna.smithmicro.com/ > > ________________________________________________________ > Paul Uttermohlen > http://www.Anoweb.com/ > http://www.Uttermohlen.com/ > Paul@Anoweb.com > Columbus, Ohio 43026 > 614-529-8963 > _______________________________________________________ > > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Alain Russell

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

WCf2 and nested tags (1997) Database Import/Export (1998) logic help (1998) pay processing (2001) How to verify email address (1997) syntax for contains a word (2002) [WebDNA] drop off not round off (2011) Digest for 09-30-97 (1997) WC2b15 File Corruption (1997) [WebDNA] Migration from 6.2 to 7. Problems with writing to DB's (2012) Attn: Bug in GeneralStore example b15 (1997) WCS Newbie question (1997) More DateMath problems (1997) WebCat editing, SiteGuard WAS:SiteAssociative lookup style? (1997) Virtual hosting and webcatNT (1997) Firewalls - What's Good? (1999) help with writefile (1998) WebDNA 5.0 & WebMerchant (2003) [OT] Looking for Work (2003) So many lookers, hey smith micro (2003)