Re: SOP for WebDNA talk - MSNBot Crashing
This WebDNA talk-list message is from 2004
It keeps the original formatting.
numero = 57804
interpreted = N
texte = I don't mean to cause trouble here but I can't remember the lsat time I saw WebDNA crash .. not even under heavy load ..The first thing I would look for here is some bad code .. code that expects a cart to be passed, eg - what happens if you call the page with no cart= ?I just don't buy the webDNA crashing line anymore ..AlainOn 14/05/2004, at 6:59 AM, Paul Uttermohlen wrote:> Blocking the ranges of IP's used by the MSNBot servers via the > firewall did> the trick.... BUT the client wants the sites indexed by MSN.>> Gotta let them in... Gotta keep webcat from crashing a thousand times > an> hour...>> Paul>>>>> On 5/13/04 2:09 PM, "Gary Krockover"
wrote:>>> Can you do a redirect for MSNBots, something like:>>>> [showif [browsername]^MSNBOT]>> [redirect (to a static sitemap that has no links & doesn't carry the >> [cart])]>> [/showif]>>>> Not sure if that would rectify the problem, just thinking out loud....>>>> GK>>>> At 11:37 AM 5/13/2004, you wrote:>>> Scott,>>>>>> This looks like what I experienced last week. I tracked the cart >>> problems>>> down to MSNBot which was flooding the shopping cart folder with >>> carts. Many>>> of the carts had file names that where hundreds of characters long. >>> That was>>> partly due to the way I handle cart naming for repeat customers.>>>>>> MSNBot is beta. I think it is flawed. MSN insists that it's just>>> sophisticated. And perhaps it is WebDNA that is flawed.>>>>>> There may be some truth to that. Large volumes of carts or long file >>> names>>> for carts should not cause Webcatalog to crash, but it does... And >>> with>>> great frequency and predictability.>>>>>> So Scott, if there is anything that you can do to stop this crashing>>> behavior displayed when MSNBot floods our servers it would be greatly>>> appreciated.>>>>>> Crashes occur on 4.5.1, 5.0.1 and 6>>>>>> Thanks, Paul>>>>>> ------------------------------------------------------------->> This message is sent to you because you are subscribed to>> the mailing list .>> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to>> >> Web Archive of this list is at: http://webdna.smithmicro.com/>> ________________________________________________________> Paul Uttermohlen> http://www.Anoweb.com/> http://www.Uttermohlen.com/> Paul@Anoweb.com> Columbus, Ohio 43026> 614-529-8963> _______________________________________________________>>>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/>-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/
Associated Messages, from the most recent to the oldest:
I don't mean to cause trouble here but I can't remember the lsat time I saw WebDNA crash .. not even under heavy load ..The first thing I would look for here is some bad code .. code that expects a cart to be passed, eg - what happens if you call the page with no cart= ?I just don't buy the webDNA crashing line anymore ..AlainOn 14/05/2004, at 6:59 AM, Paul Uttermohlen wrote:> Blocking the ranges of IP's used by the MSNBot servers via the > firewall did> the trick.... BUT the client wants the sites indexed by MSN.>> Gotta let them in... Gotta keep webcat from crashing a thousand times > an> hour...>> Paul>>>>> On 5/13/04 2:09 PM, "Gary Krockover" wrote:>>> Can you do a redirect for MSNBots, something like:>>>> [showif [browsername]^MSNBOT]>> [redirect (to a static sitemap that has no links & doesn't carry the >> [cart])]>> [/showif]>>>> Not sure if that would rectify the problem, just thinking out loud....>>>> GK>>>> At 11:37 AM 5/13/2004, you wrote:>>> Scott,>>>>>> This looks like what I experienced last week. I tracked the cart >>> problems>>> down to MSNBot which was flooding the shopping cart folder with >>> carts. Many>>> of the carts had file names that where hundreds of characters long. >>> That was>>> partly due to the way I handle cart naming for repeat customers.>>>>>> MSNBot is beta. I think it is flawed. MSN insists that it's just>>> sophisticated. And perhaps it is WebDNA that is flawed.>>>>>> There may be some truth to that. Large volumes of carts or long file >>> names>>> for carts should not cause Webcatalog to crash, but it does... And >>> with>>> great frequency and predictability.>>>>>> So Scott, if there is anything that you can do to stop this crashing>>> behavior displayed when MSNBot floods our servers it would be greatly>>> appreciated.>>>>>> Crashes occur on 4.5.1, 5.0.1 and 6>>>>>> Thanks, Paul>>>>>> ------------------------------------------------------------->> This message is sent to you because you are subscribed to>> the mailing list .>> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to>> >> Web Archive of this list is at: http://webdna.smithmicro.com/>> ________________________________________________________> Paul Uttermohlen> http://www.Anoweb.com/> http://www.Uttermohlen.com/> Paul@Anoweb.com> Columbus, Ohio 43026> 614-529-8963> _______________________________________________________>>>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/>-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/
Alain Russell
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
WCf2 and nested tags (1997)
Database Import/Export (1998)
logic help (1998)
pay processing (2001)
How to verify email address (1997)
syntax for contains a word (2002)
[WebDNA] drop off not round off (2011)
Digest for 09-30-97 (1997)
WC2b15 File Corruption (1997)
[WebDNA] Migration from 6.2 to 7. Problems with writing to DB's (2012)
Attn: Bug in GeneralStore example b15 (1997)
WCS Newbie question (1997)
More DateMath problems (1997)
WebCat editing, SiteGuard WAS:SiteAssociative lookup style? (1997)
Virtual hosting and webcatNT (1997)
Firewalls - What's Good? (1999)
help with writefile (1998)
WebDNA 5.0 & WebMerchant (2003)
[OT] Looking for Work (2003)
So many lookers, hey smith micro (2003)