Re: Freeze

This WebDNA talk-list message is from

2003


It keeps the original formatting.
numero = 47625
interpreted = N
texte = On 2/10/03 4:35 PM, John Hill wrote:> Could it be flushing large databases to disk after doing the requisit number > of append/updates? That could tie up the machine. Thanks john... This wasn't the problem but did put me on the track.I started watching some of the larger DBs.What I found in particular was one that had about 18,000 records (a discussion forum actually) what the major culprit for the seemingly 'freeze up'.You see the logic I used was: Find all starter threads for each thread lookup all threads that use the starter sku in reply field Use various math comparisons to check date of reply thread to show last post I had my max set to 30, but the search time on the an 18,000 (8 meg db) with tons o text, with 2 nested searches (90 searches per page).. Was kicking the server to the curb for about 5-8 seconds....Couple that with a 5-10pm traffic spike on that db and we had a server that appeared to be possessed. 2-3-4 people hitting it at once, or trying to anyway.So with much pain, I reworked the forum to include 3 new fields in each starter thread (reply count, reply date, reply time) Thus eliminating the need for any recursive searches.Search time went from 8 seconds... To .19 seconds....um yeah bug difference across multiple users. The pain was the clean up script that search all 18,000 records and gleaned the necessary data to get the db up to date (185 seconds per try)So human error was the cause for me (been running like this since 1999 - just not noticeable until lately due to size of db and increase in traffic)LOL.. Its the same code base for the SMSI webdna dev center forum ;-) though that looks like they will take quite some time to get 18,000 postings ... We can always improve our code!!!Lesson learned.Thanks for shove in the right direction though. Alex Alex J McCombie New World Media Chief Information Officer Drawer 607 800/724.8973 Fair Haven, NY 13064 Alex@NewWorldMedia.com http://OurClients.comInterface Designer WebDNA Programmer Database Designer------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
  1. Re: (OT) SERVER FREEZES ALL AT SAME TIME ( Ross Markbreiter 2004)
  2. Re: (OT) SERVER FREEZES ALL AT SAME TIME ( Grant Hulbert 2004)
  3. Re: (OT) SERVER FREEZES ALL AT SAME TIME ( Ross Markbreiter 2004)
  4. Re: (OT) SERVER FREEZES ALL AT SAME TIME ( Dylan Wood 2004)
  5. Re: (OT) SERVER FREEZES ALL AT SAME TIME ( Ross Markbreiter 2004)
  6. Re: (OT) SERVER FREEZES ALL AT SAME TIME ( Ross Markbreiter 2004)
  7. Re: (OT) SERVER FREEZES ALL AT SAME TIME ( Dylan Wood 2004)
  8. Re: (OT) SERVER FREEZES ALL AT SAME TIME ( Grant Hulbert 2004)
  9. Re: (OT) SERVER FREEZES ALL AT SAME TIME ( Ross Markbreiter 2004)
  10. Re: (OT) SERVER FREEZES ALL AT SAME TIME ( Alex McCombie 2004)
  11. Re: (OT) SERVER FREEZES ALL AT SAME TIME ( Ross Markbreiter 2004)
  12. Re: (OT) SERVER FREEZES ALL AT SAME TIME ( Ross Markbreiter 2004)
  13. Re: (OT) SERVER FREEZES ALL AT SAME TIME ( Alex McCombie 2004)
  14. Re: (OT) SERVER FREEZES ALL AT SAME TIME ( Dylan Wood 2004)
  15. (OT) SERVER FREEZES ALL AT SAME TIME ( Ross Markbreiter 2004)
  16. Re: Webcat engine freezes when [tcpconnect] can't connect (Rene van der Velde 2003)
  17. Re: Webcat engine freezes when [tcpconnect] can't connect (Alain Russell 2003)
  18. Webcat engine freezes when [tcpconnect] can't connect (Rene van der Velde 2003)
  19. Re: Freeze (Michael Davis 2003)
  20. Re: Freeze (Stuart Tremain 2003)
  21. Re: Freeze (Michael Davis 2003)
  22. Re: Freeze (Stuart Tremain 2003)
  23. Re: Freeze (Alex McCombie 2003)
  24. Re: Freeze (Michael Davis 2003)
  25. Re: Freeze (mmilists 2003)
  26. Re: Freeze (Stuart Tremain 2003)
  27. Re: Freeze (Dan Strong 2003)
  28. Re: Freeze (lb Lawrence 2003)
  29. Re: Freeze (lb Lawrence 2003)
  30. Re: Freeze (Dan Strong 2003)
  31. Re: Freeze (Jay Van Vark 2003)
  32. Re: Freeze (lb Lawrence 2003)
  33. Re: Temp DB (Was freeze) (Alain Russell 2003)
  34. Re: Temp DB (Was freeze) (Alex McCombie 2003)
  35. Re: Temp DB (Was freeze) (John Hill 2003)
  36. Re: Temp DB (Was freeze) (Alain Russell 2003)
  37. Re: Temp DB (Was freeze) (Alex McCombie 2003)
  38. Re: Temp DB (Was freeze) (Alex McCombie 2003)
  39. Re: Temp DB (Was freeze) (John Hill 2003)
  40. Re: Temp DB (Was freeze) (Kenneth Grome 2003)
  41. Temp DB (Was freeze) (Alex McCombie 2003)
  42. Re: Freeze (John Hill 2003)
  43. Re: Freeze (Kenneth Grome 2003)
  44. Re: Freeze (Scott Anderson 2003)
  45. Re: Freeze (Charles Kline 2003)
  46. Re: Freeze (Kenneth Grome 2003)
  47. Re: Freeze (Alex McCombie 2003)
  48. Re: Freeze (WJ Starck 2003)
  49. Re: Freeze (Kenneth Grome 2003)
  50. Re: Freeze (Alex McCombie 2003)
  51. Re: Freeze (Alex McCombie 2003)
  52. Re: Freeze (John Hill 2003)
  53. Re: Freeze (Alex McCombie 2003)
  54. Re: Freeze (Donovan 2003)
  55. Re: Freeze (John Hill 2003)
  56. Re: Freeze (Craig Forest 2003)
  57. Re: Freeze (Donovan 2003)
  58. Re: Freeze (Donovan 2003)
  59. Re: Freeze (Alex McCombie 2003)
  60. Re: Freeze (Don 2003)
  61. Re: Freeze (Donovan 2003)
  62. Re: Freeze (Alex McCombie 2003)
  63. Re: Freeze (lb Lawrence 2003)
  64. Re: Freeze (Brian Boegershausen 2003)
  65. Re: Freeze (Charles Kline 2003)
  66. Freeze (lb Lawrence 2003)
  67. Re: Emailer freezes under OSX (Paula E. Contini 2003)
  68. Emailer freezes under OSX (nelson 2003)
  69. Install Webcat 4.01 - Server Hard Freeze (Rupert Ravens 2000)
  70. Re: Server Freeze...not always (Grant Hulbert 1998)
  71. Re: Server Freeze (Kenneth Grome 1998)
  72. Re: Server Freeze (Peter Ostry 1998)
  73. Re: Server Freeze (Peter Ostry 1998)
  74. Re: Server Freeze (Sid Stary 1998)
  75. Re: Server Freeze (Britt T. 1998)
  76. Re: Server Freeze (Kenneth Grome 1998)
  77. Re: Server Freeze (bob 1998)
  78. Re: Server Freeze (dave spaulding 1998)
  79. Re: Server Freeze (Kenneth Grome 1998)
  80. Re: Server Freeze (Brian B. Burton 1998)
  81. Re: Server Freeze (Kenneth Grome 1998)
  82. Re: Server Freeze (Peter Ostry 1998)
  83. Re: Server Freeze (Sid Stary 1998)
  84. Re: Server Freeze (Brian B. Burton 1998)
  85. Re: Server Freeze (Brian B. Burton 1998)
  86. Re: Server Freeze (PCS Technical Support 1998)
  87. Re: Server Freeze (Kenneth Grome 1998)
  88. Server Freeze (Brian B. Burton 1998)
  89. Re: database freeze (Kenneth Grome 1997)
  90. database freeze (Dean Smith 1997)
  91. Re: WebSTAR 2.1 freezes my Mac (grichter@panavise.com (Gary Richter) 1997)
  92. Re: WebSTAR 2.1 freezes my Mac (Kenneth Grome 1997)
  93. Re: WebSTAR 2.1 freezes my Mac (grichter@panavise.com (Gary Richter) 1997)
  94. WebSTAR 2.1 freezes my Mac (Kenneth Grome 1997)
  95. Re: [format xs] freeze (Grant Hulbert 1997)
  96. Re: [format xs] freeze (Grant Hulbert 1997)
  97. Re: [format xs] freeze (Nelson Chen 1997)
  98. [format xs] freeze (Nelson Chen 1997)
On 2/10/03 4:35 PM, John Hill wrote:> Could it be flushing large databases to disk after doing the requisit number > of append/updates? That could tie up the machine. Thanks john... This wasn't the problem but did put me on the track.I started watching some of the larger DBs.What I found in particular was one that had about 18,000 records (a discussion forum actually) what the major culprit for the seemingly 'freeze up'.You see the logic I used was: Find all starter threads for each thread lookup all threads that use the starter sku in reply field Use various math comparisons to check date of reply thread to show last post I had my max set to 30, but the search time on the an 18,000 (8 meg db) with tons o text, with 2 nested searches (90 searches per page).. Was kicking the server to the curb for about 5-8 seconds....Couple that with a 5-10pm traffic spike on that db and we had a server that appeared to be possessed. 2-3-4 people hitting it at once, or trying to anyway.So with much pain, I reworked the forum to include 3 new fields in each starter thread (reply count, reply date, reply time) Thus eliminating the need for any recursive searches.Search time went from 8 seconds... To .19 seconds....um yeah bug difference across multiple users. The pain was the clean up script that search all 18,000 records and gleaned the necessary data to get the db up to date (185 seconds per try)So human error was the cause for me (been running like this since 1999 - just not noticeable until lately due to size of db and increase in traffic)LOL.. Its the same code base for the SMSI webdna dev center forum ;-) though that looks like they will take quite some time to get 18,000 postings ... We can always improve our code!!!Lesson learned.Thanks for shove in the right direction though. Alex Alex J McCombie New World Media Chief Information Officer Drawer 607 800/724.8973 Fair Haven, NY 13064 Alex@NewWorldMedia.com http://OurClients.comInterface Designer WebDNA Programmer Database Designer------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Alex McCombie

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

WebCat2 - [format thousands] (1997) Shopping problems with 2.1b3 acgi (1997) WebMerchant issues. [Resent] (2000) ConvertChars request (1999) Bannerad Demo (1998) What ports does Webcatalog use (2003) gateway application timeouts (1998) Custom Shipping Charges (1997) [WebDNA] Secure Cookies (2009) Multiple fields on 1 input (1997) [WebDNA] Using WebDNA with MAMP (2010) More! on [ShowCart] and GET vs. POST (1997) Need Sample Template - just purchased (1997) Error Log.db --however (1997) Access Denied! But why? (1997) WebCatalog Hosting (1996) Storebuilder, Smith-Micro Tech Support (2000) X etc.... (1999) [WebDNA] Secure Cookies (2009) Banners (1997)