Re: Freeze
This WebDNA talk-list message is from 2003
It keeps the original formatting.
numero = 47625
interpreted = N
texte = On 2/10/03 4:35 PM, John Hill
wrote:> Could it be flushing large databases to disk after doing the requisit number > of append/updates? That could tie up the machine. Thanks john... This wasn't the problem but did put me on the track.I started watching some of the larger DBs.What I found in particular was one that had about 18,000 records (a discussion forum actually) what the major culprit for the seemingly 'freeze up'.You see the logic I used was: Find all starter threads for each thread lookup all threads that use the starter sku in reply field Use various math comparisons to check date of reply thread to show last post I had my max set to 30, but the search time on the an 18,000 (8 meg db) with tons o text, with 2 nested searches (90 searches per page).. Was kicking the server to the curb for about 5-8 seconds....Couple that with a 5-10pm traffic spike on that db and we had a server that appeared to be possessed. 2-3-4 people hitting it at once, or trying to anyway.So with much pain, I reworked the forum to include 3 new fields in each starter thread (reply count, reply date, reply time) Thus eliminating the need for any recursive searches.Search time went from 8 seconds... To .19 seconds....um yeah bug difference across multiple users. The pain was the clean up script that search all 18,000 records and gleaned the necessary data to get the db up to date (185 seconds per try)So human error was the cause for me (been running like this since 1999 - just not noticeable until lately due to size of db and increase in traffic)LOL.. Its the same code base for the SMSI webdna dev center forum ;-) though that looks like they will take quite some time to get 18,000 postings ... We can always improve our code!!!Lesson learned.Thanks for shove in the right direction though. Alex Alex J McCombie New World Media Chief Information Officer Drawer 607 800/724.8973 Fair Haven, NY 13064 Alex@NewWorldMedia.com http://OurClients.comInterface Designer WebDNA Programmer Database Designer------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/
Associated Messages, from the most recent to the oldest:
On 2/10/03 4:35 PM, John Hill wrote:> Could it be flushing large databases to disk after doing the requisit number > of append/updates? That could tie up the machine. Thanks john... This wasn't the problem but did put me on the track.I started watching some of the larger DBs.What I found in particular was one that had about 18,000 records (a discussion forum actually) what the major culprit for the seemingly 'freeze up'.You see the logic I used was: Find all starter threads for each thread lookup all threads that use the starter sku in reply field Use various math comparisons to check date of reply thread to show last post I had my max set to 30, but the search time on the an 18,000 (8 meg db) with tons o text, with 2 nested searches (90 searches per page).. Was kicking the server to the curb for about 5-8 seconds....Couple that with a 5-10pm traffic spike on that db and we had a server that appeared to be possessed. 2-3-4 people hitting it at once, or trying to anyway.So with much pain, I reworked the forum to include 3 new fields in each starter thread (reply count, reply date, reply time) Thus eliminating the need for any recursive searches.Search time went from 8 seconds... To .19 seconds....um yeah bug difference across multiple users. The pain was the clean up script that search all 18,000 records and gleaned the necessary data to get the db up to date (185 seconds per try)So human error was the cause for me (been running like this since 1999 - just not noticeable until lately due to size of db and increase in traffic)LOL.. Its the same code base for the SMSI webdna dev center forum ;-) though that looks like they will take quite some time to get 18,000 postings ... We can always improve our code!!!Lesson learned.Thanks for shove in the right direction though. Alex Alex J McCombie New World Media Chief Information Officer Drawer 607 800/724.8973 Fair Haven, NY 13064 Alex@NewWorldMedia.com http://OurClients.comInterface Designer WebDNA Programmer Database Designer------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/
Alex McCombie
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Nested tags count question (1997)
[writefile] (1997)
Emailer 2.1.1 delivers to bcc twice? (1998)
I give up!! (1997)
Emailer (1997)
WebCat 5 Intranet Question (2003)
RE: IIS4b2 and WebCatalog b19 (1997)
Sandbox DB permissions (2005)
Lost Password? (2002)
RE: Cart Template (1997)
Plugin or CGI or both (1997)
Problem with [Search] inside of [Loop]? (1997)
Template transformed itself into a database? (1998)
post (1997)
Deleting Multiple Database Records based on Checkbox (1998)
A little syntax help (1997)
New public beta available (1997)
Locking up with WebCatalog... (1997)
Wrapping text (1998)
Return records from another (1997)