Re: Server Freeze
This WebDNA talk-list message is from 1998
It keeps the original formatting.
numero = 17840
interpreted = N
texte = >>So once again I'm searching for duplicate email addresses in a database (now >>5500 records). It locks up the server doing 5500 searches and 30+million >>comparisons There has to be a better way to do this. > >Are you nesting your searches, is that what's causing the slowdown? > >I thought we discussed this -- and ways to eliminate the problem -- in an >earlier thread.Yeah the searches are nested. Yeah, I could write out the info, for kicks I ran just a search of summ=T for the email address field and used a numfound to see how many originals there were. in a database of about 5500 records this took 26 seconds (locked the server) to tell me 5489 were unique. No nested searches were performed. In the meantime, the server wasn't available for http requests while this was running. I guess finding unique values is time consuming too, but Why isn't this a little better multithreaded?Also, when sending mass quantities of email, the server locks up while WebCatalog writes out 5500 files to the outgoing email directory this takes 3 to 5 minutes while the server can't be used. Brian B. Burton BOFH - Department of Redundancy Department --------------------------------------------------------------- MMT Solutions - Specializing in Online Shopping Solutions 973-808-8644 http://www.safecommerce.com
Associated Messages, from the most recent to the oldest:
>>So once again I'm searching for duplicate email addresses in a database (now >>5500 records). It locks up the server doing 5500 searches and 30+million >>comparisons There has to be a better way to do this. > >Are you nesting your searches, is that what's causing the slowdown? > >I thought we discussed this -- and ways to eliminate the problem -- in an >earlier thread.Yeah the searches are nested. Yeah, I could write out the info, for kicks I ran just a search of summ=T for the email address field and used a numfound to see how many originals there were. in a database of about 5500 records this took 26 seconds (locked the server) to tell me 5489 were unique. No nested searches were performed. In the meantime, the server wasn't available for http requests while this was running. I guess finding unique values is time consuming too, but Why isn't this a little better multithreaded?Also, when sending mass quantities of email, the server locks up while WebCatalog writes out 5500 files to the outgoing email directory this takes 3 to 5 minutes while the server can't be used. Brian B. Burton BOFH - Department of Redundancy Department --------------------------------------------------------------- MMT Solutions - Specializing in Online Shopping Solutions 973-808-8644 http://www.safecommerce.com
Brian B. Burton
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Change to 5.0 per website licensing (2003)
Integration with SQL (1997)
Another Search Question (2003)
Trouble with formula.db + more explanation (1997)
OS X (2000)
Some Questions (1997)
View Source from cache (1997)
searching by date range help needed (1997)
WebCat2b13MacPlugIn - [include] doesn't allow creator (1997)
expired beta (1997)
Unique SKU Numbers (2000)
Re:2nd WebCatalog2 Feature Request (1996)
Dummy Credit Card Number for debug? (1997)
[WebDNA] Hard-coded db write delay when running certain code? (2011)
RE: [WebDNA] webdna.us (2008)
Pithy questions on webcommerce & siteedit (1997)
Anyone using Verisign's Payflow Link for payment processing? (2000)
searching multiple databases in single search (1997)
For those of you not on the WebCatalog Beta... (1997)
Help formatting search results w/ table (1997)