Re: Why is deleting so slow?

This WebDNA talk-list message is from

2002


It keeps the original formatting.
numero = 42588
interpreted = N
texte = On 8/15/02 6:36 PM, Alain Russell mashed the following keys :> Mine deleted everything before a certain date .. It was a log file I forgot > about ;) > > Does the ST field only contain a letter - I would think this would go ok.Yup And like I said, [search db=^nwmls/data/current.tab&eqSTdata=E][numfound][/search] Pulls up 66,383 in about a sec and a half.So I think the sytax is right. The machine can copy the db very fast so it doesn;t really seem like an I/O issue. > > You sure you have the latest 4.5.0 full release ? > > What platform ? unix-Macintosh OS X Apache Module version 4.5.0It's on a dual xserve with 2gig of ram, Top sez webcat is taking 450 MB So it has lots of free ram,>> Did you delete 'everything' or a selective set? >> >> Here's my code >> [delete db=^nwmls/data/current.tab&woSTdata=E,X] >> >> I tried eqSTdata=E >> >> And it hung on that too. >> >> >> >> >> >> On 8/15/02 6:20 PM, Alain Russell mashed the following keys : >> >>> When I tried the new delete code it deleted 1 million records in no time at >>> all ?? Not sure what else you can try .. >>> >>>> Yes. >>>> >>>> Also, I tried setting 'only commit databases to disk when instructed' but >>>> it >>>> made no appreciable difference. >>>> >>>> >>>> On 8/15/02 5:20 PM, Alain Russell mashed the following keys : >>>> >>>>> The delete code was re-written in 4.5 .. >>>>> See the change notes. >>>>> Are you running the latest release ? >>>>> >>>>> Alain >>>>> >>>>>> We have a 400 MB db, which I realize is quite large, >>>>>> >>>>>> I'm trying to delete approximately 66,000 records (out of 450,000) >>>>>> And it pegs webcat @ 100% for over twenty minutes. >>>>>> >>>>>> Changing 'delete' into 'search' on the context yields a numfound result >>>>>> in >>>>>> about 2 seconds. >>>>>> >>>>>> I can use copyfile to copy the entire 400 megs in about 15 seconds, >>>>>> >>>>>> So why's webcatalog falling apart when trying to do large deletes or >>>>>> replaces? Is there anything I can do to alleviate the problem? (bump >>>>>> maxfound to a million or something?) >>>> >>>> >>>> ------------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list . >>>> To unsubscribe, E-mail to: >>>> To switch to the DIGEST mode, E-mail to >>>> >>>> Web Archive of this list is at: http://search.smithmicro.com/ >>> >>> >>> ------------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> To switch to the DIGEST mode, E-mail to >>> >>> Web Archive of this list is at: http://search.smithmicro.com/ >>> >> >> >> ------------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to >> >> Web Archive of this list is at: http://search.smithmicro.com/ > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://search.smithmicro.com/ > ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
  1. Re: Why is deleting so slow? (Aaron Lynch 2002)
  2. Re: Why is deleting so slow? (Aaron Lynch 2002)
  3. Re: Why is deleting so slow? (Alain Russell 2002)
  4. Re: Why is deleting so slow? (Aaron Lynch 2002)
  5. Re: Why is deleting so slow? (Alain Russell 2002)
  6. Re: Why is deleting so slow? (Aaron Lynch 2002)
  7. Re: Why is deleting so slow? (Alain Russell 2002)
  8. Why is deleting so slow? (Aaron Lynch 2002)
On 8/15/02 6:36 PM, Alain Russell mashed the following keys :> Mine deleted everything before a certain date .. It was a log file I forgot > about ;) > > Does the ST field only contain a letter - I would think this would go ok.Yup And like I said, [search db=^nwmls/data/current.tab&eqSTdata=E][numfound][/search] Pulls up 66,383 in about a sec and a half.So I think the sytax is right. The machine can copy the db very fast so it doesn;t really seem like an I/O issue. > > You sure you have the latest 4.5.0 full release ? > > What platform ? unix-Macintosh OS X Apache Module version 4.5.0It's on a dual xserve with 2gig of ram, Top sez webcat is taking 450 MB So it has lots of free ram,>> Did you delete 'everything' or a selective set? >> >> Here's my code >> [delete db=^nwmls/data/current.tab&woSTdata=E,X] >> >> I tried eqSTdata=E >> >> And it hung on that too. >> >> >> >> >> >> On 8/15/02 6:20 PM, Alain Russell mashed the following keys : >> >>> When I tried the new delete code it deleted 1 million records in no time at >>> all ?? Not sure what else you can try .. >>> >>>> Yes. >>>> >>>> Also, I tried setting 'only commit databases to disk when instructed' but >>>> it >>>> made no appreciable difference. >>>> >>>> >>>> On 8/15/02 5:20 PM, Alain Russell mashed the following keys : >>>> >>>>> The delete code was re-written in 4.5 .. >>>>> See the change notes. >>>>> Are you running the latest release ? >>>>> >>>>> Alain >>>>> >>>>>> We have a 400 MB db, which I realize is quite large, >>>>>> >>>>>> I'm trying to delete approximately 66,000 records (out of 450,000) >>>>>> And it pegs webcat @ 100% for over twenty minutes. >>>>>> >>>>>> Changing 'delete' into 'search' on the context yields a numfound result >>>>>> in >>>>>> about 2 seconds. >>>>>> >>>>>> I can use copyfile to copy the entire 400 megs in about 15 seconds, >>>>>> >>>>>> So why's webcatalog falling apart when trying to do large deletes or >>>>>> replaces? Is there anything I can do to alleviate the problem? (bump >>>>>> maxfound to a million or something?) >>>> >>>> >>>> ------------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list . >>>> To unsubscribe, E-mail to: >>>> To switch to the DIGEST mode, E-mail to >>>> >>>> Web Archive of this list is at: http://search.smithmicro.com/ >>> >>> >>> ------------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> To switch to the DIGEST mode, E-mail to >>> >>> Web Archive of this list is at: http://search.smithmicro.com/ >>> >> >> >> ------------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to >> >> Web Archive of this list is at: http://search.smithmicro.com/ > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://search.smithmicro.com/ > ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/ Aaron Lynch

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

HideIf ip= OR ip= (1998) Cleaner File Upload (2004) Lost and Recovered. (1998) Concealing WebCatalog in the URL (2000) SSL, WebSTAR, WebCatalog (1998) Draft Manual, Tutorial, and more (1997) Webstar Search and WebDNA (2000) [WebDNA] Decode Base64 Image (2019) Secure Server (1999) [WebDNA] Sorry WebDNA server not running. (2015) WebCat2b14MacPlugIn - [include] doesn't hide the search string (1997) [WebDNA] can webdna set the email header (w/[sendmail]) that controls where bounced email goes? (2012) The & Problem (1998) ConvertChars (1998) Re:E-Mailer (WebCatb15acgiMac) (1997) questions on variations of Ken's [text multi=T]var1=&var2=[/text] (1999) Searching multiple fields from one form field (1997) My X-Mas Wish (1999) [WebDNA] Calculate Cube root (2012) WebCommerce: Folder organization ? (1997)