Re: Table code broken?

This WebDNA talk-list message is from

2004


It keeps the original formatting.
numero = 60398
interpreted = N
texte = No, that value sets the maximum number of databases files that can be cached at any given moment. -----Original Message----- From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of Stuart Tremain Sent: Wednesday, December 08, 2004 02:36 PM To: WebDNA Talk Subject: Re: Table code broken? Scott Is that 100 = 100mb ? On 09/12/2004, at 8:15 AM, Scott Anderson wrote: > Just FYI... > > In the case where you find yourself needing to generating several > temporary > databases, you may want to take a look at your WebDNA 'CacheSizePrefs' > file > (introduced in WebDNA 4.5.1). WebDNA uses the settings in this file > to set > the size of the database and template caches, when starting up. The > 'stock' > settings are: > > DatabasesCacheSize100 > TemplatesCacheSize100 > > This file is located in the WebCatalogEngine folder. The WebDNA > process > must be restarted for the changes to take effect. > > Given the increasing amounts of RAM installed on servers these days, > you can > probably bump up the DatabasesCacheSize setting. This should reduce > the > amount of db swapping that WebDNA will be doing if the number of open > databases frequently reaches the cache size limit. Be careful when > increasing these values, as WebDNA does not currently handle the case > where > the increased number of databases does not fit in available RAM. > Perhaps > start at 150, then 175, and so on. If you find several error log > entries > where WebDNA failed to open a db due to lack of available RAM, then > back > down the cache size. > > -----Original Message----- > From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of > devaulw@onebox.com > Sent: Wednesday, December 08, 2004 12:41 PM > To: WebDNA Talk > Subject: Re: Table code broken? > > > Thanks for looking into this - I was pulling my hair out at 3am on > this one. > I was looking for a workaround to a temp database. I wanted to avoid > disk > writes and the possiblity of two people creating the same temp > database as > the same time. > > Perhaps I will keep tables for working sets of search results and > rename the > temp database to a cart name. There still is possibility of many db's > open > at the same time. > > Eventually I will move data to a permanent database, but WebDNA is so > fast > at creating these db's on the fly... > > Bill > > > -----Original Message----- > From: Scott Anderson > Sent: Wed, 8 Dec 2004 12:17:37 -0800 > To: "WebDNA Talk" > Subject: Re: Table code broken? > > There is no intentional limitation on table size. Available memory > should > be the only factor in limiting a table size. I'll take a closer look > at the > code to see if any other conditions exists that may limit the number of > records a table can hold. > > On a side note: The table context was created as a convenient way of > storing and manipulating smaller sets of data. Although storing > thousands > of records in a table should not be a problem, this can become quite > taxing > on your system resources if several request threads are creating > multiple > instances of large tables. In addition to all the WebDNA databases > that are > already cached in RAM, each WebDNA request thread maintains its own > list of > table objects. There currently is no way to 'share' a table resource > between threads. > > -----Original Message----- > From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of > devaulw@onebox.com > Sent: Wednesday, December 08, 2004 11:30 AM > To: WebDNA Talk > Subject: Re: Table code broken? > > > OK, these are identical in structure except for the directory or the > number > of dates. I assure you that there is a /Orders/ path on this server > (with > fewer than 10k order files in it). If I limit the number of entries > to the > table by restricting the date (SET 2 below), the problem disappears > for the > /Orders/ folder. See the three sets of code below for what works/what > doesn't. > > Is there a limit to either the number of entries in a table or the > size of a > table? There's no limit mentioned in the docs and there should be > plenty of > room to handle this on the server. > > Thanks, > Bill > > SET 1 THIS WORKS: > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/listfiles] > [search table=tab&neDACRdatarq=[blank]] > [founditems][ONO] [DACR]
[/founditems] > [/search] > > SET 2 THIS DATE RESTRICTED VERSION WORKS: > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/Orders] > [showif [math]{[moddate]}[/math]>[math]{[date]}-30[/math]] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/showif] > [/listfiles] > > SET 3 THIS UNRESTRICTED VERSION SHOWS NOTHING! > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/Orders/] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/listfiles] > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > Regards Stuart Tremain idfk web developments 114a/40 yeo street neutral bay 2089 australia t +612 9908 2134 f +612 9908 4837 ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
  1. Re: Table code broken? ( Stuart Tremain 2004)
  2. Re: Table code broken? ( "Scott Anderson" 2004)
  3. Re: Table code broken? ( Stuart Tremain 2004)
  4. Re: Table code broken? ( "Scott Anderson" 2004)
  5. Re: Table code broken? ( devaulw@onebox.com 2004)
  6. Re: Table code broken? ( "Scott Anderson" 2004)
  7. Re: Table code broken? ( devaulw@onebox.com 2004)
  8. Re: Table code broken? ( "Scott Anderson" 2004)
  9. Re: Table code broken? ( "Scott Anderson" 2004)
  10. Re: Table code broken? ( Larry Hewitt 2004)
  11. Re: Table code broken? ( devaulw@onebox.com 2004)
  12. Re: Table code broken? ( devaulw@onebox.com 2004)
  13. Re: Table code broken? ( Brian Fries 2004)
  14. Table code broken? ( devaulw@onebox.com 2004)
No, that value sets the maximum number of databases files that can be cached at any given moment. -----Original Message----- From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of Stuart Tremain Sent: Wednesday, December 08, 2004 02:36 PM To: WebDNA Talk Subject: Re: Table code broken? Scott Is that 100 = 100mb ? On 09/12/2004, at 8:15 AM, Scott Anderson wrote: > Just FYI... > > In the case where you find yourself needing to generating several > temporary > databases, you may want to take a look at your WebDNA 'CacheSizePrefs' > file > (introduced in WebDNA 4.5.1). WebDNA uses the settings in this file > to set > the size of the database and template caches, when starting up. The > 'stock' > settings are: > > DatabasesCacheSize100 > TemplatesCacheSize100 > > This file is located in the WebCatalogEngine folder. The WebDNA > process > must be restarted for the changes to take effect. > > Given the increasing amounts of RAM installed on servers these days, > you can > probably bump up the DatabasesCacheSize setting. This should reduce > the > amount of db swapping that WebDNA will be doing if the number of open > databases frequently reaches the cache size limit. Be careful when > increasing these values, as WebDNA does not currently handle the case > where > the increased number of databases does not fit in available RAM. > Perhaps > start at 150, then 175, and so on. If you find several error log > entries > where WebDNA failed to open a db due to lack of available RAM, then > back > down the cache size. > > -----Original Message----- > From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of > devaulw@onebox.com > Sent: Wednesday, December 08, 2004 12:41 PM > To: WebDNA Talk > Subject: Re: Table code broken? > > > Thanks for looking into this - I was pulling my hair out at 3am on > this one. > I was looking for a workaround to a temp database. I wanted to avoid > disk > writes and the possiblity of two people creating the same temp > database as > the same time. > > Perhaps I will keep tables for working sets of search results and > rename the > temp database to a cart name. There still is possibility of many db's > open > at the same time. > > Eventually I will move data to a permanent database, but WebDNA is so > fast > at creating these db's on the fly... > > Bill > > > -----Original Message----- > From: Scott Anderson > Sent: Wed, 8 Dec 2004 12:17:37 -0800 > To: "WebDNA Talk" > Subject: Re: Table code broken? > > There is no intentional limitation on table size. Available memory > should > be the only factor in limiting a table size. I'll take a closer look > at the > code to see if any other conditions exists that may limit the number of > records a table can hold. > > On a side note: The table context was created as a convenient way of > storing and manipulating smaller sets of data. Although storing > thousands > of records in a table should not be a problem, this can become quite > taxing > on your system resources if several request threads are creating > multiple > instances of large tables. In addition to all the WebDNA databases > that are > already cached in RAM, each WebDNA request thread maintains its own > list of > table objects. There currently is no way to 'share' a table resource > between threads. > > -----Original Message----- > From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of > devaulw@onebox.com > Sent: Wednesday, December 08, 2004 11:30 AM > To: WebDNA Talk > Subject: Re: Table code broken? > > > OK, these are identical in structure except for the directory or the > number > of dates. I assure you that there is a /Orders/ path on this server > (with > fewer than 10k order files in it). If I limit the number of entries > to the > table by restricting the date (SET 2 below), the problem disappears > for the > /Orders/ folder. See the three sets of code below for what works/what > doesn't. > > Is there a limit to either the number of entries in a table or the > size of a > table? There's no limit mentioned in the docs and there should be > plenty of > room to handle this on the server. > > Thanks, > Bill > > SET 1 THIS WORKS: > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/listfiles] > [search table=tab&neDACRdatarq=[blank]] > [founditems][ONO] [DACR]
[/founditems] > [/search] > > SET 2 THIS DATE RESTRICTED VERSION WORKS: > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/Orders] > [showif [math]{[moddate]}[/math]>[math]{[date]}-30[/math]] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/showif] > [/listfiles] > > SET 3 THIS UNRESTRICTED VERSION SHOWS NOTHING! > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/Orders/] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/listfiles] > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > Regards Stuart Tremain idfk web developments 114a/40 yeo street neutral bay 2089 australia t +612 9908 2134 f +612 9908 4837 ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ "Scott Anderson"

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

NumFound (1999) 2nd WebCatalog2 Feature Request (1996) Odd search results, or odd programmer, not sure which... (2002) RAM variables (1997) searchable list archive (1997) Some Questions (1997) time wrong in emails from emailer!? (2002) Multiple Pulldowns (1997) many-to-one problem (1998) Displaying text and populating form fields ... (2005) Erotic Sites (1997) WebCat2 - many [carts] on one template page? (1997) [WebDNA] Needing a new host.... (2013) The Guru Speaks-very long reply (1998) [WebDNA] Variable mystery (2009) [WebDNA] doesn't "&max=1" work in a [delete] context? (2009) Pls Remove me from all Lists (1998) All choice in popups (1997) suffix mapping, use of cache, etc. (1997) [WebDNA] Email Problem (2009)