Re: Table code broken?

This WebDNA talk-list message is from

2004


It keeps the original formatting.
numero = 60398
interpreted = N
texte = No, that value sets the maximum number of databases files that can be cached at any given moment. -----Original Message----- From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of Stuart Tremain Sent: Wednesday, December 08, 2004 02:36 PM To: WebDNA Talk Subject: Re: Table code broken? Scott Is that 100 = 100mb ? On 09/12/2004, at 8:15 AM, Scott Anderson wrote: > Just FYI... > > In the case where you find yourself needing to generating several > temporary > databases, you may want to take a look at your WebDNA 'CacheSizePrefs' > file > (introduced in WebDNA 4.5.1). WebDNA uses the settings in this file > to set > the size of the database and template caches, when starting up. The > 'stock' > settings are: > > DatabasesCacheSize100 > TemplatesCacheSize100 > > This file is located in the WebCatalogEngine folder. The WebDNA > process > must be restarted for the changes to take effect. > > Given the increasing amounts of RAM installed on servers these days, > you can > probably bump up the DatabasesCacheSize setting. This should reduce > the > amount of db swapping that WebDNA will be doing if the number of open > databases frequently reaches the cache size limit. Be careful when > increasing these values, as WebDNA does not currently handle the case > where > the increased number of databases does not fit in available RAM. > Perhaps > start at 150, then 175, and so on. If you find several error log > entries > where WebDNA failed to open a db due to lack of available RAM, then > back > down the cache size. > > -----Original Message----- > From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of > devaulw@onebox.com > Sent: Wednesday, December 08, 2004 12:41 PM > To: WebDNA Talk > Subject: Re: Table code broken? > > > Thanks for looking into this - I was pulling my hair out at 3am on > this one. > I was looking for a workaround to a temp database. I wanted to avoid > disk > writes and the possiblity of two people creating the same temp > database as > the same time. > > Perhaps I will keep tables for working sets of search results and > rename the > temp database to a cart name. There still is possibility of many db's > open > at the same time. > > Eventually I will move data to a permanent database, but WebDNA is so > fast > at creating these db's on the fly... > > Bill > > > -----Original Message----- > From: Scott Anderson > Sent: Wed, 8 Dec 2004 12:17:37 -0800 > To: "WebDNA Talk" > Subject: Re: Table code broken? > > There is no intentional limitation on table size. Available memory > should > be the only factor in limiting a table size. I'll take a closer look > at the > code to see if any other conditions exists that may limit the number of > records a table can hold. > > On a side note: The table context was created as a convenient way of > storing and manipulating smaller sets of data. Although storing > thousands > of records in a table should not be a problem, this can become quite > taxing > on your system resources if several request threads are creating > multiple > instances of large tables. In addition to all the WebDNA databases > that are > already cached in RAM, each WebDNA request thread maintains its own > list of > table objects. There currently is no way to 'share' a table resource > between threads. > > -----Original Message----- > From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of > devaulw@onebox.com > Sent: Wednesday, December 08, 2004 11:30 AM > To: WebDNA Talk > Subject: Re: Table code broken? > > > OK, these are identical in structure except for the directory or the > number > of dates. I assure you that there is a /Orders/ path on this server > (with > fewer than 10k order files in it). If I limit the number of entries > to the > table by restricting the date (SET 2 below), the problem disappears > for the > /Orders/ folder. See the three sets of code below for what works/what > doesn't. > > Is there a limit to either the number of entries in a table or the > size of a > table? There's no limit mentioned in the docs and there should be > plenty of > room to handle this on the server. > > Thanks, > Bill > > SET 1 THIS WORKS: > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/listfiles] > [search table=tab&neDACRdatarq=[blank]] > [founditems][ONO] [DACR]
[/founditems] > [/search] > > SET 2 THIS DATE RESTRICTED VERSION WORKS: > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/Orders] > [showif [math]{[moddate]}[/math]>[math]{[date]}-30[/math]] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/showif] > [/listfiles] > > SET 3 THIS UNRESTRICTED VERSION SHOWS NOTHING! > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/Orders/] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/listfiles] > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > Regards Stuart Tremain idfk web developments 114a/40 yeo street neutral bay 2089 australia t +612 9908 2134 f +612 9908 4837 ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
  1. Re: Table code broken? ( Stuart Tremain 2004)
  2. Re: Table code broken? ( "Scott Anderson" 2004)
  3. Re: Table code broken? ( Stuart Tremain 2004)
  4. Re: Table code broken? ( "Scott Anderson" 2004)
  5. Re: Table code broken? ( devaulw@onebox.com 2004)
  6. Re: Table code broken? ( "Scott Anderson" 2004)
  7. Re: Table code broken? ( devaulw@onebox.com 2004)
  8. Re: Table code broken? ( "Scott Anderson" 2004)
  9. Re: Table code broken? ( "Scott Anderson" 2004)
  10. Re: Table code broken? ( Larry Hewitt 2004)
  11. Re: Table code broken? ( devaulw@onebox.com 2004)
  12. Re: Table code broken? ( devaulw@onebox.com 2004)
  13. Re: Table code broken? ( Brian Fries 2004)
  14. Table code broken? ( devaulw@onebox.com 2004)
No, that value sets the maximum number of databases files that can be cached at any given moment. -----Original Message----- From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of Stuart Tremain Sent: Wednesday, December 08, 2004 02:36 PM To: WebDNA Talk Subject: Re: Table code broken? Scott Is that 100 = 100mb ? On 09/12/2004, at 8:15 AM, Scott Anderson wrote: > Just FYI... > > In the case where you find yourself needing to generating several > temporary > databases, you may want to take a look at your WebDNA 'CacheSizePrefs' > file > (introduced in WebDNA 4.5.1). WebDNA uses the settings in this file > to set > the size of the database and template caches, when starting up. The > 'stock' > settings are: > > DatabasesCacheSize100 > TemplatesCacheSize100 > > This file is located in the WebCatalogEngine folder. The WebDNA > process > must be restarted for the changes to take effect. > > Given the increasing amounts of RAM installed on servers these days, > you can > probably bump up the DatabasesCacheSize setting. This should reduce > the > amount of db swapping that WebDNA will be doing if the number of open > databases frequently reaches the cache size limit. Be careful when > increasing these values, as WebDNA does not currently handle the case > where > the increased number of databases does not fit in available RAM. > Perhaps > start at 150, then 175, and so on. If you find several error log > entries > where WebDNA failed to open a db due to lack of available RAM, then > back > down the cache size. > > -----Original Message----- > From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of > devaulw@onebox.com > Sent: Wednesday, December 08, 2004 12:41 PM > To: WebDNA Talk > Subject: Re: Table code broken? > > > Thanks for looking into this - I was pulling my hair out at 3am on > this one. > I was looking for a workaround to a temp database. I wanted to avoid > disk > writes and the possiblity of two people creating the same temp > database as > the same time. > > Perhaps I will keep tables for working sets of search results and > rename the > temp database to a cart name. There still is possibility of many db's > open > at the same time. > > Eventually I will move data to a permanent database, but WebDNA is so > fast > at creating these db's on the fly... > > Bill > > > -----Original Message----- > From: Scott Anderson > Sent: Wed, 8 Dec 2004 12:17:37 -0800 > To: "WebDNA Talk" > Subject: Re: Table code broken? > > There is no intentional limitation on table size. Available memory > should > be the only factor in limiting a table size. I'll take a closer look > at the > code to see if any other conditions exists that may limit the number of > records a table can hold. > > On a side note: The table context was created as a convenient way of > storing and manipulating smaller sets of data. Although storing > thousands > of records in a table should not be a problem, this can become quite > taxing > on your system resources if several request threads are creating > multiple > instances of large tables. In addition to all the WebDNA databases > that are > already cached in RAM, each WebDNA request thread maintains its own > list of > table objects. There currently is no way to 'share' a table resource > between threads. > > -----Original Message----- > From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of > devaulw@onebox.com > Sent: Wednesday, December 08, 2004 11:30 AM > To: WebDNA Talk > Subject: Re: Table code broken? > > > OK, these are identical in structure except for the directory or the > number > of dates. I assure you that there is a /Orders/ path on this server > (with > fewer than 10k order files in it). If I limit the number of entries > to the > table by restricting the date (SET 2 below), the problem disappears > for the > /Orders/ folder. See the three sets of code below for what works/what > doesn't. > > Is there a limit to either the number of entries in a table or the > size of a > table? There's no limit mentioned in the docs and there should be > plenty of > room to handle this on the server. > > Thanks, > Bill > > SET 1 THIS WORKS: > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/listfiles] > [search table=tab&neDACRdatarq=[blank]] > [founditems][ONO] [DACR]
[/founditems] > [/search] > > SET 2 THIS DATE RESTRICTED VERSION WORKS: > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/Orders] > [showif [math]{[moddate]}[/math]>[math]{[date]}-30[/math]] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/showif] > [/listfiles] > > SET 3 THIS UNRESTRICTED VERSION SHOWS NOTHING! > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/Orders/] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/listfiles] > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > Regards Stuart Tremain idfk web developments 114a/40 yeo street neutral bay 2089 australia t +612 9908 2134 f +612 9908 4837 ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ "Scott Anderson"

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

user/password validation (1998) dreamweaver (2000) [BoldWords] WebCat.acgib15Mac (1997) WebCat2b13MacPlugIn - [showif][search][/showif] (1997) Search for dates greater than [date] (1997) [WebDNA] Talklist Archive & Twitter (2009) Incrementing a number (1998) Resume Catalog ? (1997) Size issues (2001) Q: Japanese Kanji code support? (2000) Multiple prices (1997) Special delete ... (1997) [no_cache]?! (2000) send mail problem? (1997) Not carrying Zero (2000) Replace context problem ... (1997) what include am I using! (2005) question... no field names? (2002) WebMerchant & WebDelivery (2003) WC Bulletin Board Issue (2003)