Re: Table code broken?

This WebDNA talk-list message is from

2004


It keeps the original formatting.
numero = 60398
interpreted = N
texte = No, that value sets the maximum number of databases files that can be cached at any given moment. -----Original Message----- From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of Stuart Tremain Sent: Wednesday, December 08, 2004 02:36 PM To: WebDNA Talk Subject: Re: Table code broken? Scott Is that 100 = 100mb ? On 09/12/2004, at 8:15 AM, Scott Anderson wrote: > Just FYI... > > In the case where you find yourself needing to generating several > temporary > databases, you may want to take a look at your WebDNA 'CacheSizePrefs' > file > (introduced in WebDNA 4.5.1). WebDNA uses the settings in this file > to set > the size of the database and template caches, when starting up. The > 'stock' > settings are: > > DatabasesCacheSize100 > TemplatesCacheSize100 > > This file is located in the WebCatalogEngine folder. The WebDNA > process > must be restarted for the changes to take effect. > > Given the increasing amounts of RAM installed on servers these days, > you can > probably bump up the DatabasesCacheSize setting. This should reduce > the > amount of db swapping that WebDNA will be doing if the number of open > databases frequently reaches the cache size limit. Be careful when > increasing these values, as WebDNA does not currently handle the case > where > the increased number of databases does not fit in available RAM. > Perhaps > start at 150, then 175, and so on. If you find several error log > entries > where WebDNA failed to open a db due to lack of available RAM, then > back > down the cache size. > > -----Original Message----- > From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of > devaulw@onebox.com > Sent: Wednesday, December 08, 2004 12:41 PM > To: WebDNA Talk > Subject: Re: Table code broken? > > > Thanks for looking into this - I was pulling my hair out at 3am on > this one. > I was looking for a workaround to a temp database. I wanted to avoid > disk > writes and the possiblity of two people creating the same temp > database as > the same time. > > Perhaps I will keep tables for working sets of search results and > rename the > temp database to a cart name. There still is possibility of many db's > open > at the same time. > > Eventually I will move data to a permanent database, but WebDNA is so > fast > at creating these db's on the fly... > > Bill > > > -----Original Message----- > From: Scott Anderson > Sent: Wed, 8 Dec 2004 12:17:37 -0800 > To: "WebDNA Talk" > Subject: Re: Table code broken? > > There is no intentional limitation on table size. Available memory > should > be the only factor in limiting a table size. I'll take a closer look > at the > code to see if any other conditions exists that may limit the number of > records a table can hold. > > On a side note: The table context was created as a convenient way of > storing and manipulating smaller sets of data. Although storing > thousands > of records in a table should not be a problem, this can become quite > taxing > on your system resources if several request threads are creating > multiple > instances of large tables. In addition to all the WebDNA databases > that are > already cached in RAM, each WebDNA request thread maintains its own > list of > table objects. There currently is no way to 'share' a table resource > between threads. > > -----Original Message----- > From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of > devaulw@onebox.com > Sent: Wednesday, December 08, 2004 11:30 AM > To: WebDNA Talk > Subject: Re: Table code broken? > > > OK, these are identical in structure except for the directory or the > number > of dates. I assure you that there is a /Orders/ path on this server > (with > fewer than 10k order files in it). If I limit the number of entries > to the > table by restricting the date (SET 2 below), the problem disappears > for the > /Orders/ folder. See the three sets of code below for what works/what > doesn't. > > Is there a limit to either the number of entries in a table or the > size of a > table? There's no limit mentioned in the docs and there should be > plenty of > room to handle this on the server. > > Thanks, > Bill > > SET 1 THIS WORKS: > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/listfiles] > [search table=tab&neDACRdatarq=[blank]] > [founditems][ONO] [DACR]
[/founditems] > [/search] > > SET 2 THIS DATE RESTRICTED VERSION WORKS: > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/Orders] > [showif [math]{[moddate]}[/math]>[math]{[date]}-30[/math]] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/showif] > [/listfiles] > > SET 3 THIS UNRESTRICTED VERSION SHOWS NOTHING! > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/Orders/] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/listfiles] > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > Regards Stuart Tremain idfk web developments 114a/40 yeo street neutral bay 2089 australia t +612 9908 2134 f +612 9908 4837 ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
  1. Re: Table code broken? ( Stuart Tremain 2004)
  2. Re: Table code broken? ( "Scott Anderson" 2004)
  3. Re: Table code broken? ( Stuart Tremain 2004)
  4. Re: Table code broken? ( "Scott Anderson" 2004)
  5. Re: Table code broken? ( devaulw@onebox.com 2004)
  6. Re: Table code broken? ( "Scott Anderson" 2004)
  7. Re: Table code broken? ( devaulw@onebox.com 2004)
  8. Re: Table code broken? ( "Scott Anderson" 2004)
  9. Re: Table code broken? ( "Scott Anderson" 2004)
  10. Re: Table code broken? ( Larry Hewitt 2004)
  11. Re: Table code broken? ( devaulw@onebox.com 2004)
  12. Re: Table code broken? ( devaulw@onebox.com 2004)
  13. Re: Table code broken? ( Brian Fries 2004)
  14. Table code broken? ( devaulw@onebox.com 2004)
No, that value sets the maximum number of databases files that can be cached at any given moment. -----Original Message----- From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of Stuart Tremain Sent: Wednesday, December 08, 2004 02:36 PM To: WebDNA Talk Subject: Re: Table code broken? Scott Is that 100 = 100mb ? On 09/12/2004, at 8:15 AM, Scott Anderson wrote: > Just FYI... > > In the case where you find yourself needing to generating several > temporary > databases, you may want to take a look at your WebDNA 'CacheSizePrefs' > file > (introduced in WebDNA 4.5.1). WebDNA uses the settings in this file > to set > the size of the database and template caches, when starting up. The > 'stock' > settings are: > > DatabasesCacheSize100 > TemplatesCacheSize100 > > This file is located in the WebCatalogEngine folder. The WebDNA > process > must be restarted for the changes to take effect. > > Given the increasing amounts of RAM installed on servers these days, > you can > probably bump up the DatabasesCacheSize setting. This should reduce > the > amount of db swapping that WebDNA will be doing if the number of open > databases frequently reaches the cache size limit. Be careful when > increasing these values, as WebDNA does not currently handle the case > where > the increased number of databases does not fit in available RAM. > Perhaps > start at 150, then 175, and so on. If you find several error log > entries > where WebDNA failed to open a db due to lack of available RAM, then > back > down the cache size. > > -----Original Message----- > From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of > devaulw@onebox.com > Sent: Wednesday, December 08, 2004 12:41 PM > To: WebDNA Talk > Subject: Re: Table code broken? > > > Thanks for looking into this - I was pulling my hair out at 3am on > this one. > I was looking for a workaround to a temp database. I wanted to avoid > disk > writes and the possiblity of two people creating the same temp > database as > the same time. > > Perhaps I will keep tables for working sets of search results and > rename the > temp database to a cart name. There still is possibility of many db's > open > at the same time. > > Eventually I will move data to a permanent database, but WebDNA is so > fast > at creating these db's on the fly... > > Bill > > > -----Original Message----- > From: Scott Anderson > Sent: Wed, 8 Dec 2004 12:17:37 -0800 > To: "WebDNA Talk" > Subject: Re: Table code broken? > > There is no intentional limitation on table size. Available memory > should > be the only factor in limiting a table size. I'll take a closer look > at the > code to see if any other conditions exists that may limit the number of > records a table can hold. > > On a side note: The table context was created as a convenient way of > storing and manipulating smaller sets of data. Although storing > thousands > of records in a table should not be a problem, this can become quite > taxing > on your system resources if several request threads are creating > multiple > instances of large tables. In addition to all the WebDNA databases > that are > already cached in RAM, each WebDNA request thread maintains its own > list of > table objects. There currently is no way to 'share' a table resource > between threads. > > -----Original Message----- > From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of > devaulw@onebox.com > Sent: Wednesday, December 08, 2004 11:30 AM > To: WebDNA Talk > Subject: Re: Table code broken? > > > OK, these are identical in structure except for the directory or the > number > of dates. I assure you that there is a /Orders/ path on this server > (with > fewer than 10k order files in it). If I limit the number of entries > to the > table by restricting the date (SET 2 below), the problem disappears > for the > /Orders/ folder. See the three sets of code below for what works/what > doesn't. > > Is there a limit to either the number of entries in a table or the > size of a > table? There's no limit mentioned in the docs and there should be > plenty of > room to handle this on the server. > > Thanks, > Bill > > SET 1 THIS WORKS: > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/listfiles] > [search table=tab&neDACRdatarq=[blank]] > [founditems][ONO] [DACR]
[/founditems] > [/search] > > SET 2 THIS DATE RESTRICTED VERSION WORKS: > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/Orders] > [showif [math]{[moddate]}[/math]>[math]{[date]}-30[/math]] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/showif] > [/listfiles] > > SET 3 THIS UNRESTRICTED VERSION SHOWS NOTHING! > [table name=tab&fields=ONO,DACR][/table] > [listfiles path=/Orders/] > [append > table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append] > [/listfiles] > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > > ------------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/ > > Regards Stuart Tremain idfk web developments 114a/40 yeo street neutral bay 2089 australia t +612 9908 2134 f +612 9908 4837 ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ ------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/ "Scott Anderson"

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

SQL Query Question (2001) WebDNA on Intel Mac? (2006) Date search - yes or no (1997) Num Sort Descending (2004) Some Questions (1997) Heads up, cookies *may* be outlawed in Europe (2001) shownext and searches (2002) WebCatalog [FoundItems] Problem - AGAIN - (1997) Silly Question (1997) breaking words (1997) Listserver problem (1997) Protecting databases (1999) WebCat2b14MacPlugIn - [include] doesn't hide the search string (1997) PIXO support (1997) HELP WITH DATES (1997) Shared conversion under WebTen (1998) Email template names (1997) More to Expire (1998) %@#*& back button!!! (1999) [OT] Mac Utility Required (2000)