Re: Table code broken?
This WebDNA talk-list message is from 2004
It keeps the original formatting.
numero = 60396
interpreted = N
texte = ScottIs that 100 = 100mb ?On 09/12/2004, at 8:15 AM, Scott Anderson wrote:> Just FYI...>> In the case where you find yourself needing to generating several > temporary> databases, you may want to take a look at your WebDNA 'CacheSizePrefs' > file> (introduced in WebDNA 4.5.1). WebDNA uses the settings in this file > to set> the size of the database and template caches, when starting up. The > 'stock'> settings are:>> DatabasesCacheSize100> TemplatesCacheSize100>> This file is located in the WebCatalogEngine folder. The WebDNA > process> must be restarted for the changes to take effect.>> Given the increasing amounts of RAM installed on servers these days, > you can> probably bump up the DatabasesCacheSize setting. This should reduce > the> amount of db swapping that WebDNA will be doing if the number of open> databases frequently reaches the cache size limit. Be careful when> increasing these values, as WebDNA does not currently handle the case > where> the increased number of databases does not fit in available RAM. > Perhaps> start at 150, then 175, and so on. If you find several error log > entries> where WebDNA failed to open a db due to lack of available RAM, then > back> down the cache size.>> -----Original Message-----> From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of> devaulw@onebox.com> Sent: Wednesday, December 08, 2004 12:41 PM> To: WebDNA Talk> Subject: Re: Table code broken?>>> Thanks for looking into this - I was pulling my hair out at 3am on > this one.> I was looking for a workaround to a temp database. I wanted to avoid > disk> writes and the possiblity of two people creating the same temp > database as> the same time.>> Perhaps I will keep tables for working sets of search results and > rename the> temp database to a cart name. There still is possibility of many db's > open> at the same time.>> Eventually I will move data to a permanent database, but WebDNA is so > fast> at creating these db's on the fly...>> Bill>>> -----Original Message-----> From: Scott Anderson
> Sent: Wed, 8 Dec 2004 12:17:37 -0800> To: "WebDNA Talk" > Subject: Re: Table code broken?>> There is no intentional limitation on table size. Available memory > should> be the only factor in limiting a table size. I'll take a closer look > at the> code to see if any other conditions exists that may limit the number of> records a table can hold.>> On a side note: The table context was created as a convenient way of> storing and manipulating smaller sets of data. Although storing > thousands> of records in a table should not be a problem, this can become quite > taxing> on your system resources if several request threads are creating > multiple> instances of large tables. In addition to all the WebDNA databases > that are> already cached in RAM, each WebDNA request thread maintains its own > list of> table objects. There currently is no way to 'share' a table resource> between threads.>> -----Original Message-----> From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of> devaulw@onebox.com> Sent: Wednesday, December 08, 2004 11:30 AM> To: WebDNA Talk> Subject: Re: Table code broken?>>> OK, these are identical in structure except for the directory or the > number> of dates. I assure you that there is a /Orders/ path on this server > (with> fewer than 10k order files in it). If I limit the number of entries > to the> table by restricting the date (SET 2 below), the problem disappears > for the> /Orders/ folder. See the three sets of code below for what works/what> doesn't.>> Is there a limit to either the number of entries in a table or the > size of a> table? There's no limit mentioned in the docs and there should be > plenty of> room to handle this on the server.>> Thanks,> Bill>> SET 1 THIS WORKS:> [table name=tab&fields=ONO,DACR][/table]> [listfiles path=/]> [append> table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append]> [/listfiles]> [search table=tab&neDACRdatarq=[blank]]> [founditems][ONO] [DACR]
[/founditems]> [/search]>> SET 2 THIS DATE RESTRICTED VERSION WORKS:> [table name=tab&fields=ONO,DACR][/table]> [listfiles path=/Orders]> [showif [math]{[moddate]}[/math]>[math]{[date]}-30[/math]]> [append> table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append]> [/showif]> [/listfiles]>> SET 3 THIS UNRESTRICTED VERSION SHOWS NOTHING!> [table name=tab&fields=ONO,DACR][/table]> [listfiles path=/Orders/]> [append> table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append]> [/listfiles]>>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to> > Web Archive of this list is at: http://webdna.smithmicro.com/>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to> > Web Archive of this list is at: http://webdna.smithmicro.com/>>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to> > Web Archive of this list is at: http://webdna.smithmicro.com/>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/>>RegardsStuart Tremainidfk web developments114a/40 yeo street neutral bay 2089 australiat +612 9908 2134f +612 9908 4837-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/
Associated Messages, from the most recent to the oldest:
ScottIs that 100 = 100mb ?On 09/12/2004, at 8:15 AM, Scott Anderson wrote:> Just FYI...>> In the case where you find yourself needing to generating several > temporary> databases, you may want to take a look at your WebDNA 'CacheSizePrefs' > file> (introduced in WebDNA 4.5.1). WebDNA uses the settings in this file > to set> the size of the database and template caches, when starting up. The > 'stock'> settings are:>> DatabasesCacheSize100> TemplatesCacheSize100>> This file is located in the WebCatalogEngine folder. The WebDNA > process> must be restarted for the changes to take effect.>> Given the increasing amounts of RAM installed on servers these days, > you can> probably bump up the DatabasesCacheSize setting. This should reduce > the> amount of db swapping that WebDNA will be doing if the number of open> databases frequently reaches the cache size limit. Be careful when> increasing these values, as WebDNA does not currently handle the case > where> the increased number of databases does not fit in available RAM. > Perhaps> start at 150, then 175, and so on. If you find several error log > entries> where WebDNA failed to open a db due to lack of available RAM, then > back> down the cache size.>> -----Original Message-----> From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of> devaulw@onebox.com> Sent: Wednesday, December 08, 2004 12:41 PM> To: WebDNA Talk> Subject: Re: Table code broken?>>> Thanks for looking into this - I was pulling my hair out at 3am on > this one.> I was looking for a workaround to a temp database. I wanted to avoid > disk> writes and the possiblity of two people creating the same temp > database as> the same time.>> Perhaps I will keep tables for working sets of search results and > rename the> temp database to a cart name. There still is possibility of many db's > open> at the same time.>> Eventually I will move data to a permanent database, but WebDNA is so > fast> at creating these db's on the fly...>> Bill>>> -----Original Message-----> From: Scott Anderson > Sent: Wed, 8 Dec 2004 12:17:37 -0800> To: "WebDNA Talk" > Subject: Re: Table code broken?>> There is no intentional limitation on table size. Available memory > should> be the only factor in limiting a table size. I'll take a closer look > at the> code to see if any other conditions exists that may limit the number of> records a table can hold.>> On a side note: The table context was created as a convenient way of> storing and manipulating smaller sets of data. Although storing > thousands> of records in a table should not be a problem, this can become quite > taxing> on your system resources if several request threads are creating > multiple> instances of large tables. In addition to all the WebDNA databases > that are> already cached in RAM, each WebDNA request thread maintains its own > list of> table objects. There currently is no way to 'share' a table resource> between threads.>> -----Original Message-----> From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of> devaulw@onebox.com> Sent: Wednesday, December 08, 2004 11:30 AM> To: WebDNA Talk> Subject: Re: Table code broken?>>> OK, these are identical in structure except for the directory or the > number> of dates. I assure you that there is a /Orders/ path on this server > (with> fewer than 10k order files in it). If I limit the number of entries > to the> table by restricting the date (SET 2 below), the problem disappears > for the> /Orders/ folder. See the three sets of code below for what works/what> doesn't.>> Is there a limit to either the number of entries in a table or the > size of a> table? There's no limit mentioned in the docs and there should be > plenty of> room to handle this on the server.>> Thanks,> Bill>> SET 1 THIS WORKS:> [table name=tab&fields=ONO,DACR][/table]> [listfiles path=/]> [append> table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append]> [/listfiles]> [search table=tab&neDACRdatarq=[blank]]> [founditems][ONO] [DACR]
[/founditems]> [/search]>> SET 2 THIS DATE RESTRICTED VERSION WORKS:> [table name=tab&fields=ONO,DACR][/table]> [listfiles path=/Orders]> [showif [math]{[moddate]}[/math]>[math]{[date]}-30[/math]]> [append> table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append]> [/showif]> [/listfiles]>> SET 3 THIS UNRESTRICTED VERSION SHOWS NOTHING!> [table name=tab&fields=ONO,DACR][/table]> [listfiles path=/Orders/]> [append> table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append]> [/listfiles]>>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to> > Web Archive of this list is at: http://webdna.smithmicro.com/>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to> > Web Archive of this list is at: http://webdna.smithmicro.com/>>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to> > Web Archive of this list is at: http://webdna.smithmicro.com/>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/>>RegardsStuart Tremainidfk web developments114a/40 yeo street neutral bay 2089 australiat +612 9908 2134f +612 9908 4837-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/
Stuart Tremain
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Tab Charactor (1997)
PCS Frames (1997)
NT or Mac (1997)
emailer cc to figured out (1997)
Trigger time setting (2002)
webdna+post+WinIE6 (2004)
Sorting Orders (1997)
Close Databases Crash? (1998)
WebCat Bulletin Board Solution ? (1998)
WebCatalog for guestbook ? (1997)
[protect] (2000)
[WebDNA] Hmmm ... (2008)
[OT] Next Gen Browsers [Was] Decimal point in search.... (2004)
WebCat2b13MacPlugIn - [include] (1997)
[OT] Search Engine Tips (2003)
Associative lookup style? + bit more (1997)
Extracting a filename (2004)
Date or time comparisons have bugs ... (1998)
WebCatalog for Mac 2.0.1 Released (1997)
Re1000001: Setting up shop (1997)