Re: [WebDNA] A new popuated field to a DB with 700.000 records
This WebDNA talk-list message is from 2009
It keeps the original formatting.
numero = 104106
interpreted = N
texte = Hi Chris, This one did the trick in a jimmy. Almost no waitingtime (less than 15 = seconds). No change to the commit to disk or anything... So, thanks a lot. --- snip --- [search db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1] [replacefounditems]l4_index=3D[index][/replacefounditems] [/search] --- snip --- On 03/12/2009, at 20.52, christophe.billiottet@webdna.us wrote: > I am not sure about it. You can unckeck the "Automatically commit = databases to disk after modification", use the "Activity Monitor" to = visualize the disk activity and prefer [replacefounditems] (without the = "[founditems]" context) which is much faster than [replace] > Something like >=20 > [search db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1] > [replacefounditems]l4_index=3D[index][/replacefounditems] > [/search] >=20 > (http://www.webdna.us/page.dna?numero=3D211) >=20 > Please tell us what results you get. >=20 > thanks! > - chris >=20 >=20 >=20 > On Dec 3, 2009, at 17:31, Palle Bo Nielsen wrote: >=20 >> Hi Chris, >>=20 >> DB size is 96 MB and the Automatically Commit to Databases to Disk = after Modification is enabled and in works fine under normal operations = but I can see where you are getting if you need to write to 700.000 = records in one process. Actually, will it write once or 700.000 times in = such a process? >>=20 >> Mac OS X Server 10.5.8 >> 8 GB RAM >> 2x2.8 GHz Quad Core Intel Xeon >>=20 >> Palle >>=20 >>=20 >> On 03/12/2009, at 14.07, christophe.billiottet@webdna.us wrote: >>=20 >>> Palle, just curiosity: what size (MB) is your 700,000 records = database? is the "Automatically commit databases to disk after = modification" checked in your preferences? what version of WebDNA are = you running and what is the hardware (CPU/RAM) ? >>>=20 >>> thank you! >>> - chris >>>=20 >>>=20 >>> On Dec 2, 2009, at 18:27, Palle Bo Nielsen wrote: >>>=20 >>>> Hi all, >>>>=20 >>>> I got a DB which has 11 fields and more that 700.000 lines of data. >>>>=20 >>>> Now I need to add a new field and I need to populate this field = with an index from the number 1 to the most recent number which for = example is 700.000. >>>>=20 >>>> The number 1 is the first lines of data within this BD and the = 700.000 is the most recent added line of data. >>>>=20 >>>> If have done some test and sand-boxing and every time WebDNA goes = into it's knees. >>>>=20 >>>> I need some good advise from you all to figure out the best = solution. >>>>=20 >>>> I look forward to your suggestions. >>>>=20 >>>> **** this one is rough and breaks WebDNA **** >>>> [search = db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1][numFound][foundIte= ms] >>>> [replace db=3Dl4.db&eql4_skudata=3D[l4_sku]]l4_index=3D[index][/repla= ce] >>>> [/foundItems][/search] >>>> **** snip **** >>>>=20 >>>>=20 >>>> Palle--------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list
. >>>> To unsubscribe, E-mail to: >>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>> old archives: http://dev.webdna.us/TalkListArchive/ >>>> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >>>=20 >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> old archives: http://dev.webdna.us/TalkListArchive/ >>> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >>>=20 >>=20 >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> old archives: http://dev.webdna.us/TalkListArchive/ >> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >=20 > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > old archives: http://dev.webdna.us/TalkListArchive/ > Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >=20
Associated Messages, from the most recent to the oldest:
Hi Chris, This one did the trick in a jimmy. Almost no waitingtime (less than 15 = seconds). No change to the commit to disk or anything... So, thanks a lot. --- snip --- [search db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1] [replacefounditems]l4_index=3D[index][/replacefounditems] [/search] --- snip --- On 03/12/2009, at 20.52, christophe.billiottet@webdna.us wrote: > I am not sure about it. You can unckeck the "Automatically commit = databases to disk after modification", use the "Activity Monitor" to = visualize the disk activity and prefer [replacefounditems] (without the = "[founditems]" context) which is much faster than [replace] > Something like >=20 > [search db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1] > [replacefounditems]l4_index=3D[index][/replacefounditems] > [/search] >=20 > (http://www.webdna.us/page.dna?numero=3D211) >=20 > Please tell us what results you get. >=20 > thanks! > - chris >=20 >=20 >=20 > On Dec 3, 2009, at 17:31, Palle Bo Nielsen wrote: >=20 >> Hi Chris, >>=20 >> DB size is 96 MB and the Automatically Commit to Databases to Disk = after Modification is enabled and in works fine under normal operations = but I can see where you are getting if you need to write to 700.000 = records in one process. Actually, will it write once or 700.000 times in = such a process? >>=20 >> Mac OS X Server 10.5.8 >> 8 GB RAM >> 2x2.8 GHz Quad Core Intel Xeon >>=20 >> Palle >>=20 >>=20 >> On 03/12/2009, at 14.07, christophe.billiottet@webdna.us wrote: >>=20 >>> Palle, just curiosity: what size (MB) is your 700,000 records = database? is the "Automatically commit databases to disk after = modification" checked in your preferences? what version of WebDNA are = you running and what is the hardware (CPU/RAM) ? >>>=20 >>> thank you! >>> - chris >>>=20 >>>=20 >>> On Dec 2, 2009, at 18:27, Palle Bo Nielsen wrote: >>>=20 >>>> Hi all, >>>>=20 >>>> I got a DB which has 11 fields and more that 700.000 lines of data. >>>>=20 >>>> Now I need to add a new field and I need to populate this field = with an index from the number 1 to the most recent number which for = example is 700.000. >>>>=20 >>>> The number 1 is the first lines of data within this BD and the = 700.000 is the most recent added line of data. >>>>=20 >>>> If have done some test and sand-boxing and every time WebDNA goes = into it's knees. >>>>=20 >>>> I need some good advise from you all to figure out the best = solution. >>>>=20 >>>> I look forward to your suggestions. >>>>=20 >>>> **** this one is rough and breaks WebDNA **** >>>> [search = db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1][numFound][foundIte= ms] >>>> [replace db=3Dl4.db&eql4_skudata=3D[l4_sku]]l4_index=3D[index][/repla= ce] >>>> [/foundItems][/search] >>>> **** snip **** >>>>=20 >>>>=20 >>>> Palle--------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list . >>>> To unsubscribe, E-mail to: >>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>> old archives: http://dev.webdna.us/TalkListArchive/ >>>> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >>>=20 >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> old archives: http://dev.webdna.us/TalkListArchive/ >>> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >>>=20 >>=20 >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> old archives: http://dev.webdna.us/TalkListArchive/ >> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >=20 > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > old archives: http://dev.webdna.us/TalkListArchive/ > Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >=20
Palle Bo Nielsen
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Re[2]: 2nd WebCatalog2 Feature Request (1996)
WebCat2: Items xx to xx shown, etc. (1997)
WebCat editing, SiteGuard & SiteEdit (1997)
Spell Check (2003)
Carts & Refering URLs (1997)
CC and Europe (1999)
Math Problem - Format? (1997)
[format xs] freeze (1997)
Bug or syntax error on my part? (1997)
WebCatalog [FoundItems] Problem - AGAIN - (1997)
Fwd: 502 Bad Gateway (1998)
OT: [WAY IN RIGHT FIELD SOMEWHERE] Spam Filters (2005)
Opinion: [input] should be called [output] ... (1997)
b12 cannot limit records returned and more. (1997)
Date Formats (1997)
hmmm (2006)
Nesting format tags (1997)
WebCat b13 CGI -shownext- (1997)
Grep Help (2007)
WebCat2 several catalogs? (1997)