Re: [WebDNA] WebDNA slow processing
This WebDNA talk-list message is from 2011
It keeps the original formatting.
numero = 107741
interpreted = N
texte = I followed your advice and shut off the error logging. I had thought the errors we only appended to the file but they may have been consuming RAM and CPU. I will try the removal option as well and resume error logging only while trouble shooting. Thanks, Bill On Sat, Nov 26, 2011 at 11:16 AM, Mr. Robert Minor Jr.
wrote: > Bill if you want to clean up all those old error log files and start fres= h on your mac you can run this command line via sudo > > find /Your/Web/Root -name ErrorLog.txt -exec rm {} \; > > where /Your/Web/Root is actually the path to your webserver root folder i= e /Library/WebServer/Documents > > then turn logging back on when your ready to trouble shoot your pages. Us= e this command to find where all the error logs are: > > find /Your/Web/Root -name ErrorLog.txt > > Personally you I don't think error logging should be kept on indefinitely= . Its a troubleshooting aid and shouldn't be turned on unless your actively= using it. > > On Nov 26, 2011, at 8:11 AM, William DeVaul wrote: > >> I can also report that turning off all error logging has helped my >> situation. =A0Now when I see 99.9% WebCatalog activity for extended >> time, the system stays responsive. >> >> Bill >> >> On Sat, Nov 26, 2011 at 9:09 AM, William DeVaul wrot= e: >>> Can you tell us what column 3, 4, and 6 are used for? >>> >>> On Sat, Nov 26, 2011 at 7:25 AM, =A0 w= rote: >>>> Based on what you copy here, the problem seems to be a RAM problem: da= tabases and templates are loaded in RAM by WebDNA, and there might be other= applications running on your server that could need lots of memory (Safari= is a good example). You can type "free" in your terminal to see the avaiab= le RAM, check the swap usage (this would tremendously slow things down) or = even use your "Activity Monitor" application >>>> >>>> >>>> Here is the .debug exemple, broken in lines to simplify the reading >>>> >>>> The webdna.debug, activated by "Technical Support Information" >>>> >>>> 1.- 11/18/08 >>>> 2.- 14:20:09 >>>> 3.- 11 >>>> 4.- -944508928 >>>> 5.- 024.183.098.016 >>>> 6.- >>>> 7.- /var/www/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>> 8.- Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.7.7) G= ecko/20050416 >>>> 9.- login >>>> 10.- password >>>> 11.- http://www.domain.com/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.t= pl >>>> 12.- /cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>> 13.- /var/www/html/ >>>> 14.- command=3DAdminPut&InterpretAll=3DF&SerialNumber=3D************&S= erialNumber2=3Dnone&DateFormat=3D%25m%2F%25d%2F%25Y&TimeFormat=3D%25H%3A%25= M%3A%25S&ReadDateFormat=3Dmdy&MathUseDateFormat=3D0&MaxFound=3D16000&Centur= yBreak=3D0&LimitThreads=3D25&ZapNulls=3D0&PreParseScript=3D1&PostParseScrip= t=3D0&CacheTemplates=3DF&CheckTemplateInterval=3D2&AutoCommit=3DT&DeadlockS= econds=3D20&SafeWriteDatabase=3D1&CommandSecurity=3DT&CommandsAllowed=3DSho= wPage%2C+FlushCache%2C+ShowCart%2C+Add%2C+Remove%2C+NewCart%2C+Purchase%2C+= NewCartSearch%2C+Clear&CheckTemplateExtensions=3DT&ValidTemplateExtensions= =3D.tmpl+.tpl+.tp2+.dna+.html+.htm&CheckDatabaseExtensions=3DT&ValidDatabas= eExtensions=3D.db%2C+.txt&LineItemChangePassword=3Dftj8*%289&AbsolutePath= =3D0&InsecureFileMode=3D666&SecureFileMode=3D660&DebugLevel=3D0&CatchSignal= =3D0&LogError=3D0&DisplayError=3D1 >>>> 15.- __utmz=3D238728966.1225062648.23.3.utmcsr=3Dstore.webdna.us|utmcc= n=3D(referral)|utmcmd=3Dreferral|utmcct=3D/default.tpl&__utma=3D238728966.1= 140128720646497800.1222376773.1226506042.1226682779.28& >>>> 16.- Host=3D www.domain.com&User-Agent=3DMozilla/5.0%20%28Macintosh%3B= %20U%3B%20PPC%20Mac%20OS%20X%20Mach-O%3B%20en-US%3B%20rv%3A1.7.7%29%20Gecko= /20050416&Accept=3Dtext/xml%2Capplication/xml%2Capplication/xhtml%2Bxml%2Ct= ext/html%3Bq%3D0.9%2Ctext/plain%3Bq%3D0.8%2Cimage/png%2C%2A/%2A%3Bq%3D0.5&A= ccept-Language=3Den-us%2Cen%3Bq%3D0.5&Accept-Encoding=3Dgzip%2Cdeflate&Acce= pt-Charset=3DISO-8859-1%2Cutf-8%3Bq%3D0.7%2C%2A%3Bq%3D0.7&Keep-Alive=3D300&= Connection=3Dkeep-alive&Referer=3Dhttp%3A//www.domain.com/cgi-bin/WebCatalo= gEngine/Admin/AdminPrefs.tpl&Cookie=3D__utmz%3D238728966.1225062648.23.3.ut= mcsr%3Dstore.webdna.us%7Cutmccn%3D%28referral%29%7Cutmcmd%3Dreferral%7Cutmc= ct%3D/default.tpl%3B%20__utma%3D238728966.1140128720646497800.1222376773.12= 26506042.1226682779.28&Authorization=3DBasic%20YWRtaW46VTZeamF0MQ%3D%3D&Con= tent-Type=3Dapplication/x-www-form-urlencoded&Content-Length=3D792& >>>> >>>> The SignalCatcher.debug, activated by "Catching Terminate signal" =A0w= ill provide the problematic code and the domain name: >>>> >>>> ---Thu Oct 23 01:59:05 2008 CDT Starting processid 16763 receive SIGSE= GV: >>>> ContextName: [EXCLUSIVELOCK] >>>> TemplatePath: /var/www/html/www.domain.com/euca/dev/a1pg/WebMerchant/p= rocessorders.tpl >>>> Includefile: ^WebMerchant/DoPurchases.inc >>>> PartOfWebDNA: [ExclusiveLock db=3DWebMerchantPrefs.db&db=3DOrders.db] >>>> =A0 =A0 =A0 =A0[text]ordersFolder=3D../[lookup db=3DSandBoxPrefs&lookI= nField=3Dpreference&value=3DOrdersFolder&returnField=3Dvalue][/text] >>>> =A0 =A0 =A0 =A0[text]completedFolder=3D../[lookup db=3DSandBoxPrefs&lo= okInField=3Dpreference&value=3DCompletedF >>>> >>>> >>>> - chris >>>> >>>> On Nov 25, 2011, at 11:29, Thierry Almy wrote: >>>> >>>>> Hi >>>>> >>>>> We're running a copy of WebDNA 6.2 on a MacPro 2x QuadCore 2,4 GHz, 6= GB RAM, OS 10.6.8, iTools 9.0.5i >>>>> Apache has about 35 vhosts >>>>> >>>>> As soon as the server gets a bit load (~100 concurrent connections) a= nd WebDNA uses 110% to 160% of the processor, it takes up to 10 seconds to = serve a page with WebDNA. >>>>> Since we have 8-Cores in the server, I guess WebDNA should be able to= use more than 160% .... or am I wrong? >>>>> >>>>> Pages served directly from apache (no DNA) appear very quick. >>>>> >>>>> In cases of heavy load I have the following lines in the console log: >>>>> 25.11.11 14:26:43 =A0 =A0 sioux =A0 WebDNA[210] =A0 =A0 Error =A0 Cou= ld not establish connection with the module. >>>>> >>>>> >>>>> And I've also seen the following lines, which makes me even more nerv= ous: >>>>> 25.11.11 11:18:44 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0*** set a breakpoint in malloc_error_break to debug >>>>> 25.11.11 11:18:45 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0WebCatalog(210,0xa047a540) malloc: *** error for object 0xe0c= 970: pointer being freed was not allocated >>>>> 25.11.11 11:47:12 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0sem_open failed: returned EMFILE: Too many open files >>>>> >>>>> All the lines are repeated several times. >>>>> >>>>> >>>>> How can I find out what's blocking WebCatalog? >>>>> Is something wrong with my module? >>>>> >>>>> >>>>> Thanks for any help >>>>> Thierry >>>>> >>>>> ______________________ >>>>> mac&web gmbh >>>>> thierry almy >>>>> grabenstrasse 15 >>>>> 8200 schaffhausen >>>>> switzerland >>>>> web =A0 www.mac-web.ch >>>>> >>>>> --------------------------------------------------------- >>>>> This message is sent to you because you are subscribed to >>>>> the mailing list . >>>>> To unsubscribe, E-mail to: >>>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>>> Bug Reporting: support@webdna.us >>>> >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list . >>>> To unsubscribe, E-mail to: >>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>> Bug Reporting: support@webdna.us >>>> >>> >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> Bug Reporting: support@webdna.us > > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > Bug Reporting: support@webdna.us >
Associated Messages, from the most recent to the oldest:
I followed your advice and shut off the error logging. I had thought the errors we only appended to the file but they may have been consuming RAM and CPU. I will try the removal option as well and resume error logging only while trouble shooting. Thanks, Bill On Sat, Nov 26, 2011 at 11:16 AM, Mr. Robert Minor Jr. wrote: > Bill if you want to clean up all those old error log files and start fres= h on your mac you can run this command line via sudo > > find /Your/Web/Root -name ErrorLog.txt -exec rm {} \; > > where /Your/Web/Root is actually the path to your webserver root folder i= e /Library/WebServer/Documents > > then turn logging back on when your ready to trouble shoot your pages. Us= e this command to find where all the error logs are: > > find /Your/Web/Root -name ErrorLog.txt > > Personally you I don't think error logging should be kept on indefinitely= . Its a troubleshooting aid and shouldn't be turned on unless your actively= using it. > > On Nov 26, 2011, at 8:11 AM, William DeVaul wrote: > >> I can also report that turning off all error logging has helped my >> situation. =A0Now when I see 99.9% WebCatalog activity for extended >> time, the system stays responsive. >> >> Bill >> >> On Sat, Nov 26, 2011 at 9:09 AM, William DeVaul wrot= e: >>> Can you tell us what column 3, 4, and 6 are used for? >>> >>> On Sat, Nov 26, 2011 at 7:25 AM, =A0 w= rote: >>>> Based on what you copy here, the problem seems to be a RAM problem: da= tabases and templates are loaded in RAM by WebDNA, and there might be other= applications running on your server that could need lots of memory (Safari= is a good example). You can type "free" in your terminal to see the avaiab= le RAM, check the swap usage (this would tremendously slow things down) or = even use your "Activity Monitor" application >>>> >>>> >>>> Here is the .debug exemple, broken in lines to simplify the reading >>>> >>>> The webdna.debug, activated by "Technical Support Information" >>>> >>>> 1.- 11/18/08 >>>> 2.- 14:20:09 >>>> 3.- 11 >>>> 4.- -944508928 >>>> 5.- 024.183.098.016 >>>> 6.- >>>> 7.- /var/www/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>> 8.- Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.7.7) G= ecko/20050416 >>>> 9.- login >>>> 10.- password >>>> 11.- http://www.domain.com/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.t= pl >>>> 12.- /cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>> 13.- /var/www/html/ >>>> 14.- command=3DAdminPut&InterpretAll=3DF&SerialNumber=3D************&S= erialNumber2=3Dnone&DateFormat=3D%25m%2F%25d%2F%25Y&TimeFormat=3D%25H%3A%25= M%3A%25S&ReadDateFormat=3Dmdy&MathUseDateFormat=3D0&MaxFound=3D16000&Centur= yBreak=3D0&LimitThreads=3D25&ZapNulls=3D0&PreParseScript=3D1&PostParseScrip= t=3D0&CacheTemplates=3DF&CheckTemplateInterval=3D2&AutoCommit=3DT&DeadlockS= econds=3D20&SafeWriteDatabase=3D1&CommandSecurity=3DT&CommandsAllowed=3DSho= wPage%2C+FlushCache%2C+ShowCart%2C+Add%2C+Remove%2C+NewCart%2C+Purchase%2C+= NewCartSearch%2C+Clear&CheckTemplateExtensions=3DT&ValidTemplateExtensions= =3D.tmpl+.tpl+.tp2+.dna+.html+.htm&CheckDatabaseExtensions=3DT&ValidDatabas= eExtensions=3D.db%2C+.txt&LineItemChangePassword=3Dftj8*%289&AbsolutePath= =3D0&InsecureFileMode=3D666&SecureFileMode=3D660&DebugLevel=3D0&CatchSignal= =3D0&LogError=3D0&DisplayError=3D1 >>>> 15.- __utmz=3D238728966.1225062648.23.3.utmcsr=3Dstore.webdna.us|utmcc= n=3D(referral)|utmcmd=3Dreferral|utmcct=3D/default.tpl&__utma=3D238728966.1= 140128720646497800.1222376773.1226506042.1226682779.28& >>>> 16.- Host=3D www.domain.com&User-Agent=3DMozilla/5.0%20%28Macintosh%3B= %20U%3B%20PPC%20Mac%20OS%20X%20Mach-O%3B%20en-US%3B%20rv%3A1.7.7%29%20Gecko= /20050416&Accept=3Dtext/xml%2Capplication/xml%2Capplication/xhtml%2Bxml%2Ct= ext/html%3Bq%3D0.9%2Ctext/plain%3Bq%3D0.8%2Cimage/png%2C%2A/%2A%3Bq%3D0.5&A= ccept-Language=3Den-us%2Cen%3Bq%3D0.5&Accept-Encoding=3Dgzip%2Cdeflate&Acce= pt-Charset=3DISO-8859-1%2Cutf-8%3Bq%3D0.7%2C%2A%3Bq%3D0.7&Keep-Alive=3D300&= Connection=3Dkeep-alive&Referer=3Dhttp%3A//www.domain.com/cgi-bin/WebCatalo= gEngine/Admin/AdminPrefs.tpl&Cookie=3D__utmz%3D238728966.1225062648.23.3.ut= mcsr%3Dstore.webdna.us%7Cutmccn%3D%28referral%29%7Cutmcmd%3Dreferral%7Cutmc= ct%3D/default.tpl%3B%20__utma%3D238728966.1140128720646497800.1222376773.12= 26506042.1226682779.28&Authorization=3DBasic%20YWRtaW46VTZeamF0MQ%3D%3D&Con= tent-Type=3Dapplication/x-www-form-urlencoded&Content-Length=3D792& >>>> >>>> The SignalCatcher.debug, activated by "Catching Terminate signal" =A0w= ill provide the problematic code and the domain name: >>>> >>>> ---Thu Oct 23 01:59:05 2008 CDT Starting processid 16763 receive SIGSE= GV: >>>> ContextName: [exclusivelock] >>>> TemplatePath: /var/www/html/www.domain.com/euca/dev/a1pg/WebMerchant/p= rocessorders.tpl >>>> Includefile: ^WebMerchant/DoPurchases.inc >>>> PartOfWebDNA: [ExclusiveLock db=3DWebMerchantPrefs.db&db=3DOrders.db] >>>> =A0 =A0 =A0 =A0[text]ordersFolder=3D../[lookup db=3DSandBoxPrefs&lookI= nField=3Dpreference&value=3DOrdersFolder&returnField=3Dvalue][/text] >>>> =A0 =A0 =A0 =A0[text]completedFolder=3D../[lookup db=3DSandBoxPrefs&lo= okInField=3Dpreference&value=3DCompletedF >>>> >>>> >>>> - chris >>>> >>>> On Nov 25, 2011, at 11:29, Thierry Almy wrote: >>>> >>>>> Hi >>>>> >>>>> We're running a copy of WebDNA 6.2 on a MacPro 2x QuadCore 2,4 GHz, 6= GB RAM, OS 10.6.8, iTools 9.0.5i >>>>> Apache has about 35 vhosts >>>>> >>>>> As soon as the server gets a bit load (~100 concurrent connections) a= nd WebDNA uses 110% to 160% of the processor, it takes up to 10 seconds to = serve a page with WebDNA. >>>>> Since we have 8-Cores in the server, I guess WebDNA should be able to= use more than 160% .... or am I wrong? >>>>> >>>>> Pages served directly from apache (no DNA) appear very quick. >>>>> >>>>> In cases of heavy load I have the following lines in the console log: >>>>> 25.11.11 14:26:43 =A0 =A0 sioux =A0 WebDNA[210] =A0 =A0 Error =A0 Cou= ld not establish connection with the module. >>>>> >>>>> >>>>> And I've also seen the following lines, which makes me even more nerv= ous: >>>>> 25.11.11 11:18:44 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0*** set a breakpoint in malloc_error_break to debug >>>>> 25.11.11 11:18:45 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0WebCatalog(210,0xa047a540) malloc: *** error for object 0xe0c= 970: pointer being freed was not allocated >>>>> 25.11.11 11:47:12 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0sem_open failed: returned EMFILE: Too many open files >>>>> >>>>> All the lines are repeated several times. >>>>> >>>>> >>>>> How can I find out what's blocking WebCatalog? >>>>> Is something wrong with my module? >>>>> >>>>> >>>>> Thanks for any help >>>>> Thierry >>>>> >>>>> ______________________ >>>>> mac&web gmbh >>>>> thierry almy >>>>> grabenstrasse 15 >>>>> 8200 schaffhausen >>>>> switzerland >>>>> web =A0 www.mac-web.ch >>>>> >>>>> --------------------------------------------------------- >>>>> This message is sent to you because you are subscribed to >>>>> the mailing list . >>>>> To unsubscribe, E-mail to: >>>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>>> Bug Reporting: support@webdna.us >>>> >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list . >>>> To unsubscribe, E-mail to: >>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>> Bug Reporting: support@webdna.us >>>> >>> >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> Bug Reporting: support@webdna.us > > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > Bug Reporting: support@webdna.us >
William DeVaul
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Sorting error (1997)
Emailer errors (1997)
bug ? causes NT event log to fill (1997)
Include an include file as raw webDNA (2002)
[] Boxes in Safari (2004)
Format of Required fields error message (1997)
[WebDNA] On click show hidden include (2009)
Errata: WCS Newbie question (1997)
WebCat2b15MacPlugin - showing [math] (1997)
Viewing old carts (was FEW QUESTIONS) (1997)
two unique banners on one page (1997)
[WebDNA] Cheers (2008)
ListFiles Sorting (2000)
Re:Emailer and encryption (1997)
can WC render sites out? (1997)
System 8.5.1 question (1999)
2.1b3 --> way slow (1997)
ANother SHOWIF problem (1997)
[format 40s]text[/format] doesn't work (1997)
New command suggestion (was Modifying databases manually) (1997)