Re: [WebDNA] WebDNA slow processing
This WebDNA talk-list message is from 2011
It keeps the original formatting.
numero = 107743
interpreted = N
texte = Looks like shutting off error reporting only does so much. I have more non-responsiveness from my server. Pages take minutes to return a result, if they even do so. I'll share what I learn. Bill On Sat, Nov 26, 2011 at 1:08 PM, William DeVaul
wrote: > I followed your advice and shut off the error logging. =A0I had thought > the errors we only appended to the file but they may have been > consuming RAM and CPU. > > I will try the removal option as well and resume error logging only > while trouble shooting. > > Thanks, > Bill > > On Sat, Nov 26, 2011 at 11:16 AM, Mr. Robert Minor Jr. > wrote: >> Bill if you want to clean up all those old error log files and start fre= sh on your mac you can run this command line via sudo >> >> find /Your/Web/Root -name ErrorLog.txt -exec rm {} \; >> >> where /Your/Web/Root is actually the path to your webserver root folder = ie /Library/WebServer/Documents >> >> then turn logging back on when your ready to trouble shoot your pages. U= se this command to find where all the error logs are: >> >> find /Your/Web/Root -name ErrorLog.txt >> >> Personally you I don't think error logging should be kept on indefinitel= y. Its a troubleshooting aid and shouldn't be turned on unless your activel= y using it. >> >> On Nov 26, 2011, at 8:11 AM, William DeVaul wrote: >> >>> I can also report that turning off all error logging has helped my >>> situation. =A0Now when I see 99.9% WebCatalog activity for extended >>> time, the system stays responsive. >>> >>> Bill >>> >>> On Sat, Nov 26, 2011 at 9:09 AM, William DeVaul wro= te: >>>> Can you tell us what column 3, 4, and 6 are used for? >>>> >>>> On Sat, Nov 26, 2011 at 7:25 AM, =A0 = wrote: >>>>> Based on what you copy here, the problem seems to be a RAM problem: d= atabases and templates are loaded in RAM by WebDNA, and there might be othe= r applications running on your server that could need lots of memory (Safar= i is a good example). You can type "free" in your terminal to see the avaia= ble RAM, check the swap usage (this would tremendously slow things down) or= even use your "Activity Monitor" application >>>>> >>>>> >>>>> Here is the .debug exemple, broken in lines to simplify the reading >>>>> >>>>> The webdna.debug, activated by "Technical Support Information" >>>>> >>>>> 1.- 11/18/08 >>>>> 2.- 14:20:09 >>>>> 3.- 11 >>>>> 4.- -944508928 >>>>> 5.- 024.183.098.016 >>>>> 6.- >>>>> 7.- /var/www/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>>> 8.- Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.7.7) = Gecko/20050416 >>>>> 9.- login >>>>> 10.- password >>>>> 11.- http://www.domain.com/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.= tpl >>>>> 12.- /cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>>> 13.- /var/www/html/ >>>>> 14.- command=3DAdminPut&InterpretAll=3DF&SerialNumber=3D************&= SerialNumber2=3Dnone&DateFormat=3D%25m%2F%25d%2F%25Y&TimeFormat=3D%25H%3A%2= 5M%3A%25S&ReadDateFormat=3Dmdy&MathUseDateFormat=3D0&MaxFound=3D16000&Centu= ryBreak=3D0&LimitThreads=3D25&ZapNulls=3D0&PreParseScript=3D1&PostParseScri= pt=3D0&CacheTemplates=3DF&CheckTemplateInterval=3D2&AutoCommit=3DT&Deadlock= Seconds=3D20&SafeWriteDatabase=3D1&CommandSecurity=3DT&CommandsAllowed=3DSh= owPage%2C+FlushCache%2C+ShowCart%2C+Add%2C+Remove%2C+NewCart%2C+Purchase%2C= +NewCartSearch%2C+Clear&CheckTemplateExtensions=3DT&ValidTemplateExtensions= =3D.tmpl+.tpl+.tp2+.dna+.html+.htm&CheckDatabaseExtensions=3DT&ValidDatabas= eExtensions=3D.db%2C+.txt&LineItemChangePassword=3Dftj8*%289&AbsolutePath= =3D0&InsecureFileMode=3D666&SecureFileMode=3D660&DebugLevel=3D0&CatchSignal= =3D0&LogError=3D0&DisplayError=3D1 >>>>> 15.- __utmz=3D238728966.1225062648.23.3.utmcsr=3Dstore.webdna.us|utmc= cn=3D(referral)|utmcmd=3Dreferral|utmcct=3D/default.tpl&__utma=3D238728966.= 1140128720646497800.1222376773.1226506042.1226682779.28& >>>>> 16.- Host=3D www.domain.com&User-Agent=3DMozilla/5.0%20%28Macintosh%3= B%20U%3B%20PPC%20Mac%20OS%20X%20Mach-O%3B%20en-US%3B%20rv%3A1.7.7%29%20Geck= o/20050416&Accept=3Dtext/xml%2Capplication/xml%2Capplication/xhtml%2Bxml%2C= text/html%3Bq%3D0.9%2Ctext/plain%3Bq%3D0.8%2Cimage/png%2C%2A/%2A%3Bq%3D0.5&= Accept-Language=3Den-us%2Cen%3Bq%3D0.5&Accept-Encoding=3Dgzip%2Cdeflate&Acc= ept-Charset=3DISO-8859-1%2Cutf-8%3Bq%3D0.7%2C%2A%3Bq%3D0.7&Keep-Alive=3D300= &Connection=3Dkeep-alive&Referer=3Dhttp%3A//www.domain.com/cgi-bin/WebCatal= ogEngine/Admin/AdminPrefs.tpl&Cookie=3D__utmz%3D238728966.1225062648.23.3.u= tmcsr%3Dstore.webdna.us%7Cutmccn%3D%28referral%29%7Cutmcmd%3Dreferral%7Cutm= cct%3D/default.tpl%3B%20__utma%3D238728966.1140128720646497800.1222376773.1= 226506042.1226682779.28&Authorization=3DBasic%20YWRtaW46VTZeamF0MQ%3D%3D&Co= ntent-Type=3Dapplication/x-www-form-urlencoded&Content-Length=3D792& >>>>> >>>>> The SignalCatcher.debug, activated by "Catching Terminate signal" =A0= will provide the problematic code and the domain name: >>>>> >>>>> ---Thu Oct 23 01:59:05 2008 CDT Starting processid 16763 receive SIGS= EGV: >>>>> ContextName: [EXCLUSIVELOCK] >>>>> TemplatePath: /var/www/html/www.domain.com/euca/dev/a1pg/WebMerchant/= processorders.tpl >>>>> Includefile: ^WebMerchant/DoPurchases.inc >>>>> PartOfWebDNA: [ExclusiveLock db=3DWebMerchantPrefs.db&db=3DOrders.db] >>>>> =A0 =A0 =A0 =A0[text]ordersFolder=3D../[lookup db=3DSandBoxPrefs&look= InField=3Dpreference&value=3DOrdersFolder&returnField=3Dvalue][/text] >>>>> =A0 =A0 =A0 =A0[text]completedFolder=3D../[lookup db=3DSandBoxPrefs&l= ookInField=3Dpreference&value=3DCompletedF >>>>> >>>>> >>>>> - chris >>>>> >>>>> On Nov 25, 2011, at 11:29, Thierry Almy wrote: >>>>> >>>>>> Hi >>>>>> >>>>>> We're running a copy of WebDNA 6.2 on a MacPro 2x QuadCore 2,4 GHz, = 6GB RAM, OS 10.6.8, iTools 9.0.5i >>>>>> Apache has about 35 vhosts >>>>>> >>>>>> As soon as the server gets a bit load (~100 concurrent connections) = and WebDNA uses 110% to 160% of the processor, it takes up to 10 seconds to= serve a page with WebDNA. >>>>>> Since we have 8-Cores in the server, I guess WebDNA should be able t= o use more than 160% .... or am I wrong? >>>>>> >>>>>> Pages served directly from apache (no DNA) appear very quick. >>>>>> >>>>>> In cases of heavy load I have the following lines in the console log= : >>>>>> 25.11.11 14:26:43 =A0 =A0 sioux =A0 WebDNA[210] =A0 =A0 Error =A0 Co= uld not establish connection with the module. >>>>>> >>>>>> >>>>>> And I've also seen the following lines, which makes me even more ner= vous: >>>>>> 25.11.11 11:18:44 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0*** set a breakpoint in malloc_error_break to debug >>>>>> 25.11.11 11:18:45 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0WebCatalog(210,0xa047a540) malloc: *** error for object 0xe0c= 970: pointer being freed was not allocated >>>>>> 25.11.11 11:47:12 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0sem_open failed: returned EMFILE: Too many open files >>>>>> >>>>>> All the lines are repeated several times. >>>>>> >>>>>> >>>>>> How can I find out what's blocking WebCatalog? >>>>>> Is something wrong with my module? >>>>>> >>>>>> >>>>>> Thanks for any help >>>>>> Thierry >>>>>> >>>>>> ______________________ >>>>>> mac&web gmbh >>>>>> thierry almy >>>>>> grabenstrasse 15 >>>>>> 8200 schaffhausen >>>>>> switzerland >>>>>> web =A0 www.mac-web.ch >>>>>> >>>>>> --------------------------------------------------------- >>>>>> This message is sent to you because you are subscribed to >>>>>> the mailing list . >>>>>> To unsubscribe, E-mail to: >>>>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>>>> Bug Reporting: support@webdna.us >>>>> >>>>> --------------------------------------------------------- >>>>> This message is sent to you because you are subscribed to >>>>> the mailing list . >>>>> To unsubscribe, E-mail to: >>>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>>> Bug Reporting: support@webdna.us >>>>> >>>> >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> Bug Reporting: support@webdna.us >> >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> Bug Reporting: support@webdna.us >> >
Associated Messages, from the most recent to the oldest:
Looks like shutting off error reporting only does so much. I have more non-responsiveness from my server. Pages take minutes to return a result, if they even do so. I'll share what I learn. Bill On Sat, Nov 26, 2011 at 1:08 PM, William DeVaul wrote: > I followed your advice and shut off the error logging. =A0I had thought > the errors we only appended to the file but they may have been > consuming RAM and CPU. > > I will try the removal option as well and resume error logging only > while trouble shooting. > > Thanks, > Bill > > On Sat, Nov 26, 2011 at 11:16 AM, Mr. Robert Minor Jr. > wrote: >> Bill if you want to clean up all those old error log files and start fre= sh on your mac you can run this command line via sudo >> >> find /Your/Web/Root -name ErrorLog.txt -exec rm {} \; >> >> where /Your/Web/Root is actually the path to your webserver root folder = ie /Library/WebServer/Documents >> >> then turn logging back on when your ready to trouble shoot your pages. U= se this command to find where all the error logs are: >> >> find /Your/Web/Root -name ErrorLog.txt >> >> Personally you I don't think error logging should be kept on indefinitel= y. Its a troubleshooting aid and shouldn't be turned on unless your activel= y using it. >> >> On Nov 26, 2011, at 8:11 AM, William DeVaul wrote: >> >>> I can also report that turning off all error logging has helped my >>> situation. =A0Now when I see 99.9% WebCatalog activity for extended >>> time, the system stays responsive. >>> >>> Bill >>> >>> On Sat, Nov 26, 2011 at 9:09 AM, William DeVaul wro= te: >>>> Can you tell us what column 3, 4, and 6 are used for? >>>> >>>> On Sat, Nov 26, 2011 at 7:25 AM, =A0 = wrote: >>>>> Based on what you copy here, the problem seems to be a RAM problem: d= atabases and templates are loaded in RAM by WebDNA, and there might be othe= r applications running on your server that could need lots of memory (Safar= i is a good example). You can type "free" in your terminal to see the avaia= ble RAM, check the swap usage (this would tremendously slow things down) or= even use your "Activity Monitor" application >>>>> >>>>> >>>>> Here is the .debug exemple, broken in lines to simplify the reading >>>>> >>>>> The webdna.debug, activated by "Technical Support Information" >>>>> >>>>> 1.- 11/18/08 >>>>> 2.- 14:20:09 >>>>> 3.- 11 >>>>> 4.- -944508928 >>>>> 5.- 024.183.098.016 >>>>> 6.- >>>>> 7.- /var/www/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>>> 8.- Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.7.7) = Gecko/20050416 >>>>> 9.- login >>>>> 10.- password >>>>> 11.- http://www.domain.com/cgi-bin/WebCatalogEngine/Admin/AdminPrefs.= tpl >>>>> 12.- /cgi-bin/WebCatalogEngine/Admin/AdminPrefs.tpl >>>>> 13.- /var/www/html/ >>>>> 14.- command=3DAdminPut&InterpretAll=3DF&SerialNumber=3D************&= SerialNumber2=3Dnone&DateFormat=3D%25m%2F%25d%2F%25Y&TimeFormat=3D%25H%3A%2= 5M%3A%25S&ReadDateFormat=3Dmdy&MathUseDateFormat=3D0&MaxFound=3D16000&Centu= ryBreak=3D0&LimitThreads=3D25&ZapNulls=3D0&PreParseScript=3D1&PostParseScri= pt=3D0&CacheTemplates=3DF&CheckTemplateInterval=3D2&AutoCommit=3DT&Deadlock= Seconds=3D20&SafeWriteDatabase=3D1&CommandSecurity=3DT&CommandsAllowed=3DSh= owPage%2C+FlushCache%2C+ShowCart%2C+Add%2C+Remove%2C+NewCart%2C+Purchase%2C= +NewCartSearch%2C+Clear&CheckTemplateExtensions=3DT&ValidTemplateExtensions= =3D.tmpl+.tpl+.tp2+.dna+.html+.htm&CheckDatabaseExtensions=3DT&ValidDatabas= eExtensions=3D.db%2C+.txt&LineItemChangePassword=3Dftj8*%289&AbsolutePath= =3D0&InsecureFileMode=3D666&SecureFileMode=3D660&DebugLevel=3D0&CatchSignal= =3D0&LogError=3D0&DisplayError=3D1 >>>>> 15.- __utmz=3D238728966.1225062648.23.3.utmcsr=3Dstore.webdna.us|utmc= cn=3D(referral)|utmcmd=3Dreferral|utmcct=3D/default.tpl&__utma=3D238728966.= 1140128720646497800.1222376773.1226506042.1226682779.28& >>>>> 16.- Host=3D www.domain.com&User-Agent=3DMozilla/5.0%20%28Macintosh%3= B%20U%3B%20PPC%20Mac%20OS%20X%20Mach-O%3B%20en-US%3B%20rv%3A1.7.7%29%20Geck= o/20050416&Accept=3Dtext/xml%2Capplication/xml%2Capplication/xhtml%2Bxml%2C= text/html%3Bq%3D0.9%2Ctext/plain%3Bq%3D0.8%2Cimage/png%2C%2A/%2A%3Bq%3D0.5&= Accept-Language=3Den-us%2Cen%3Bq%3D0.5&Accept-Encoding=3Dgzip%2Cdeflate&Acc= ept-Charset=3DISO-8859-1%2Cutf-8%3Bq%3D0.7%2C%2A%3Bq%3D0.7&Keep-Alive=3D300= &Connection=3Dkeep-alive&Referer=3Dhttp%3A//www.domain.com/cgi-bin/WebCatal= ogEngine/Admin/AdminPrefs.tpl&Cookie=3D__utmz%3D238728966.1225062648.23.3.u= tmcsr%3Dstore.webdna.us%7Cutmccn%3D%28referral%29%7Cutmcmd%3Dreferral%7Cutm= cct%3D/default.tpl%3B%20__utma%3D238728966.1140128720646497800.1222376773.1= 226506042.1226682779.28&Authorization=3DBasic%20YWRtaW46VTZeamF0MQ%3D%3D&Co= ntent-Type=3Dapplication/x-www-form-urlencoded&Content-Length=3D792& >>>>> >>>>> The SignalCatcher.debug, activated by "Catching Terminate signal" =A0= will provide the problematic code and the domain name: >>>>> >>>>> ---Thu Oct 23 01:59:05 2008 CDT Starting processid 16763 receive SIGS= EGV: >>>>> ContextName: [exclusivelock] >>>>> TemplatePath: /var/www/html/www.domain.com/euca/dev/a1pg/WebMerchant/= processorders.tpl >>>>> Includefile: ^WebMerchant/DoPurchases.inc >>>>> PartOfWebDNA: [ExclusiveLock db=3DWebMerchantPrefs.db&db=3DOrders.db] >>>>> =A0 =A0 =A0 =A0[text]ordersFolder=3D../[lookup db=3DSandBoxPrefs&look= InField=3Dpreference&value=3DOrdersFolder&returnField=3Dvalue][/text] >>>>> =A0 =A0 =A0 =A0[text]completedFolder=3D../[lookup db=3DSandBoxPrefs&l= ookInField=3Dpreference&value=3DCompletedF >>>>> >>>>> >>>>> - chris >>>>> >>>>> On Nov 25, 2011, at 11:29, Thierry Almy wrote: >>>>> >>>>>> Hi >>>>>> >>>>>> We're running a copy of WebDNA 6.2 on a MacPro 2x QuadCore 2,4 GHz, = 6GB RAM, OS 10.6.8, iTools 9.0.5i >>>>>> Apache has about 35 vhosts >>>>>> >>>>>> As soon as the server gets a bit load (~100 concurrent connections) = and WebDNA uses 110% to 160% of the processor, it takes up to 10 seconds to= serve a page with WebDNA. >>>>>> Since we have 8-Cores in the server, I guess WebDNA should be able t= o use more than 160% .... or am I wrong? >>>>>> >>>>>> Pages served directly from apache (no DNA) appear very quick. >>>>>> >>>>>> In cases of heavy load I have the following lines in the console log= : >>>>>> 25.11.11 14:26:43 =A0 =A0 sioux =A0 WebDNA[210] =A0 =A0 Error =A0 Co= uld not establish connection with the module. >>>>>> >>>>>> >>>>>> And I've also seen the following lines, which makes me even more ner= vous: >>>>>> 25.11.11 11:18:44 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0*** set a breakpoint in malloc_error_break to debug >>>>>> 25.11.11 11:18:45 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0WebCatalog(210,0xa047a540) malloc: *** error for object 0xe0c= 970: pointer being freed was not allocated >>>>>> 25.11.11 11:47:12 =A0 =A0 sioux =A0 com.apple.SystemStarter[36] =A0 = =A0 Notice =A0sem_open failed: returned EMFILE: Too many open files >>>>>> >>>>>> All the lines are repeated several times. >>>>>> >>>>>> >>>>>> How can I find out what's blocking WebCatalog? >>>>>> Is something wrong with my module? >>>>>> >>>>>> >>>>>> Thanks for any help >>>>>> Thierry >>>>>> >>>>>> ______________________ >>>>>> mac&web gmbh >>>>>> thierry almy >>>>>> grabenstrasse 15 >>>>>> 8200 schaffhausen >>>>>> switzerland >>>>>> web =A0 www.mac-web.ch >>>>>> >>>>>> --------------------------------------------------------- >>>>>> This message is sent to you because you are subscribed to >>>>>> the mailing list . >>>>>> To unsubscribe, E-mail to: >>>>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>>>> Bug Reporting: support@webdna.us >>>>> >>>>> --------------------------------------------------------- >>>>> This message is sent to you because you are subscribed to >>>>> the mailing list . >>>>> To unsubscribe, E-mail to: >>>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>>> Bug Reporting: support@webdna.us >>>>> >>>> >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> Bug Reporting: support@webdna.us >> >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> Bug Reporting: support@webdna.us >> >
William DeVaul
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Date Formats (1997)
Hiding HTML and breaking the page (1997)
Ad Serving Software (2002)
WebCommerce: Folder organization ? (1997)
Modifying order output (1997)
Re[2]: WebCatalog on Linux (2000)
Which beta for w* 4.1 and a problem w/b12 (1999)
searchable list archive (1997)
Search in 2 or more catalogs (1997)
my price won't move (1997)
[SHOWIF AND/OR] (1997)
[carts] and databases (1997)
Number of Line Items (1998)
[TaxableTotal] - not working with AOL and IE (1997)
Search/sort in URL Was: GuestBook example (1997)
RAM variables (1997)
simple answer? [hideif] (1997)
Setting up WebCatalog with Retail Pro data (1996)
HomePage Caution (1997)
Setting up WebCatalog with Retail Pro data (1996)