Re: macosx 1 process, linux N processes, macosx chokes under load

This WebDNA talk-list message is from

2001


It keeps the original formatting.
numero = 36817
interpreted = N
texte = Le Pham wrote: >Dale LaFountain wrote: >> >> I have been doing extensive performance testing to find the fastest >> hardware/software combination to run our websites. In my testing, I >> found that for single executions, MacOSX executes webcat code about >> 33% faster than a similar Linux box (P3-550 dual). >> >> However, when I execute any number of simultaneous requests using a >> performance tool like Netsplat, MacOSX quickly grinds to a halt while >> Linux keeps up rather well. >> >> Upon further inspection, it appears that Linux webcat starts 4 >> processes on launch, and then spawns additional child processes for >> every simultanous request. The OSX version runs ALL requests through >> a single process, which is apparently a huge bottleneck. >FYI, Mac OS X does spwan threads to handle request, it is just in >different way. Use command top during your test you can see >number of threads that spawned by WebCatalog >After WebCatalog is launched on Mac OS X, using top command you >will see there are three threads attached with WebCatalog process >Linux shows 4 processes. These are include 1 for main WebCatalog >process and the remain three are spawned threadsOK, fair enough. I see the threadcount rising now when I run Netsplat on OSX.> > >> Why is webcat set up this way on OSX, and can it be fixed to act more >> like Linux? >WebCat itself is using the same method of spwaning threads to handle >requests. But POSIX thread package is implemented different on >Linux and Mac OSX. And it is the part of kernel, we could not do >any thing to force both OS act as the same way. > >> >> Also, the 10.0.4 update to OSXS 2.0 resulted in a 50% improvement in >> webcat performance in cpu-intensive calculations. However, it's >> still an order of magnitude slower than Linux when under a heavy load >> (134 seconds vs 18 seconds). >We are experience the same result here. WebCat/Linux always runs >faster the WebCat/Mac OS X Server/Client >I think it is OS dependentOSX is NOT always slower. Running a single instance of my template, OSX is faster by 50%. It's only when multiple requests occur simultaneously that OSX crawls, even in comparison to OS9/Webstar on the same hardware.Isn't it possible that some inefficiencies exist in the way webcat/osx handles threads that could cause this massive difference in performance? Do other applications that run on both OSX and Linux have this problem, or is this a problem specific to webcat? If not in webcat, then the problem should be reported to the Darwin group and to Apple as a bug.If this is an inherent flaw in (current) OSX, I would strongly discourage anyone from using webcat/osx for busy webcat-driven sites. It certainly can't keep up with our (relatively simple) testing suite using Netsplat.-Dale -- Dale LaFountain Vice President of Information Technology, WebMaster Dark Horse Comics, Inc. mailto:dalel@darkhorse.com Phone: 503-652-8815 x324 http://www.darkhorse.com/------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/ Associated Messages, from the most recent to the oldest:

    
  1. Re: macosx 1 process, linux N processes, macosx chokes under load (Aaron Lynch 2001)
  2. Re: macosx 1 process, linux N processes, macosx chokes under load (Dale LaFountain 2001)
  3. Re: macosx 1 process, linux N processes, macosx chokes under load (Alain Russell 2001)
  4. Re: macosx 1 process, linux N processes, macosx chokes under load (Aaron Lynch 2001)
  5. Re: macosx 1 process, linux N processes, macosx chokes under load (Dale LaFountain 2001)
  6. Re: macosx 1 process, linux N processes, macosx chokes under load (Aaron Lynch 2001)
  7. Re: macosx 1 process, linux N processes, macosx chokes under load (Alain Russell 2001)
  8. Re: macosx 1 process, linux N processes, macosx chokes under load (Dale LaFountain 2001)
  9. Re: macosx 1 process, linux N processes, macosx chokes under load (Le Pham 2001)
  10. macosx 1 process, linux N processes, macosx chokes under load (Dale LaFountain 2001)
Le Pham wrote: >Dale LaFountain wrote: >> >> I have been doing extensive performance testing to find the fastest >> hardware/software combination to run our websites. In my testing, I >> found that for single executions, MacOSX executes webcat code about >> 33% faster than a similar Linux box (P3-550 dual). >> >> However, when I execute any number of simultaneous requests using a >> performance tool like Netsplat, MacOSX quickly grinds to a halt while >> Linux keeps up rather well. >> >> Upon further inspection, it appears that Linux webcat starts 4 >> processes on launch, and then spawns additional child processes for >> every simultanous request. The OSX version runs ALL requests through >> a single process, which is apparently a huge bottleneck. >FYI, Mac OS X does spwan threads to handle request, it is just in >different way. Use command top during your test you can see >number of threads that spawned by WebCatalog >After WebCatalog is launched on Mac OS X, using top command you >will see there are three threads attached with WebCatalog process >Linux shows 4 processes. These are include 1 for main WebCatalog >process and the remain three are spawned threadsOK, fair enough. I see the threadcount rising now when I run Netsplat on OSX.> > >> Why is webcat set up this way on OSX, and can it be fixed to act more >> like Linux? >WebCat itself is using the same method of spwaning threads to handle >requests. But POSIX thread package is implemented different on >Linux and Mac OSX. And it is the part of kernel, we could not do >any thing to force both OS act as the same way. > >> >> Also, the 10.0.4 update to OSXS 2.0 resulted in a 50% improvement in >> webcat performance in cpu-intensive calculations. However, it's >> still an order of magnitude slower than Linux when under a heavy load >> (134 seconds vs 18 seconds). >We are experience the same result here. WebCat/Linux always runs >faster the WebCat/Mac OS X Server/Client >I think it is OS dependentOSX is NOT always slower. Running a single instance of my template, OSX is faster by 50%. It's only when multiple requests occur simultaneously that OSX crawls, even in comparison to OS9/Webstar on the same hardware.Isn't it possible that some inefficiencies exist in the way webcat/osx handles threads that could cause this massive difference in performance? Do other applications that run on both OSX and Linux have this problem, or is this a problem specific to webcat? If not in webcat, then the problem should be reported to the Darwin group and to Apple as a bug.If this is an inherent flaw in (current) OSX, I would strongly discourage anyone from using webcat/osx for busy webcat-driven sites. It certainly can't keep up with our (relatively simple) testing suite using Netsplat.-Dale -- Dale LaFountain Vice President of Information Technology, WebMaster Dark Horse Comics, Inc. mailto:dalel@darkhorse.com Phone: 503-652-8815 x324 http://www.darkhorse.com/------------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://search.smithmicro.com/ Dale LaFountain

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

Almost a there but..bye bye NetCloak (1997) emailer and bad addresses (1997) Using Plug-In while running 1.6.1 (1997) Newbie search question (between two dates) (2001) New WebMerchant/Mac beta available (1997) [SearchString] usage (1997) WC2f3 (1997) Re:Has this happened to you? (1997) 6.0 Serial - Moving to New Server (2004) Re:Non-technical messages ... (1997) Secure server question (1997) WebCatalog Mac and cgi-bin (WebSTAR 2.0) (1997) Caching [include] files ... (1997) database problems (1999) Searching multiple fields from one form field (1997) input and accents (2000) Sort Order on a page search (1997) Requiring that certain fields be completed (1997) Test! (2003) orderfile headers (was: 2nd Request for help/adviceonvariable pricing) (2000)