Re: Server Freeze
This WebDNA talk-list message is from 1998
It keeps the original formatting.
numero = 17847
interpreted = N
texte = >>>Also, when sending mass quantities of email, the server locks up while >>>WebCatalog writes out 5500 files to the outgoing email directory this takes >>>3 to 5 minutes while the server can't be used. >> >>It takes a while to write 5500 new text files to disk. The MacOS has to >>catalogue them as they are created, so the delay is most likely not a >>WebCatalog issue, it's probably an issue related to the speed of the MacOS itself. > >I don't have a problem with the speed, I'd be happy if it took 15 minutes, >I'm not expecting a miracle here, I realize Hard drive access is required >for this. I'm annoyed that the webserver can't be used as a web server while >this is happening. It is an insult that ANY program running on ANY server >should monopolize 100% of the CPU time.I've noticed similar limitations in my recent WebCatalog-intensive tasks myself. Even though WebCatalog is supposed to be multi-threaded, intensive tasks seem to stop everything else!So Im not so sure that WebCatalog's multi-threading is working properly ... or if it is, then I'm the one who has made some foolish assumptions based on lack of information.I always *assumed* that if one thread was performing a task that was going to take a long time, the other threads would be available and still functional ...WRONG!Here's what I was trying to do within WebCatalog -- which I now have to do externally, because WebCatalog stops serving for literally 10 or 20 hours at a time when I attempt this:Each week I get a new a 10,000 record update file from my supplier, and that update file must be *merged* with a 250,000 record WebCat database file.Basically, every record in the 10,000 record update file that's flagged with a C for change, or a D for delete must be found in the 250,000 record database, and the proper action taken to update or delete the matching record. Then there's usually a bunch of A records in the update file which must be appended as well ...I had thought that even though one thread might be busy with this task for several hours or even days, the other threads would continue to hum right along, serving data with WebCatalog's incredible speed as usual.But surprise surprise ... that's *not* how it works!Instead of ANY of the other threads remaining functional, they ALL seem to stop working.So now I have to run my updates thru Panorama on the desktop, then when it's done, I take the newly-updated 250,000 record database Panorama has exported , and I use it to replace the existing 250,000 record db WebCat is currently using.It seems this multi-threading thing works a whole lot differently than I thought it did. Apparently you cannot perform processor-intensive tasks in a single thread because the processor ends up getting taken over and then it simply cannot handle *anything else* until it's finished.To me, that's a serious problem to watch out for ... :(Sincerely, Ken Grome 808-737-6499 WebDNA Solutions mailto:ken@webdna.net http://www.webdna.net
Associated Messages, from the most recent to the oldest:
>>>Also, when sending mass quantities of email, the server locks up while >>>WebCatalog writes out 5500 files to the outgoing email directory this takes >>>3 to 5 minutes while the server can't be used. >> >>It takes a while to write 5500 new text files to disk. The MacOS has to >>catalogue them as they are created, so the delay is most likely not a >>WebCatalog issue, it's probably an issue related to the speed of the MacOS itself. > >I don't have a problem with the speed, I'd be happy if it took 15 minutes, >I'm not expecting a miracle here, I realize Hard drive access is required >for this. I'm annoyed that the webserver can't be used as a web server while >this is happening. It is an insult that ANY program running on ANY server >should monopolize 100% of the CPU time.I've noticed similar limitations in my recent WebCatalog-intensive tasks myself. Even though WebCatalog is supposed to be multi-threaded, intensive tasks seem to stop everything else!So Im not so sure that WebCatalog's multi-threading is working properly ... or if it is, then I'm the one who has made some foolish assumptions based on lack of information.I always *assumed* that if one thread was performing a task that was going to take a long time, the other threads would be available and still functional ...WRONG!Here's what I was trying to do within WebCatalog -- which I now have to do externally, because WebCatalog stops serving for literally 10 or 20 hours at a time when I attempt this:Each week I get a new a 10,000 record update file from my supplier, and that update file must be *merged* with a 250,000 record WebCat database file.Basically, every record in the 10,000 record update file that's flagged with a C for change, or a D for delete must be found in the 250,000 record database, and the proper action taken to update or delete the matching record. Then there's usually a bunch of A records in the update file which must be appended as well ...I had thought that even though one thread might be busy with this task for several hours or even days, the other threads would continue to hum right along, serving data with WebCatalog's incredible speed as usual.But surprise surprise ... that's *not* how it works!Instead of ANY of the other threads remaining functional, they ALL seem to stop working.So now I have to run my updates thru Panorama on the desktop, then when it's done, I take the newly-updated 250,000 record database Panorama has exported , and I use it to replace the existing 250,000 record db WebCat is currently using.It seems this multi-threading thing works a whole lot differently than I thought it did. Apparently you cannot perform processor-intensive tasks in a single thread because the processor ends up getting taken over and then it simply cannot handle *anything else* until it's finished.To me, that's a serious problem to watch out for ... :(Sincerely, Ken Grome 808-737-6499 WebDNA Solutions mailto:ken@webdna.net http://www.webdna.net
Kenneth Grome
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
HomePage Caution (1997)
can WC render sites out? (1997)
Summing fields (1997)
SPAM (OT) (2004)
WebCat 4.5 and Windows Server 2003 (2006)
Practice runs ? (1997)
setting taxable to true (1997)
Location of Browser Info.txt file (1997)
[WriteFile] problems (1997)
Many $WebCat.exe processes (1998)
SSL and reg web*L and reg web* (1997)
HomePage Caution (1997)
Auto entering Friday's date in a field (2002)
syntax question, not in online refernce (1997)
Protect Tag and Groups (1998)
getting images' width/height (1998)
OT: Unix Find Question (2004)
Bug Report, maybe (1997)
syntax question, not in online refernce (1997)
Searching multiple Databases (1997)