Re: Mondo amounts of Mail [long]

This WebDNA talk-list message is from

1999


It keeps the original formatting.
numero = 25267
interpreted = N
texte = At 11:43 AM 12/8/99, John Butler wrote: >> Joe, >> I am new at bulk email concepts... but you are saying then... that the >>first template >> that has to do the 10,000 [replace]s to make FIELD1=NO on all those >>10,00 records is not a >> webcat crashing risk, and so is much safer than trying to do 10,000 >>[writefile]s? >>That's correct. The 10,000 replaces happen in RAM and there is no disk access involved, provided you don't do a [commitdatabase] after each one. You can do a [commitdatabase] once after all 10,000 are set.The reason the server might crash when sending 10,000 [sendmail]s or 10,000 [writefile]s or similar operation, is because the MacOS just will not handle it. Something crashes...I did one of these giant e-mails on a development server. I had the folder that was going to contain the output files open and visible on the desktop at the same time I hit the template from my browser.The template was supposed to find the next 300 records, set their flag to YES, write a sendmail file and display Done in the browser window.The browser window returned Done. is less then 3 seconds. At that same moment however, the folder only contained ~50 files. I watched as over the next 50 seconds the rest of the files appeared in the folder. Now before you say that the finder was just running behind displaying the files in the desktop window, I should say that the files were being written to a drive that has a red led activity light... it was blinking and the drive was clicking away during this 50 seconds.So the bottom line is that WebCat can handle grabbing the data and spooling the files to the OS, but somewhere it's too fast for the OS to handle and I suspect it's the OS that is choking.I now keep my records returned and files to write to 300 per template hit.YMMV and I don't know how, if at all, this relates to other OS.___Joe____________________________________________________ Joseph D'Andrea JoeDan@West21.com WEST21.com Internet services for the 21st Century http://www.west21.com/ _________________________________________________ ------------------------------------------------------------- Brought to you by CommuniGate Pro - The Buzz Word Compliant Messaging Server. To end your Mail problems go to .This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Associated Messages, from the most recent to the oldest:

    
  1. Re: Mondo amounts of Mail [long] (Marty Schmid 1999)
  2. Re: Mondo amounts of Mail [long] (Joseph D'Andrea 1999)
  3. Re: Mondo amounts of Mail [long] (Jay Van Vark 1999)
  4. Re: Mondo amounts of Mail [long] (Nitai 1999)
  5. Re: Mondo amounts of Mail [long] (Brian B. Burton 1999)
  6. Re: Version number missing (was Re: Mondo amounts of Mail [long]) (Aaron Lynch 1999)
  7. Version number missing (was Re: Mondo amounts of Mail [long]) (Kenneth Grome 1999)
  8. Re: Mondo amounts of Mail [long] (Marty Schmid 1999)
  9. Re: Mondo amounts of Mail [long] (Aaron Lynch 1999)
  10. Re: Mondo amounts of Mail [long] (Aaron Lynch 1999)
  11. Re: Mondo amounts of Mail [long] (Joseph D'Andrea 1999)
  12. Re: Mondo amounts of Mail [long] (Aaron Lynch 1999)
  13. Re: Mondo amounts of Mail [long] (John Butler 1999)
  14. Re: Mondo amounts of Mail [long] (Joseph D'Andrea 1999)
  15. Re: Mondo amounts of Mail [long] (John Butler 1999)
  16. Re: Mondo amounts of Mail [long] (Joseph D'Andrea 1999)
  17. Re: Mondo amounts of Mail [long] (Michael O Shea 1999)
  18. Mondo amounts of Mail [long] (Aaron Lynch 1999)
At 11:43 AM 12/8/99, John Butler wrote: >> Joe, >> I am new at bulk email concepts... but you are saying then... that the >>first template >> that has to do the 10,000 [replace]s to make FIELD1=NO on all those >>10,00 records is not a >> webcat crashing risk, and so is much safer than trying to do 10,000 >>[writefile]s? >>That's correct. The 10,000 replaces happen in RAM and there is no disk access involved, provided you don't do a [commitdatabase] after each one. You can do a [commitdatabase] once after all 10,000 are set.The reason the server might crash when sending 10,000 [sendmail]s or 10,000 [writefile]s or similar operation, is because the MacOS just will not handle it. Something crashes...I did one of these giant e-mails on a development server. I had the folder that was going to contain the output files open and visible on the desktop at the same time I hit the template from my browser.The template was supposed to find the next 300 records, set their flag to YES, write a sendmail file and display Done in the browser window.The browser window returned Done. is less then 3 seconds. At that same moment however, the folder only contained ~50 files. I watched as over the next 50 seconds the rest of the files appeared in the folder. Now before you say that the finder was just running behind displaying the files in the desktop window, I should say that the files were being written to a drive that has a red led activity light... it was blinking and the drive was clicking away during this 50 seconds.So the bottom line is that WebCat can handle grabbing the data and spooling the files to the OS, but somewhere it's too fast for the OS to handle and I suspect it's the OS that is choking.I now keep my records returned and files to write to 300 per template hit.YMMV and I don't know how, if at all, this relates to other OS.___Joe____________________________________________________ Joseph D'Andrea JoeDan@West21.com WEST21.com Internet services for the 21st Century http://www.west21.com/ _________________________________________________ ------------------------------------------------------------- Brought to you by CommuniGate Pro - The Buzz Word Compliant Messaging Server. To end your Mail problems go to .This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Joseph D'Andrea

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

2nd WebCatalog2 Feature Request (1996) WebCat2 several catalogs? (1997) Setting up shop (1997) Cart/ Form Use (1998) Problem 2: Prefs file... (1997) Weather (2003) Running 2 two WebCatalog.acgi's (1996) FTP upload TCP Connect (2003) WebCat2b13MacPlugIn - More limits on [include] (1997) purchase.log file (1997) [OT] HTML Email in Lotus Notes (2005) Authorize.Net and AIM (2004) Uh...can someone help me out with the b10? (1997) interesting Unix bug (2000) emailer setup (1997) Writing to PDF (2003) Search/sort in URL Was: GuestBook example (1997) RE: Credit Card Checksum (1997) Customer - again (1998) Grep help needed (2004)