Re: [WebDNA] Mass email using WebDNA
This WebDNA talk-list message is from 2008
It keeps the original formatting.
numero = 100840
interpreted = N
texte = I'm running RedHat 4ES on a dual Xeon. The website became sluggish when there were about 4500 files in the EMailsCompleted folder. They tried to send another 1000 emails and the entire site almost came to a stop. It was only that Sandbox though. Perhaps it's a limitation of the filesystem on Linux. I didn't research it further because I had already created a solution. Unfortunately my solution wasn't working that day because the Triggers on many of my Sandboxes frequently stop working all together or reset themselves to several days into the future. IMHO the Triggers need a lot of work to make them more stable. We need to rely on them a lot and they are way too buggy. Matthew A Perosi | Psi Prime, Inc. | http://www.psiprime.com | http://en.wikipedia.org/wiki/Psi_Prime%2C_Inc | 323 Union Blvd. | Totowa, NJ 07512 | P: 973.413.8210 | F: 973.413.8217 | Marc Thompson wrote: > Matthew, > Interesting that you have EMailFolders that don't "like more than 2000 > files at a time."? I'm running on Solaris and have an EMailCompleted > folder with 405795 files in it. These files date back to early 2005 > and we've not had any problem? > Do they need to be archived? Yes, and while I'm thinking about it > I'll get that done, but it's something I've never really had to worry > about... > > Marc Thompson > > Psi Prime, Matthew A Perosi wrote: >
>> I can also tell you from personal experience that none of the >> EMailFolders like more than 2000 files at a time. The server or >> sandbox chokes to death! In my early attempts with this I tried >> process too many [sendmails] at a time and the server got caught in >> an endless loop of sending a single email over and over until I >> rebooted. >> >> I wrote a trigger that reorganizes the EMailFolders every night. It >> moves the done emails into another subfolder and prevents the choking >> I mentioned above. But if you want to send 400000 emails in a day >> you need to account for this issue. >> >> >> Matthew A Perosi | >> Psi Prime, Inc. | >> http://www.psiprime.com | >> http://en.wikipedia.org/wiki/Psi_Prime%2C_Inc | >> 323 Union Blvd. | >> Totowa, NJ 07512 | >> P: 973.413.8210 | >> F: 973.413.8217 | >> > > > >> >> >> Donovan Brooke wrote: >>> Tom Duke wrote: >>> >>>> Hi all, >>>> >>>> I need to upgrade a mass email tool that I have built for a client. >>>> They are currently mailing to a list of about 7000. I was >>>> wondering if anyone else has built such a tool? >>>> >>>> Things I need to code in to the upgrade are: >>>> >>>> - the ability to mail to a list of up 400000 >>>> - the ability to track open rates for the email >>>> - some method of handling email bounces >>>> >>>> I figure I need to decide whether WebDNA can do all this or whether >>>> I need to look at something else like phpList. >>>> >>>> Thanks >>>> - Tom >>> >>> >>> Hi Tom, >>> I haven't built quite the robust system.. but why not.. I don't think >>> it is a question of whether or not WebDNA could do this, but whether >>> or not it's coded correctly... 400000 emails eh? I'm >>> not gonna qet more spam am I? ;-) >>> >>> I guess you'd have to build a robust system that not only plays well >>> with the CPU but accounts for errors. I would think 5 spawned threads >>> at a time? and make the general page a spawned function as well?.. >>> just guessing really. >>> >>> Maybe instead of one search through the database, your system >>> keeps track of the "max" and "startat" params... so you are always >>> sending a limited search that gives the system a break between >>> searches?? >>> >>> then upon failure (if it were to happen), you would know what your >>> last startat was?? Just a couple thoughts. >>> >>> Good luck. >>> Donovan >>> >>> >>> >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list
. >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> old archives: http://dev.webdna.us/TalkListArchive/ >> >
Associated Messages, from the most recent to the oldest:
I'm running RedHat 4ES on a dual Xeon. The website became sluggish when there were about 4500 files in the EMailsCompleted folder. They tried to send another 1000 emails and the entire site almost came to a stop. It was only that Sandbox though. Perhaps it's a limitation of the filesystem on Linux. I didn't research it further because I had already created a solution. Unfortunately my solution wasn't working that day because the triggers on many of my Sandboxes frequently stop working all together or reset themselves to several days into the future. IMHO the triggers need a lot of work to make them more stable. We need to rely on them a lot and they are way too buggy. Matthew A Perosi | Psi Prime, Inc. | http://www.psiprime.com | http://en.wikipedia.org/wiki/Psi_Prime%2C_Inc | 323 Union Blvd. | Totowa, NJ 07512 | P: 973.413.8210 | F: 973.413.8217 | Marc Thompson wrote: > Matthew, > Interesting that you have EMailFolders that don't "like more than 2000 > files at a time."? I'm running on Solaris and have an EMailCompleted > folder with 405795 files in it. These files date back to early 2005 > and we've not had any problem? > Do they need to be archived? Yes, and while I'm thinking about it > I'll get that done, but it's something I've never really had to worry > about... > > Marc Thompson > > Psi Prime, Matthew A Perosi wrote: > >> I can also tell you from personal experience that none of the >> EMailFolders like more than 2000 files at a time. The server or >> sandbox chokes to death! In my early attempts with this I tried >> process too many [sendmails] at a time and the server got caught in >> an endless loop of sending a single email over and over until I >> rebooted. >> >> I wrote a trigger that reorganizes the EMailFolders every night. It >> moves the done emails into another subfolder and prevents the choking >> I mentioned above. But if you want to send 400000 emails in a day >> you need to account for this issue. >> >> >> Matthew A Perosi | >> Psi Prime, Inc. | >> http://www.psiprime.com | >> http://en.wikipedia.org/wiki/Psi_Prime%2C_Inc | >> 323 Union Blvd. | >> Totowa, NJ 07512 | >> P: 973.413.8210 | >> F: 973.413.8217 | >> > > > >> >> >> Donovan Brooke wrote: >>> Tom Duke wrote: >>> >>>> Hi all, >>>> >>>> I need to upgrade a mass email tool that I have built for a client. >>>> They are currently mailing to a list of about 7000. I was >>>> wondering if anyone else has built such a tool? >>>> >>>> Things I need to code in to the upgrade are: >>>> >>>> - the ability to mail to a list of up 400000 >>>> - the ability to track open rates for the email >>>> - some method of handling email bounces >>>> >>>> I figure I need to decide whether WebDNA can do all this or whether >>>> I need to look at something else like phpList. >>>> >>>> Thanks >>>> - Tom >>> >>> >>> Hi Tom, >>> I haven't built quite the robust system.. but why not.. I don't think >>> it is a question of whether or not WebDNA could do this, but whether >>> or not it's coded correctly... 400000 emails eh? I'm >>> not gonna qet more spam am I? ;-) >>> >>> I guess you'd have to build a robust system that not only plays well >>> with the CPU but accounts for errors. I would think 5 spawned threads >>> at a time? and make the general page a spawned function as well?.. >>> just guessing really. >>> >>> Maybe instead of one search through the database, your system >>> keeps track of the "max" and "startat" params... so you are always >>> sending a limited search that gives the system a break between >>> searches?? >>> >>> then upon failure (if it were to happen), you would know what your >>> last startat was?? Just a couple thoughts. >>> >>> Good luck. >>> Donovan >>> >>> >>> >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> old archives: http://dev.webdna.us/TalkListArchive/ >> >
"Psi Prime, Matthew A Perosi "
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Webcat 3.0.7 & Webmerchant (2002)
Email Set-Up? (1997)
searching for items that begin with a number (2004)
[WebDNA] WebDNA 7.1 (2012)
unable to launch acgi in WebCat (1997)
Every other record deleted (2005)
Sort Order on a page search (1997)
[WebDNA] set HTTP-Status Code from webdna (2016)
What is the maximum record length? (1998)
forming a SKU (1999)
Requiring that certain fields be completed (1997)
Problem (1997)
encryption in browser? (1998)
Generating unique SKU from [cart] - Still Stumped... (1997)
State Coalition Approves Internet Sales Tax Plan (2002)
webcatalog loosing serial number (1998)
New command suggestion (1997)
A two part question (1999)
Emailer help needed (1998)
NetForms for mail, sorry (1998)