Re: [WebDNA] Mass email using WebDNA

This WebDNA talk-list message is from

2008


It keeps the original formatting.
numero = 100845
interpreted = N
texte = For very heavy mail activity, we use an external dedicated mail server, replacing "localhost" by the SMTP server name. The external delivery server then takes care of queueing and limiting speed for some domains (Some large providers will assume you are a spammer if you send too many messages in an hour). This allows not to rely too heavily on WebDNA to deliver the mails and is much faster for mass mailing. WebDNA load is also lower. - chris On Sep 18, 2008, at 13:22, Psi Prime, Matthew A Perosi wrote: > I'm running RedHat 4ES on a dual Xeon. The website became sluggish > when there were about 4500 files in the EMailsCompleted folder. > They tried to send another 1000 emails and the entire site almost > came to a stop. It was only that Sandbox though. > > Perhaps it's a limitation of the filesystem on Linux. I didn't > research it further because I had already created a solution. > Unfortunately my solution wasn't working that day because the > Triggers on many of my Sandboxes frequently stop working all > together or reset themselves to several days into the future. > > IMHO the Triggers need a lot of work to make them more stable. We > need to rely on them a lot and they are way too buggy. > > Matthew A Perosi | > Psi Prime, Inc. | > http://www.psiprime.com | > http://en.wikipedia.org/wiki/Psi_Prime%2C_Inc | > 323 Union Blvd. | > Totowa, NJ 07512 | > P: 973.413.8210 | > F: 973.413.8217 | > > > > Marc Thompson wrote: >> Matthew, >> Interesting that you have EMailFolders that don't "like more than >> 2000 files at a time."? I'm running on Solaris and have an >> EMailCompleted folder with 405795 files in it. These files date >> back to early 2005 and we've not had any problem? >> Do they need to be archived? Yes, and while I'm thinking about it >> I'll get that done, but it's something I've never really had to >> worry about... >> >> Marc Thompson >> >> Psi Prime, Matthew A Perosi wrote: >> >>> I can also tell you from personal experience that none of the >>> EMailFolders like more than 2000 files at a time. The server or >>> sandbox chokes to death! In my early attempts with this I tried >>> process too many [sendmails] at a time and the server got caught >>> in an endless loop of sending a single email over and over until I >>> rebooted. >>> >>> I wrote a trigger that reorganizes the EMailFolders every night. >>> It moves the done emails into another subfolder and prevents the >>> choking I mentioned above. But if you want to send 400000 emails >>> in a day you need to account for this issue. >>> >>> >>> Matthew A Perosi | >>> Psi Prime, Inc. | >>> http://www.psiprime.com | >>> http://en.wikipedia.org/wiki/Psi_Prime%2C_Inc | >>> 323 Union Blvd. | >>> Totowa, NJ 07512 | >>> P: 973.413.8210 | >>> F: 973.413.8217 | >>> >> >> >> >>> >>> >>> Donovan Brooke wrote: >>>> Tom Duke wrote: >>>> >>>>> Hi all, >>>>> >>>>> I need to upgrade a mass email tool that I have built for a >>>>> client. They are currently mailing to a list of about 7000. I >>>>> was wondering if anyone else has built such a tool? >>>>> >>>>> Things I need to code in to the upgrade are: >>>>> >>>>> - the ability to mail to a list of up 400000 >>>>> - the ability to track open rates for the email >>>>> - some method of handling email bounces >>>>> >>>>> I figure I need to decide whether WebDNA can do all this or >>>>> whether I need to look at something else like phpList. >>>>> >>>>> Thanks >>>>> - Tom >>>> >>>> >>>> Hi Tom, >>>> I haven't built quite the robust system.. but why not.. I don't >>>> think >>>> it is a question of whether or not WebDNA could do this, but >>>> whether >>>> or not it's coded correctly... 400000 emails eh? I'm >>>> not gonna qet more spam am I? ;-) >>>> >>>> I guess you'd have to build a robust system that not only plays >>>> well >>>> with the CPU but accounts for errors. I would think 5 spawned >>>> threads >>>> at a time? and make the general page a spawned function as well?.. >>>> just guessing really. >>>> >>>> Maybe instead of one search through the database, your system >>>> keeps track of the "max" and "startat" params... so you are always >>>> sending a limited search that gives the system a break between >>>> searches?? >>>> >>>> then upon failure (if it were to happen), you would know what your >>>> last startat was?? Just a couple thoughts. >>>> >>>> Good luck. >>>> Donovan >>>> >>>> >>>> >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> old archives: http://dev.webdna.us/TalkListArchive/ >>> >> > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > old archives: http://dev.webdna.us/TalkListArchive/ Associated Messages, from the most recent to the oldest:

    
  1. Re: [WebDNA] Mass email using WebDNA (Stuart Tremain 2008)
  2. Re: [WebDNA] Mass email using WebDNA ("Psi Prime, Matthew A Perosi " 2008)
  3. Re: [WebDNA] Mass email using WebDNA (Stuart Tremain 2008)
  4. Re: [WebDNA] Mass email using WebDNA (Chris 2008)
  5. Re: [WebDNA] Mass email using WebDNA (Stuart Tremain 2008)
  6. Re: [WebDNA] Mass email using WebDNA (Chris 2008)
  7. Re: [WebDNA] Mass email using WebDNA ("Psi Prime, Matthew A Perosi " 2008)
  8. Re: [WebDNA] Mass email using WebDNA (Donovan Brooke 2008)
  9. Re: [WebDNA] Mass email using WebDNA (Marc Thompson 2008)
  10. Re: [WebDNA] Mass email using WebDNA ("Psi Prime, Matthew A Perosi " 2008)
  11. Re: [WebDNA] Mass email using WebDNA (Chris 2008)
  12. Re: [WebDNA] Mass email using WebDNA ("Tom Duke" 2008)
  13. Re: [WebDNA] Mass email using WebDNA (Donovan Brooke 2008)
  14. [WebDNA] Mass email using WebDNA ("Tom Duke" 2008)
For very heavy mail activity, we use an external dedicated mail server, replacing "localhost" by the SMTP server name. The external delivery server then takes care of queueing and limiting speed for some domains (Some large providers will assume you are a spammer if you send too many messages in an hour). This allows not to rely too heavily on WebDNA to deliver the mails and is much faster for mass mailing. WebDNA load is also lower. - chris On Sep 18, 2008, at 13:22, Psi Prime, Matthew A Perosi wrote: > I'm running RedHat 4ES on a dual Xeon. The website became sluggish > when there were about 4500 files in the EMailsCompleted folder. > They tried to send another 1000 emails and the entire site almost > came to a stop. It was only that Sandbox though. > > Perhaps it's a limitation of the filesystem on Linux. I didn't > research it further because I had already created a solution. > Unfortunately my solution wasn't working that day because the > triggers on many of my Sandboxes frequently stop working all > together or reset themselves to several days into the future. > > IMHO the triggers need a lot of work to make them more stable. We > need to rely on them a lot and they are way too buggy. > > Matthew A Perosi | > Psi Prime, Inc. | > http://www.psiprime.com | > http://en.wikipedia.org/wiki/Psi_Prime%2C_Inc | > 323 Union Blvd. | > Totowa, NJ 07512 | > P: 973.413.8210 | > F: 973.413.8217 | > > > > Marc Thompson wrote: >> Matthew, >> Interesting that you have EMailFolders that don't "like more than >> 2000 files at a time."? I'm running on Solaris and have an >> EMailCompleted folder with 405795 files in it. These files date >> back to early 2005 and we've not had any problem? >> Do they need to be archived? Yes, and while I'm thinking about it >> I'll get that done, but it's something I've never really had to >> worry about... >> >> Marc Thompson >> >> Psi Prime, Matthew A Perosi wrote: >> >>> I can also tell you from personal experience that none of the >>> EMailFolders like more than 2000 files at a time. The server or >>> sandbox chokes to death! In my early attempts with this I tried >>> process too many [sendmails] at a time and the server got caught >>> in an endless loop of sending a single email over and over until I >>> rebooted. >>> >>> I wrote a trigger that reorganizes the EMailFolders every night. >>> It moves the done emails into another subfolder and prevents the >>> choking I mentioned above. But if you want to send 400000 emails >>> in a day you need to account for this issue. >>> >>> >>> Matthew A Perosi | >>> Psi Prime, Inc. | >>> http://www.psiprime.com | >>> http://en.wikipedia.org/wiki/Psi_Prime%2C_Inc | >>> 323 Union Blvd. | >>> Totowa, NJ 07512 | >>> P: 973.413.8210 | >>> F: 973.413.8217 | >>> >> >> >> >>> >>> >>> Donovan Brooke wrote: >>>> Tom Duke wrote: >>>> >>>>> Hi all, >>>>> >>>>> I need to upgrade a mass email tool that I have built for a >>>>> client. They are currently mailing to a list of about 7000. I >>>>> was wondering if anyone else has built such a tool? >>>>> >>>>> Things I need to code in to the upgrade are: >>>>> >>>>> - the ability to mail to a list of up 400000 >>>>> - the ability to track open rates for the email >>>>> - some method of handling email bounces >>>>> >>>>> I figure I need to decide whether WebDNA can do all this or >>>>> whether I need to look at something else like phpList. >>>>> >>>>> Thanks >>>>> - Tom >>>> >>>> >>>> Hi Tom, >>>> I haven't built quite the robust system.. but why not.. I don't >>>> think >>>> it is a question of whether or not WebDNA could do this, but >>>> whether >>>> or not it's coded correctly... 400000 emails eh? I'm >>>> not gonna qet more spam am I? ;-) >>>> >>>> I guess you'd have to build a robust system that not only plays >>>> well >>>> with the CPU but accounts for errors. I would think 5 spawned >>>> threads >>>> at a time? and make the general page a spawned function as well?.. >>>> just guessing really. >>>> >>>> Maybe instead of one search through the database, your system >>>> keeps track of the "max" and "startat" params... so you are always >>>> sending a limited search that gives the system a break between >>>> searches?? >>>> >>>> then upon failure (if it were to happen), you would know what your >>>> last startat was?? Just a couple thoughts. >>>> >>>> Good luck. >>>> Donovan >>>> >>>> >>>> >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> old archives: http://dev.webdna.us/TalkListArchive/ >>> >> > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > old archives: http://dev.webdna.us/TalkListArchive/ Christophe Billiottet

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

Add htmlarea 3 to SiteBuilder (2004) WC2.0 Memory Requirements (1997) WebCat2b15MacPlugin - [protect] (1997) & in Lookups (1997) WebCatalog Serial Number (2003) Re:no [search] with NT (1997) [OT] MacWorld Expo (2004) Newbie questions (1999) Add htmlarea 3 to SiteBuilder (2004) [if] and [showif] - A solution (2002) referrer and no caches (1997) more re newbie ? re ssl/non-ssl (1999) notification solutions (1997) Creating Dynamic Charts using WebCat and Flash (2000) Converting characters to numbers ... (1997) emailer (1997) Max Record length restated as maybe bug (1997) WebCat2b13MacPlugIn - More limits on [include] (1997) MacOS 9 => ODBC=> Ms SQL Server 7 (2000) Emailer on NT CAN'T handle large email files (1997)