Campaign email queue not working good

[jeffdude]

Reading through the forums it seems others have a similar problem but I have found no solution yet.

I have an email campaign set up, emails are in the queue, and cron is set up. It works but not like it should. It sends emails but not as many as it should. It sends a few and it's very inconsistent.

Background Info:
Cron is set as recommended to run every minute.
Email is text with one image which is attached. (39kb)
Email batch size is 5
Scheduled to run every 10 minutes between 7am and 5pm
SugarCRM 6.1.1
Shared host (LAMP)


Issue 1: Setting the campaign active times does not map properly. For example if I set Active from to a certain time, it saves to be a different number. It's like it's offset.

Working through Issue 1, I entered in offset numbers so that it finally shows it's active from 7am to 5pm after saved.

Here are the results today:
As per the scheduler, it ran at 5:00pm and 5:10pm. Nothing since and it's now 6:24pm.
At 5:00pm 5 were sent (good).
At 5:10pm 3 were sent (missing 2)
Still 100+ in message queue.

In the email queue via Admin they are all saying they have been attempted 2 times (I have been trying many things over the past few days) and they are all checked "In Progress".

The email host is the same as the web host. Yesterday I changed my outgoing email server from mail.example.com (authenticated) to localhost (unauthenticated). Email still works this way but does not help my campaign email issue.

I will continue to try and figure out what is wrong, but can someone please offer suggestions??? Thanks

[jeffdude]

I've had a little bit more luck, but things are still not perfect.

- I set the cron to run every 5 mins.
- I set the campaign schedule to run every 5 mins (ie. 60 per hour)
- set the scheduler to be active always.

Ran ok for a few hours perfectly. Then at 9:45pm it sent 4 of the 5 and stopped. Didn't send an email since then. In the scheduler its logging that it's being triggered every 5 mins still so it's not the cron or the scheduler. Somehow it's like the email queue or email account is locking up.

[jeffdude]

I have 27 emails stuck in the email queue. Again, cron is working and the Scheduler is showing it's running as per the schedule. But the emails aren't moving.

Any idea why???

[jeffdude]

This is in the SugarCRM logs.... Anyone know what this means?
-------------

Wed Apr 27 22:50:24 2011 [31425][500a7e23-fd41-f5c5-0ae5-4d4c9cadf239][FATAL] SugarPHPMailer encountered an error: SMTP Error: Data not accepted.
Wed Apr 27 22:50:24 2011 [31425][500a7e23-fd41-f5c5-0ae5-4d4c9cadf239][FATAL] Email delivery FAILURE:Array
(
[date_entered] => 2011-04-25 07:35:26
[date_modified] =>
[user_id] => 500a7e23-fd41-f5c5-0ae5-4d4c9cadf239
[id] => 245
[campaign_id] => bb87596f-1657-0d75-7dd6-4db4743fd751
[marketing_id] => 984066fc-d0f0-62b4-a02a-4db477f7927e
[list_id] => cd8a2fa6-cc25-873d-c1f1-4db47411eb2d
[send_date_time] => 2011-04-24 07:00:00
[modified_user_id] =>
[in_queue] => 1
[in_queue_date] => 2011-04-26 10:38:36
[send_attempts] => 2
[deleted] => 0
[related_id] => 18789c59-e17f-43f8-62c0-4db51ffa8d71
[related_type] => Prospects
)

Wed Apr 27 22:50:24 2011 [31425][500a7e23-fd41-f5c5-0ae5-4d4c9cadf239][FATAL] Email delivery error:Array
(
[date_entered] => 2011-04-25 07:35:26
[date_modified] =>
[user_id] => 500a7e23-fd41-f5c5-0ae5-4d4c9cadf239
[id] => 245
[campaign_id] => bb87596f-1657-0d75-7dd6-4db4743fd751
[marketing_id] => 984066fc-d0f0-62b4-a02a-4db477f7927e
[list_id] => cd8a2fa6-cc25-873d-c1f1-4db47411eb2d
[send_date_time] => 2011-04-24 07:00:00
[modified_user_id] =>
[in_queue] => 1
[in_queue_date] => 2011-04-26 10:38:36
[send_attempts] => 2
[deleted] => 0
[related_id] => 18789c59-e17f-43f8-62c0-4db51ffa8d71
[related_type] => Prospects
)
SMTP Error: Data not accepted.

[jeffdude]

Anyone have any ideas??

I started another campaign and same thing. I'm sending batched of 10 and not always do all of them get sent. For example 7 gets send and the other in the EMail Queue show In Progress and attempted 1 time. Why??

[bbeyst]

I'm encountering nearly the same issue trying to conduct an email campaign....

Using SugarCE 5.5.1 on a hosted Linux system

I have 5 individuals in my target list, all with unique and verified emails. I've set up a campaign with multiple emails, each at a different time (i.e. 4:00, 4:15, etc). The campaign was set up to send emails (as opposed to newsletters). The emails are very simple and small text emails for testing purposes -- pulls the recipient's 1st name from the database, may use bod or italic text, but no more then 3 lines, no graphics. Outbound mail server has been properly configured and used to send emails to leads. The first time cron/scheduler initiated the emails to be sent from the queue, 2 of my 5 recipients received an email (one is "opted out" for test purposes), and two remained in the queue. On the second attempt 15 minutes later, the other two recipients received an email, the first two recipients' emails remained in the queue, and again the opted-out recipient's email was dropped from the queue. Here's the truly strange thing: if I click on "Send Queued Emails" right at the time when the emails are scheduled to go out, everyone receives their email, nothing is left abandoned in the queue.

I also set up this test as 4 separate campaigns, each utilizing one of the simple email templates used above and sending at the same frequency. The results are essentially the same, with some (most) of the emails remaining stuck in the queue.

Having repeated this test numerous with different variations on frequency, number of emails per campaign, even using a newsletter campaign vs an email campaign, the results are unchanged -- the scheduler fires right on time, but its a total shot in the dark as to which emails will be sent and which will remain in the queue.

I've noted in the forums that issues similar to this have existed for some time -- spanning versions 4.x through 6.x. I'm convinced that Sugar is the way to go for our company, having already tried the competing community-based crms available. However, some of this bugginess and lack of functionality is getting frustrating (I've already flattened my forehead banging my head against the keyboard ). I would deeply appreciate any guidance or help from the more experienced Sugar users....

Another related question: many of the replies on other forums have indicated that it may be necessary to modify the php.ini file to increase the maximum execution time. Our hosted system allows for the cron job to fire at the most every 15 minutes -- can it really take more than 900 seconds to send 5 short text-only emails?

If its helpful, below is a sample from the sugarlog file:

Fri May 13 09:30:30 2011 [7018][1][FATAL] SCHEDULERS: could not get an IMAP connection resource for ID [ e3c34a75-dc37-a5c1-decf-4dca19f8eb67 ]. Skipping mailbox [ Sales@ ].
Fri May 13 09:45:24 2011 [7315][1][FATAL] SCHEDULERS: could not get an IMAP connection resource for ID [ e3c34a75-dc37-a5c1-decf-4dca19f8eb67 ]. Skipping mailbox [ Sales@ ].
Fri May 13 09:45:26 2011 [7315][1][FATAL] SMTP -> ERROR:Password not accepted from server. Code: 535 Reply: 535 5.7.8 Error: authentication failed: UGFzc3dvcmQ6

Fri May 13 09:45:26 2011 [7315][1][FATAL] SugarPHPMailer encountered an error: SMTP Error: Could not authenticate.
Fri May 13 09:45:26 2011 [7315][1][FATAL] SugarPHPMailer encountered an error: SMTP Error: Could not connect to SMTP host.
Fri May 13 09:45:26 2011 [7315][1][FATAL] SugarPHPMailer encountered an error: An outbound mail server is not configured for outoing email for the mail account that you are using. Please select or add an outbound mail server for the mail account.
Fri May 13 09:45:26 2011 [7315][1][FATAL] Email delivery FAILURE:Array
(
[date_entered] => 2011-05-13 09:03:15
[date_modified] =>
[user_id] => 1
[id] => 159
[campaign_id] => b0a80328-d1b1-ce54-df13-4dccf24b89fa
[marketing_id] => 245db26c-3314-7388-6bfe-4dccf2b7801e
[list_id] => 59b5378c-4c6e-04d3-200d-4dcaf2030a6c
[send_date_time] => 2011-05-13 09:45:00
[modified_user_id] =>
[in_queue] => 0
[in_queue_date] =>
[send_attempts] => 0
[deleted] => 0
[related_id] => b2f4e229-883f-ed24-80a1-4dcaf73319bb
[related_type] => Leads
)

Fri May 13 09:45:26 2011 [7315][1][FATAL] Email delivery error:Array
(
[date_entered] => 2011-05-13 09:03:15
[date_modified] =>
[user_id] => 1
[id] => 159
[campaign_id] => b0a80328-d1b1-ce54-df13-4dccf24b89fa
[marketing_id] => 245db26c-3314-7388-6bfe-4dccf2b7801e
[list_id] => 59b5378c-4c6e-04d3-200d-4dcaf2030a6c
[send_date_time] => 2011-05-13 09:45:00
[modified_user_id] =>
[in_queue] => 0
[in_queue_date] =>
[send_attempts] => 0
[deleted] => 0
[related_id] => b2f4e229-883f-ed24-80a1-4dcaf73319bb
[related_type] => Leads
)
An outbound mail server is not configured for outoing email for the mail account that you are using. Please select or add an outbound mail server for the mail account.
Fri May 13 09:45:28 2011 [7315][1][FATAL] SMTP -> ERROR:Password not accepted from server. Code: 535 Reply: 535 5.7.8 Error: authentication failed: UGFzc3dvcmQ6

[agcopley]

Check this link out.

It helped me some time back and may have some ideas for you
http://www.sugarcrm.com/forums/showt...ht=tracker+url

Thx
Andrew

[bbeyst]

Thanks for the response.

Yes, did try the deleting technique and the patch as suggested the that thread, neither of which worked. My above post was after doing each.

I was very hopeful with the patch as I'm sure this is a coding issue. But when I made the prescribed changes to Modules/EmailTemplates/EmailTemplate.php I was unable to add an email template to the campaign -- everytime I clicked on add email template it acted as if it just executed a script by wiping out all the displayed email module form and subpanels and replacing it with a single line of text.

The error message we're getting suggests that Sugar is loosing the system password and/or user name after a few emails. This suggests a coding issue for which the patch seems to be on the right track. I only know enough php to be mildly dangerous, not even a little effective. If someone can help me apply the patch that others have found so wonderful I'd be grateful.

[bbeyst]

When I modified modules/phpmailer/class.smtp.php as follows all the emails go out instantly and without error:

// $password = from_html($password);
$password = 'smtp_password';
// Send encoded password
fputs($this->smtp_conn, base64_encode($password) . $this->CRLF);

Apparently the code $password = from_html($password) is not pulling the user's smtp password from the config.php file. By hard coding my smtp password into the class.smtp.php file all errors go away.