Soft-/Hardbounce

duke · Post by **duke** » Tue Nov 27, 2007 4:42 pm

Hello,

I recently started using OpenEMM, everything works fine so far except of my bounce-management:
hardbounces (at SMTP-Data time) are recognized correctly, but bounces with non delivery reports (NDR, "User unknown") are allways flagged as softbounce. My <insertdatehere>-extbounce.log allways shows "5.0.0;0;7;0;13;mailloop=Action: failed".
I tried to tweak the bav.rule with no success ... but maybe it's the wrong way, too.

Maybe someone could push me in the right direction?

Thanks in advance and kind regards,
Michael

ud · Post by ud » Wed Nov 28, 2007 8:38 am

As every mail server seems to report errors in its very own way, you can change the "bav.rule" file to catch these cases. Be aware to either send us the changes to add them to the next release or backup your rule files before updates and restore your version then.

-- ud

duke · Post by **duke** » Wed Nov 28, 2007 9:22 am

Thanks for the fast reply

Sure I'll send you the changes as soon as I figured them out.
Is there any documentation for the bav.rule-file?

And whats this "mailloop=Action: failed" about?

Kind regards,
Michael

ud · Post by ud » Wed Nov 28, 2007 9:47 am

The bav.rule file has several section starting wirh [...] followed by a regular expression, one per line to match for this section. For hardbounces the section [hard] is the one to add your rules.

The line in the extbounce file shows the part of the mail that matches a regular expression from bav.rule.

To be most conservative we only mark these cases as hard bounce when we really got a valid DSN from the mail indicating this. This avoids marking recipients as hard bounces when their mail server just sends unspecific error messages.

-- ud

slackamp · Post by **slackamp** » Fri Dec 07, 2007 7:38 pm

How should I add like in bav.rule to process this as a hard bounce? Currently it is not processing it as such.

Dec 7 12:15:31 hostname sendmail[4494]: 118aT65fd00000001: to=<johndoe@domain.com>, delay=00:00:59, xdelay=00:00:02, mailer=esmtp, pri=0, relay=mail.domain.com. [xx.xx.xxx.xx], dsn=5.1.1, stat=User unknown

Do I just add a line that says "User unknown" under hard?

slackamp · Post by **slackamp** » Mon Dec 10, 2007 5:11 pm

any one? btw 5.1.1 should be a hard error right? it is not in bav.rule

harfst · Post by **harfst** » Thu Jan 24, 2008 11:50 pm

I had to add the following to bav.rule under [hard]:

550 No such recipient

I would suggest to others to look at var/spool/filter/unspec-1, look at the bounce messages there, and look for a tell tail line that can be put in bav.rule.

I spent about two hours putting debug messages in bavd.py and testing to figure out what it was doing before figuring out why bav.rule wasn't catching my messages. A LITTLE DOCUMENTATION WOULD BE NICE!!!!

BYW, contrary to what's been posted, nothing ever gets written to extbounce.log.

slackamp · Post by **slackamp** » Fri Apr 25, 2008 8:56 pm

until now there is answer or fix to his? User unknown is still not being triggered as hard bounce? how is bav.rule setup to add this?

I tried like this:

[hard]
#
unknown user|user unknown|user not found
User unknown

or like this:

[hard]
#
unknown user|user unknown|user not found|User unknown

harfst · Post by **harfst** » Mon Apr 28, 2008 2:30 pm

The format uses regular expressions. Putting each possibliity on a seperate line seems to work better.

I had to add a bunch of stuff to get mine to work properly. The base file barely got anything. Here is my [hard] section:

[hard]
#
unknown user|user unknown|user not found
550 No such recipient
Remote host said: 550
Diagnostic-[Cc]ode: .*550
5\.1\.0 - Unknown address error 550-
550-.*Your message was blocked
Delivery status.*550
MTA Response :550
\[SMTP Error Code 550\]
^ Recipient.s Mailbox unavailable
^Receiver not found:
^Action: failed
^Sorry, no mailbox here by that name\.
^ The recipient name is not recognized
^Invalid receiver address:
^did not reach the following recipient$s$:
^Ihre Mail ist leider nicht zustellbar\.
^Sorry. Your message could not be delivered to:
^No such user\.
^ user .* not known at this site\.
^ unknown local-part .* in domain .*
^.* sorry, no such mailbox here
^User not listed in public
The user.s email name is not found\.
: unknown recipient:
^User not known
^Diese Adresse ist nicht mehr verfuegbar\.$
#
# tassilos hard world
^The following destination addresses were unknown
Received <<< 550 Invalid recipient <.*>
Unknown recipient address
address: <.*> ... failed
<<< 550 <.*> ... failed
550 No [Ss]uch [Uu]ser
550 No such recipient
550 Invalid recipient <.*>
550 Unknown local part .* in <.*>
550 #5\.1\.0 Address rejected
550 .* mailbox unavailable
550 5\.1\.1 .* User unknown
550 MAILBOX NOT FOUND
does not like recipient
no mailbox here
550 [Mm]ailbox not found
553 Invalid recipient address
Sorry, I couldn't find any host named .* (#5.1.2)
[Ss]orry, no mailbox
550 .* User unknown
User name is unknown
Delivery to the following recipients failed
no vaild recipients were found for this message
This user doesn.t have a yahoo.de account
recipients failed permanently

Post by **maschoff** » Tue Apr 29, 2008 3:12 pm

harfst, thank you for your hard work! We will work through your extensive list and include the appropriate lines in the next release of OpenEMM.

But please be aware that - unfortunately - sometimes a message indicating a hard bounce is really only a soft bounce. You can test this by yourself when you send a mailing only to addresses filtered by your list above a few days later and suddenly some of the mails go through and even generate openings and link clicks.

dlaplant · Post by **dlaplant** » Sat Jul 05, 2008 5:46 am

Do you have to do anything other than edit bav.rule to expand the filters? Do you have to stop/start OpenEMM?

Post by **maschoff** » Mon Jul 07, 2008 8:33 am

The rules are updates every 3 minutes. Therefore, no restart is necessary.

BG · Post by BG » Mon Jul 07, 2008 2:50 pm

Hi

Something is not clear for me.
The bav.rule file is used for processing incoming NDR e-mail messages or used for parse the maillog?
Unfortunately the instant bounce (maillog parse) does not work on my machine, however the rigths on the file are OK.
I have this line in the maillog

Code: Select all

Jul  7 15:28:54 hostname sendmail[3652]: e42Tc86700000001: to=<invalid@address.com>, delay=00:00:33, xdelay=00:00:00, mailer=esmtp, pri=0, dsn=5.1.1, stat=User unknown

and this line in the bav.rule

Code: Select all

[hard]
#
[Uu]nknown user|[Uu]ser unknown|[Uu]ser not found

and I don't see bounces under the Delivery Statictics

Thank you in advance
bg

BG · Post by BG » Tue Jul 08, 2008 3:54 pm

Hi,

Now I know that detection of instant bounces are made by the slrtscn.py script. Which could not parse my maillog file. I did some changes, now it could parse, but the statictics do not show it.

http://www.openemm.org/forums/viewtopic.php?p=2485#2485
If anyone have any comment on this please post.
Thank you
bg