[EMAIL]: excessive false positive spam detection

NRK commented

2023-01-16 07:24:25 +01:00

In the past 2-3~ weeks I've noticed that mails from various mailing lists are excessively getting flagged as spam. I've forwarded them to ham.report@disroot.org but it doesn't seem to have any effect.

Is there anyway to reduce the false positives. Being able to disable automatic spam detection at a profile/account level would be something I'd be interested in as well (I'd rather just delete spam mails myself, as I get very few).

(Appologies if this isn't the right place to report such issues)

In the past 2-3~ weeks I've noticed that mails from various mailing lists are excessively getting flagged as spam. I've forwarded them to `ham.report@disroot.org` but it doesn't seem to have any effect. Is there anyway to reduce the false positives. Being able to disable automatic spam detection at a profile/account level would be something I'd be interested in as well (I'd rather just delete spam mails myself, as I get very few). *(Appologies if this isn't the right place to report such issues)*

muppeth commented

2023-01-16 10:05:10 +01:00

Owner

Hi,
Thanks for the report. I will be looking into it.

Hi, Thanks for the report. I will be looking into it.

NRK commented

2023-01-21 18:15:01 +01:00

Author

Just to illustrate the ridiculousness of the situation, my own mail that I sent to a mailing list got marked as spam:

From: NRK <nrk@disroot.org>
To: hackers@suckless.org
Subject: [SPAM Warning!][hackers] Re: [dwm][PATCH v2] Use sigaction(SA_NOCLDWAIT) for SIGCHLD handling

Would really appreciate if something can be done about this soon (preferably, I'd just like to disable the spam filter entirely for my account). Thanks!

Just to illustrate the ridiculousness of the situation, my own mail that I sent to a mailing list got marked as spam: ``` From: NRK <nrk@disroot.org> To: hackers@suckless.org Subject: [SPAM Warning!][hackers] Re: [dwm][PATCH v2] Use sigaction(SA_NOCLDWAIT) for SIGCHLD handling ``` Would really appreciate if something can be done about this soon (preferably, I'd just like to disable the spam filter entirely for my account). Thanks!

muppeth commented

2023-01-21 22:50:48 +01:00

Owner

I understand. It's on my todo list for upcomming week.

muppeth added this to the 23.01 - January milestone 2023-01-21 22:52:14 +01:00

muppeth added this to the 23.01 - January project 2023-01-21 22:52:21 +01:00

muppeth added the

Mail

Urgent!

spam-protection

labels 2023-01-21 22:52:32 +01:00

muppeth commented

2023-01-30 19:48:06 +01:00

Owner

I did some research and looks like the issue is affecting mainly mailinglists due to DMARC where mailing list server modifies headers causing the dmarc to fail. If domain has set policy to "reject" which is pretty much most of the public providers (thanks spammers), email should be rejected. We instead of rejecting, give it a higher spam score which results in those email landing in the Junk folder.
I tried to figure out whether this is fixed on mailing list software side and looks like Mailman did some fixes few years back so if list owners updated it should work. I am not sure though if it only applied to DMARC policy "quarantine" though.
So more investigation needs to be done here to verify if the issue is and will persist because of how mailing lists work or if there is something on our end we could do.

One way foward would be of course to somehow make allowlist for most of mailinglists we see passing through the server, but thats of course not ideal as it means we woul have to fish for those smaller ones.

https://lists.debian.org/debian-user/2021/07/msg00449.html
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=752084
https://lists.gnu.org/archive/html/mailman/2017-08/msg00006.html
https://lists.gnu.org/archive/html/help-gnu-emacs/2019-03/msg00007.html
https://lists.gnu.org/archive/html/savannah-hackers-public/2019-06/msg00018.html

I did some research and looks like the issue is affecting mainly mailinglists due to DMARC where mailing list server modifies headers causing the dmarc to fail. If domain has set policy to "reject" which is pretty much most of the public providers (thanks spammers), email should be rejected. We instead of rejecting, give it a higher spam score which results in those email landing in the Junk folder. I tried to figure out whether this is fixed on mailing list software side and looks like Mailman did some fixes few years back so if list owners updated it should work. I am not sure though if it only applied to DMARC policy "quarantine" though. So more investigation needs to be done here to verify if the issue is and will persist because of how mailing lists work or if there is something on our end we could do. One way foward would be of course to somehow make allowlist for most of mailinglists we see passing through the server, but thats of course not ideal as it means we woul have to fish for those smaller ones. https://lists.debian.org/debian-user/2021/07/msg00449.html https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=752084 https://lists.gnu.org/archive/html/mailman/2017-08/msg00006.html https://lists.gnu.org/archive/html/help-gnu-emacs/2019-03/msg00007.html https://lists.gnu.org/archive/html/savannah-hackers-public/2019-06/msg00018.html

muppeth removed the

Urgent!

label 2023-01-30 19:51:24 +01:00

NRK commented

2023-02-08 00:26:20 +01:00

Author

but thats of course not ideal as it means we woul have to fish for those smaller ones.

I agree that this is more of a temporary hack/workaround than an actual solution. But as of now, I'm having cases where almost every single mail from a mailing list is ending up on the junk folder.

I also noticed that there has been no response regarding being able to disable spam filter on an account basis. Is there any technical (or design/philosophical) reason as to why that cannot be done?

Thanks.

> but thats of course not ideal as it means we woul have to fish for those smaller ones. I agree that this is more of a temporary hack/workaround than an actual solution. But as of now, I'm having cases where almost every single mail from a mailing list is ending up on the junk folder. I also noticed that there has been no response regarding being able to disable spam filter on an account basis. Is there any technical (or design/philosophical) reason as to why that cannot be done? Thanks.

muppeth commented

2023-02-08 10:26:26 +01:00

Owner

@NRK could you pm me the list of mailinglists (eg. to support@disroot.org or my personal).

As for your other question. ATM spam filtering is set globally for all,there is no possibility to switch it off based on user's preferences.

@NRK could you pm me the list of mailinglists (eg. to support@disroot.org or my personal). As for your other question. ATM spam filtering is set globally for all,there is no possibility to switch it off based on user's preferences.

NRK commented

2023-02-08 22:40:21 +01:00

Author

@NRK could you pm me the list of mailinglists (eg. to support@disroot.org or my personal).

Done.

As for your other question. ATM spam filtering is set globally for all,there is no possibility to switch it off based on user's preferences.

Unfortunate - but thanks for answering the question.

> @NRK could you pm me the list of mailinglists (eg. to support@disroot.org or my personal). Done. > As for your other question. ATM spam filtering is set globally for all,there is no possibility to switch it off based on user's preferences. Unfortunate - but thanks for answering the question.

muppeth closed this issue

2023-02-15 22:51:33 +01:00

[EMAIL]: excessive false positive spam detection #409