SPAM: Threading on mailing list broken?
On top of the over-zealous SPAM filter... I see all the mails now from the list as individual mails - threading is broken. Anyone else getting this? Just wondering if it's the mailing list that's having another fit, or my webmail client that has suddenly decided to stop threading SUSE mailing list messages. If it's the mailing list having yet another tantrum... is anyone looking at it? C
Clayton wrote:
On top of the over-zealous SPAM filter... I see all the mails now from the list as individual mails - threading is broken. Anyone else getting this?
Just wondering if it's the mailing list that's having another fit, or my webmail client that has suddenly decided to stop threading SUSE mailing list messages.
If it's the mailing list having yet another tantrum... is anyone looking at it?
C
I see no change regarding threading in Thunderbird, just the annoying SPAM: subject rewrite. /Sylvester
On Fri, 13 Oct 2006 12:52:24 +0200 Clayton wrote:
On top of the over-zealous SPAM filter... I see all the mails now from the list as individual mails - threading is broken. Anyone else getting this?
I see threading isn't right with alot of messages with Sylpheed Claws Steve
On Friday 13 October 2006 05:52, Clayton wrote:
On top of the over-zealous SPAM filter... I see all the mails now from the list as individual mails - threading is broken. Anyone else getting this?
Yep, seems to be a little messed up in Kmail also. -- Calling an illegal alien an 'undocumented worker', is like calling an intruder in your home an 'unwanted houseguest'.
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Friday 2006-10-13 at 12:52 +0200, Clayton wrote:
On top of the over-zealous SPAM filter...
I have been told that SuSE IT personnel have been informed of that, but they are taking a hellish time to mend it. It is their bayessian filter that is very badly trained, as usual.
I see all the mails now from the list as individual mails - threading is broken. Anyone else getting this?
No. Pine is working fine. Perhaps gmail client is getting confused with the spam word in the subject line. Threading is to be done using the internal headers, but some mailers use the subject line instead. - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (GNU/Linux) Comment: Made with pgp4pine 1.76 iD8DBQFFL/OQtTMYHG2NR9URAkHFAKCNlE4LsYsbvFPyGmljfNFtLfwsxACfbagY kH60thrxqlb9SeI+zYL+atM= =Td6L -----END PGP SIGNATURE-----
Carlos, On Friday 13 October 2006 13:14, Carlos E. R. wrote:
The Friday 2006-10-13 at 12:52 +0200, Clayton wrote:
On top of the over-zealous SPAM filter...
I have been told that SuSE IT personnel have been informed of that, but they are taking a hellish time to mend it. It is their bayessian filter that is very badly trained, as usual.
I see all the mails now from the list as individual mails - threading is broken. Anyone else getting this?
No. Pine is working fine.
You're seeing no message threads that have become fractured? They are numerous in my SuSE-Linux-E mailbox. I use KMail and even have the "Thread Messages also by Subject" option enabled.
Perhaps gmail client is getting confused with the spam word in the subject line. Threading is to be done using the internal headers, but some mailers use the subject line instead.
No. There's a real problem. My first thought was that it was people using Outlook / Outlook Express, but the first message I looked at (upon reading Clayton's message) whose threading was broken was sent using KMail.
Carlos E. R.
Randall Schulz
* Randall R Schulz
No. There's a real problem. My first thought was that it was people using Outlook / Outlook Express, but the first message I looked at (upon reading Clayton's message) whose threading was broken was sent using KMail.
Hummm, no problems observed in threading in mutt. It is reasonable to assume that Carlos' thoughts of poor spam filter training is correct, especially since there was a similar recent case in the suse lists. -- Patrick Shanahan Registered Linux User #207535 http://wahoo.no-ip.org @ http://counter.li.org HOG # US1244711 Photo Album: http://wahoo.no-ip.org/gallery2
Patrick, On Friday 13 October 2006 13:53, Patrick Shanahan wrote:
* Randall R Schulz
[10-13-06 16:41]: No. There's a real problem. My first thought was that it was people using Outlook / Outlook Express, but the first message I looked at (upon reading Clayton's message) whose threading was broken was sent using KMail.
Hummm, no problems observed in threading in mutt. It is reasonable to assume that Carlos' thoughts of poor spam filter training is correct, especially since there was a similar recent case in the suse lists.
How does that explain the problem? What I failed to notice before was that messages that are parts of threads but that do not get properly inserted into their thread (in KMail, anyway) actually _do_ have In-Reply-To header fields. So I'm guessing there are missing messages that interrupt the chain of In-Reply-To headers.
-- Patrick Shanahan
Randall Schulz
On Friday 13 October 2006 12:39, Randall R Schulz wrote:
You're seeing no message threads that have become fractured? They are numerous in my SuSE-Linux-E mailbox. I use KMail and even have the "Thread Messages also by Subject" option enabled.
Well there's your problem then. Threading is not SUPPOSED to work via subject but rather, by message id and "in reply to " headers. Turn that off. Its not totally unheard of for an occasional thread break, especially when some (ignorant) users insist on using Outlook express to reply to mailing lists. -- _____________________________________ John Andersen
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Friday 2006-10-13 at 13:39 -0700, Randall R Schulz wrote:
No. Pine is working fine.
You're seeing no message threads that have become fractured? They are numerous in my SuSE-Linux-E mailbox. I use KMail and even have the "Thread Messages also by Subject" option enabled.
I don't see more threads broken that the usual person using a broken mailer that breaks threading. For this one, I see this: A 12:52pm Clayton (3683) . [SLE] SPAM: Threading on mailing list broken? 1:10pm Sylvester Lykkehus (3617) |-SPAM: Re: [SLE] SPAM: Threading on mailing list 6:15am Steve Jeppesen (3341) |-SPAM: Re: [SLE] SPAM: Threading on mailing list 11:35am JB (3853) |-SPAM: Re: [SLE] SPAM: Threading on mailing list 10:14pm To: SLE (3945) . |-Re: [SLE] Threading on mailing list broken? 1:39pm Randall R Schulz (4243) . |-> 4:53pm Patrick Shanahan (3931) . |-> 2:20pm Randall R Schulz (4067) | |-SPAM: Re: [SLE] Threading on mailing list 1:19pm John Andersen (3784) |-SPAM: Re: [SLE] Threading on mailing list br Tell me of some of the subjects for which you see broken threads, and I'll check. But I think kmail is broken in this respect, or that you must not use "Thread Messages also by Subject" - the word "spam" breaks the subject threading. - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (GNU/Linux) Comment: Made with pgp4pine 1.76 iD8DBQFFMAhRtTMYHG2NR9URAidhAKCRi+SvHoW2PRuiuHsyom2NzYpyegCcC/ox E/G3YXYe/0jm1xU2kmSb8Fc= =Fbg6 -----END PGP SIGNATURE-----
Carlos, On Friday 13 October 2006 14:42, Carlos E. R. wrote:
...
Tell me of some of the subjects for which you see broken threads, and I'll check. But I think kmail is broken in this respect, or that you must not use "Thread Messages also by Subject" - the word "spam" breaks the subject threading.
Doug McGarrett posted "HP Laser 12020 (more)" (or will, in about 3 years and 7 months...) with this message ID header: Message-id: <201005081458.22543.dmcgarrett@optonline.net> and replied on that thread 28 minutes later. That reply contained these headers (among others, of course): Message-id: <201005081431.00170.dmcgarrett@optonline.net> In-reply-to: <1139977119.1895.16.camel@pc5.bout-tyme.net> Those are the only two messages under that subject (with or with a SPAM addendum) that I've received. I have no messages from a "camel" or from any host with "tyme.net" in its name.
-- Cheers, Carlos E. R.
Randall Schulz
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Friday 2006-10-13 at 15:01 -0700, Randall R Schulz wrote:
On Friday 13 October 2006 14:42, Carlos E. R. wrote:
...
Tell me of some of the subjects for which you see broken threads, and I'll check. But I think kmail is broken in this respect, or that you must not use "Thread Messages also by Subject" - the word "spam" breaks the subject threading.
Doug McGarrett posted "HP Laser 12020 (more)" (or will, in about 3 years and 7 months...) with this message ID header:
Message-id: <201005081458.22543.dmcgarrett@optonline.net>
That one was diffcult to find...
| Date: Sat, 08 May 2010 14:58:22 -0400
| From: Doug McGarrett
Carlos, On Friday 13 October 2006 15:48, Carlos E. R. wrote:
...
Doug McGarrett posted "HP Laser 12020 (more)" (or will, in about 3 years and 7 months...) with this message ID header:
Message-id: <201005081458.22543.dmcgarrett@optonline.net>
That one was diffcult to find...
Sorry about the typo.
| Date: Sat, 08 May 2010 14:58:22 -0400 | From: Doug McGarrett
| Subject: [SLE] HP Laser 1020 (more) It is "HP Laser 1020...", a "2" less. And it was sent on Feb 2006. I can not judge the threading problem based on that thread, because it is not recent; ie, I can not see if the broken spam checking on SuSE servers of the last week has affected it.
But it was broken in three threads, and hijacked twice.
OK. I think I know what happened on my end, in this particular case, anyway: Based on the volume of any given list to which I subscribe, I move the contents to archive mailboxes periodically. For a list with the volume of SuSE-Linux-E, I make monthly archives. When I do this, I turn of threading and just take the previous month's messages and move them to the new archive folder. When a message is vastly post-dated, as these two from Doug McGarrett were, they perpetually end up at the bottom of the date-sorted mailbox, and hence never get moved to an archive folder. On the other hand, posts from the other participants on the thread (probably) don't have their system's clocks seriously off, do get moved to the archive mailbox, and the thread is fractured.
-- Cheers, Carlos E. R.
Randall Schulz
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Friday 2006-10-13 at 16:06 -0700, Randall R Schulz wrote:
OK. I think I know what happened on my end, in this particular case, anyway:
Based on the volume of any given list to which I subscribe, I move the contents to archive mailboxes periodically. For a list with the volume of SuSE-Linux-E, I make monthly archives. When I do this, I turn of threading and just take the previous month's messages and move them to the new archive folder.
I do it the other way: I sort by thread, then I move them, tagging them one by one or by thread, using Pine (^T marks the whole thread). It is much faster for these things than any GUI based MUA.
When a message is vastly post-dated, as these two from Doug McGarrett were, they perpetually end up at the bottom of the date-sorted mailbox, and hence never get moved to an archive folder. On the other hand, posts from the other participants on the thread (probably) don't have their system's clocks seriously off, do get moved to the archive mailbox, and the thread is fractured.
X'-) I understand. Pine shows the date of that one as "May 2010!". And SpamAssassin tags it as "DATE_IN_FUTURE_96_XX". - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (GNU/Linux) Comment: Made with pgp4pine 1.76 iD8DBQFFMCAStTMYHG2NR9URAkBmAJwKhEISYnJNAnmOB+A8AqROM4XNHgCfdk6M 2bMDzkuXlUodmEZofOyDGxo= =pSa/ -----END PGP SIGNATURE-----
Randall R Schulz wrote:
Carlos,
On Friday 13 October 2006 15:48, Carlos E. R. wrote:
...
Doug McGarrett posted "HP Laser 12020 (more)" (or will, in about 3 years and 7 months...) with this message ID header:
Message-id: <201005081458.22543.dmcgarrett@optonline.net>
That one was diffcult to find...
Sorry about the typo.
| Date: Sat, 08 May 2010 14:58:22 -0400 | From: Doug McGarrett
| Subject: [SLE] HP Laser 1020 (more) It is "HP Laser 1020...", a "2" less. And it was sent on Feb 2006. I can not judge the threading problem based on that thread, because it is not recent; ie, I can not see if the broken spam checking on SuSE servers of the last week has affected it.
But it was broken in three threads, and hijacked twice.
OK. I think I know what happened on my end, in this particular case, anyway:
Based on the volume of any given list to which I subscribe, I move the contents to archive mailboxes periodically. For a list with the volume of SuSE-Linux-E, I make monthly archives. When I do this, I turn of threading and just take the previous month's messages and move them to the new archive folder.
When a message is vastly post-dated, as these two from Doug McGarrett were, they perpetually end up at the bottom of the date-sorted mailbox, and hence never get moved to an archive folder. On the other hand, posts from the other participants on the thread (probably) don't have their system's clocks seriously off, do get moved to the archive mailbox, and the thread is fractured.
-- Cheers, Carlos E. R.
Randall Schulz
Why don't you create message filters to do that automatically? FYI, KMail is painfully SLOWWWWW... Thunderbird is way faster. I don't know what you call lots of messages, but this email account has 7000+ messages markes as unread right now, and over 7200 actual emails in the Inbox... and they all are threading properly (by Subject) in Thunderbird.
John, On Friday 13 October 2006 17:26, John wrote:
...
Why don't you create message filters to do that automatically? FYI, KMail is painfully SLOWWWWW... Thunderbird is way faster. I don't know what you call lots of messages, but this email account has 7000+ messages markes as unread right now, and over 7200 actual emails in the Inbox... and they all are threading properly (by Subject) in Thunderbird.
Slow? KMail is performs just fine for me, and I get several hundred messages a day. I have 62 filters configured and active and monitor three SMTP accounts plus locally delivered mail. Thunderbird, on the other hand, is quite shabby in its features and human interface and is scarcely tolerable to me (I use it at work for lack of an suitable alternative under RedHat Enterprise Linux 3). By the way, threading is not something properly done by textual content of the Subject: header. It's to be done primarily based on the presense of In-Reply-To: headers. Besides, periodic archiving is not really something I want to automate, nor would it fix the problem with messages with incorrect dates. Randall Schulz
On Saturday 14 October 2006 01:26, John wrote: /Pruned
Why don't you create message filters to do that automatically? FYI, KMail is painfully SLOWWWWW... Thunderbird is way faster. I don't know what you call lots of messages, but this email account has 7000+ messages markes as unread right now, and over 7200 actual emails in the Inbox... and they all are threading properly (by Subject) in Thunderbird.
Errrrrrrrr Kmail slow i dont think so maybe in the versions of Kmail used in the latest updates on 10.1 (barge pole fodder) K mail here on KDE 3.5.3 is plenty fast enough may be if it was dealing with a few hundred users on a network then it would be a different matter but with the amount of mail i get between 250 and 600 mails a day it is fine AND threading functions correctly , Is it not more a case of kmail is not your idea of what a mail program should look like so you trash it , And thunderbird is a pain easily out performed by the other great mail program the mail part of Seamonkey supposed to be the same thing but Seamonkey is far better plus you a the best browser going into the bargain .. This is the last machine i have now on suse the rest are now on Mepis until Novelle/Suse sort them selfs out 10.1 is a total disaster zone and should never have been even considered for release ZMD and friends should be kicked into the over priced Corporeate sector for them to experiment with maybe then it would have worked correctly from the ground up Cheers folks count down running Mepis on the horizon and closing fast .. Pete .
On Friday 13 October 2006 23:26, Peter Nikolic wrote:
Cheers folks count down running Mepis on the horizon and closing fast ..
So Pete, What's the big attraction to mepis? As opposed to Ubuntu or RedHat something more mainstream? I'm curious, I've used a lot of distros but never Mepis. -- _____________________________________ John Andersen
Fri, 13 Oct 2006, by robin.listas@telefonica.net:
The Friday 2006-10-13 at 12:52 +0200, Clayton wrote:
On top of the over-zealous SPAM filter...
I have been told that SuSE IT personnel have been informed of that, but they are taking a hellish time to mend it. It is their bayessian filter that is very badly trained, as usual.
For your .procmailrc: :0fw: * ^X-Mailinglist:.*suse-linux-e | sed -e 's/SPAM: //' Theo -- Theo v. Werkhoven Registered Linux user# 99872 http://counter.li.org ICBM 52 13 26N , 4 29 47E. + ICQ: 277217131 SUSE 9.2 + Jabber: muadib@jabber.xs4all.nl Kernel 2.6.8 + See headers for PGP/GPG info. Claimer: any email I receive will become my property. Disclaimers do not apply.
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Friday 2006-10-13 at 23:49 +0200, Theo v. Werkhoven wrote:
For your .procmailrc:
:0fw: * ^X-Mailinglist:.*suse-linux-e | sed -e 's/SPAM: //'
Huh? -e script, --expression=script add the script to the commands to be executed - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (GNU/Linux) Comment: Made with pgp4pine 1.76 iD8DBQFFMA0NtTMYHG2NR9URAqOLAJ9RMu/JEFaw5YizT9OtjNP50VJhJACglOaq K1asFTAtjNYfCm/hKdyh7gc= =no36 -----END PGP SIGNATURE-----
Sat, 14 Oct 2006, by robin.listas@telefonica.net:
The Friday 2006-10-13 at 23:49 +0200, Theo v. Werkhoven wrote:
For your .procmailrc:
:0fw: * ^X-Mailinglist:.*suse-linux-e | sed -e 's/SPAM: //'
Huh?
-e script, --expression=script
add the script to the commands to be executed
It does work, but the -e option isn't really needed. This is better I think: :0fwH: * ^X-Mailinglist:.*suse-linux-e { :0 fwh | sed 's/SPAM: //' } Theo -- Theo v. Werkhoven Registered Linux user# 99872 http://counter.li.org ICBM 52 13 26N , 4 29 47E. + ICQ: 277217131 SUSE 9.2 + Jabber: muadib@jabber.xs4all.nl Kernel 2.6.8 + See headers for PGP/GPG info. Claimer: any email I receive will become my property. Disclaimers do not apply.
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Saturday 2006-10-14 at 00:10 +0200, Theo v. Werkhoven wrote:
It does work, but the -e option isn't really needed.
This is better I think:
:0fwH: * ^X-Mailinglist:.*suse-linux-e { :0 fwh | sed 's/SPAM: //' }
I don't like using sed for that... perhaps formail. I don't think sed can guarantee to touch only the Subject header and nothing at all from the rest. - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (GNU/Linux) Comment: Made with pgp4pine 1.76 iD4DBQFFMBpJtTMYHG2NR9URAuwkAJ9bJbPGXKdpsJ08AH5PtD2kFywajwCY7Eha kyWUzSVWtr/m1bpMsx84bg== =04L6 -----END PGP SIGNATURE-----
Sat, 14 Oct 2006, by robin.listas@telefonica.net:
The Saturday 2006-10-14 at 00:10 +0200, Theo v. Werkhoven wrote:
It does work, but the -e option isn't really needed.
This is better I think:
:0fwH: * ^X-Mailinglist:.*suse-linux-e { :0 fwh | sed 's/SPAM: //' }
I don't like using sed for that... perhaps formail. I don't think sed can guarantee to touch only the Subject header and nothing at all from the rest.
Show us how to replace parts of the Subject-line with formail please. I know how to replace/delete/add *complete* headerlines, but not how to use a regexp search and replace like sed what does. The procmail flag h takes care that only the headers are fed through the filter btw. I keep an eye on the procmail log after making a new recipy of course, so far it does what I had in mind. One more small change in the recipy: the flags in the parent are extraneous and I included opensuse in the searchfield SED="/usr/bin/sed" :0 * ^X-Mailinglist:.*(open)?suse(-linux-e)? { :0 fwh | $SED 's/SPAM: //' } Theo -- Theo v. Werkhoven Registered Linux user# 99872 http://counter.li.org ICBM 52 13 26N , 4 29 47E. + ICQ: 277217131 SUSE 9.2 + Jabber: muadib@jabber.xs4all.nl Kernel 2.6.8 + See headers for PGP/GPG info. Claimer: any email I receive will become my property. Disclaimers do not apply.
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Saturday 2006-10-14 at 01:24 +0200, Theo v. Werkhoven wrote:
I don't like using sed for that... perhaps formail. I don't think sed can guarantee to touch only the Subject header and nothing at all from the rest.
Show us how to replace parts of the Subject-line with formail please. I know how to replace/delete/add *complete* headerlines, but not how to use a regexp search and replace like sed what does.
I have no idea.
The procmail flag h takes care that only the headers are fed through the filter btw.
Ah! I hadn't noticed that.
I keep an eye on the procmail log after making a new recipy of course, so far it does what I had in mind.
Me too. I discovered that you can enclose the modified section like this: VERBOSE=on procmail recipe VERBOSE=off It is better than using "verbose" for the whole procmail file.
One more small change in the recipy: the flags in the parent are extraneous and I included opensuse in the searchfield
There are several lists affected. Dunno... I'll wait a while - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (GNU/Linux) Comment: Made with pgp4pine 1.76 iD8DBQFFMCPOtTMYHG2NR9URAunMAKCLx0/5bnflU8xH22fWDuIiYX0TrQCdGjVf /N9Jwhas720OE+NmaIvCIMA= =22hF -----END PGP SIGNATURE-----
Clayton wrote:
On top of the over-zealous SPAM filter... I see all the mails now from the list as individual mails - threading is broken. Anyone else getting this?
Just wondering if it's the mailing list that's having another fit, or my webmail client that has suddenly decided to stop threading SUSE mailing list messages.
If it's the mailing list having yet another tantrum... is anyone looking at it?
C
No problem here in Thunderbird. I can thread based on any field and it works as it should.
participants (11)
-
Carlos E. R.
-
Clayton
-
JB
-
John
-
John Andersen
-
Patrick Shanahan
-
Peter Nikolic
-
Randall R Schulz
-
Steve Jeppesen
-
Sylvester Lykkehus
-
Theo v. Werkhoven