[opensuse] Slow spamd/spamc
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, Since I updated to 10.3, I find spamd/spamc sluggish. My mail fetching setup is: fetchmail --> postfix --> procmail --> spamc/spamd A mail is scanned, then it stops for some seconds (almost no cpu usage) then it continues. It takes around 8 seconds per single email to check. I think it is querying some of the network databases that is slow. The other detail is that it only processes two mails at a time, I mean, postfix spawns two children only: root /usr/lib/postfix/master postfix \_ qmgr -l -t unix -u postfix \_ local -t unix cer | \_ /usr/bin/procmail cer | \_ /usr/bin/procmail cer | \_ /usr/bin/spamc -s 350000 postfix \_ local -t unix cer | \_ /usr/bin/procmail cer | \_ /usr/bin/procmail cer | \_ /usr/bin/spamc -s 350000 postfix \_ pickup -l -t unix -u postfix \_ showq -t unix -u I believe this is controlled in /etc/postfix/master.cf by this line: local unix - n n - 4 local or perhaps this one: procmail unix - n n - 5 pipe flags=R user=nobody argv=/usr/bin/procmail -t -m /etc/procmailrc ${sender} ${recipient} but according to that, I should get 4 (or 5) children... so I must be missing something. My idea is that if could get more emails to be processed simultaneously (while one waits another is scanned) then throughput would be faster. - -- Cheers, Carlos Robinson -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4-svn0 (GNU/Linux) iD8DBQFHjQuntTMYHG2NR9URAl3JAKCHy0dg+J212A0Zjsy6bCum7eEyhACcC0jc 9A2qAi5Pz67sjSKVmvcm6VM= =2bqH -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 * Carlos E. R. <robin.listas@telefonica.net> [01-15-08 14:40]:
I believe this is controlled in /etc/postfix/master.cf by this line:
local unix - n n - 4 local
procmail unix - n n - 5 pipe flags=R user=nobody argv=/usr/bin/procmail -t -m /etc/procmailrc ${sender} ${recipient}
but according to that, I should get 4 (or 5) children... so I must be
I have neither of these parameters, (4,5) in my master.cf and get 3 and I seem to remember seeing 4 instances of spamd. (also have procmail calling spamc/d) - -- Patrick Shanahan Plainfield, Indiana, USA HOG # US1244711 http://wahoo.no-ip.org Photo Album: http://wahoo.no-ip.org/gallery2 Registered Linux User #207535 @ http://counter.li.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (GNU/Linux) iD8DBQFHjRUSClSjbQz1U5oRAqNcAJsFRpmpIleedJKMujaeWZVzBF3lWQCfXnlD 9n8bbNhC6XGvnpyHCqYa5uQ= =c4yi -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Tuesday 2008-01-15 at 15:18 -0500, Patrick Shanahan wrote:
* Carlos E. R. <> [01-15-08 14:40]:
I believe this is controlled in /etc/postfix/master.cf by this line:
local unix - n n - 4 local
procmail unix - n n - 5 pipe flags=R user=nobody argv=/usr/bin/procmail -t -m /etc/procmailrc ${sender} ${recipient}
but according to that, I should get 4 (or 5) children... so I must be
I have neither of these parameters, (4,5) in my master.cf and get 3 and I seem to remember seeing 4 instances of spamd.
I too had none (ie, a dash) but I changed to 4 explicitly in an attempt to correct the problem. No good... I'll reset to a dash and see. The one for procmail was the other way round: a year or two ago I reduced the number, because so many spamc processes used a lot of memory and slowed the whole computer
(also have procmail calling spamc/d)
It might be this one: local_destination_concurrency_limit = 2 I'll try 3. Two is the default value. - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4-svn0 (GNU/Linux) iD8DBQFHjU2LtTMYHG2NR9URAmCBAJ4hUQEFSBFAZz32WtxiV7eEbMX3JQCfdZrP fPR/WZa9mMq1+IqqoKVERbI= =hwpL -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Wednesday 2008-01-16 at 01:19 +0100, Carlos E. R. wrote:
It might be this one:
local_destination_concurrency_limit = 2
I'll try 3. Two is the default value.
That was it! - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4-svn0 (GNU/Linux) iD8DBQFHjdtOtTMYHG2NR9URAi86AJ9DHMJ0tL4ZSE+gRduOi1IlIfyjIQCfejrP XWkO4c1X8AUBrJzbnDbaWHM= =FtKu -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On 01/16/2008 03:38 AM, Carlos E. R. wrote:
Hi,
Since I updated to 10.3, I find spamd/spamc sluggish. My mail fetching setup is:
fetchmail --> postfix --> procmail --> spamc/spamd
A mail is scanned, then it stops for some seconds (almost no cpu usage) then it continues. It takes around 8 seconds per single email to check. I think it is querying some of the network databases that is slow.
I believe that is the problem. Try commenting out # Enhance the uridnsbl_skip_domain list with some usefull entries # Do not block the web-sites of Novell and SUSE ifplugin Mail::SpamAssassin::Plugin::URIDNSBL uridnsbl_skip_domain suse.de opensuse.org suse.com suse.org uridnsbl_skip_domain novell.com novell.org novell.ru novell.de novell.hu novell.co.uk endif # Mail::SpamAssassin::Plugin::URIDNSBL in /etc/mail/spammassassin/local.cf. HTH. -- Joe Morris Registered Linux user 231871 running openSUSE 10.3 x86_64 -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Wednesday 2008-01-16 at 07:45 +0800, Joe Morris (NTM) wrote:
A mail is scanned, then it stops for some seconds (almost no cpu usage) then it continues. It takes around 8 seconds per single email to check. I think it is querying some of the network databases that is slow. I believe that is the problem. Try commenting out # Enhance the uridnsbl_skip_domain list with some usefull entries # Do not block the web-sites of Novell and SUSE ifplugin Mail::SpamAssassin::Plugin::URIDNSBL uridnsbl_skip_domain suse.de opensuse.org suse.com suse.org uridnsbl_skip_domain novell.com novell.org novell.ru novell.de novell.hu novell.co.uk endif # Mail::SpamAssassin::Plugin::URIDNSBL
in /etc/mail/spammassassin/local.cf. HTH.
That does not disable that network test, and there are many other network tests. What it does is telling SA not to consider opensuse.org as a spammer site; ie, without those lines, opensuse.org will count as spammer. Besides, I do not want to disable network tests, they are quite useful. what I want is to analyze more emails at the same time. - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4-svn0 (GNU/Linux) iD8DBQFHjUrAtTMYHG2NR9URAvfSAJ9fc38mw4exH5rd4mSNkvxpPW6kzACeJqsr BNCQKUz3BTaVIl8QLL4/RuY= =umRr -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
On 01/16/2008 08:07 AM, Carlos E. R. wrote:
The Wednesday 2008-01-16 at 07:45 +0800, Joe Morris (NTM) wrote:
A mail is scanned, then it stops for some seconds (almost no cpu usage) then it continues. It takes around 8 seconds per single email to check. I think it is querying some of the network databases that is slow. I believe that is the problem. Try commenting out # Enhance the uridnsbl_skip_domain list with some usefull entries # Do not block the web-sites of Novell and SUSE ifplugin Mail::SpamAssassin::Plugin::URIDNSBL uridnsbl_skip_domain suse.de opensuse.org suse.com suse.org uridnsbl_skip_domain novell.com novell.org novell.ru novell.de novell.hu novell.co.uk endif # Mail::SpamAssassin::Plugin::URIDNSBL
in /etc/mail/spammassassin/local.cf. HTH.
That does not disable that network test, and there are many other network tests. What it does is telling SA not to consider opensuse.org as a spammer site; ie, without those lines, opensuse.org will count as spammer.
Besides, I do not want to disable network tests, they are quite useful. what I want is to analyze more emails at the same time.
Commenting out ifplugin Mail::SpamAssassin::Plugin::URIDNSBL will disable that plugin, which will stop the blacklist check, which on my systems get a lot of failures or slow DNS lookups. It does only that. It does not disable all network tests. -- Joe Morris Registered Linux user 231871 running openSUSE 10.3 x86_64 -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Wednesday 2008-01-16 at 08:20 +0800, Joe Morris (NTM) wrote:
Commenting out ifplugin Mail::SpamAssassin::Plugin::URIDNSBL will disable that plugin, which will stop the blacklist check, which on my systems get a lot of failures or slow DNS lookups. It does only that. It does not disable all network tests.
No, it does not stop the plugin at all. It justs add a list to the existing plugin. - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4-svn0 (GNU/Linux) iD8DBQFHjVQAtTMYHG2NR9URAkTZAJoDWpQ6FQLugiV80yBxONwIRNGzlwCfcOFp 7s48w9Qp+GCUErD9OEH2U+M= =4Fqy -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Carlos E. R. wrote:
The Wednesday 2008-01-16 at 08:20 +0800, Joe Morris (NTM) wrote:
Commenting out ifplugin Mail::SpamAssassin::Plugin::URIDNSBL will disable that plugin, which will stop the blacklist check, which on my systems get a lot of failures or slow DNS lookups. It does only that. It does not disable all network tests.
No, it does not stop the plugin at all. It justs add a list to the existing plugin.
You are correct, sorry. It is /etc/mail/spamassassin/init.pre. Comment out URIDNSBL - look up URLs found in the message against several DNS # blocklists. # loadplugin Mail::SpamAssassin::Plugin::URIDNSBL to stop the blacklists check. You could try it and compare before after to see if it significantly impacts spamassassin's processing speed. -- Joe -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
participants (4)
-
Carlos E. R. -
Joe Morris -
Joe Morris (NTM)
-
Patrick Shanahan