Spam Filter ISP Forums : Unable to add email to quarantine -to many updates

Unable to add email to quarantine -to many updates : Iâ€™m including a section of our...

Wed, 22 Apr 2009 15:50:11 +0000

Author: LogSat
Subject: 6551
Posted: 22 April 2009 at 3:50pm

I’m including a section of our manual, which explains how SpamFilter can be executed:

SpamFilter Service / Console Application

SpamFilter can run in two different ways.
• As a Windows service (the most common - SpamFilterSvc.exe).
• As a standalone application using SpamFilter.exe. This is mostly used for troubleshooting and testing purposes.

If SpamFilter is already running as a service, subsequently running the standalone application (SpamFilter.exe) will open a new instance of SpamFilter, it will not be the GUI for the service. This will most likely create a conflict and problems, as two applications cannot bind to the same port on a server.

Please note that the SpamFilter service does show display a GUI (launched from an icon in the tray bar), but if you are accessing a Windows 2000 server remotely using Terminal Services will not be able to display the GUI. This is because Terminal Services in Windows 2000 is not able to display the server's physical console.

Looking at the physical server's screen, or using a product like PCAnywhere, DameWare, VNC etc that displays the actual screen will reveal the console.

Microsoft fixed this limitation in Windows 2003. In this version of the operating system, Terminal Services allows RDP clients to connect to the server's console.

Some Terminal Services clients have a checkbox in their settings that forces them to connect to the console. In the Remote Desktop client that ships with Windows XP, Microsoft (in)conveniently decided to not make this checkbox available. In this case, to view the server's physical console, you'll need to invoke Remote Desktop from the command line as follows:

mstsc –console

Please note that some newer versions of the Terminal Services client have replaced the “/console” option with a new “/admin” switch. For these versions you will need to use the command mstsc /admin in order to view the server’s console.

Unable to add email to quarantine -to many updates : here is some strange problem that...

Wed, 22 Apr 2009 09:32:12 +0000

Author: criminallawyer
Subject: 6551
Posted: 22 April 2009 at 9:32am

here is some strange problem that I can not figure out of.

We run MySQL quarantine database, size is at all time about 1GB. It delete files after 6 days.

hi,

There are two other things that happens:

When Spamfilter.exe is running alone it seems to be working fine.

When spamfiltercvs.exe also appair on the menu, it normally means problem.

Starts to freeze and I can not close it. Not eaven from taskmanager. Have to stop the Spamfilter windows service to get by thisproblem remotely from another server via MMC snapin.

The other thing is that when i browse into the spamfilter folderand want to open quarantine folder, the server freezes and the only wayto get on is to stop the service again.

I then thought it was a Windows Explorer problem that caused thisand i tried to enter the same library in command propt. the same thinghappens. The folder "quarantine" is about 800MB in size.

Unable to add email to quarantine -to many updates : Morten,A common cause of problems...

Wed, 10 Sep 2008 16:53:03 +0000

Author: LogSat
Subject: 6551
Posted: 10 September 2008 at 4:53pm

Morten,

A common cause of problems is running SpamFilter’s service, and then also opening another instance of the “Standalone” SpamFilter application. If you are running two instances of SpamFilter, both installed in the same directory, this is bound to cause issues as they are both accessing the same resources, and when you’re terminating the standalone application this may cause the service application to become unresponsive.

I’m including a section of our manual, which explains how SpamFilter can be executed:

SpamFilter Service / Console Application

SpamFilter can run in two different ways.
• As a Windows service (the most common - SpamFilterSvc.exe).
• As a standalone application using SpamFilter.exe. This is mostly used for troubleshooting and testing purposes.

If SpamFilter is already running as a service, subsequently running the standalone application (SpamFilter.exe) will open a new instance of SpamFilter, it will not be the GUI for the service. This will most likely create a conflict, as two applications cannot bind to the same port on a server.

Please note that the SpamFilter service does show display a GUI (launched from an icon in the tray bar), but if you are accessing a Windows 2000 server remotely using Terminal Services will not be able to display the GUI. This is because Terminal Services in Windows 2000 is not able to display the server's physical console.

Looking at the physical server's screen, or using a product like PCAnywhere, DameWare, VNC etc that displays the actual screen will reveal the console.

Microsoft fixed this limitation in Windows 2003. In this version of the operating system, Terminal Services allows RDP clients to connect to the server's console.

Some Terminal Services clients have a checkbox in their settings that forces them to connect to the console. In the Remote Desktop client that ships with Windows XP, Microsoft (in)conveniently decided to not make this checkbox available. In this case, to view the server's physical console, you'll need to invoke Remote Desktop from the command line as follows:

mstsc –console

Unable to add email to quarantine -to many updates : Hi Thanks for your very detalied...

Wed, 10 Sep 2008 16:42:26 +0000

Author: morten44
Subject: 6551
Posted: 10 September 2008 at 4:42pm

Hi Thanks for your very detalied answer. I do understand what you are trying to say.

There is some strange problem that I can not figure out of.

We run MySQL quarantine database, size is at all time about 1GB. It delete files after 6 days.

There are two other things that happens:

When Spamfilter.exe is running alone it seems to be working fine.

When spamfiltercvs.exe also appair on the menu, it normally means problem.

Starts to freeze and I can not close it. Not eaven from task manager. Have to stop the Spamfilter windows service to get by this problem remotely from another server via MMC snapin.

The other thing is that when i browse into the spamfilter folder and want to open quarantine folder, the server freezes and the only way to get on is to stop the service again.

I then thought it was a Windows Explorer problem that caused this and i tried to enter the same library in command propt. the same thing happens. The folder "quarantine" is about 800MB in size.

Does any of this sounds familuar for you or not.

what is spamfiltercvs.exe and why/when does it start

Kind Regards

Morten

Unable to add email to quarantine -to many updates : Morten,The log entry above:09/08/08...

Tue, 09 Sep 2008 22:01:25 +0000

Author: LogSat
Subject: 6551
Posted: 09 September 2008 at 10:01pm

Morten,

The log entry above:

09/08/08 22:36:35:140 -- (5516) Error - Unable to add email to quarantine - too many updates pending - archival queued

indicates a very specific situation.

Each time SpamFilter receives a spam email, a new thread is created within SpamFilter that is in charge of storing the email in the quarantine database. This multi-thread mechanism allows SpamFilter to continue processing incoming spam emails without having to wait for the emails to be stored in the database, greatly increasing performance.

This is just fine as long as the database is able to keep up with the flow of incoming emails. If however your database server is not able to accept new archival requests as fast as new emails are received, we will have a situation where the threads created to store emails in the database will grow continuously as they cannot keep up with the flow of emails.

To avoid running out of memory, SpamFilter will only create and queue as many quarantine threads as the maximum number of incoming connections SpamFilter will accept. This means that if at any time there are more quarantine archival threads than the maximum number of incoming connections in SpamFilter, in this case SpamFilter will take the spam archival threads that "overflow" and will queue them to disk.

SpamFilter attempts to process this disk queue every few minutes, and if the database is available and the number of archival threads are below the above threshold, the queue will be archived.

If you see this problem too often, that does indicate performance issues with the database server. A possible workaround is to try increasing the maximum number of concurrent incoming connections SpamFilter will accept, as that will directly correlate to higher archival connections, but if you do this please do monitor your database server to ensure it does not get overloaded.

Unable to add email to quarantine -to many updates : HiWe have some issues that spamfilter...

Tue, 09 Sep 2008 10:38:43 +0000

Author: morten44
Subject: 6551
Posted: 09 September 2008 at 10:38am

Hi
We have some issues that spamfilter block a mail and for some reason it is not sent to the spamfilter. See example below:
______________________________________________

09/08/08 22:36:32:734 -- (7812) Received MAIL FROM:
09/08/08 22:36:32:921 -- (7812) Received RCPT TO: asger@e-advice.dk
09/08/08 22:36:32:968 -- (7812) Resolving 65.54.246.212 - bay0-omc3-s12.bay0.hotmail.com
09/08/08 22:36:32:968 -- (7812) found SPF record for hotmail.com: v=spf1 include:spf-a.hotmail.com include:spf-b.hotmail.com include:spf-c.hotmail.com include:spf-d.hotmail.com ~all
09/08/08 22:36:32:968 -- (7812) found SPF record for spf-a.hotmail.com: v=spf1 ip4:209.240.192.0/19 ip4:65.52.0.0/14 ip4:131.107.0.0/16 ip4:157.54.0.0/15 ip4:157.56.0.0/14 ip4:157.60.0.0/16 ip4:167.220.0.0/16 ip4:204.79.135.0/24 ip4:204.79.188.0/24 ip4:204.79.252.0/24 ip4:207.46.0.0/16 ip4:199.2.137.0/24 ~all
09/08/08 22:36:32:968 -- (7812) SPF query result: pass
09/08/08 22:36:32:968 -- (7812) - SPF analysis for spf-a.hotmail.com done: - pass
09/08/08 22:36:32:968 -- (7812) SPF query result: pass
09/08/08 22:36:32:968 -- (7812) - SPF analysis for hotmail.com done: - pass
09/08/08 22:36:32:968 -- (7812) Mail from: mary_knudsen@hotmail.com
09/08/08 22:36:33:453 -- (7812) - MAPS search done...
09/08/08 22:36:33:453 -- (7812) RCPT TO: asger@e-advice.dk accepted
09/08/08 22:36:34:390 -- (7812) Detected blank email with specified attachment
09/08/08 22:36:34:390 -- (7812) Starting quarantine procedures
09/08/08 22:36:35:125 -- (7812) Created thread (5516) to add email to quarantine
09/08/08 22:36:35:125 -- (7812) Starting bayesian procedures
09/08/08 22:36:35:140 -- (5516) Adding to Quarantine file:Qrtn50CD19FE-B03B-4E44-8FF2-8AD8EBB78C72.tmp
09/08/08 22:36:35:140 -- (5516) Error - Unable to add email to quarantine - too many updates pending - archival queued
______________________________________________

I know that the mail was blocked as there where no text but only attached documents, but now the user can not logon to his spambox and find the mail.
I have checked the spamfilter quarantine and i still get mail all the time quarantined, so I am not sure why i get this error. In my log file I see several examples during the day.

Some days ago the quarantine database stopped working and came up with a message ”[MYSQL][ODBC] To manyconnections"
I edited php.ini from "max_connection=100 to 500" and that resolved the issue. Not sure if this is related.
We are running version 4.0.1.783 (registered version)
SpamfilterScv.e seems to hang in task manager as well for some reason

Any idea where to look?

Kind Regards
Morten

Edited by morten44 - 09 September 2008 at 10:44am