Print Page | Close Window

spamisp 100% utilization

Printed From: LogSat Software
Category: Spam Filter ISP
Forum Name: Spam Filter ISP Support
Forum Description: General support for Spam Filter ISP
URL: http://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5093
Printed Date: 17 December 2017 at 3:18am


Topic: spamisp 100% utilization
Posted By: Terry
Subject: spamisp 100% utilization
Date Posted: 07 March 2005 at 8:46pm

I am on release 2.1.2.406 and today we have suddenly gone into overload 3 times requiring that I stop the service and restart it.  The server was running at near 100% utilization for the spamfilter.  The connection count was near 150 but that was when I looked and I am not sure what it was when it first started having problems.  What can I give you to help in debugging this?  When I look at the server now after I restarted the server it seems to be running normally with between 5-10 connections at the most and usually less.  Anything I should do to help make solving this easier?

Terry

Make it 4 times...just happened again after restarting...ran about 10 minutes before 100% again




Replies:
Posted By: JimMeredith
Date Posted: 07 March 2005 at 11:52pm

Terry,

Two questions...

  1. Have you made any recent (within the past 7 days or so) changes to your filtering rules... especially the keywords filter?  -- AND/OR --
  2. Has anything happened that might have increased your volume of inbound mail traffic?

From past personal experience, I can tell you that there is a "breaking point" that can be reached with keywords filtering, especially if you're inclined to use a lot of multi-word (four words or longer) phrases in your keywords list.  Also, this issue seems to sneak up on you... everything's going fine, and then suddenly (usually on a Monday), BAM! CPU is suddenly pegged at 100%.

A few CPU cycles are required for each keyword scan.  Multiply this by each keyword in your list, and then multiply this by the number of messages you are receiving.  When you see an increase in either of these factors -- keywords (controllable) or message traffic (usually not controllable) -- a server that was running just fine one day can start pegging-out at 100% CPU utilization the next day.  Shutting-down and restarting the server does no good; the CPU will just go right back to 100% within a few minutes, because of the backlog of mail traffic waiting to be delivered to your server.

If this is the case... if you have added keywords (or seen increased mail traffic) lately, get rid of a few keywords, especially the longer phrases, and see if this helps. Also, "Desperado" Dan who posts on this board all of the time has posted some great RegEx ideas in the past.  Smart use of RegEx can really make SpamFilter fly, by eliminating the need to have a long keyword list in the first place.

This isn't the only thing that can cause 100% CPU, of course... but it is a "unique" issue with this type of solution, and just something to be aware of.  Hope this is helpful.

Jim



Posted By: Terry
Date Posted: 08 March 2005 at 9:30am

Thanks for the information Jim.

Yes I continually add words to the keyword filters list....I usually target the subject line (Subject:something something) to try to get them blocked at that level.  I will back off of some of these.

I know of nothing that would increase our traffic at this time but looking at the log yesterday I did see bunches 3-5 connections suddenly pop in fractions of seconds in the logs...I do not believe that always happens...

I will watch closely today. It made it through the night unattended that was a good thing.

Terry

 



Posted By: LogSat
Date Posted: 08 March 2005 at 4:09pm
Terry,

In addition to what Jim correctly suggested, can you take a look at your database and see if there's any connections from SpamFilter that have been locked? We have seen at times the database "hanging" on queries if it (the DB server) cannot keep up with the email traffic.


-------------
Roberto Franceschetti

http://www.logsat.com" rel="nofollow - LogSat Software

http://www.logsat.com/sfi-spam-filter.asp" rel="nofollow - Spam Filter ISP


Posted By: Terry
Date Posted: 08 March 2005 at 6:03pm

All seems to be running good since this morning after  I reduced the keyword list...I will keep this in mind if it happens again.  Thanks Roberto.

 

Terry




Print Page | Close Window