Spam Filter ISP Support Forum

  New Posts New Posts RSS Feed - spamisp 100% utilization
  FAQ FAQ  Forum Search   Register Register  Login Login

spamisp 100% utilization

 Post Reply Post Reply
Author
Terry View Drop Down
Senior Member
Senior Member


Joined: 06 February 2005
Status: Offline
Points: 155
Post Options Post Options   Thanks (0) Thanks(0)   Quote Terry Quote  Post ReplyReply Direct Link To This Post Topic: spamisp 100% utilization
    Posted: 07 March 2005 at 8:46pm

I am on release 2.1.2.406 and today we have suddenly gone into overload 3 times requiring that I stop the service and restart it.  The server was running at near 100% utilization for the spamfilter.  The connection count was near 150 but that was when I looked and I am not sure what it was when it first started having problems.  What can I give you to help in debugging this?  When I look at the server now after I restarted the server it seems to be running normally with between 5-10 connections at the most and usually less.  Anything I should do to help make solving this easier?

Terry

Make it 4 times...just happened again after restarting...ran about 10 minutes before 100% again



Edited by Terry
Back to Top
JimMeredith View Drop Down
Newbie
Newbie


Joined: 27 January 2005
Location: United States
Status: Offline
Points: 28
Post Options Post Options   Thanks (0) Thanks(0)   Quote JimMeredith Quote  Post ReplyReply Direct Link To This Post Posted: 07 March 2005 at 11:52pm

Terry,

Two questions...

  1. Have you made any recent (within the past 7 days or so) changes to your filtering rules... especially the keywords filter?  -- AND/OR --
  2. Has anything happened that might have increased your volume of inbound mail traffic?

From past personal experience, I can tell you that there is a "breaking point" that can be reached with keywords filtering, especially if you're inclined to use a lot of multi-word (four words or longer) phrases in your keywords list.  Also, this issue seems to sneak up on you... everything's going fine, and then suddenly (usually on a Monday), BAM! CPU is suddenly pegged at 100%.

A few CPU cycles are required for each keyword scan.  Multiply this by each keyword in your list, and then multiply this by the number of messages you are receiving.  When you see an increase in either of these factors -- keywords (controllable) or message traffic (usually not controllable) -- a server that was running just fine one day can start pegging-out at 100% CPU utilization the next day.  Shutting-down and restarting the server does no good; the CPU will just go right back to 100% within a few minutes, because of the backlog of mail traffic waiting to be delivered to your server.

If this is the case... if you have added keywords (or seen increased mail traffic) lately, get rid of a few keywords, especially the longer phrases, and see if this helps. Also, "Desperado" Dan who posts on this board all of the time has posted some great RegEx ideas in the past.  Smart use of RegEx can really make SpamFilter fly, by eliminating the need to have a long keyword list in the first place.

This isn't the only thing that can cause 100% CPU, of course... but it is a "unique" issue with this type of solution, and just something to be aware of.  Hope this is helpful.

Jim

Back to Top
Terry View Drop Down
Senior Member
Senior Member


Joined: 06 February 2005
Status: Offline
Points: 155
Post Options Post Options   Thanks (0) Thanks(0)   Quote Terry Quote  Post ReplyReply Direct Link To This Post Posted: 08 March 2005 at 9:30am

Thanks for the information Jim.

Yes I continually add words to the keyword filters list....I usually target the subject line (Subject:something something) to try to get them blocked at that level.  I will back off of some of these.

I know of nothing that would increase our traffic at this time but looking at the log yesterday I did see bunches 3-5 connections suddenly pop in fractions of seconds in the logs...I do not believe that always happens...

I will watch closely today. It made it through the night unattended that was a good thing.

Terry

 

Back to Top
LogSat View Drop Down
Admin Group
Admin Group
Avatar

Joined: 25 January 2005
Location: United States
Status: Offline
Points: 4066
Post Options Post Options   Thanks (0) Thanks(0)   Quote LogSat Quote  Post ReplyReply Direct Link To This Post Posted: 08 March 2005 at 4:09pm
Terry,

In addition to what Jim correctly suggested, can you take a look at your database and see if there's any connections from SpamFilter that have been locked? We have seen at times the database "hanging" on queries if it (the DB server) cannot keep up with the email traffic.
Roberto Franceschetti

LogSat Software

Spam Filter ISP
Back to Top
Terry View Drop Down
Senior Member
Senior Member


Joined: 06 February 2005
Status: Offline
Points: 155
Post Options Post Options   Thanks (0) Thanks(0)   Quote Terry Quote  Post ReplyReply Direct Link To This Post Posted: 08 March 2005 at 6:03pm

All seems to be running good since this morning after  I reduced the keyword list...I will keep this in mind if it happens again.  Thanks Roberto.

 

Terry

Back to Top
 Post Reply Post Reply
  Share Topic   

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.063 seconds.