Print Page | Close Window

Corpus and CPU hit

Printed From: LogSat Software
Category: Spam Filter ISP
Forum Name: Spam Filter ISP Support
Forum Description: General support for Spam Filter ISP
URL: https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=2736
Printed Date: 01 July 2025 at 9:04am


Topic: Corpus and CPU hit
Posted By: dcook
Subject: Corpus and CPU hit
Date Posted: 22 January 2004 at 1:24pm

My primary spamfilter running beta 2.0.0.278 is taking a large CPU hit.  Upon inspection I restarted the service and the cpu did not throttle down. I noticed a continual activity of items being added to the "corpus" database.  In the corpus/queue directory there was over two thousand files.  I let it run and it emptied the queue folder.  Why did it stop processing the queue folder and why was there a backup of files? Can you put more fiber in the next beta?

I have logs on the issue but they don't show CPU.  I am running this on a bladeserver -- dual 700mhz with 1gb of ram.  Has anybody else seen this CPU and queue issue?

Dwight 


Replies:
Posted By: LogSat
Date Posted: 22 January 2004 at 10:54pm

Dwight,

We have received similar reports last week, and were able to duplicate the issue. We have placed a pre-beta build at

http://www.logsat.com/spamfilter/pub/temp/sf279.zip" CLASS="ASPForums" TITLE="WARNING: URL created by poster. ‘http://www.logsat.com/spamfilter/pub/temp/sf279.zip’ - http://www.logsat.com/spamfilter/pub/temp/sf279.zip" CLASS="ASPForums" TITLE="WARNING: URL created by poster. - http://www.logsat.com/spamfilter/pub/temp/sf279.zip

With the fix. In a few days, after it's been tested further, we'll release it as a public beta. Please feel free to try it if you wish.

Roberto F.
LogSat Software

Posted By: dcook
Date Posted: 23 January 2004 at 12:04pm
Thanks I'll give it a try today.

Posted By: dcook
Date Posted: 23 January 2004 at 12:26pm

Inital results are still not great -- I replaced the two files and the results are the same on the CPU 66% to 100% hit on both CPU's.  I also deleted the corpus data and restarted, only  to find the same results. 

My other spamfilter server with the same 278 beta is doing just fine, the CPU on it is only a few % most of the time.

Dwight

 

Posted By: Guests
Date Posted: 25 January 2004 at 1:37am
Is it an SMP issue?


Print Page | Close Window