Spam Filter ISP Support Forum

  New Posts New Posts RSS Feed - Exessive memory usage
  FAQ FAQ  Forum Search   Register Register  Login Login

Exessive memory usage

 Post Reply Post Reply
Author
StevenJohns View Drop Down
Senior Member
Senior Member


Joined: 03 August 2006
Status: Offline
Points: 119
Post Options Post Options   Thanks (0) Thanks(0)   Quote StevenJohns Quote  Post ReplyReply Direct Link To This Post Topic: Exessive memory usage
    Posted: 19 August 2006 at 5:19pm

Roberto,

Looking at task manager, it appears thst SF is using 364MB of memory and over 700MB of virtual memory.

Surely this is exessive ??

 

Back to Top
LogSat View Drop Down
Admin Group
Admin Group
Avatar

Joined: 25 January 2005
Location: United States
Status: Offline
Points: 4106
Post Options Post Options   Thanks (0) Thanks(0)   Quote LogSat Quote  Post ReplyReply Direct Link To This Post Posted: 19 August 2006 at 6:15pm
It really depends on the amount of email traffic. If SpamFilter receives in the order of 1 million emails/day, the RAM is normal. If it's in the 10,000 emails/day, then yes, it's excessive.

If it's the 2nd case, can you ensure that on SpamFilter's quarantine tab you hide the list of quarantined emails? That database view does consume a lot of RAM, and is designed to be hidden once it's been used. Also, can you please let us know what the size of the files in the SpamFilter\corpus directory?
Roberto Franceschetti

LogSat Software

Spam Filter ISP
Back to Top
StevenJohns View Drop Down
Senior Member
Senior Member


Joined: 03 August 2006
Status: Offline
Points: 119
Post Options Post Options   Thanks (0) Thanks(0)   Quote StevenJohns Quote  Post ReplyReply Direct Link To This Post Posted: 19 August 2006 at 6:32pm

Roberto,

My case is the second, I am still in the testing phase, so havent moved all domains to SF yet. Since August 3rd, weve had 19000 emails forwarded and 186000 mails blocked.

The database view is hidden....in fact I never use it, it's a bit clumsy for me, I use MySQL browser and use custom SQL scripts.

FYI the files in the corpus folder are as follows

db.dat 33,942 KB

db.dat.rpb 32133 KB

I would imagine that this is not too exessive???

Also, we only have 46 domains configured, 4 entries in the Autowhitelistforcedelivery.txt file and nothing in any other text file.

When I restarted the service, the memory went up to 260MB and the VM went to 260MB, but I guess that they will rise in time.

So, do I assume that the memory usage is too much?

Any other ideas?

Back to Top
LogSat View Drop Down
Admin Group
Admin Group
Avatar

Joined: 25 January 2005
Location: United States
Status: Offline
Points: 4106
Post Options Post Options   Thanks (0) Thanks(0)   Quote LogSat Quote  Post ReplyReply Direct Link To This Post Posted: 19 August 2006 at 6:58pm
Yeap... The RAM usage in your case should be in the order of 30MB-60MB. The problem is most likely linked to the size of your corpus database, as the files are about 10x larger than they should be.

Can you please check the value of the "CleanUpCorpusIntervalDays" parameter in the SpamFilter.ini file? It should be around 7 days.

If you edit the SpamFilter\corpus\corpus.ini file, you should see values for "Spam" and "Good" similar to the values you posted. Can you ensure it is so? For some reason, the corpus database is either not cleaning up old items, or contains way more entries than it normally should.

If the corpus data is legitimate, and the corpus DB size is correct, then the RAM usage is indeed normal.

A quick fix would be to stop SpamFilter, delete/rename the corpus directory, and restart SpamFilter. This will reset the corpus database, and the RAM should drop to more normal values.
Roberto Franceschetti

LogSat Software

Spam Filter ISP
Back to Top
StevenJohns View Drop Down
Senior Member
Senior Member


Joined: 03 August 2006
Status: Offline
Points: 119
Post Options Post Options   Thanks (0) Thanks(0)   Quote StevenJohns Quote  Post ReplyReply Direct Link To This Post Posted: 19 August 2006 at 7:05pm

CleanUpCorpusIntervalDays was set at 7

spam and good were similar to what i posted

i deleted the corpus folder and restarted SF adn not were running at 14MB memory and 10MB VM

I will wait until the baysian db kicks in again (5000 good and 5000 bad mails i think) and see the results then.

 

cheers

Back to Top
 Post Reply Post Reply
  Share Topic   

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.184 seconds.