Exessive memory usage
Printed From: LogSat Software
Category: Spam Filter ISP
Forum Name: Spam Filter ISP Support
Forum Description: General support for Spam Filter ISP
URL: https://www.logsat.com/spamfilter/forums/forum_posts.asp?TID=5763
Printed Date: 29 November 2025 at 6:09am
Topic: Exessive memory usage
Posted By: StevenJohns
Subject: Exessive memory usage
Date Posted: 19 August 2006 at 5:19pm
|
Roberto, Looking at task manager, it appears thst SF is using 364MB of memory and over 700MB of virtual memory. Surely this is exessive ??
|
Replies:
Posted By: LogSat
Date Posted: 19 August 2006 at 6:15pm
|
It really depends on the amount of email traffic. If SpamFilter receives in the order of 1 million emails/day, the RAM is normal. If it's in the 10,000 emails/day, then yes, it's excessive. If it's the 2nd case, can you ensure that on SpamFilter's quarantine tab you hide the list of quarantined emails? That database view does consume a lot of RAM, and is designed to be hidden once it's been used. Also, can you please let us know what the size of the files in the SpamFilter\corpus directory? ------------- Roberto Franceschetti http://www.logsat.com" rel="nofollow - LogSat Software http://www.logsat.com/sfi-spam-filter.asp" rel="nofollow - Spam Filter ISP |
Posted By: StevenJohns
Date Posted: 19 August 2006 at 6:32pm
|
Roberto, My case is the second, I am still in the testing phase, so havent moved all domains to SF yet. Since August 3rd, weve had 19000 emails forwarded and 186000 mails blocked. The database view is hidden....in fact I never use it, it's a bit clumsy for me, I use MySQL browser and use custom SQL scripts. FYI the files in the corpus folder are as follows db.dat 33,942 KB db.dat.rpb 32133 KB I would imagine that this is not too exessive??? Also, we only have 46 domains configured, 4 entries in the Autowhitelistforcedelivery.txt file and nothing in any other text file. When I restarted the service, the memory went up to 260MB and the VM went to 260MB, but I guess that they will rise in time. So, do I assume that the memory usage is too much? Any other ideas? |
Posted By: LogSat
Date Posted: 19 August 2006 at 6:58pm
|
Yeap... The RAM usage in your case should be in the order of 30MB-60MB. The problem is most likely linked to the size of your corpus database, as the files are about 10x larger than they should be. Can you please check the value of the "CleanUpCorpusIntervalDays" parameter in the SpamFilter.ini file? It should be around 7 days. If you edit the SpamFilter\corpus\corpus.ini file, you should see values for "Spam" and "Good" similar to the values you posted. Can you ensure it is so? For some reason, the corpus database is either not cleaning up old items, or contains way more entries than it normally should. If the corpus data is legitimate, and the corpus DB size is correct, then the RAM usage is indeed normal. A quick fix would be to stop SpamFilter, delete/rename the corpus directory, and restart SpamFilter. This will reset the corpus database, and the RAM should drop to more normal values. ------------- Roberto Franceschetti http://www.logsat.com" rel="nofollow - LogSat Software http://www.logsat.com/sfi-spam-filter.asp" rel="nofollow - Spam Filter ISP |
Posted By: StevenJohns
Date Posted: 19 August 2006 at 7:05pm
|
CleanUpCorpusIntervalDays was set at 7 spam and good were similar to what i posted i deleted the corpus folder and restarted SF adn not were running at 14MB memory and 10MB VM I will wait until the baysian db kicks in again (5000 good and 5000 bad mails i think) and see the results then.
cheers |