Spam Filter ISP Support Forum

  New Posts New Posts RSS Feed - bayes not kicking in..?
  FAQ FAQ  Forum Search   Register Register  Login Login

bayes not kicking in..?

 Post Reply Post Reply
Author
keizersozay View Drop Down
Groupie
Groupie
Avatar

Joined: 26 January 2005
Location: United States
Status: Offline
Points: 77
Post Options Post Options   Thanks (0) Thanks(0)   Quote keizersozay Quote  Post ReplyReply Direct Link To This Post Topic: bayes not kicking in..?
    Posted: 23 March 2004 at 5:25pm
It's been well over 5000 emails and the bayes filter does not seem to be kicking in. everything still reports 0% spam. Do I just need to wait longer?

windows 2003 server 2.6 ghz, 1/2 gig ram build 302 mdac 2.8 logging to mysql on same server

Thanks.
Back to Top
Desperado View Drop Down
Senior Member
Senior Member
Avatar

Joined: 27 January 2005
Location: United States
Status: Offline
Points: 1143
Post Options Post Options   Thanks (0) Thanks(0)   Quote Desperado Quote  Post ReplyReply Direct Link To This Post Posted: 24 March 2004 at 11:12pm

Do you have both 5000 good and bad?

Dan S/

 

Back to Top
LogSat View Drop Down
Admin Group
Admin Group
Avatar

Joined: 25 January 2005
Location: United States
Status: Offline
Points: 4065
Post Options Post Options   Thanks (0) Thanks(0)   Quote LogSat Quote  Post ReplyReply Direct Link To This Post Posted: 24 March 2004 at 11:26pm

Keizersozay,

Did you receive 5,000 spam and 5,000 good emails? The Bayesian filter kicks in after both good and bad count are over 5000. If so, even if your other filters were super-effective, you should see at least a small amonut of emails blocked by the Bayesian filter. Please note that the statistical analysis only occurs after all other filters have failed to catch spam, so the number of emails blocked by the Bayesian filter will be small when compared to others.

Can you try running the following query on the database? It returns a list of howm many emails in the quarantine have been blocked by the various rules, and post the results?

Roberto F.
LogSat Software

SELECT     tblQuarantine.RejectID, tblRejectCodes.RejectDesc, COUNT(tblQuarantine.RejectID) AS Total
FROM         tblQuarantine INNER JOIN
                      tblRejectCodes ON tblQuarantine.RejectID = tblRejectCodes.RejectID
GROUP BY tblQuarantine.RejectID, tblRejectCodes.RejectDesc

Back to Top
George View Drop Down
Guest Group
Guest Group
Post Options Post Options   Thanks (0) Thanks(0)   Quote George Quote  Post ReplyReply Direct Link To This Post Posted: 25 March 2004 at 1:12am

After running the query script posted by Roberto further down this thread I got these results showing that it does work when the good/bad  emails go past 5000.

Reverse DNS not found =1466
Empty Mail From =32
Mail From and Mail To are equal =2
Exceeded maximum number of RCPT TO =1950
Keywords found in content =879
Statistical filter match =61

server1 Duel XEON1000/1.5gb mem, 2000adv build 302 via udl to sql (no odbc) mdac 2.8  Mcafee Netshield 4.51
server2 DuelPentiumPro200 256mb mem, 2000adv and MS SQL2000
server3 Duel XEON1000/1.5gb mem, 2000adv, Sendmail 3.05

While this setup is not high end by any means, it handles things pretty good. The cpu load stays down around 50% with some spikes up to 100%. Memory usage by SF is 48,000K to 52,000K

In the last 3 1/2 hours, 64 emails were deleted by the AV for virus's.

 

Back to Top
Keizersozay View Drop Down
Guest Group
Guest Group
Post Options Post Options   Thanks (0) Thanks(0)   Quote Keizersozay Quote  Post ReplyReply Direct Link To This Post Posted: 25 March 2004 at 9:44am

Hi Roberto,
Thanks for the response. It has been well over 5000 good and 5000 bad messages. I looked in the corpus.ini to confirm and it is more that double what it should be. When I ran the query I got this info:
+----------+------------------------------------------+-------+
| RejectID | RejectDesc                                            | Total |
+----------+------------------------------------------+-------+
|        2 | EmailFrom is in local blacklist file            |    27 |
|        4 | Empty Mail From                                        |  1287 |
|        8 | IP address is from a blacklisted country |  1721 |
|       12 | IP found in MAPS search                        | 18718 |
|       13 | Keywords found in content                     |  4038 |
+----------+------------------------------------------+-------+
5 rows in set (0.28 sec)

You should also know that I disable the bayes at night and enable it in the morning. I do this in reference to this problem http://www.logsat.com/spamfilter/forums/showmessage.asp?messageID=3261 that I still have. I can't affort for the sevice to crash at night when I am not around so I just activate the bayes during the day.
Also in reference to the above messageID 3261 I have since moved the spamfilter program to a new "server" that is a 2.6 ghz dell workstation with .5 gig of ram with windows 2003 server. The server has nothing else on it except Trend Server Protect and mysql. The errors are much less frequent but it still happened (once) yesterday. I will try the latest build and see how it goes.
I was reading through the posts and it looked like Dan posted something a while back about not releasing stale connections and the service eventually bombs out..this is what happens to me eventually when I have bayes enabled.

this really isn't an emergency for me, I just wanted to make sure I wasn't doing something wrong with the bayes portion and to further help the development process.  I guess its possible that bayes just hasn't found anything yet....

Thanks again for a fantastic product.

Back to Top
LogSat View Drop Down
Admin Group
Admin Group
Avatar

Joined: 25 January 2005
Location: United States
Status: Offline
Points: 4065
Post Options Post Options   Thanks (0) Thanks(0)   Quote LogSat Quote  Post ReplyReply Direct Link To This Post Posted: 25 March 2004 at 11:03pm

It is very strange that you do not have even a single email caught by the Bayes filter, I'm pretty sure there is something else going on.

If you are running the latest build 312, and if you email us at the support address your SpamFilter logfile for a day or two well try to understand what the problem is.

Roberto F.
LogSat Software

Back to Top
Keizersozay View Drop Down
Guest Group
Guest Group
Post Options Post Options   Thanks (0) Thanks(0)   Quote Keizersozay Quote  Post ReplyReply Direct Link To This Post Posted: 26 March 2004 at 10:13am

I will download the new build shortly, but it may be until monday before I can set it up. Also, my log files are about 30 mb for each day so I will post it to our ftp site and email you with details.

Thanks again.

Back to Top
john1234 View Drop Down
Guest Group
Guest Group
Post Options Post Options   Thanks (0) Thanks(0)   Quote john1234 Quote  Post ReplyReply Direct Link To This Post Posted: 27 March 2004 at 3:44am
I ran the query, but also got nothing at all in the quarantine. What to do?
Back to Top
Desperado View Drop Down
Senior Member
Senior Member
Avatar

Joined: 27 January 2005
Location: United States
Status: Offline
Points: 1143
Post Options Post Options   Thanks (0) Thanks(0)   Quote Desperado Quote  Post ReplyReply Direct Link To This Post Posted: 27 March 2004 at 3:47am

John,

What does your corpus.ini file have in it ... it is in the corpus folder.

Dan S.

Back to Top
stan View Drop Down
Guest Group
Guest Group
Post Options Post Options   Thanks (0) Thanks(0)   Quote stan Quote  Post ReplyReply Direct Link To This Post Posted: 31 March 2004 at 11:01pm

Hello,

      I seem to have the same problem.  Below is the contents of my copus.ini http://file:

[Messages]
Spam=20255
Good=19621

    Below is the output of my query:

Reverse DNS not found 4960
Empty Mail From 294
IP found in MAPS search 18004
Keywords found in content 1433

The Statistical filter does not appear to be catching anything.

Thanks,

Stan

Back to Top
judu View Drop Down
Guest Group
Guest Group
Post Options Post Options   Thanks (0) Thanks(0)   Quote judu Quote  Post ReplyReply Direct Link To This Post Posted: 09 April 2004 at 10:18am

I too have also yet to see the filter kicking in, only 4?

EMail from *** to *** passes Bayesian filter - 0% spam (0ms) < havent seen one say > 0%

running v2.0.1.302

query

Query1
RejectID RejectDesc Total
1 Domain is in local blacklist file 401
2 EmailFrom is in local blacklist file 140
4 Empty Mail From 743
12 IP found in MAPS search 3886
13 Keywords found in content 1484
14 Statistical filter match 4

corpu.ini

[Messages]
Spam=13817
Good=49039

Thanks

 

 

Back to Top
 Post Reply Post Reply
  Share Topic   

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.141 seconds.