qydlqcwsiacfymissuesapacheorg httpissuesapacheorgspamassassinshow_bugcgiid5686 additional comments user7gvcceaschallengecc 20071015 0551 lets graphs heres graph scores svn trunks version bayes measured using 10fold cross validation corpus 2000 recent spam 2000 recent ham collection im using corpus measure results develop httptaintorgx2007graph_trunkpng heres graph corpus classified using osbflua httptaintorgx2007graph_osbfluapng see several things current trunks bayes tendency put fair bit spam unsure middle ground bayes_50 gets score osbflua better separating samples correct class less clear dividing line around 15 im sure score figure represents demonstrates algorithms used osbflua pretty effective opinion gives us idea osbf something aim implementation implementation winnowosbf checked r584432 compared svn trunk heres score histogram trunk score numhit detail overall histogram ham spam 0000 99914 0000 0761 0040 0020 0040 0028 0080 0050 0120 0015 0120 0039 0160 0005 0160 0011 0200 0017 0240 0005 0240 0022 0280 0017 0320 0011 0360 0028 0400 0010 0400 0017 0440 0005 0440 0083 0480 0025 0480 2122 0520 0231 0560 0138 0600 0088 0640 0127 0680 0121 0720 0182 0760 0193 0800 0187 0840 0116 0880 0215 0920 0375 0960 94825 hopefully pastes ok thing want see 0000 096010 05 10 false positives 00 05 false negatives heres histogram r584432 score numhit detail overall histogram ham spam 0000 94728 0000 0077 0960 5272 0960 99923 thats good except 5272 false positives need avoid since 5 fps serious thresholds cost figure resultsthresholdsstatic comes singlefigure metric based score distribution looks like trunk threshold optimization hamcutoff030 spamcutoff070 cost22230 total hamspam 1976418144 fp 0 0000 fn 168 0926 unsure 543 1432 ham 8 0040 spam 535 2949 tcrs l1 25809 l5 25809 l9 25809 summary 030070 fp 0 fn 168 uh 8 us 535 c 22230 r584432 threshold optimization hamcutoff030 spamcutoff070 cost1043400 total hamspam 1976418144 fp 1042 5272 fn 14 0077 unsure 0 0000 ham 0 0000 spam 0 0000 tcrs l1 17182 l5 3473 l9 1932 summary 030070 fp 1042 fn 14 uh 0 us 0 c 1043400 cost metric penalised 5 fp rate heavily receiving mail assignee bug watching assignee wed 06 aug 2008 054559 0700 bug 5686 add osbfwinnow alternative bayes