jlapacheorg author jm date tue oct 23 050540 2007 new revision 587469 url httpsvnapacheorgviewvcrev587469viewrev log bug 5868 ongoing osbf investigation remove bcr_combine go back traditional naivebayes combining since performing best far update tokenization cope token formats xspamrelays headers decomposed address tokens modified spamassassinbranchesbug5293pluginizedbayeslibmailspamassassinpluginosbfpm modified spamassassinbranchesbug5293pluginizedbayeslibmailspamassassinpluginosbfpm url httpsvnapacheorgviewvcspamassassinbranchesbug5293pluginizedbayeslibmailspamassassinpluginosbfpmrev587469r1587468r2587469viewdiff spamassassinbranchesbug5293pluginizedbayeslibmailspamassassinpluginosbfpm original spamassassinbranchesbug5293pluginizedbayeslibmailspamassassinpluginosbfpm tue oct 23 050540 2007 7108 7107 goto skip score bcr_combinens nn sorted score mailspamassassinbayescombinecombinens nn sorted score mailspamassassinbayescombinecombinens nn sorted couldnt come probability goto skip unless defined score 77047 7696 return score combine using bayes chain rule algorithm described eddc paper sub bcr_combine ns nn probary _ pcs ns ns nn pci spam pch nn ns nn pci ham ns nn 0 return combine without ham spam ps 05 accumulators ph 05 foreach p probary note denominator sum i1 p fj ci p ci two classes h pf p pf h 1p p pcs 1p pch invp 1p denom p pcs invp pch ps p denom ph invp denom avoid underflow theyve become 0 reset non0 value multiplications still work ps 0 ps 1e300 ph 0 ph 1e300 pick lowest value tip httpwwwbglnubogofilterbcrfisherhtml ph ps ps 1ph else ph 1ps return ps plugin hook 9729 93012 next unless lengthtoken skip still 0length tokens hash substrsha1token 5 tokenshash token weightshash distance set based see first weightshash distance return keys tokens 9908 95113 magic_re selfstoreget_magic_re w1w2w3w4w5 jm changes crm114osbflua standard add start allowing udorg decomposed address tokens add middle allowing intl0 tokens xspamrelays hdrs words _1 pzpcplpmpng pzpcplpmpng foreach token words next token punctuation wed 06 aug 2008 230425 0000 svn commit r587469 spamassassinbranchesbug5293pluginizedbayeslibmailspamassassinpluginosbfpm