timonecomcastnet tim peters jeremy total collections 1100 messages trained 11005 messages thats lot training data picked random subsets corpora got much better behavior ratespy output fp rate per run left column fn rate right training datahamset1 dataspamset1 220 hams 220 spams 0000 1364 0000 0455 0000 1818 0000 1364 training datahamset2 dataspamset2 220 hams 220 spams 0455 2727 0455 0455 0000 0909 0455 2273 training datahamset3 dataspamset3 220 hams 220 spams 0000 2727 0455 0909 0000 0909 0000 1818 training datahamset4 dataspamset4 220 hams 220 spams 0000 2727 0000 0909 0000 0909 0000 1818 training datahamset5 dataspamset5 220 hams 220 spams 0000 1818 0000 1364 0000 0909 0000 2273 total false pos 4 0363636363636 total false neg 29 263636363636 another full run another randomly chosen disjoint 220 set much score distribution also quite sharp ham distribution runs 74 items 000 4381 250 3 500 3 750 1 1000 0 1250 0 1500 1 1750 1 2000 1 2250 0 2500 0 2750 0 3000 1 3250 0 3500 0 3750 0 4000 1 4250 0 4500 0 4750 0 5000 0 5250 0 5500 0 5750 1 6000 0 6250 0 6500 0 6750 1 7000 0 7250 0 7500 0 7750 0 8000 0 8250 0 8500 0 8750 1 9000 0 9250 2 9500 0 9750 2 spam distribution runs 73 items 000 13 250 0 500 4 750 5 1000 0 1250 2 1500 1 1750 1 2000 2 2250 1 2500 0 2750 1 3000 0 3250 3 3500 0 3750 0 4000 0 4250 0 4500 1 4750 3 5000 16 5250 0 5500 0 5750 0 6000 1 6250 0 6500 2 6750 1 7000 1 7250 0 7500 1 7750 0 8000 3 8250 2 8500 1 8750 2 9000 2 9250 4 9500 4 9750 4323 hard say whether need better ham better spam suspect better spam 18 30 powerful discriminators htmlrelated spam indicators top 10 overall 312 099 329 099 click 334 099 335 099 wrote 381 001 skip 10 398 099 python 428 001 contenttypetexthtml 454 099 html tags come nonmultipartalternative html messages html tags arent stripped lots spam sets doesnt account though strip html tags rates little worse raining datahamset1 dataspamset1 220 hams 220 spams 0000 1364 0000 1818 0455 1818 0000 1818 raining datahamset2 dataspamset2 220 hams 220 spams 0000 1364 0455 1818 0455 0909 0000 1818 raining datahamset3 dataspamset3 220 hams 220 spams 0000 2727 0000 0909 0909 0909 0455 1818 raining datahamset4 dataspamset4 220 hams 220 spams 0000 1818 0000 0909 0455 0909 0000 1364 raining datahamset5 dataspamset5 220 hams 220 spams 0000 2727 0000 1364 0455 2273 0455 2273 otal false pos 4 0363636363636 otal false neg 34 309090909091 4thstrongest discriminator still finds another html clue though subjectpython 164 001 money 169 099 contenttypetextplain 185 02 charsetusascii 191 0127273 im 232 001 contenttypetexthtml 248 0983607 255 099 wrote 372 001 python 431 001 click 519 099 heh forgot fri 06 sep 2002 225124 0400 spambayes understanding high false negative rate