text_combined: timonecomcastnet tim peters anthony baxter 5 sets 1800ham1550spam ran matched 5 ratespy sez training datahamset1 dataspamset1 1798 hams 1548 spams 0445 0388 0445 0323 2108 4072 0556 1097 training datahamset2 dataspamset2 1798 hams 1546 spams 2113 0517 1335 0194 3106 5365 2113 2903 training datahamset3 dataspamset3 1798 hams 1547 spams 2447 0646 0945 0388 2884 3426 2058 1097 training datahamset4 dataspamset4 1803 hams 1547 spams 1057 2584 0723 1682 0890 1164 0445 0452 training datahamset5 dataspamset5 1798 hams 1550 spams 0779 4328 0501 3299 0667 3361 0388 4977 total false pos 273 303501945525 total false neg 367 474282760403 msgs broken 5 sets set4 particular giving sets severe problems set5 blows fn rate everything predicting rates across runs within training set vary much factor 25 suggests systematic bias way sets chosen example perhaps broken sets arrival time thats go back break sets randomly instead partition randomly wild variance across runs mondo mysterious expect hammie much better job already hand grepping sure stare false positives get spam yah theres chickenandegg problem want stuff thats _known_ right test stuff look every message eyeball scheme nonzero error rates kinds using spambayes code tell whether spam going help trust helps lot expect everyone done testing discovered spam ham vice versa results improve improve categorization gross mistakes straightened much less tedious scan rest eyeball skip tokens yep shows lot spam also different forms hams hams manage pick different variant whatever dont end counteracting various bits spam looking _lot_ bad skip rubbish coming uuencoded viruses c spamset whatever reason appear brucegs spam collection added code strip uuencoded sections pump uuencode summary tokens instead ill check didnt make significant difference usual test run single spam set4 judged ham 4 sets nothing else changed shrink database size percent let us know whether helps stripping uuencoded sections false positive percentages 0000 0000 tied 0000 0000 tied 0050 0050 tied 0000 0000 tied 0025 0025 tied 0000 0000 tied 0075 0075 tied 0025 0025 tied 0025 0025 tied 0000 0000 tied 0050 0050 tied 0000 0000 tied 0025 0025 tied 0000 0000 tied 0000 0000 tied 0050 0050 tied 0025 0025 tied 0000 0000 tied 0025 0025 tied 0050 0050 tied 0 times tied 20 times lost 0 times total unique fp went 8 8 tied false negative percentages 0255 0255 tied 0364 0364 tied 0254 0291 lost 1457 0509 0509 tied 0436 0436 tied 0218 0218 tied 0182 0218 lost 1978 0582 0582 tied 0327 0327 tied 0255 0255 tied 0254 0291 lost 1457 0582 0582 tied 0545 0545 tied 0255 0255 tied 0291 0291 tied 0400 0400 tied 0291 0291 tied 0218 0218 tied 0218 0218 tied 0145 0182 lost 2552 0 times tied 16 times lost 4 times total unique fn went 89 90 lost 112 wed 11 sep 2002 201306 0400 spambayes current histograms