jeremyalummitedu jeremy hylton think one step towards deployment creating reusable tokenizer mail messages current codebase doesnt expose easytouse easytocustomize tokenizer timtest module seems contain enormous body practical knowledge parse mail messages module wasnt designed reuse id like see module take single message collection messages tokenize one id like see tokenize customizable tim exclude headers test data particular biases test data people test data without biases ought able customize tokenizer include exclude others jeremy fri 6 sep 2002 122809 0400 spambayes deployment