christos dimitrakakis ogrvxiujfastmailfm emerson lopes machado wrote dear colleagues doubt concerning choose final classifier comparing three preprocessors auc area roc curve scores utilizing 10fold crossvalidation let b c three preprocessors suppose b got significantly best auc result among 10fold crossvalidation 10 classifiers generated folds saved later purpose final classifier considering two options basically crossvalidation test attempts answer question three models b c best data b appears overall best choice one way proceed would use model b first case use crossvalidation hypothesis test use one type model one use get answer simply create appropriate model type data second modality suggest problematic cross validation score depends 1 model 2 training data 3 validation data however could use 10 classifiers generated via preprocessor b mixing would form bootstrapping similar bagging think examples literature n models built nfold crossvalidiation used kind mixing could viewed nonbayesian model averaging somewhat tangetial comment committing using auc though recommend read expected performance curve bengio et al icml 2005 av spam filtering mguardian risk free email tm _______________________________________________ uai mailing list faqengrorstedu httpssecureengroregonstateedumailmanlistinfouai thu 07 aug 2008 021847 0200 uai building classifier