Until now , translation models have been evaluated either subjectively ( e.g. White and O'Connell 1993 ) or using relative metrics , such as perplexity with respect to other models ( Brown et al. 1993b ) .
but dictionaries are data too
Peter F Brown Stephen A Della Pietra Vincent J Della Pietra Meredith J Goldsmith Jan Hajic Robert L Mercer Surya Mohanty
6.1.1 Experiment 1 . Until now , translation models have been evaluated either subjectively ( e.g. White and O'Connell 1993 ) or using relative metrics , such as perplexity with respect to other models ( Brown et al. 1993b ) . Objective and more accurate tests can be carried out using a `` gold standard . ''
Until now , translation models have been evaluated either subjectively ( e.g. White and O'Connell 1993 ) or using relative metrics , such as perplexity with respect to other models ( @@CITATIONb ) .