It can be shown ( Berger et al. , 1996 ) that the use of this model with maximum likelihood parameter estimation is justified on information-theoretic grounds when q represents some prior knowledge about the true distribution and when the expected values of f in the training corpus are identical to their true expected values .3 There is no requirement that the components of f represent disjoint or statistically independent events .
a maximum entropy approach to natural language processing
Adam L Berger Stephen A Della Pietra Vincent J Della Pietra
However , since the models tested apparently differed in other aspects , it is hard to determine how much of this gain can be attributed to the use of ME . It can be shown ( Berger et al. , 1996 ) that the use of this model with maximum likelihood parameter estimation is justified on information-theoretic grounds when q represents some prior knowledge about the true distribution and when the expected values of f in the training corpus are identical to their true expected values .3 There is no requirement that the components of f represent disjoint or statistically independent events . This result motivates the use of MEMD models , but it offers only weak guidance on how to select q or f .
It can be shown ( @@CITATION ) that the use of this model with maximum likelihood parameter estimation is justified on information-theoretic grounds when q represents some prior knowledge about the true distribution and when the expected values of f in the training corpus are identical to their true expected values .3 There is no requirement that the components of f represent disjoint or statistically independent events .