This method can be generalized , inspired by Stolcke and Segal ( 1994 ) , who derive N-gram probabilities from stochastic context-free grammars .
precise ngram probabilities from stochastic contextfree grammars
Andreas Stolcke Jonathan Segal
That is , each X E EA is a terminal , or a nonterminal not in the same set Ni as A , but immediately reachable from set N â through B E N . This method can be generalized , inspired by Stolcke and Segal ( 1994 ) , who derive N-gram probabilities from stochastic context-free grammars . By ignoring the probabilities , each N = 1 , 2 , 3 , ... gives rise to a superset approximation that can be described as follows : The set of strings derivable from a nonterminal A is approximated by the set of strings al ... an such that
This method can be generalized , inspired by @@CITATION , who derive N-gram probabilities from stochastic context-free grammars .