Standardization can be accomplished through simple rule-based data transformations or more complex procedures such as lexicon-based tokenization and probabilistic hidden Markov models.[9] Several of the packages listed in the Software Implementations section provide some of these features to simplify the process of data standardization.