In this paper, we improve the named-entity recognition NER capabilities for an already existing text-based dialog system TDS in Spanish. Our solution is twofold: first, we developed a hidden Markov model part-of-speech POS tagger trained with the frequencies from over 120-million words; second, we obtained 2,i¾?283 real-world conversations from the interactions between users and a TDS. All interactions occurred through a natural-language text-based chat interface. The TDS was designed to help users decide which product from a well-defined catalog best suited their needs. The conversations were manually tagged using the classical Penn Treebank tag set, with the addition of an ENTITY tag for all words relating to a brand or product. The proposed system uses an hybrid approach to NER: first it looks up each word in a previously defined catalog. If the word is not found, then it uses the tagger to tag it with its appropriate POS tag. When tested on an independent conversation set, our solution presented a higher accuracy and higher recall rates compared to a current development from the industry.
['Victor R. Martinez', 'Luis Eduardo Pérez', 'Francisco Iacobelli', 'Salvador Suárez Bojórquez', 'Victor M. Gonzalez']
Semi-Supervised Approach to Named Entity Recognition in Spanish Applied to a Real-World Conversational System