text:
JP2010525415A - Recognition architecture for generating Asian characters - Google Patents
Recognition architecture for generating Asian characters Download PDF
JP5622566B2 (en
チットラプ アラン
ゴン イーファン
イー.ファイゲ ケビン
クオ シウン−ツ
ミワ タロウ
マイクロソフト コーポレーション
2007-04-26 Priority to US11/789,878 priority Critical
2008-04-08 Application filed by マイクロソフト コーポレーション filed Critical マイクロソフト コーポレーション
230000004044 response Effects 0 abstract 1
G06F40/129—
An architecture for correcting inaccurate recognition results in an Asian speech recognition system is provided. A spelling mode for correcting incorrect spelling of recognition results and generating new words can be activated in response to voice input. Corrections are obtained using voice and / or manual selection and entry. This architecture facilitates correction in a single pass rather than multiple times as in conventional systems. Words corrected using spelling mode are corrected as a unit and treated as a word. The spelling mode is applicable to at least Asian continental languages, for example, Asian languages such as Simplified Chinese, Traditional Chinese, and / or Japanese.
The present invention relates to speech recognition, and more particularly to a recognition architecture for generating Asian characters.
Because the English speech recognition (SR) engine cannot contain mainly all or nearly all proper nouns, it can not contain names in the engine lexicon, so the spelling wizard ( spelling wizard) is required. On the other hand, a set of Chinese characters can be considered closed because all Chinese characters are included in the lexicon. There is no need to consider or worry about characters other than vocabulary. However, a big problem with Chinese speech recognition engines is homonyms that many different characters share. There are about 47,000 valid Chinese characters, but there are only about 1,600 syllables that are different but fixed in Chinese. This means that if syllables are assigned uniformly different characters, each syllable can correspond to about 23-31 different characters, many of which mean different.
A fixed syllable is a set of syllables associated with valid Chinese characters. For example, the syllable "chu" . . Corresponds to (Pinyin / ch uh /), but there is no valid character corresponding to "chiu". Due to the limited number of fixed syllables, a significant number of characters share the same pronunciation. The following is an example of 54 characters that share the same pronunciation as / l ih /. This list of / l ih / is not comprehensive.
Thus, if the engine misrecognizes a word, the user can try to correct the word from the alternative list or repeatedly speak to recognize the desired word. If not successful, it depends on the following issues:
First, voice audio is not accurately processed by the acoustic model (AM), or the acoustic model has a lower relevance score for the desired word than other words, If the language model (LM) score of the word is higher, the exact word from the alternative list may not be output no matter how many times the user utters the word.
Second, even if it is assumed that voiced audio is processed correctly by the acoustic model, the desired character is in the list entry beyond the number of alternative items and is not presented to the user The user will not be able to get the word without typing. This problem is more likely to occur in Chinese, especially when the letters are the same sound of numbers or numbers, in which case the speech recognition engine further performs inverse text normalization (ITN) (eg, Inversed-Text Normalization) (eg, Normalization from "twelve" to "12") Displays various forms of results.
Third, even if there are no characters other than the vocabulary that must be considered for the Chinese speech recognition engine, a new word may be created by the user with a combination of different characters. In addition to new words, there are no spaces between words to indicate word boundaries. To determine word boundaries, Asian Simplified Chinese (CHS), Traditional Chinese (CHT), and Japanese (JPN) are either in-engine or input method editor (IME: Word segmentation is necessary in the input method (input method editor) process. For this reason, when a user instructs a Chinese speech recognition engine on a proper noun such as a human name that is very likely to be an unknown word, the name is very common and can be found in training data Unless it is a thing, it is very unlikely that a speech recognition engine will process the name correctly. Even if the acoustic and language models are working correctly, the user may receive an output with the name of a character such as "Liu Li" (the focus is the second character. Yes, the second character is a name). The output of this name is different from the desired output "Liu Wei" because of the same-sound problem already described. In other words, "Rei" and "莉" are the same sound, but are used with different names. This also applies to human perception during Chinese conversation. If the first person tells the second person his name, the second person will need to specifically ask the first person what character to use in the name.
Finally, when the user is trying to correct the word character during the speech recognition process, the correct character can be obtained by selecting the character (s) and / or repeatedly speaking the character (s). By determining whether or not it finally appears on the alternative list, it is possible to obtain an accurate output. In many cases, when a character does not have many homophones, it is possible to obtain the exact word to replace. However, this type of correction is based on individual characters. Since speech recognition is learned not in units of characters but in terms of words, this correction is not learned in speech recognition. Therefore, if the user needs this character multiple times in the document, the user will have to repeat the correction process each time the character is spoken. Thus, the conventional recognition process is cumbersome and inefficient.
The present invention has been made in view of the above-described problems, and an object of the present invention is to provide an architecture for correcting an inaccurate recognition result in an Asian speech recognition system.
The following presents a simplified summary for a basic understanding of some of the novel embodiments described within this specification. This summary is not an extensive overview. This summary does not identify important / critical elements, nor does it delineate the scope. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is presented later.
The disclosed architecture provides a spelling mode for Asian speech recognition algorithms. This facilitates determining new word boundaries and adding new words to the lexicon. Therefore, unlike the conventional system in which the word correction is performed a plurality of times, the word correction is generated only once based on the spelling mode.
Specifically, in the context of Chinese characters, the spelling mode facilitates the input of Chinese characters when the speech recognition engine returns an incorrect character in dictation. Words that are corrected using spelling mode are corrected as a unit and treated as a single word. This is because, for example, the boundaries of Asian languages are unclear, unlike English words in which the boundaries of words are easily distinguished. Therefore, inputting Chinese characters (in this example) by using spelling mode reduces or eliminates word misrecognition in the next recognition process.
The disclosed spelling mode applies to other Asian languages such as Simplified Chinese, Traditional Chinese, and / or Japanese. In these languages, the characters have a corresponding fixed sound.
To the accomplishment of the related objectives described above, certain embodiments are set forth herein in conjunction with the following description and the annexed drawings. However, these embodiments are just a few examples of the various ways in which the principles disclosed herein can be used and are intended to include all such embodiments and equivalents. Other advantages and novel features will become apparent from the following detailed description when considered in conjunction with the drawings.
It is a figure which shows the translation system mounted in the computer. FIG. 2 illustrates a system that facilitates lexicon sharing based on new words learned during spelling / correction processing. FIG. 7 illustrates a system that uses an inference component that facilitates automation of one or more functions. FIG. 6 illustrates one or more methods that can be used with the spelling / correction architecture disclosed herein. It is a figure which shows the system which uses word pronunciation as a character designation | designated method. FIG. 10 is a screenshot of a spelling dialog panel displayed when a user wants Asian characters / words as output. FIG. 6 is a screenshot of a spelling dialog panel displayed when a user wants an English word as output. It is a figure of the screen shot of the spelling dialog panel displayed for a sound command process. It is a figure of the screenshot of the spelling mode dialog panel displayed in response to the utterance start command for correction of the same sound. It is a figure which shows the panel by which the word box of the misrecognition was corrected and the list box was cleared in response to the index selection by utterance. FIG. 10 is a screen shot of a spelling dialog panel displayed for utterance pronunciation. It is a figure of the screen shot of the spelling dialog panel displayed for correction of utterance pronunciation. FIG. 6 is a screenshot of a spelling dialog panel displayed with a modified homophone list box based on correction of utterance pronunciation. Screenshot of the spelling dialog panel that appears when the cursor moves to the next character in the pronunciation process so that the misrecognized word is corrected and the user can continue correcting the next character if necessary FIG. FIG. 3 illustrates a system that uses positive, neutral and negative meanings of character weighting according to a second method. FIG. 7 illustrates a system that uses word decomposition by speech input of desired character subcomponents according to a third method. FIG. 10 is a screenshot of a spelling dialog panel displayed for Japanese recognition and processing by hiragana utterance / type input to obtain kanji. FIG. 10 is a screenshot of a spelling dialog panel displayed for Japanese recognition and processing related to romaji acquisition. FIG. 3 illustrates a method for speech recognition in accordance with the disclosed architecture. It is a figure which shows the method of correcting a recognition result using a spelling wizard. It is a figure which shows the method of converting speech pronunciation into a character. FIG. 6 is a diagram illustrating a method of using Asian and English segmentation commands for correction processing. It is a figure which shows the method of using the same sound command of an Asian spelling wizard. It is a figure which shows the method of giving a weight value to the meaning of a word. FIG. 6 illustrates a method for sharing an updated lexicon. FIG. 6 is a diagram illustrating a method of using character decomposition for spelling correction. It is a figure which shows the method of the correction process based on the several method of spelling correction. It is a figure which shows the method of the correction process based on the several method of spelling correction. 1 is a block diagram of a computing system operable to perform correction processing in accordance with the disclosed architecture. 1 is a schematic block diagram of an exemplary computing environment for correction processing in accordance with the disclosed architecture.
Disclosed herein is at least one user interface (UI) including algorithms, data, Asian speech recognition and spelling modes for new word / character acquisition or misrecognition character correction. It is an architecture to provide.
Reference is now made to the figure. In the drawings, the same reference numerals are used throughout to designate the same elements. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding. It may be evident, however, that the novel embodiments can be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate description.
Referring first to FIG. 1, FIG. 1 shows a translation system 100 implemented on a computer. The system 100 includes a speech recognition component 102 that receives an Asian utterance input or speech input and performs recognition processing on the input. Sometimes the recognition process will output incorrect Asian characters and / or words. Thus, the system 100 further generates corrections to generate accurate characters and / or words based on incorrect Asian characters / words and / or new Asian characters / words output by the speech recognition component. Includes component 104.
The system 100 includes at least a user interface for user interaction, a search for English and Asian words, and a split spelling for providing and executing different commands for launching and interacting with the user interface panel. Panel user interface, user spelling mode for capturing new words and determining word boundaries is shown in more detail. The system 100 further assists the user in obtaining a character by utterance input using pronunciation, a word containing the desired character, a subcomponent containing the desired character, and a selection from the homophone list, after which the conversion candidate Select the desired character from. A data store is provided that includes data for storing phonetic speech distance information in a speech system and a confusion matrix table. This information helps the user to quickly and easily correct misrecognized pronunciations and reduces the likelihood that the system will make similar mistakes.
A data store is provided that includes the usage frequency of each character, as well as possible categories where characters such as personal names and company names exist. Thus, when a keyword is detected, the corresponding category is triggered and the character used in that category will be pushed higher in the list. Reading important characters in a word and rearranging the character list so that the desired character appears at the top of the remaining correction list are also part of the method disclosed herein.
The system 100 facilitates obtaining a character by uttering input using a word containing the desired character, and further obtaining a character by examining subcomponents of the character. The user interface of the system 100 processes the phonetic commands to get the correct word and to avoid re-entry of pronunciation. The user can also share a new word lexicon and return the new word to evaluate the new word and to update a different lexicon. In addition, other Asian (eg, Japanese) voice input can be switched between many (eg, four) different writing systems.
FIG. 2 illustrates a system 200 that facilitates lexicon sharing based on new words learned during correction processing. System 200 includes voice recognition component 102 and spelling / correction component 104 of FIG. However, the output of the correction component 104 is fed back to the recognition component 102 to update the internal lexicon 202. Note, however, that lexicon 202 may be external to recognition component 102.
The system 200 can further include a language model (LM) 204 and an acoustic model (AM) 206 as in a conventional recognition system. Language model 204 (or grammar file) includes a set of word sequence probabilities. The acoustic model 206 characterizes the acoustic behavior of words in the form of phonemes based on the speech data and its transcription. The acoustic model 206 models a speech unit of a language based on a feature vector generated from a speech audio signal (speech audio signal). The recognition component 102 processes the input received from the language model 204 and the acoustic model 206 to provide the best output. However, as shown, for complex applications such as Asian language recognition processing, it can be difficult to produce accurate results and resolve inaccurate results. Thus, it is beneficial to update (or improve) the lexicon 202 when the corrected result is reached. These updates can be important in such complex applications. Thus, along with appropriate safety checks in place, sharing component 208 facilitates sharing information such as lexicon 202 with other users or systems and / or lexicon vendors who distribute new lexicon corpora. This will be described in more detail herein.
FIG. 3 is an illustration of a system 300 that employs an inference component 302 that facilitates automation of one or more functions. For example, inference can be based on speech correction operations that the component 302 learns and infers as well as the user (eg, user profile). If the user is much more fluent in English than Chinese, and that is long-term, the inference component 302 learns that the user typically makes a speech recognition error associated with a particular Chinese character . Accordingly, the component 302 can automate the functions of the user interface in anticipation of the user making the same mistake by displaying the spelling mode interface versus the pronunciation interface, and can support the user more efficiently.
In another example, the user can learn to generally prefer to use the spelling mode over any other mode provided. Thus, component 302 will automatically display a spell mode user interface when it encounters a choice of method to correct. These are just a few examples of the many inferences that can be made based on learning and reasoning not only about user interaction, but also about system processing that tends to occur repeatedly based on certain input criteria.
The inference component 302 can use machine learning and reasoning (MLR) for monitoring, analysis, calculation, use of learning and inference results, for example. The subject architecture (eg, related to selection) can employ various MLR-based schemes to implement various aspects thereof. For example, the process of determining what letter or which letter of a word should be selected and displayed can be facilitated using an automatic classifier system and process.
The classifier (classifier) is a function that maps the input attribute vector x = (x1, x2, x3, x4, xn) to the class label class (x). Further, the classifier can output the reliability that the input belongs to the class, that is, f (x) = confidence (class (x)). Such classification uses probabilistic analysis and / or other statistical analysis (eg, analysis factoring in the utility or cost of the analysis to maximize expectations for one or more people). Thus, it is possible to predict or infer an action that the user desires to automatically execute.
As used herein, "inferring" and "inferencing" generally refers to inferences about systems, environments and / or users from a set of observations as captured through events and / or data. A process or inference state. Inference can be employed to identify a specific context or action, or can generate a probability distribution over states, for example. Inference is probabilistic, that is, the result of calculating a probability distribution in the state of interest based on consideration of data and events. Inference may also refer to techniques used to construct higher level events from a set of events and / or data. Such inferences are observed whether events and data are from one or more event sources and data sources, whether or not the events are closely related to temporal proximity. A new event or action will be constructed from the set of events and / or stored event data.
A support vector machine (SVM) is an example of a classifier that can be used. SVM operates by finding in a space of possible inputs a hypersurface that divides trigger input events from non-trigger events in an optimal way. Intuitively, this makes the classification of test data close to training data but not the same. Other specified and non-specified model classification techniques include, for example, statistical regression, naive Bayes, Bayesian networks, decision trees, neural networks, fuzzy logic models, and other statistical models that represent the uniqueness of different patterns that can be employed. Includes various forms of classification models. As used herein, classification further includes methods used to assign ranks and / or priorities.
As can be readily appreciated from this specification, the subject architecture is trained explicitly (eg, using general training data) and implicitly (eg, observing user behavior, external information) Trained classifiers) can be used. For example, the SVM is configured using a learning or training phase and feature selection module in the classifier constructor. Thus, the classifier (s) can be used to automatically learn and perform a number of functions according to predetermined criteria.
Inference component 302 interfaces with recognition component 102, correction component 104, lexicon 202, language model 204 (connection not shown), acoustic model 206 and sharing component 208 to monitor, for example, user and system processing and data Can be obtained. Using the inference component 302 in the system 300 is only one example of the many different ways in which inference can be used and associated. That is, the reasoning component 302 can be used with more detailed examples of system components in later drawings.
FIG. 4 is a diagram illustrating one or more methods 400 that may be used with the correction architecture disclosed herein. For example, the spelling / correction component 104 can include a word pronunciation method 402, an in-word character method 404, and a character decomposition method 406. These methods 400 provide at least three ways of specifying characters. Methods that can specify characters include providing information about how to pronounce a word using partial phonetic symbols (eg, pronunciation method 402). In-word character method 404 includes providing information on how to write a character by presenting a word in which the character is present. For example, if the user selects the designation "薫", the user can say "薫陶的 薫". This is similar to using "a, as in apple " in English.
Providing information regarding the method of composing characters (or decomposing characters) is performed by the decomposition method 406. That is, the user can speak the constituent elements of the characters. For example, if the user wants to designate "Li", the user can say "Ki; Li". These three methods (402, 404, 406) are described in more detail herein.
The first method pronunciation method 402 is provided using a spelling wizard, while methods 404 and 406 are applied directly without a wizard. However, it should be understood that all methods (402, 404, 406) can be implemented using a wizard so that the user can select one of the word correction methods. It should also be understood that the use of the term "wizard" should in no way be construed as limiting. That is, rather than displaying what the wizard would normally be able to guide the user through the entire process, a series of dialogs can be displayed that concentrate on a small portion of the overall process.
The pronunciation method 402 is used when the user attempts to type with Chinese characters or words. The use of Asian pronunciation is common in some Asian countries. However, there are other input methods that can be used besides the pronunciation of traditional Chinese OS. Considering the convenience of pronunciation, many users use pronunciation (notes) when typing characters on the keyboard. This is the case with more Chinese users when using a simplified Chinese OS. In a simplified Chinese OS, a character is typed with a keyboard using a partial pronunciation system called Pinyin. Taiwanese users (using traditional Chinese)
But typing is time consuming and prone to mistakes. This is a time consuming and labor consuming task especially for Taiwanese users. This is because the traditional Chinese speech system is different from the set of 26 English characters (in Pinyin) used in Continental Chinese. For example, the phonetic symbol is
The first symbol
Is considered a sound of / b /, but 1 (number) instead of the letter b on the keyboard! Get it with the key (exclamation point). Thus, the user needs to learn where each symbol is located on the keyboard. On the other hand, Pinyin used in continental China is composed of 26 alphabetic characters, and if the user is familiar with the location of the 26 alphabetic characters on the keyboard, there is no need to learn another keyboard set. .
The spelling wizard overcomes the above limitations by allowing the user to obtain Chinese words by speaking instead of typing. This is particularly useful if the user is not familiar with the location of the phonetic symbols and / or the 26 alphabetic characters on the keyboard or quickly selects and enters symbols without frequently interacting with the symbols.
It can be said that the second (or intra-word character) method 404 is more complicated than the word pronunciation method 402. This is because the selected word including the character may be an arbitrary word including even a famous person name. The disclosed architecture will include all the characters used in Chinese, but especially if it includes all the words, such as the name of a recently famous person who is not yet part of the training data. I can't say that.
The user can select a word containing the desired character, but the character may not be the first character in the word. Letters can appear in the middle or at the end of a word. For example, the user speaks " 薫 陶的 陶" and obtains the last (or bold) character "ceramic".
To get sufficient recognition accuracy, what type of words people use to specify letters, assign higher weights to those words, or specifically train those words It is desirable to fully understand either of the above. Accurate collection and sequencing of data helps improve the accuracy of speech recognition. Furthermore, the better the acoustic model for speech recognition, the better the results obtained from this method. Once this has been achieved, it may be easier to use this method 404 to correct misrecognized Chinese words than the first method 402. This is because the number of steps for obtaining an accurate character is smaller than that in the case of pronunciation.
The third method 406 can be used for a small number of words that are easily decomposed to a lesser degree than other methods. In other words, the number of words that can be easily decomposed and widely used by people is not large. Accordingly, decomposable words can be listed in the grammar (or language model) to assist this method 406.
FIG. 5 is a diagram illustrating a system 500 that uses word pronunciation as a character designation method. As described above, the spelling wizard can be used for the pronunciation method. To help the user pronounce and select the correct character, the wizard uses one or more data files that map between the character and the pronunciation. Furthermore, an optimal list of homophones can be provided so that the user can quickly obtain the desired character.
In the following, a data file for conversion between a voice system and characters will be described. In the first example, the audio system is shown in simplified Chinese (CHS) / traditional Chinese (CHT) with an outline of an exemplary data file.
As mentioned above, Simplified Chinese uses Pinyin, which uses as many as 26 English characters, but is optionally used with tone information. In contrast, Traditional Chinese uses emoji symbols, Zhuyin, but is not standard Chinese. Traditional Chinese phonetic sounds are similar to the international phonetic alphabet (IPA) of English. For example, the phonetic notation of simplified Chinese (CHS) and traditional Chinese (CHT) is as follows for the character "ta".
The recognition component 102 of FIG. 5 shows a plurality of Asian language engines (Asian language 1 speech recognition engine,... Asian language n speech recognition engine, where n is a positive integer) 502. The first engine 504 of the engine 502 uses the word pronunciation method 402 and further uses three data files 506 to provide data. Each language engine 502 uses three data files 506 for the process of converting pronunciation to characters. The first data file 508 stores words as an index and stores related information for each word as a value including pronunciation, tone, frequency of use, and / or possible categories. The second data file 510 stores pronunciation as an index, and stores all words having the pronunciation as values in order based on the frequency of use. The third data file 512 is used to store confusion matrix information in phonemes so that the user can efficiently correct misrecognized phonemes.
As shown, the first data file 508 stores information on characters, character pronunciation, tone, frequency, and / or possible categories. For example,
Characters with different pronunciations in different words, for example "good" (this character is "good" (meaning "very good") are used in the third voice, but "good" ("like" Is used in the fourth voice), the possible pronunciations are recorded in one line with elements separated by semicolons (;).
According to recent information, there are about 47,035 valid Chinese characters, many of which are rarely used and have accumulated over a long history. About 2,000 characters are actively used by people who can read characters in China. For this reason, characters corresponding to a set of 2,000 actively used characters can be displayed first. To know whether a character in the actively used set is displayed at or near the top of the list presented to the user, the actively used character is "1". Others are marked as "2". Characters that appear in a particular category, such as a person's name, can be given a category code, such as "n" for a person's name.
The system 500 can further include a frequency component 514 for tracking the frequency of use of characters and / or words when stored in the second data file 510. The second data file 510 stores the pronunciation and the character associated with the pronunciation in the order of the frequency of appearance in different words, and further in the order of the frequency of the words or characters. The first data file 508 stores whether the word corresponds to 2,000 actively used characters. This second data file 510 orders the characters according to one or both of the overall high / low frequency and according to the usage frequency associated with other homophone characters. Frequency information can be obtained from existing training data. The order in the second data file 510 can be adjusted based on learning of the user's selection and inferences about the user's selection. The second data file 510 can be created from the first data file 508 if more specific frequency information can be specified in the first data file 508. However, the second data file 510 should be created and stored in the user profile folder so that the second file 510 can be used to store the adjusted order after learning from the user's selection. is there. The following list shows pronunciation and word frequencies. Underlined words are rarely used.
A context-free grammar (CFG) can be applied to store valid syllables. In simplified Chinese, the user can say "TIAN" to obtain "tian" of the simplified Chinese speech system, which can then be converted into a list of characters that use this pronunciation. The context free grammar includes another option that allows the user to say "TIAN" and receive "tian" before converting it to a character. This method classifies some of the vowels or the vowel and the last nasal sound by the following commands.
In Traditional Chinese, only the phoneme of the vowel is used in the grammar. Furthermore, the pronunciation used in the engine is applied in the grammar to improve the accuracy of speech recognition.
If the pronunciation is recognized incorrectly, the wizard allows the user to correct the pronunciation. After selecting the phonemes to correct, the wizard displays a list of phonemes that are close to the misrecognized phonemes, depending on the effects of articulation location, articulation style, utterance, context, and other regional dialects, for example. Thus, it is possible to order the distances between the two phonemes.
Many people in Taiwan speak both Chinese Mandarin and Southern Min. The sound structure of the Min Nan dialect has a significant influence on the Chinese standard dialect in several ways. Most people
(Sleigh tongue: retroflex components),
Cannot be distinguished from (alveolar consonants). Also,
(Labial-dental frictional sound),
Some people cannot be distinguished from (velar fricative). In some dialects of Southern China, / n / and / l / are indistinguishable, and / n / and / l / affect the generation of other learning languages. The minimum distance between sets of phonemes that can be distinguished is a shorter distance.
Context refers to whether two phonemes appear in the same context. For example,
(/ B /),
(/ Ph /) is contextual,
It is closer to (/ f /). This is because a phoneme can come before the same nuclear vowel (s) and tail consonant (s).
An exemplary confusion matrix table based on these features of consonants used in Traditional Chinese is shown as follows: The following table is obtained by calculating the distance based on the location of articulation, articulation style, utterance, context, and other regional dialect effects. This type of confusion matrix can also be generated by automatically comparing acoustic models of different sounds, which supplements the articulation position, articulation style, and utterance. Furthermore, the confusion matrix can be obtained with acoustic models of different sounds and adjusted for its final form based on the influence of context and other regional dialects. The same method can be used to generate a matrix of traditional Chinese vowels and tones, and all other Asian consonants and vowels.
8-10 are diagrams illustrating screenshots associated with a process that uses same-tone correction. FIG. 8 is a screen shot of the spelling dialog panel 800 displayed for the same sound command processing. In order to obtain the correct character, a command that is the same sound is uttered. The displayed / recognized word is provided as 608 "stuttering" (meaning "same sound"). This voicing command interface is considered more effective than typing because it avoids repeated typing of phonetic symbols. That is, sometimes the spoken command is strictly recognized, but the user may desire a different character. Rather than instructing the user to repeat the pronunciation, the command can be processed and a homophone list can be output. Using this feature, voice correction provides an improved user experience over manual input (eg, typing). That is, when the user manually inputs a pronunciation by typing and selects a word from the homophone list, the word is displayed as text with an underline of a broken line. In this form, the user can further change the characters from the list.
However, if the user is confident of the word, the user selects the input (or "OK") selector 610 to lock the word in the text so that the input system does not automatically adjust the word from the assigned language model score. Can do. Thus, once a word is locked in dialog panel 800, if the user wants to change the word again, he must retype the phonetic symbol. By recognizing the "stutter" ("sound") command, the voice command interface can save extra time for manual input. As a first step, the user selects the word to be corrected by speaking with "Fixed one character" (correcting the first character). Thereafter, the first character 802 is highlighted. The user can then speak the same sound "sound" or select the "sound" ("sound") selector 608 to obtain the H (same sound) character of the original Chinese character. The panel 800 displays dialog selectors (sound selector 608, OK selector 610, cancel selector 612) in Chinese.
Note that correction using the phonetic command or correction by pronunciation can be done for any character (in the field labeled 1, 2, 3) on panel 800. In the panel 800, 802 is the first character. However, the candidate character list is different. The candidate list from the homophone command will contain characters with the same or slightly different tone. The candidate list by pronunciation includes characters that exactly match the pronunciation by the user. When the user adopts pronunciation, the screen shot of FIG. 8 is displayed with the second character highlighted instead of the first character 802 as shown in FIG. Thereafter, after the user pronounces the sound, the screen shot of FIG. 11 is displayed.
FIG. 9 is a screen shot of a spell mode dialog panel 900 that is displayed in response to an utterance activation command for the same tone correction. The pronunciation of the original characters is assisted by the spelling wizard so that the indexed homophone character list is displayed in the list box 902. The user can then select the desired candidate by speaking the associated index number, such as "first" ("1") or "first" (first) of the first candidate, or in this case by clicking on the letter 906. Select a character. In response, the pronunciation panel 900 clears the list box 902, replaces the original character 802 with the selected character 906, and the list box 902 is cleared in response to the index selection by utterance as shown in FIG. Will be displayed as a panel 1000. The wizard then transfers the dialog to the second character 1002 (in the second field) for similar processing, as described according to character 802 (in the first field) of FIG.
While continuing the processing in FIG. 10, correction by utterance can be performed by generating pronunciation. If the wizard has not yet moved and the second character has not been highlighted, the user will speak the "corrected second character" ("correct second character") to highlight the second character 1002. By displaying, it starts by selecting or navigating to the word to be corrected.
FIG. 11 is a screen shot of a spelling dialog panel 1100 displayed for pronunciation to be uttered. Next, the user pronounces
And the pronunciation is displayed to the user in the pronunciation field 1102 and the wizard again provides an index list of words in the list box 902. The list box 902 lists candidate words in order by placing the most frequently used words at the top and the less frequently used words near the bottom. Further, if the system directs the first character 802 to be corrected with a keyword such as a surname, the system detects the keyword and adjusts the correction of the next character candidate list. In this case, the character used for the surname will be raised to the top of the candidate list 902 in correcting the remaining characters. As described above, the user then selects, for example, "2" ("2") or "2" ("No. 2") associated with the second candidate to obtain "薫". A desired character can be selected by uttering a related index number. Thereafter, the selected candidate is replaced with the old character, the pronunciation panel 1100 is cleared, and the list box 902 is removed from the dialog.
If speech recognition incorrectly recognizes the pronunciation, the wizard will display the nearest phoneme based on the confusion matrix described above. FIG. 12 is a screen shot of a spelling dialog panel 1200 that is displayed to correct a pronounced pronunciation. The user can correct by interacting with the wizard by speaking the phoneme and speaking, for example, "corrected first phoneme" ("correct first phoneme"). Next, the first phoneme 1202 is highlighted. Thereafter, a phoneme list box 1204 is displayed together with a list of phonemes in order of phoneme distance. Next, the user
(= Piin's "qi") and the first misrecognized phoneme 1202 is converted to the corrected phoneme of index "1" in the list box 1204.
FIG. 13 is a screen shot of a spelling dialog panel 1300 displayed with a homophone list box 902 that has been modified based on the pronunciation corrections made. The homophone list box 902 is corrected based on the changed phoneme. Next, the user utters a related number such as "one" ("1") or "one glance" (number 1) in this case, for example, and then the first character 1402 shown in FIG. Select. As a result, the selected candidate is replaced with the original candidate, the pronunciation field 1102 is cleared, and the list box 902 is removed from the dialog. FIG. 14 is a screen shot of the spelling dialog panel 1400 displayed when the cursor moves to the next character for the processing of the pronounced pronunciation or when the processing of FIG. 13 is completed.
As described herein, in the case of a name, a spelling wizard will be required because each user does not know exactly the characters used in the name. Therefore, a hint can be obtained from the name and provided. For example, in some cases, there are only a few hundred surname types to consider, and it is known that the set is fixed as described above. Therefore, when a surname is selected that should always be the first character of the word / string, the character candidate list displayed in the list box is adjusted. For example, for a name using "fan", the characters are "ordinary" (meaning "ordinary"), "traditional" (meaning "complex"), and "annoying" (meaning "complex"). , "藩" (meaning "barbaric"), "criminal" (meaning "prisoner"), etc.
For most characters, the user chooses a positive or neutral meaning for the name, as in the first two examples above. However, most of the training data comes from newspapers, and this is a problem with very recent language training systems, but letters are often associated with the last meaning "criminals" ("prisoners"). There is a possibility that. Therefore, by providing the category information of the data file, the word list can be adjusted according to the hint. Possible hints are: the name of the person (eg last name), the name of the street (eg "road" ("road"), "city" ("street"), "city" ("city"), "縣" (" Locality)), company name / organization name (eg, using "company" ("company"), "institution" ("organization")), but not limited to.
The above scenario is familiar or familiar to the user selecting words with multiple characters in spelling mode and accurately analyzing words (at word boundaries) based on limited character sequences. Is easier to process (or recognize) with the disclosed system. If the user only selects one character from a plurality of characters, the system may lose information on the word boundaries of the new word.
In the second method described above, Chinese characters are acquired by utterance input of a word including a desired character. FIG. 15 illustrates a system 1500 that employs positive, neutral, and negative meanings for character weights according to a second method. The recognition component 102 of FIG. 15 shows a plurality of Asian language engines 502. The first engine 504 uses the in-word character method 404 and further uses the data file 1502 to provide data. Each language engine 502 can use the data file 1502 to obtain characters based on the in-word character method 404. The first data file 1504 contains words of positive and neutral meaning, the second data file 1506 contains words of negative meaning, and the third data file 1508 is a data file (1504 and lexicon). 1506) including the remaining words.
Providing pronunciation according to the in-word character method 404 and / or for further character acquisition, the user may also acquire characters by providing other words that include the desired character (s) Can do. Similar to "a, the as in apple", the user, for example, by saying a word containing the character "Kaoru""Kaoru ceramic MatoKaoru", to specify the desired character such as "Kaoru" it can. "Tutelage" is a word that contains "Kaoru" desired character. The word "target" means possessive meaning that the desired character is part of the word.
In order to obtain speech recognition accuracy, it is desirable to have information and data about words that people tend to use to designate letters. In many cases, people tend to use the most frequently used words and more positive words to specify letters. The following is how words can be obtained for context-free grammar. A large corpus of names can be collected to create a list of characters typically used in such names. The corpus should also be a small subset of valid characters.
In addition, the recognition accuracy finds a large corpus of words containing letters, and the words are in the first group or first file 1504 (including positive or neutral meaning), second group or second file. It can be improved by classifying it (including negative meaning). People tend to use words that have a positive or neutral meaning to specify the letters to use in their names. System 1500 can include a weighting component 1510 for assigning weight data or weight values to words. In this case, positive and neutral meanings are given higher weight values, negative meanings are given intermediate weight values, and lower weight values are given to the rest of the words that do not contain letters that people often use in their names. Can be assigned. Further, the frequency component 514 of FIG. 5 can be used to order the three groups of words based on word usage frequency.
This method can be applied not only to Chinese but also to Japanese kanji, for example. This method is active when the user interface cursor is over one of the characters in the top (or split or Chinese) panel of the spelling window, such as the characters in 802, 1002, 1402, for example. It is. That is, the user can provide either a pronunciation or a word containing letters, and finally obtain the desired letter (s).
The third method described above acquires Chinese characters by word decomposition. FIG. 16 is an illustration of a system 1600 that employs word decomposition from utterance input of a desired character subcomponent in accordance with a third method. The recognition component 102 shows a plurality of Asian language engines 502. The first engine 504 uses the character decomposition method 406 and further uses the data file 1602 to provide data. Each language engine 502 can use the data file 1602 to obtain characters based on the character decomposition method 406. The first data file 1604 contains non-decomposable characters, and the second data file 1606 contains character components.
The user can obtain a desired character by providing word subcomponent (s) by speaking "Kiko; Lee" to designate "Li". Where "tree" ("tree") and "child" ("child") are subcomponent symbols that are combined to form "Li", and "tree" is the symbol at the top of the letter, "Child" is a subordinate symbol.
It should be understood that not many characters are decomposable and widely used by users. Thus, all decomposable characters and widely used decomposable expressions will be collected and included in the grammar. Similar to the second method 404, the third method 406 is used when the cursor is on one of the characters on the top panel, which is a split panel of the spelling wizard panel, such as characters in 802, 1002, 1402, for example. Active. That is, the user can obtain a desired character by providing a pronunciation or a word to be included or a subcomponent. The system 1600 includes a popularity component 1608 to find, process, and store commonly used characters 1604 and decompose them into constituent components 1606.
Briefly describing FIG. 2, the sharing component 208 allows a user to share a local lexicon to improve the accuracy of speech recognition, or reduce correction effort for other users. When a user deals with aspects of this architecture, the user can "lead" the system, or the system (eg, using the learning and reasoning functions of the reasoning component 302 of FIG. 3) and user activity and System data / parameters can be learned. As the user indicates, the probability of a recognized word can be changed to indicate which word is most frequently used. Further, if the word does not appear in the default lexicon 202 of FIG. 2, the user can add the word to a portion of the user-defined lexicon. At this point, the user can "inform" the speech recognizer 102 where additional words can be found in the lexicon (default or user defined).
The ability to share, load, and unload new lexicons among multiple users facilitates continuous improvement of the distributed corpus. That is, each user uses the same or similar words to "teacher" the individual user's computer and method. There are benefits, for example, in sharing user-defined lexicons with other users within a group or in a collaborative environment. For example, in the context of a team project, when a user updates an associated user lexicon that has new words, these new words can be shared to other members of the project team. Sharing can be performed in a number of ways, including a central location where a single file is shared among multiple users, and word order sharing for batch sharing.
In addition to sharing with another user or team, the sharing component 208 of the disclosed architecture feeds back what the speech recognizer 102 has learned to the vendor entity so that the vendor can improve the default lexicon. Includes functionality. To this end, the speech recognizer 102 includes a mechanism that allows the user to indicate whether new words added to the user-defined lexicon can be shared outside the user system, project team, and / or company boundaries. be able to. If authorized, the recognizer 102 can send the information to the vendor for subsequent public release or update, for review, and inclusion in the default lexicon. However, if the user does not allow this, the newly added term will not be sent to the vendor. An example of a term that can be sent to a vendor is a new industry term that has recently become popular in organizations, but an example of a private word can be a company name or an internal name for a project. Security issues should be considered so that sharing does not violate, for example, the provisions of intellectual property, the scope of shared content, and the decision to process sharing.
The disclosed architecture further facilitates the use and implementation of different Asian character set commands. For example, Japanese has four different writing systems: hiragana, katakana, kanji, and romaji. Hiragana is a Japanese speech system and is considered to be an effective writing system (like Spanish, people write the sound of words). Katakana is a more formal writing system that maps one-on-one to hiragana. Kanji is often used for writing names. Similar to Chinese, a set of Hiragana sounds can correspond to multiple Kanji homophones. Therefore, the same spelling panel and process can be employed to obtain kanji from hiragana.
Further, when the user wants only hiragana or the corresponding katakana instead of using the same-tone function like Chinese, the hiragana and katakana buttons are provided, the split panel method (1708 in FIG. 17 or To obtain the word in the word top panel of 1806) of FIG. 18, the function or button of the utterance command can be used. To convert hiragana to romaji, a button or selector for the user to select and / or a method of utterance command by button name can be used. Since a set of hiragana characters may correspond to more than one roman character, the user can speak the hiragana pronunciation, eg, "romaji" to trigger a roman character conversion and list the kanji of the same sound. The list box will be cleared and populated again with the result of romaji. The user can then say the index number before the desired Roman letter and move that Roman letter to the word top panel (1708 in FIG. 17 or 1806 in FIG. 18).
For example, with respect to the character "Sat" ("Sat"), the output of this character in four writing systems of Hiragana, Katakana, Kanji, and Romaji is as follows.
Hiragana: Tsuchi Katakana: Tsuchi Romaji: tsuchi, tuchi, tuti
Kanji: Sat
There are other kanji that share the same pronunciation, ie the same hiragana. For example,
Homophones with the same sound: 槌, 鎚, yang, shii
FIG. 17 is a screen shot of a spelling dialog panel 1700 displayed for Japanese recognition and processing by speaking / typing hiragana to obtain kanji. Panel 1700 includes a title bar indicating the use of hiragana. The list box 1704 displays 1802 of FIG. 18 for the kanji homophone list or the Roman word list. The character string 1706 tells the user to use hiragana as input and perform conversion processing to the desired writing system. The word panel 1708 stores the last character entered into the word processor application. Pronunciation field 1710 displays the recognized input for processing. The panel 1700 includes the following selectors. A Roman character (R) selector 1712, a hiragana (H) selector 1714, a katakana (K) selector 1716, an OK (O) selector 1718, and a cancel (E) selector 1720.
To obtain a Kanji character, the user speaks "Hiragana Input Panel", triggers the spelling panel 1700 of the wizard, then speaks "Tuchi", and this "Tuchi" is in the pronunciation field 1710. Is displayed as feedback to the user (the list box 1704 automatically generates a list of kanji homophones with a number index in front of each character). Next, the user utters "No. 1" to move the first word "Sat" in the list box 1704 to the word panel field 1708. Thereafter, the list box 1704 is not displayed. The user then says "OK", closes the spelling panel 1700, and copies "Sat" in the word panel 1708 into the document using any word processor currently in use.
To obtain hiragana, the user can say "Hiragana Input Panel" and start activating spelling panel 1700. When the user speaks "Tsuchi" so that "Tsuchi" is displayed in the pronunciation field 1710, the list box 1704 automatically generates a list of Kanji homophones as a default list, but the user does You can choose to ignore. Next, when the user utters "Hiragana", "Tachi" recognized in 1710 is automatically moved into the word panel 1708. Thereafter, list box 1704 is removed because it is no longer needed. The user closes the spelling panel 1700 of the dialog by saying "OK" and the words in the word panel 1708 will be copied into the currently open document.
To obtain katakana, the user can say "Hiragana input panel" and start activation of the spelling panel 1700. When the user speaks "Tsuchi" so that "Tsuchi" is displayed in the pronunciation panel field 1710, the list box 1704 automatically generates a list of homophones of Kanji, but the user ignores the list. You can choose to do that. Next, when the user says "Katakana", the system acquires a Katakana version like "Tuchi", and the system writes "Tuchi" directly in the word panel 1708. Thereafter, the list box 1704 can be deleted because it is no longer needed. The user can select "OK" to close the spelling panel 1700 and copy the words in the word panel 1708 to the document using an existing word processor.
FIG. 18 is a screen shot of a spelling dialog panel 1800 displayed for Japanese language recognition and processing associated with the acquisition of Roman characters. To obtain romaji, the user can speak "Hiragana Input Panel" and begin to open the spelling panel 1800. When the user utters "tsuchi" so that "tsuchi" is displayed in the pronunciation panel field 1804, the list box 1802 automatically generates a list of kanji homophones in the list box 1802. Can ignore this list. If the user utters "Romaji", the system converts "Tachi" to the Romaji version. Since there are a plurality of candidates in the Romaji version, the Kanji candidates in the list box 1802 are replaced with Romaji candidates. The user utters "No. 1" to obtain the first word in the list box 1802, and as a result, "tsuchi" can move to the word panel 1806. The list box 1802 can then be erased. If the user says "OK", the spelling panel 1800 closes and the words in the word panel 1806 are copied to the document or word processor in use.
Although a particular method of displaying information to a user will be described with respect to a particular drawing as a screen shot, those skilled in the art will appreciate that various other alternatives may be used. The terms "screen", "screenshot", "web page", "document", "page" are generally used interchangeably within this specification. The page or screen may be stored and / or displayed as a display description, as a graphical user interface, or by other means of representing information on the screen (eg, a personal computer, PDA, cell phone, or other suitable device). Or store the layout and information or content displayed on the page in memory, a database, or another storage location.
FIG. 19 is a diagram illustrating a method for recognizing speech according to the disclosed architecture. For the sake of brevity, one or more of the methods shown herein are described as a series of operations, for example in the form of flowcharts or flow diagrams, but given the description and description herein, It should be understood and appreciated that methods are not limited by the order of operations, as such operations may occur in different orders and / or concurrently with other operations according to the method. For example, those skilled in the art will understand and appreciate that a method could alternatively be represented as a series of correlation states or correlation events, eg, in a state diagram. Moreover, not all operations illustrated in the methods are necessary for a new implementation.
At 1900, the speech recognition engine receives speech input in the form of Asian speech. At 1902, the Asian speech signal is recognized and output a result. At 1904, the spell / correct mode is entered to spell a new word or correct the result. At 1906, the resulting spelling is corrected in a single pass based on phonetic pronunciation and / or character selection. Next, at 1908, the correction result is output to a document or application.
FIG. 20 is a diagram illustrating a method of correcting the recognition result using the spelling wizard. At 2000, the recognition engine receives an Asian speech input. In 2002, an Asian speech signal is recognized and entered into a correction mode to correct the spelling of the result. In 2004, the spelling wizard is activated as part of the correction mode. In 2006, Asian characters are entered into the wizard by phonetic pronunciation. In 2008, the spelling is corrected based on the phonetic pronunciation through the wizard.
FIG. 21 is a diagram illustrating a method of converting phonetic pronunciation into characters. At 2100, preparation of the data file begins for conversion processing. At 2102, a data file of the indexed word and word value is created. This value includes pronunciation, tone, usage frequency and category. In 2104, the indexed pronunciation and a word data file having pronunciation as a value are created in order of use frequency. In 2106, a data file of a confusion matrix of phoneme distances is created. At 2108, the data file is accessed for pronunciation processing using the spelling wizard.
FIG. 22 is a diagram showing a method of using Asian and English division commands for correction processing. At 2200, Asian and English split commands are displayed. At 2202, a check is made to see if the English spelling mode should be entered. If yes, enter 2204 in English spelling mode. At 2206, a list of candidate characters is displayed based on the utterance signal using methods available in spelling mode. At 2208, a new word is spelled or a misrecognized word is corrected based on the selected candidate. If the English spelling mode is not entered at 2202, the process proceeds to 2210, where the Asian spelling mode is entered, and then proceeds to 2206 to continue the process as described above.
FIG. 23 is a diagram illustrating a method of using the same-sound command of the Asian spelling wizard. At 2300, Asian and English split commands are displayed. At 2302, an Asian spelling correction mode is entered. At 2304, the same sound command is received. In 2306, a list of candidate characters is displayed based on the homophones of the target character. At 2308, the misrecognized word is corrected based on the selected candidate.
FIG. 24 is a diagram illustrating a method of assigning weight values to word meanings. At 2400, preparation for correction with a word containing the desired character is initiated. At 2402, a large name corpus is collected. At 2404, a word that includes the letter in its name is found. At 2406, the words are classified into positive and neutral meaning files. At 2408, the words are classified into negative meaning files. At 2410, high weights are assigned to words in groups of positive and neutral meaning. At 2412, intermediate weights are assigned to words in the negative meaning group. At 2414, a low weight is given to words that do not belong to the two groups described above. At 2416, the words are ordered based on usage frequency.
FIG. 25 is a diagram illustrating a method for sharing updated lexicons. At 2500, the correction mode is entered. At 2502, new words employed during the correction mode are tracked and logged. At 2504, the new word is placed in the local lexicon. Next, at 2506, the updated lexicon is sent to other users. At 2508, the user can optionally send an updated lexicon to the vendor to update the distributed lexicon corpus.
FIG. 26 is a diagram illustrating a method of using character decomposition for spelling correction. At 2600, spelling correction is started. At 2602, the user utters a symbol of the desired character subcomponent. At 2604, the method loops through a correspondence table of relationships between subcomponents and each character. At 2606, if there is more than one match, display all possible characters of the subcomponent. Next, at 2608, a candidate character is selected based on the subcomponent.
FIG. 27A and FIG. 27B are diagrams illustrating a correction processing method based on a plurality of spelling correction methods. At 2700, the engine receives an Asian speech input. At 2702, the recognized engine result is displayed on the user interface. At 2704, the system receives an utterance command and enters spelling / correction mode (directly enters a new word). Thereafter, processing proceeds to 2706, where the same and / or other characters are processed with respect to the context of the word. Alternatively, processing proceeds from 2702 to 2708, where the system receives an utterance command to select and correct a word. At 2710, the system receives a voice command, enters spelling mode, selects and corrects characters. As described above, processing then proceeds to 2706 where the same character and / or other characters are processed with respect to the word context.
Moving to FIG. 27B, at 2712 a potential word list is accessed based on the calculated context. For example, the context can be a personal name. At 2714, the words in the word list are ranked based on the same character and / or other characters. At 2716, a character selection method is selected. At 2718, the process proceeds to 2720, where a method of uttering words containing similar usage characters is selected. Alternatively, in 2722, a method of acquiring a character by sounding a desired character is selected. Alternatively, at 2724, a method of uttering a word is selected to obtain characters by subcomponents. Alternatively, at 2726, a method of uttering the word (s) is selected for obtaining the homophone list and selecting from the homophone list. At 2728, a new word is added or an incorrect character in a misspelled word is replaced with the selected character. At 2730, an utterance confirmation is received from the user that the entire word is accurate. At 2732, the engine results are corrected using the correct characters.
As used in this application, the terms "component" and "system" refer to either computer-related entities, hardware, a combination of hardware and software, software, or running software. For example, a component may be a process executing on a processor, a processor, a hard disk drive, a plurality of storage devices (optical and / or magnetic storage media), objects, executable files, execution threads, programs, and / or computers. However, it is not limited to these. By way of illustration, both an application running on a server and the server can be a component. One or more components can reside within a process and / or thread of execution, and a component can be localized on one computer and / or distributed across two or more computers.
FIG. 28 is a block diagram of a computing system 2800 operable to perform correction processing in accordance with the disclosed architecture. In order to provide additional context for this various aspects, FIG. 28 and the following description briefly and schematically describe a suitable computing system 2800 in which the various aspects may be implemented. Although the above description has been written in the general context of computer-executable instructions that can be executed on one or more computers, those skilled in the art may combine with other program modules and / or combinations of hardware and software. As will be appreciated, novel embodiments may be implemented.
Generally, program modules include routines, programs, components, data structures, etc. that perform particular tasks and implement particular abstract data types. Further, those skilled in the art will appreciate that the method of the present invention can be implemented in other computer system configurations. For example, a single processor or multiprocessor computer system, a minicomputer, a mainframe computer, a personal computer, a handheld computing device, a microprocessor-based or programmable appliance, each of which has one or more associated Can be operably coupled to the device.
The illustrated aspects may also be practiced in distributed computing environments where certain tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules can be located in both local and remote storage devices.
A computer typically includes a variety of computer-readable media. Computer readable media can be any available media that can be accessed by a computer. The computer readable media include volatile and non-volatile media, removable and non-removable media. By way of example, computer readable media can comprise, but is not limited to, computer storage media and communication media. Computer storage media is volatile and non-volatile media, removable and non-removable implemented in any method or technique for storing information such as computer readable instructions, data structures, program modules, or other data Media. Computer storage media include RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, DVD (digital video disk) or other optical disk storage device, magnetic cassette, magnetic tape, magnetic disk storage device Or other, but not limited to, any other magnetic storage device or any other medium that can be used to store the desired information and is accessible by the computer.
Referring again to FIG. 28, an exemplary computing system 2800 for implementing various aspects includes a computer 2802, which includes a processing unit 2804, a system memory 2806, and a system bus 2808. System bus 2808 provides an interface for system components including, but not limited to, system memory 2806 to processing unit 2804. The processing unit 2804 can be any of a variety of commercially available processors. Dual microprocessor and other multiprocessor architectures may also be used as the processing unit 2804.
The system bus 2808 can also be any of several types of buses that can be interconnected to a memory bus (with or without a memory controller), a peripheral bus, and a local bus using any of a variety of commercially available bus architectures. It can be a structure. The system memory 2806 includes a ROM (read-only memory) 2810 and a RAM (random access memory) 2812. A BIOS (basic input / output system: basic input / output system) is stored in a nonvolatile memory 2810 such as a ROM, EPROM, or EEPROM. The BIOS includes basic routines that help to transfer information between elements within the computer 2802, such as at startup. The RAM 2812 can also include a high-speed RAM such as a static RAM for caching data.
The computer 2802 further includes a built-in hard disk drive (HDD) 2814 (eg, EIDE, SATA), and the built-in hard disk drive 2814 can be removed by placing it in an appropriate case (not shown). Or FDD (magnetic floppy disk drive) 2816 (eg, for reading or writing to removable disc 2818) and optical disc drive 2820 (eg, CD-ROM disk 2822 or for reading or writing to other high capacity optical media such as a DVD). The hard disk drive 2814, magnetic disk drive 2816, and optical disk drive 2820 are connected to the system bus 2808 by a hard disk drive interface 2824, a magnetic disk drive interface 2826, and an optical disk drive interface 2828, respectively. can do. Interface 2824 for external drive implementation includes Universal Serial Bus (USB) and / or IEEE 1394 interface technology.
The drive and associated computer readable media store non-volatile storage of data, data structures, computer-executable instructions, and the like. In the computer 2802, the drive and the medium store arbitrary data in an appropriate digital format. Although the above description of computer readable media refers to removable optical media such as HDDs, removable magnetic disks, CDs or DVDs, those skilled in the art will understand that zip drives, magnetic cassettes, flash memory cards, Other types of computer readable media, such as cartridges, may also be used in the exemplary operating environment, and any such media may include computer executable instructions for performing the novel methods of the disclosed architecture. Please understand that you can.
A number of program modules can be stored in the drive and RAM 2812. For example, an operating system 2830, one or more application programs 2832, other program modules 2834, and program data 2836. All or part of the operating system, applications, modules, and / or data can be cached in RAM 2812. It should be understood that the disclosed architecture can be implemented with various commercially available operating systems or combinations of operating systems.
A user may enter commands and information into the computer 2802 using one or more wired / wireless input devices, eg, a pointing device such as a keyboard 2838, mouse 2840, and the like. Input / output devices may include a microphone / speaker 2837 and other devices (not shown) such as, for example, an IR remote control, joystick, game pad, stylus pen, touch screen, and the like. These and other input devices are often connected to the processing unit 2804 using an input device interface 2842 coupled to the system bus 2808, for example, a parallel port, an IEEE 1394 serial port, a game port, In some cases, the connection is made through another interface such as a USB port or IR interface.
A monitor 2844 or other type of display device is also connected to the system bus 2808 using an interface, such as a video adapter 2846. In addition to the monitor 2844, the computer typically includes other peripheral output devices (not shown) such as speakers and printers.
Computer 2802 can operate in a networked environment using logical connections via wired and / or wireless communications to one or more remote computers, such as remote computer (s) 2848. The remote computer (s) 2848 can be a workstation, server computer, router, personal computer, portable computer, microprocessor-based entertainment device, peer device or other common network node. The remote computer (s) 2848 typically includes many or all of the elements described with respect to the computer 2802, but for simplicity, only the memory / storage device 2850 is illustrated. The illustrated logical connections include a wired / wireless connection to a local area network (LAN) 2852 and / or a larger network, eg, a wide area network (WAN) 2854. Such LAN and WAN network environments are common in offices and companies and facilitate enterprise-wide computer networks such as intranets. All of these network environments may be connected to a global communication network such as the Internet.
When used in a LAN networking environment, the computer 2802 is connected to the local network 2852 using a wired and / or wireless communication network interface or adapter 2856. The adapter 2856 can facilitate wired or wireless communication to the LAN 2582, and the LAN can further include a wireless access point disposed on the LAN to communicate with the wireless adapter 2856.
When used in a WAN network environment, the computer 2802 can include a modem 2858 or can be connected to a communication server on the WAN 2854 or have other means for establishing communication over the WAN 2854, eg, over the Internet. . The modem 2858 can be internal or external and can be a wired and / or wireless device, but is connected to the system bus 2808 using a serial port interface 2842. In a networked environment, the program modules described with respect to computer 2802, or portions thereof, may be stored in remote memory / storage device 2850. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers can be used.
The computer 2802 is associated with any wireless device or entity operably disposed in wireless communication, such as a printer, scanner, desktop computer and / or portable computer, portable data terminal, communications satellite, wirelessly detectable tag It is operable to communicate with any installed facility or location (eg, kiosk, newspaper shop, restroom) and telephone. This includes at least Wi-Fi and Bluetooth® wireless technologies. Thus, the communication can be a predetermined structure as in a conventional network, or simply an ad hoc communication between at least two devices.
FIG. 29 is a schematic block diagram of an exemplary computing environment 2900 for correction processing in accordance with the disclosed architecture. System 2900 includes one or more clients 2902. Client 2902 can be hardware and / or software (eg, threads, processes, computing devices). Client 2902 can store, for example, cookie (s) and / or associated contextual information.
System 2900 further includes one or more servers 2904. Server 2904 may be hardware and / or software (eg, threads, processes, computing devices). Server 2904 performs the conversion, for example, by storing threads and using their architecture. One possible communication between client 2902 and server 2904 may be in the form of a data packet adapted to be transmitted between multiple computer processes. The data packet may include, for example, a cookie and / or related context information. System 2900 includes a communication framework 2906 (eg, a global communication network such as the Internet) that can be used to facilitate communication between client 2902 and server 2904.
Communication can be facilitated using wired technology (such as optical fiber) and / or wireless technology. Client 2902 is operatively connected to one or more client data stores 2908 that can be used to store information local to client 2902 (eg, cookies and / or associated contextual information). Similarly, server 2904 is operatively connected to one or more server data store (s) 2910 that can be used to store information local to server 2904.
What has been described above includes examples of the disclosed architecture. Of course, it is not possible to describe all possible component and / or method combinations, but those skilled in the art will appreciate that many additional combinations and substitutions are possible. Accordingly, the novel architecture includes all such alternatives, modifications and variations that fall within the spirit and scope of the present invention. Further, to the extent that the term "comprising" is used in this specification or in the claims, this term is interpreted as the term "comprising" is used as a transitional phrase in the claims, It shall have a comprehensive meaning as well as "provide".
A speech recognition component (102) for outputting Asian characters based on speech input;
A computer-implemented translation system (100), comprising: a correction component (104) for generating a corrected output based on an inaccurate output by the speech recognition component.
The system of claim 1, wherein the correction component includes a spelling wizard that facilitates user interaction by vocalization and manually to select and correct inaccurate output.
The system of claim 1, wherein the correction component receives information about word pronunciation using partial phonetic symbols.
The system of claim 1, wherein the correction component receives information about how to write a word by providing a word in which characters are used.
The system of claim 1, wherein the correction component receives information regarding how characters are structured.
The system of claim 1, further comprising an inference component that employs probabilistic and / or statistical based analysis to predict or infer actions that are desirably performed automatically.
The system of claim 1, further comprising a sharing component for sharing the updated lexicon with other users and lexicon vendors.
The system of claim 1, further comprising a weighting component for weighting words based on meaning.
The system of claim 1, further comprising a frequency component for storing usage frequency information, wherein the correction component provides a list of candidate characters ranked using the usage frequency information.
The system of claim 1, wherein the Asian characters are in Chinese or Japanese writing format including hieroglyphs with associated fixed pronunciations.
Recognizing an Asian speech signal and outputting a result (1902);
Entering a spelling / correction mode and correcting the spelling of the result (1904);
And (1906) correcting the spelling of the result in a single pass based on at least one of phonetic pronunciation or character selection.
The method of claim 11, further comprising automatically entering a spelling / correction mode in response to receiving the Asian speech signal, wherein the correction mode includes a spelling wizard for receiving phonetic pronunciation. Method.
The method of claim 11, further comprising applying a confusion matrix that stores phoneme distances used for spelling correction.
The method of claim 11, further comprising correcting the spelling using a phonetic homophone command.
12. The method of claim 11, further comprising correcting spelling based on word decomposition into symbol subcomponents.
The method of claim 11, further comprising: building a new lexicon while correcting spelling; and sending the new lexicon to another user.
The method of claim 11, further comprising switching between a plurality of writing systems based on a language of the Asian speech signal.
The method of claim 11, further comprising selecting a character based on utterance input of one or more words that include the character.
The method of claim 11, further comprising: generating a priority list of candidate characters; and displaying the candidate characters as an index list for selecting characters manually or by an utterance command.
Computer-implemented means (102) for recognizing an Asian speech signal to output a result;
Computer implemented means (302) for entering a spelling / correction mode to correct the spelling of the result;
Computer-implemented means (502) for performing a keyword search;
Computer-implemented system comprising: computer-implemented means (104) for correcting the spelling of the result in a single pass based on utterance commands and manual character selection.
JP2010506381A 2007-04-26 2008-04-08 Recognition Architecture for generating Asian characters Active JP5622566B2 (en)
US11/789,878 US8457946B2 (en) 2007-04-26 2007-04-26 Recognition architecture for generating Asian characters
PCT/US2008/059688 WO2008134208A1 (en) 2007-04-26 2008-04-08 Recognition architecture for generating asian characters
JP5622566B2 JP5622566B2 (en) 2014-11-12
JP2010506381A Active JP5622566B2 (en) 2007-04-26 2008-04-08 Recognition Architecture for generating Asian characters
BR (1) BRPI0810626A2 (en)
WO2012042578A1 (en) * 2010-10-01 2012-04-05 三菱電機株式会社 Speech recognition device
JP2016091028A (en) * 2014-10-31 2016-05-23 株式会社東芝 Voice recognition result optimizer, voice recognition result optimization method and program
Families Citing this family (131)
US8645137B2 (en) 2000-03-16 2014-02-04 Apple Inc. Fast, language-independent method for user authentication by voice
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US8365071B2 (en) * 2007-08-31 2013-01-29 Research In Motion Limited Handheld electronic device and associated method enabling phonetic text input in a text disambiguation environment and outputting an improved lookup window
CN101408873A (en) * 2007-10-09 2009-04-15 劳英杰 Full scope semantic information integrative cognition system and application thereof
US20090157385A1 (en) * 2007-12-14 2009-06-18 Nokia Corporation Inverse Text Normalization
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
US9959870B2 (en) 2008-12-11 2018-05-01 Apple Inc. Speech recognition involving a mobile device
EP2211336B1 (en) * 2009-01-23 2014-10-08 Harman Becker Automotive Systems GmbH Improved speech input using navigation information
CN102439544A (en) * 2009-03-20 2012-05-02 谷歌股份有限公司 Interaction with ime computing device
WO2010131256A1 (en) * 2009-05-13 2010-11-18 Rajesh Mehra A keyboard for linguistic scripts
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US9104244B2 (en) * 2009-06-05 2015-08-11 Yahoo! Inc. All-in-one Chinese character input method
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US9431006B2 (en) 2009-07-02 2016-08-30 Apple Inc. Methods and apparatuses for automatic speech recognition
US20110171617A1 (en) * 2010-01-11 2011-07-14 Ideographix, Inc. System and method for teaching pictographic languages
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US10496753B2 (en) 2010-01-18 2019-12-03 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
CN101847407B (en) * 2010-03-12 2013-01-02 中山大学 Speech recognition parameter processing method based on XML
GB2480649B (en) * 2010-05-26 2017-07-26 Sun Lin Non-native language spelling correction
US9262397B2 (en) * 2010-10-08 2016-02-16 Microsoft Technology Licensing, Llc General purpose correction of grammatical and word usage errors
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US20120303368A1 (en) * 2011-05-27 2012-11-29 Ting Ma Number-assistant voice input system, number-assistant voice input method for voice input system and number-assistant voice correcting method for voice input system
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US8855997B2 (en) 2011-07-28 2014-10-07 Microsoft Corporation Linguistic error detection
CN102324233B (en) * 2011-08-03 2014-05-07 中国科学院计算技术研究所 Method for automatically correcting identification error of repeated words in Chinese pronunciation identification
US8706472B2 (en) * 2011-08-11 2014-04-22 Apple Inc. Method for disambiguating multiple readings in language conversion
US8994660B2 (en) 2011-08-29 2015-03-31 Apple Inc. Text correction processing
JP5642037B2 (en) * 2011-09-22 2014-12-17 株式会社東芝 Search device, search method, and program
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US9483461B2 (en) 2012-03-06 2016-11-01 Apple Inc. Handling speech synthesis of content for multiple languages
CN103324621B (en) * 2012-03-21 2017-08-25 北京百度网讯科技有限公司 A kind of Thai text spelling correcting method and device
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
US9495129B2 (en) 2012-06-29 2016-11-15 Apple Inc. Device, method, and user interface for voice-activated navigation and browsing of a document
US9576574B2 (en) 2012-09-10 2017-02-21 Apple Inc. Context-sensitive handling of interruptions by intelligent digital assistant
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
KR20140058945A (en) * 2012-11-07 2014-05-15 삼성전자주식회사 Display apparatus and method for correcting character thereof
CN103076893B (en) * 2012-12-31 2016-08-17 百度在线网络技术(北京)有限公司 A kind of method and apparatus for realizing phonetic entry
US9858038B2 (en) * 2013-02-01 2018-01-02 Nuance Communications, Inc. Correction menu enrichment with alternate choices and generation of choice lists in multi-pass recognition systems
EP2954514A2 (en) 2013-02-07 2015-12-16 Apple Inc. Voice trigger for a digital assistant
US9368114B2 (en) 2013-03-14 2016-06-14 Apple Inc. Context-sensitive handling of interruptions
WO2014144949A2 (en) 2013-03-15 2014-09-18 Apple Inc. Training an at least partial voice command system
WO2014144579A1 (en) 2013-03-15 2014-09-18 Apple Inc. System and method for updating an adaptive speech recognition model
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
WO2014197336A1 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
CN105264524B (en) 2013-06-09 2019-08-02 苹果公司 For realizing the equipment, method and graphic user interface of the session continuity of two or more examples across digital assistants
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
CN105265005B (en) 2013-06-13 2019-09-17 苹果公司 System and method for the urgent call initiated by voice command
US9423890B2 (en) * 2013-06-28 2016-08-23 Lenovo (Singapore) Pte. Ltd. Stylus lexicon sharing
WO2015057907A2 (en) * 2013-10-16 2015-04-23 Interactive Intelligence Group, Inc. System and method for learning alternate pronunciations for speech recognition
US9626354B2 (en) 2014-01-21 2017-04-18 Lenovo (Singapore) Pte. Ltd. Systems and methods for using tone indicator in text recognition
US9620105B2 (en) 2014-05-15 2017-04-11 Apple Inc. Analyzing audio input for efficient speech and music recognition
US9502031B2 (en) 2014-05-27 2016-11-22 Apple Inc. Method for supporting dynamic grammars in WFST-based ASR
US10289433B2 (en) 2014-05-30 2019-05-14 Apple Inc. Domain specific language for encoding assistant dialog
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US10078631B2 (en) 2014-05-30 2018-09-18 Apple Inc. Entropy-guided text prediction using combined word and character n-gram language models
AU2015266863B2 (en) 2014-05-30 2018-03-15 Apple Inc. Multi-command single utterance input method
US9785630B2 (en) 2014-05-30 2017-10-10 Apple Inc. Text prediction using combined word N-gram and unigram language models
US9760559B2 (en) 2014-05-30 2017-09-12 Apple Inc. Predictive text input
US9734193B2 (en) 2014-05-30 2017-08-15 Apple Inc. Determining domain salience ranking from ambiguous words in natural speech
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US9946704B2 (en) * 2014-07-18 2018-04-17 Lenovo (Singapore) Pte. Ltd. Tone mark based text suggestions for chinese or japanese characters or words
US10446141B2 (en) 2014-08-28 2019-10-15 Apple Inc. Automatic speech recognition based on user feedback
US9953646B2 (en) 2014-09-02 2018-04-24 Belleau Technologies Method and system for dynamic speech recognition and tracking of prewritten script
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US9711141B2 (en) 2014-12-09 2017-07-18 Apple Inc. Disambiguating heteronyms in speech synthesis
RU2598300C2 (en) * 2015-01-27 2016-09-20 Общество с ограниченной ответственностью "Аби Девелопмент" Methods and systems for automatic recognition of characters using forest solutions
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
WO2016165120A1 (en) * 2015-04-17 2016-10-20 Microsoft Technology Licensing, Llc Deep neural support vector machines
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
SG11201704826YA (en) * 2015-07-01 2017-07-28 Vasan Sun Methods for multi-language data entry using a processor, and systems and devices for multi-language data entry
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US9971758B1 (en) 2016-01-06 2018-05-15 Google Llc Allowing spelling of arbitrary words
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK179309B1 (en) 2016-06-09 2018-04-23 Apple Inc Intelligent automated assistant in a home environment
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
DK179049B1 (en) 2016-06-11 2017-09-18 Apple Inc Data driven natural language event detection and classification
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
DK179329B1 (en) 2016-06-12 2018-05-07 Apple Inc Handwriting keyboard for monitors
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
US10332518B2 (en) 2017-05-09 2019-06-25 Apple Inc. User interface for correcting recognition errors
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
US10410637B2 (en) 2017-05-12 2019-09-10 Apple Inc. User-specific acoustic models
US10482874B2 (en) 2017-05-15 2019-11-19 Apple Inc. Hierarchical belief states for digital assistants
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US10303715B2 (en) 2017-05-16 2019-05-28 Apple Inc. Intelligent automated assistant for media exploration
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
US20180358004A1 (en) * 2017-06-07 2018-12-13 Lenovo (Singapore) Pte. Ltd. Apparatus, method, and program product for spelling words
US10445429B2 (en) 2017-09-21 2019-10-15 Apple Inc. Natural language understanding using vocabularies with compressed serialized tries
US10403283B1 (en) 2018-06-01 2019-09-03 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US10496705B1 (en) 2018-06-03 2019-12-03 Apple Inc. Accelerated task performance
JPH08212213A (en) * 1995-01-31 1996-08-20 Toshiba Corp Character conversion method
JPH09128383A (en) * 1995-08-16 1997-05-16 Internatl Business Mach Corp <Ibm> System and method for processing chinese text
JPH11306176A (en) * 1998-04-22 1999-11-05 Sharp Corp Character processing device and method and medium storing control program of the device and method
JP2001229162A (en) * 2000-02-15 2001-08-24 Matsushita Electric Ind Co Ltd Method and device for automatically proofreading chinese document
JP2002189490A (en) * 2000-12-01 2002-07-05 Leadtek Research Inc Method of pinyin speech input
JP2007011358A (en) * 2005-06-28 2007-01-18 Avaya Technology Corp Speech recognition assisted autocompletion of composite character
JP2008090625A (en) * 2006-10-02 2008-04-17 Sharp Corp Character input device, character input method, control program, and recording medium
US5220639A (en) 1989-12-01 1993-06-15 National Science Council Mandarin speech input method for Chinese computers and a mandarin speech recognition machine
US5787230A (en) 1994-12-09 1998-07-28 Lee; Lin-Shan System and method of intelligent Mandarin speech input for Chinese computers
US6903723B1 (en) * 1995-03-27 2005-06-07 Donald K. Forest Data entry method and apparatus
US5903861A (en) 1995-12-12 1999-05-11 Chan; Kun C. Method for specifically converting non-phonetic characters representing vocabulary in languages into surrogate words for inputting into a computer
JP2820093B2 (en) * 1995-12-26 1998-11-05 日本電気株式会社 Monosyllabic recognition device
US6067520A (en) 1995-12-29 2000-05-23 Lee And Li System and method of recognizing continuous mandarin speech utilizing chinese hidden markou models
US6018708A (en) 1997-08-26 2000-01-25 Nortel Networks Corporation Method and apparatus for performing speech recognition utilizing a supplementary lexicon of frequently used orthographies
CN1120436C (en) 1997-09-19 2003-09-03 国际商业机器公司 Speech recognition method and system for identifying isolated non-relative Chinese character
KR19990043026A (en) 1997-11-28 1999-06-15 유기범 Voice recognition input device Hangul
US6694055B2 (en) 1998-07-15 2004-02-17 Microsoft Corporation Proper name identification in chinese
PL349929A1 (en) * 1999-02-19 2002-10-21 Custom Speech Usa Automated transcription system and method using two speech converting instances and computer-assisted correction
CN1207664C (en) 1999-07-27 2005-06-22 国际商业机器公司 Error correcting method for voice identification result and voice identification system
US7403888B1 (en) * 1999-11-05 2008-07-22 Microsoft Corporation Language input user interface
AU5944601A (en) * 2000-05-02 2001-11-12 Dragon Systems Inc Error correction in speech recognition
US7200555B1 (en) * 2000-07-05 2007-04-03 International Business Machines Corporation Speech recognition correction for devices having limited or no display
US7085716B1 (en) 2000-10-26 2006-08-01 Nuance Communications, Inc. Speech recognition using word-in-phrase command
FI20010644A (en) * 2001-03-28 2002-09-29 Nokia Corp Specify the language of the character sequence
JP2002323969A (en) * 2001-04-24 2002-11-08 Omron Corp Communication supporting method, system and device using the method
AU2002336458A1 (en) * 2002-09-06 2004-03-29 Jordan R. Cohen Methods, systems, and programming for performing speech recognition
US7467087B1 (en) * 2002-10-10 2008-12-16 Gillick Laurence S Training and using pronunciation guessers in speech recognition
US7003457B2 (en) * 2002-10-29 2006-02-21 Nokia Corporation Method and system for text editing in hand-held electronic device
US7359850B2 (en) 2003-09-26 2008-04-15 Chai David T Spelling and encoding method for ideographic symbols
US8019602B2 (en) * 2004-01-20 2011-09-13 Microsoft Corporation Automatic speech recognition learning using user corrections
JP2005227510A (en) * 2004-02-12 2005-08-25 Ntt Docomo Inc Voice recognition device and voice recognition method
TWI247276B (en) 2004-03-23 2006-01-11 Delta Electronics Inc Method and system for inputting Chinese character
JP2006031092A (en) * 2004-07-12 2006-02-02 Sony Corp Voice character input program and portable terminal
TWI258731B (en) 2004-11-04 2006-07-21 Univ Nat Cheng Kung Chinese speech synthesis unit selection module and method
TWI244638B (en) 2005-01-28 2005-12-01 Delta Electronics Inc Method and apparatus for constructing Chinese new words by the input voice
RU2296376C2 (en) * 2005-03-30 2007-03-27 Открытое акционерное общество "Корпорация "Фазотрон - научно-исследовательский институт радиостроения" Method for recognizing spoken words
US20060271882A1 (en) 2005-05-26 2006-11-30 Inventec Appliances Corp. Method for implementing a fuzzy spelling while inputting Chinese characters into a mobile phone
US7643985B2 (en) 2005-06-27 2010-01-05 Microsoft Corporation Context-sensitive communication and translation methods for enhanced interactions and understanding among speakers of different languages
US7620549B2 (en) * 2005-08-10 2009-11-17 Voicebox Technologies, Inc. System and method of supporting adaptive misrecognition in conversational speech
JP4751192B2 (en) * 2005-12-12 2011-08-17 本田技研工業株式会社 Mobile robot
2008-04-08 EP EP08745321.3A patent/EP2153352A4/en active Pending
2008-04-08 RU RU2009139274/08A patent/RU2477518C2/en active
2008-04-08 CN CN200880013543.XA patent/CN101669116B/en active IP Right Grant
2008-04-08 BR BRPI0810626-6A2A patent/BRPI0810626A2/en not_active IP Right Cessation
US9239829B2 (en) 2010-10-01 2016-01-19 Mitsubishi Electric Corporation Speech recognition device
US9672817B2 (en) 2014-10-31 2017-06-06 Kabushiki Kaisha Toshiba Method and apparatus for optimizing a speech recognition result
RU2009139274A (en) 2011-04-27
BRPI0810626A2 (en) 2014-11-04
EP0645757B1 (en) 2000-04-05 Semantic co-occurrence filtering for speech recognition and signal transcription applications
US7627466B2 (en) 2009-12-01 Natural language interface for driving adaptive scenarios
JP4559946B2 (en) 2010-10-13 Input device, input method, and input program
EP0867857B1 (en) 2005-03-09 Enrolment in speech recognition
EP0376501B1 (en) 1997-06-04 Speech recognition system
JP4510953B2 (en) 2010-07-28 Non-interactive enrollment in speech recognition
US7937262B2 (en) 2011-05-03 Method, apparatus, and computer program product for machine translation
JP4267081B2 (en) 2009-05-27 Pattern recognition registration in distributed systems
US7139698B1 (en) 2006-11-21 System and method for generating morphemes
JP4064413B2 (en) 2008-03-19 Communication support device, communication support method, and communication support program
JP4416643B2 (en) 2010-02-17 Multimodal input method
EP0965979B1 (en) 2004-01-14 Position manipulation in speech recognition
US6347300B1 (en) 2002-02-12 Speech correction apparatus and method
US9640175B2 (en) 2017-05-02 Pronunciation learning from user correction
Schuster et al. 2012 Japanese and korean voice search
US8768699B2 (en) 2014-07-01 Techniques for aiding speech-to-speech translation
US7974844B2 (en) 2011-07-05 Apparatus, method and computer program product for recognizing speech
US6581033B1 (en) 2003-06-17 System and method for correction of speech recognition mode errors
US7584102B2 (en) 2009-09-01 Language model for use in speech recognition
US7912700B2 (en) 2011-03-22 Context based word prediction
TWI543150B (en) 2016-07-21 Method, computer-readable storage device, and system for providing voice stream augmented note taking
US6910012B2 (en) 2005-06-21 Method and system for speech recognition using phonetically similar word alternatives
JP4705023B2 (en) 2011-06-22 Speech recognition apparatus, speech recognition method, and program
JP2004046807A (en) 2004-02-12 Multi-modal input of ideographic language
CN1205572C (en) 2005-06-08 Language input architecture for converting one text form on another text form with minimized typographical errors and conversion errors
2013-07-02 RD03 Notification of appointment of power of attorney
Free format text: JAPANESE INTERMEDIATE CODE: A7423
2013-07-18 RD04 Notification of resignation of power of attorney
2013-08-21 A02 Decision of refusal
2013-12-26 A911 Transfer of reconsideration by examiner before appeal (zenchi)
2014-02-10 A912 Removal of reconsideration by examiner before appeal (zenchi)