Systems and methods are described for facilitating non-verbal communication. An electronic processor receives data from the hand-gesture sensor indicative of one or more gestures performed by a user, determines at least one word or phrase corresponding to the data from the hand-gestures sensor, and outputs a text representation of the at least one word or phrase on the display screen. Some systems output the text representation as a natural language sentence based on the data from the hand-gesture sensor and linguistic prosody information determined based, at least in part, on image data of the user captured while performing the one or more gesture. Some systems also includes at least one brain sensor and generate an alternative natural language text sentence in response to detecting a signal from the brain sensor indicative of a contradiction response after displaying the natural language text sentence on the display screen.
Gesture recognition and communication