Answers.Body: <p>As per this <a href="http://www.dailymail.co.uk/sciencetech/article-2095214/As-scientists-discover-translate-brainwaves-words--Could-machine-read-innermost-thoughts.html" rel="nofollow">site</a></p>
  
  <blockquote>
    <p>Researchers recorded the complex patterns of electrical activity generated by someone’s brain, as the subject listened to someone talking.
    By feeding those brainwave patterns into a computer, they were able to translate them back into actual words — the same words that the volunteer had been hearing.</p>
    
    <p><strong>The scientists behind the work believe they can now go further and read the unspoken thoughts of people using electrodes placed against the brain.</strong></p>
    
    <p>In the experiment, each patient listened to a recording of spoken words for five to ten minutes, while the net of electrodes placed under their skull monitored activity in a part of the brain involved in understanding speech called <a href="https://en.wikipedia.org/wiki/Wernicke%27s_area" rel="nofollow">Wernicke’s area</a>.</p>
    
    <p>In one experiment, volunteers looked at black-and-white photographs while the scanner monitored activity in part of the brain that handles vision called the primary visual cortex.
    A computer predicted accurately the image that the person was looking at purely from the pattern of brain activity.</p>
  </blockquote>
  
  <p>So AI might be able to read our emotions as well in near future.</p>
  
  <p>I found that <a href="http://electronics.howstuffworks.com/gadgets/high-tech-gadgets/google-glass-detect-emotions.htm" rel="nofollow">google glasses can detect people's emotion</a> via facial expression, voice tone e.t.c, (just like us), obviously not what they are thinking in their brain.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-04T18:16:59.370Z
Answers.Text: Hm, the article doesn't mention any AI. Could just be statistical analysis, right?
Answers.UserDisplayName: dynrepsys
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-04T14:00:13.253Z
Answers.LastActivityDate: 2016-08-23T15:25:23.607Z
Answers.LastEditDate: 2016-08-23T15:25:23.607Z
Answers.UserDisplayName: Vishnu JK
Answers.Body: <p>There has been previous research with promising results cited at length in the following recent article, and although they have limited training data, here is some <a href="http://uaf46365.ddns.uark.edu/SarahStolze_Thesis.pdf" rel="noreferrer">impressive research for an undergraduate thesis at the University of Arkansas</a> which extends that research using an artificial neural network on enhancing a classifying algorithm's capacity to facilitate unspoken, or imagined, speech recognition by collecting and analyzing a large dataset of simultaneous EEG signal and video data streams. </p>
  
  <blockquote>
    <p>Imagined speech (unspoken speech, silent speech, or covert speech) is
    the process by which one thinks about a word, or “hears” the word in
    one’s head, in the absence of any vocalization or physical movement
    indicating the word. Though there exists evidence that it is possible
    for imagined speech information to be captured and interpreted. To
    facilitate imagined speech, a Brain-to-Computer Interface (BCI) must
    be implemented to provide silent communication abilities directly
    between the two entities. One of the most popular methods for
    interfacing directly between a human brain and a computer is through
    electroencephalographic signals.</p>
    
    <p>Researchers have created models capable of achieving 70 - 90%
    predictive accuracy in recognizing patterns in EEG data;
    however, the accuracy of current methods for unspoken speech
    recognition is not yet sufficient to enable fluid communication
    between humans and machines.</p>
  </blockquote>
  
  <p>High Level Experiment Design</p>
  
  <blockquote>
    <p>the subjects were asked to imagine a specific word or feeling (label).
    The subjects responded to a set of uniform verbal cues describing the
    set of labels as well as the desired individual label to imagine. The
    data was then processed in order to minimize the effects of irrelevant
    signal activity, or noise. Additionally the data was processed to
    minimize its volume while still maintaining the core “information” in
    the data. The condensed dataset was created by dropping irrelevant
    information from the EEG device and applying principal component
    analysis (PCA) to the video stream data. Once the data was processed
    and assembled into the correct format, cross-validation using a random
    forest algorithm was performed on the control group of EEG signals
    alone and on the hypothesis group consisting of both EEG and video
    data. The predictive accuracy measurements obtained from the
    cross-validation experiments were used as metrics to evaluate the
    success of the hypothesis.</p>
  </blockquote>
  
  <p>The results show a notable improvement classifying thoughts when in conjunction with the video streams.</p>
  
  <p><a href="https://i.sstatic.net/LH6sI.png" rel="noreferrer"><img src="https://i.sstatic.net/LH6sI.png" alt="graph of predictive accuracy"></a></p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2016-08-04T20:15:37.607Z
Answers.LastActivityDate: 2016-08-04T20:15:37.607Z
Answers.UserDisplayName: Jeff Puckett
Body: <p>Have there been any studies which attempted to use AI algorithms to detect human thoughts or emotions based on brain activity, such as using <a href="https://en.wikipedia.org/wiki/Brain%E2%80%93computer_interface#EEG-based" rel="nofollow">BCI/EEG devices</a>?</p>
  
  <p>By this, I mean simple guesses such as whether the person was happy or angry, or what object (e.g. banana, car) they were thinking about.</p>
  
  <p>If so, did any of those studies show some degree of success?</p>
  
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-08-04T12:03:42.830Z
Comments.Text: Yes, there absolutely is a research project in my department that has been consistently accurate at identifying a word that you were thinking (limited to a select sample of predetermined words) from exclusively monitoring an EEG. ping me when the question is reopened and I'll provide the link to the research paper.
Comments.UserDisplayName: Jeff Puckett
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-08-04T12:18:01.707Z
Comments.Text: It's not quite the detection of thoughts, but there has also been a study where they tried to do speech recognition based on brain activity. I'll post it later if the question gets reopened.
Comments.UserDisplayName: Disenchanted Lurker
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-08-04T15:39:34.223Z
Comments.Text: On second thought, we definitely should avoid making a separate answer for every such study, so I'll leave it to someone more familiar with the topic to make a more general answer. I don't really know much about it myself besides having seen the paper I mentioned.
Comments.UserDisplayName: Disenchanted Lurker
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-08-04T15:39:42.287Z
Comments.Text: The paper itself can be found [here (link)](http://dx.doi.org/10.3389/fnins.2015.00217) and [this site (link)](http://www.kurzweilai.net/brain-to-text-system-converts-speech-brainwave-patterns-to-text) has a nice summary. Feel free to include it in any answers.
Comments.UserDisplayName: Disenchanted Lurker
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2016-08-04T17:37:05.843Z
Comments.Text: Was that the way Hawkins communicated
Comments.UserDisplayName: Goku
Tags: <research><signal-processing>
Title: Are there any studies which attempt to use AI to guess the human emotion based on the brainwaves?
UserDisplayName: kenorb
ThreadText: # Are there any studies which attempt to use AI to guess the human emotion based on the brainwaves?
  
  (Asked by: username_0 on 2016-08-04)
  
  Have there been any studies which attempted to use AI algorithms to detect human thoughts or emotions based on brain activity, such as using [BCI/EEG devices](https://en.wikipedia.org/wiki/Brain%E2%80%93computer_interface#EEG-based)?
  
  By this, I mean simple guesses such as whether the person was happy or angry, or what object (e.g. banana, car) they were thinking about.
  
  If so, did any of those studies show some degree of success?
  
  **Tags:** research, signal-processing
  > **Comments:**
  > **username_1**: Yes, there absolutely is a research project in my department that has been consistently accurate at identifying a word that you were thinking (limited to a select sample of predetermined words) from exclusively monitoring an EEG. ping me when the question is reopened and I'll provide the link to the research paper.  
  > **username_2**: It's not quite the detection of thoughts, but there has also been a study where they tried to do speech recognition based on brain activity. I'll post it later if the question gets reopened.  
  > **username_2**: On second thought, we definitely should avoid making a separate answer for every such study, so I'll leave it to someone more familiar with the topic to make a more general answer. I don't really know much about it myself besides having seen the paper I mentioned.  
  > **username_2**: The paper itself can be found [here (link)](http://dx.doi.org/10.3389/fnins.2015.00217) and [this site (link)](http://www.kurzweilai.net/brain-to-text-system-converts-speech-brainwave-patterns-to-text) has a nice summary. Feel free to include it in any answers.  
  > **username_3**: Was that the way Hawkins communicated  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_4 on 2016-08-04. Score: 6
  
  As per this [site](http://www.dailymail.co.uk/sciencetech/article-2095214/As-scientists-discover-translate-brainwaves-words--Could-machine-read-innermost-thoughts.html)
  
  > Researchers recorded the complex patterns of electrical activity generated by someone’s brain, as the subject listened to someone talking.
  > By feeding those brainwave patterns into a computer, they were able to translate them back into actual words — the same words that the volunteer had been hearing.
  >
  > **The scientists behind the work believe they can now go further and read the unspoken thoughts of people using electrodes placed against the brain.**
  >
  > In the experiment, each patient listened to a recording of spoken words for five to ten minutes, while the net of electrodes placed under their skull monitored activity in a part of the brain involved in understanding speech called [Wernicke’s area](https://en.wikipedia.org/wiki/Wernicke%27s_area).
  >
  > In one experiment, volunteers looked at black-and-white photographs while the scanner monitored activity in part of the brain that handles vision called the primary visual cortex.
  > A computer predicted accurately the image that the person was looking at purely from the pattern of brain activity.
  
  So AI might be able to read our emotions as well in near future.
  
  I found that [google glasses can detect people's emotion](http://electronics.howstuffworks.com/gadgets/high-tech-gadgets/google-glass-detect-emotions.htm) via facial expression, voice tone e.t.c, (just like us), obviously not what they are thinking in their brain.
  
  > **Comments:**
  > **username_5**: Hm, the article doesn't mention any AI. Could just be statistical analysis, right?  
  
  ---
  
  ### Answer by username_1 on 2016-08-04. Score: 5
  
  There has been previous research with promising results cited at length in the following recent article, and although they have limited training data, here is some [impressive research for an undergraduate thesis at the University of Arkansas](http://uaf46365.ddns.uark.edu/SarahStolze_Thesis.pdf) which extends that research using an artificial neural network on enhancing a classifying algorithm's capacity to facilitate unspoken, or imagined, speech recognition by collecting and analyzing a large dataset of simultaneous EEG signal and video data streams.
  
  > Imagined speech (unspoken speech, silent speech, or covert speech) is
  > the process by which one thinks about a word, or “hears” the word in
  > one’s head, in the absence of any vocalization or physical movement
  > indicating the word. Though there exists evidence that it is possible
  > for imagined speech information to be captured and interpreted. To
  > facilitate imagined speech, a Brain-to-Computer Interface (BCI) must
  > be implemented to provide silent communication abilities directly
  > between the two entities. One of the most popular methods for
  > interfacing directly between a human brain and a computer is through
  > electroencephalographic signals.
  >
  > Researchers have created models capable of achieving 70 - 90%
  > predictive accuracy in recognizing patterns in EEG data;
  > however, the accuracy of current methods for unspoken speech
  > recognition is not yet sufficient to enable fluid communication
  > between humans and machines.
  
  High Level Experiment Design
  
  > the subjects were asked to imagine a specific word or feeling (label).
  > The subjects responded to a set of uniform verbal cues describing the
  > set of labels as well as the desired individual label to imagine. The
  > data was then processed in order to minimize the effects of irrelevant
  > signal activity, or noise. Additionally the data was processed to
  > minimize its volume while still maintaining the core “information” in
  > the data. The condensed dataset was created by dropping irrelevant
  > information from the EEG device and applying principal component
  > analysis (PCA) to the video stream data. Once the data was processed
  > and assembled into the correct format, cross-validation using a random
  > forest algorithm was performed on the control group of EEG signals
  > alone and on the hypothesis group consisting of both EEG and video
  > data. The predictive accuracy measurements obtained from the
  > cross-validation experiments were used as metrics to evaluate the
  > success of the hypothesis.
  
  The results show a notable improvement classifying thoughts when in conjunction with the video streams.
  
  [![graph of predictive accuracy](https://i.sstatic.net/LH6sI.png)](https://i.sstatic.net/LH6sI.png)
  
  
  ---
  
  