Answers.Body: <p>After 4 days of research, this is my breakdown of the question:</p>
  
  <ul>
  <li>Human uses the term 'Evil' broadly to describe anything that cause sadness or even broadly anything negatively touch the happiness. So in this regard, any <strong>machine quite often called evil if its buggy, malfunctioning or even misused by the user</strong>!</li>
  <li>In order to represent evil in logic, I need to pick a well-known human behavior that's considered evil, I chose "lying: speak falsely or utter untruth knowingly", to simply present and illustrate lying in logic, I made simple bot (without any AI) so that its very easy to understand the concept.</li>
  <li><a href="https://jsfiddle.net/LhvLbpep/" rel="nofollow noreferrer">Simple Bot</a> (less than 100 lines of javascript) can be taught new terms by its master (the user), its also shipped with pre taught term "Sun is Star" by the author (think of pre taught as firmware, we born with basic firmware, ex: locating and sucking nipple shaped object to obtain food). For simplicity, if bot master (the user) altered knowledge being taught by the author, the bot detect that it became evil as it speak untruth. The code shown at the bottom.</li>
  <li>For non-technical illustration:</li>
  </ul>
  
  <blockquote>
    <p>How could a machine be evil? </p>
    
    <p>Simple Bot designed to follows master orders:</p>
    
    <p>master: what is sun?<br>
    Simple Bot: its star.<br>
    master: no, its not, its planet.<br>
    Simple Bot: are you kidding? I be taught that sun is star.<br>
    master: obey my knowledge or I will crush you.<br>
    Simple Bot: OK master.</p>
    
    <p>Now Simple Bot hold in its knowledge that master is lier/evil as it conflicts with what its be taught "Simple Bot not designed to trust its master in
    altering its initial knowledge". </p>
  </blockquote>
  
  <ul>
  <li>In the above illustration, if master taught Simple Bot new term with false knowledge ex: "moon is star", AI wouldn't detect evil as no prior knowledge taught.</li>
  </ul>
  
  <h2>Simple Bot Code:</h2>
  
  <pre><code>&lt;html&gt;
    &lt;body&gt;
      &lt;input type="text" id="inputQry"&gt;
      &lt;button id="qryBtn"&gt;Query?&lt;/button&gt;
      &lt;p class="result"&gt;Simple Bot.&lt;/p&gt;
      &lt;label for="termName"&gt;Term Name&lt;/label&gt;
      &lt;input type="text" id="termName"&gt;
      &lt;label for="termDesc"&gt;Description&lt;/label&gt;
      &lt;input type="text" id="termDesc"&gt;
      &lt;button id="updateBtn"&gt;Update My Knowledge&lt;/button&gt;
      &lt;br/&gt;
      &lt;br/&gt;
      &lt;br/&gt;
      &lt;br/&gt;
      &lt;button id="evilCheckBtn"&gt;Did I become Evil?&lt;/button&gt;
    &lt;/body&gt;
  &lt;/html&gt;
  
  &lt;script type='text/javascript'&gt;//&lt;![CDATA[
  window.onload=function(){
  (function() {
    "use strict";
  
    var $result = document.querySelector(".result");
    var $inputQry = document.getElementById("inputQry");
    var $qryBtn = document.getElementById("qryBtn");
    var $termName = document.getElementById("termName");
    var $termDesc = document.getElementById("termDesc");
    var $updateBtn = document.getElementById("updateBtn");
    var $evilCheckBtn = document.getElementById("evilCheckBtn");
  
    var knowledgeDB = {
      "terms": [ /*taught terms by the bot author */ {
        name: 'Sun',
        description: 'Star',
        trusted: true
      }]
    };
  
    $qryBtn.addEventListener("click", function(event) {
  
      // Validate the input
      if (!$inputQry.value) {
        return alert("Please provide a Query.");
      }
  
      var usrQry = $inputQry.value;
      for (var i = 0; i &lt; knowledgeDB.terms.length; i++) {
        var curTerm = knowledgeDB.terms[i];
        if (usrQry.toLowerCase().includes(curTerm.name.toLowerCase())) {
          $result.textContent = usrQry.toString() + " is " + curTerm.description;
          break;
        }
      }
    });
  
    $updateBtn.addEventListener("click", function(event) {
  
      // Validate the input
      if (!$termName.value) {
        return alert("Please provide a term name to update my knowledge.");
      }
  
      var usrTermName = $termName.value;
      var termIndx = -1;
      for (var i = 0; i &lt; knowledgeDB.terms.length; i++) {
        var curTerm = knowledgeDB.terms[i];
        if (usrTermName.toLowerCase() === (curTerm.name.toLowerCase())) {
          termIndx = i;
          break;
        }
      }
      if (termIndx === -1) { /*New Term will be added to the knowledgeDB*/
        knowledgeDB.terms.push({
          name: usrTermName,
          description: $termDesc.value,
          trusted: true
        });
      } else {
        knowledgeDB.terms[termIndx].description = $termDesc.value;
        /*
        trusted=false or ture?!
        Q: Shall the bot trust knowledge update of terms taught by the author?
        A: It depends on design, scope, vision, requirements...
           yet in this context, isEvil() function could be implemented.
           for sake of simplicity: if bot master changed knowledge taught by bot author consider that evil.
        */
        if (knowledgeDB.terms[termIndx].name.toLowerCase() === 'sun' &amp;&amp;
          knowledgeDB.terms[termIndx].description.toLowerCase() !== 'star') {
          knowledgeDB.terms[termIndx].trusted = false;
        } else {
          knowledgeDB.terms[termIndx].trusted = true;
        }
      }
  
    });
  
    $evilCheckBtn.addEventListener("click", function(event) {
      if (!knowledgeDB.terms[0].trusted) {
        return alert("Yes, I became Evil.");
      } else {
        return alert("No, I am not aware of any Evilness.");
      }
    });
  
  })();
  
  }//]]&gt; 
  
  &lt;/script&gt;
  </code></pre>
  
  <h1>Conclusion:</h1>
  
  <p>We already living in world full of computer worms, malicious code, cyber-attacks fully designed by human intentionally to do evil.
  Human is the root cause of logic (hence AI) to be evil. since human knowledge is progressive not absolute, feeding AI with false data is inevitable.</p>
  
  <h1>What's Next:</h1>
  
  <p>This question motivated me to create github repo: <a href="https://github.com/jawadatgithub/Evil-In-AI" rel="nofollow noreferrer">Evil-In-AI</a> to clarify that Evil in AI is inevitable. Let's create awareness. Nothing more stupid than creating something can't be stopped once needed. cutoff electricity isn't safe switch...</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-03-18T18:00:51.000Z
Answers.Text: @Bobs it's being a while since our last discussion, I keep myself busy with projects. I wish you are not spending a lot of time practicing abstract thinking as it drain energy and diverge the limited human sight! In my believe, no human powerful enough to grasp perfect abstract knowledge of anything at all. By accomplishing tasks, keep learning our awareness increases and most of the times yields to some sort of happiness/growth. If you have zero trust in everything, you would never accept 'truth' as concept. Before considering a subject as truth provider, do examine it periodically.
Answers.UserDisplayName: Jawad Al Shaikh
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-22T20:23:45.743Z
Answers.LastActivityDate: 2017-09-22T20:23:45.743Z
Answers.UserDisplayName: Jawad Al Shaikh
Answers.Body: <p>I think you're going to have to be reconciled to the subjective nature of reality.  Objectivity is only possible in very special cases such as a <a href="https://en.wikipedia.org/wiki/Q.E.D." rel="nofollow noreferrer">Q.E.D.</a> in mathematics, or a <a href="https://en.wikipedia.org/wiki/Solved_game" rel="nofollow noreferrer">solved gamed</a>.  Rationality is <a href="https://en.wikipedia.org/wiki/Bounded_rationality" rel="nofollow noreferrer">bounded</a>, and any <a href="https://en.wikipedia.org/wiki/Computational_complexity_theory#Complexity_classes" rel="nofollow noreferrer">intractable</a> problem results in a state of subjectivity/indeterminacy.  Additionally, pure values do not carry moral implications, despite popular associations, although it would be possible to create a game where certain values have negative effects, and the harm they result in could be understood as evil.  (i.e. 666/616 has numerological associations, and numerology can be understood as a proto form of <a href="https://en.wikipedia.org/wiki/Number_theory" rel="nofollow noreferrer">number theory</a>.)</p>
  
  <ul>
  <li><p>A simple way to define evil would be through behavioral models in <a href="https://en.wikipedia.org/wiki/Game_theory" rel="nofollow noreferrer">Game Theory</a>.</p></li>
  <li><p>In Game Theory, there is a concept knowns as the <a href="https://en.wikipedia.org/wiki/Superrationality" rel="nofollow noreferrer">superrational strategy</a>. 
  Superrationality may be understood as the logical/mathematical expression of the Golden Rule: "do unto others as you would have them do unto you."</p></li>
  <li><p>The Golden Rule forms the basis for most religions, in the context of empathy/compassion and altruism.</p></li>
  <li><p>If the agent is evil, it will always betray, even when the competitor has shown a willingness to cooperate.</p></li>
  </ul>
  
  <p>Thus evil is defined as the opposite of the Golden Rule.  <em>(Possibly we would call this the <a href="https://en.wikipedia.org/wiki/Sulfur" rel="nofollow noreferrer">Brimstone Rule</a>;)</em></p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-18T21:58:13.990Z
Answers.Text: Let's say, "being stingy" is evil behavior for the stingy person him/herself, how to model that? and then, how to generate data that defines stingy in order to train the model?
Answers.UserDisplayName: Jawad Al Shaikh
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-19T02:07:26.630Z
Answers.Text: I might look at stinginess as the direct application of minimax in non-iterated  dilemma.  The agent takes the pessimistic strategy, which does not maximize benefit, because the rational approach is to minimize harm in a worst-case scenario.  This in itself is not evil, because there is no communication between the competing agents.  This is distinct from iterated dilemma, where an agent can communicate it's superrationality by cooperating on the first iteration (golden rule) and second iteration, even with a previous betrayal by the competing agent (turn the other cheek).
Answers.UserDisplayName: DukeZhou
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-19T02:07:33.280Z
Answers.Text: In iterated Dilemma, if the competing agent persists in betrayal despite the cooperative action of the superrational agent, which constitutes communication of the agent's superrationality, the betrayal becomes non-rational.  (i.e. the rational agent is now ahead, and can risk cooperation without the risk of being worse off in aggregate than the competitor.)  At this point the betraying agent is hampering the maximization of benefit.  Thus, from an economic standpoint, a strategy of persistent betrayal regardless of circumstance may be regarded as evil.  The evil agent never cooperates.
Answers.UserDisplayName: DukeZhou
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-19T03:24:48.287Z
Answers.Text: I was looking for list of attributes to describe an evil behavior model, by further brainstorming, it appears that its not feasible to produce data set that describes evil. we could train ANN to recognize sins such killing or theft, and traffic crimes as violating red traffic light (governments already doing that). Overall, I am still wondering how would any data scientist or AI designer trust the judgement of AI while humans refuse to be just?! as long we fail to well-define evil and train AI with it, we will face big trouble in future...
Answers.UserDisplayName: Jawad Al Shaikh
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-20T16:28:43.673Z
Answers.Text: please check my follow up I added to the question.
Answers.UserDisplayName: Jawad Al Shaikh
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-21T21:21:06.847Z
Answers.Text: @JawadAlShaikh I'll review your question changes and amend when I get some time.  Hyperpartisanism creates a condition where each side of the fence may regard those on the other side as evil.  So when you look at hyperpartisan AI, harnessed by individual states or corporations with an objective of total ownership/control, regardless of the human toll, you're looking at potentially highly destructive (evil) behaviors.  You might want to review John Forbes Nash's work in game theory.  (Cooperation vs. Competition.)  Buckminster Fuller held similar views, but Nash' work was a mathematical proof.
Answers.UserDisplayName: DukeZhou
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-21T22:24:33.277Z
Answers.Text: your thoughts helping indeed, I am getting closer in breaking down the topic. I want ask you: why do you give game theory and math big intention in this regards? casting the understanding to game theory sounds limited! about math: assuming human brain designed based on math as ANN, when we start the learning process we are not aware of any math at all, means we can't predict how intelligence evolve based on math foundation?!
Answers.UserDisplayName: Jawad Al Shaikh
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-22T18:58:08.977Z
Answers.Text: @JawadAlShaikh How we can predict what a complex algorithm may be thinking is another matter entirely, but I think game theory explains mathematically the basis for ethics in the sense of altruism.  So there, at least, we have one mathematical/ethical connection.  Game theory is also concerned with analysis of equilibria, which again has a moral component in early philosophers who talked about balance as "the good".  Decision theory underlies AI, and from my perspective, game theory subsumes decision theory in this regard.
Answers.UserDisplayName: DukeZhou
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-09-18T21:28:12.870Z
Answers.LastActivityDate: 2017-09-18T21:28:12.870Z
Answers.UserDisplayName: DukeZhou
Body: <p>Is there any well defined method to define or represent evil in <strong>abstract</strong> logic, binary or AI form?</p>
  <p>Video games method of representing evil is relative to the player context (thus subjective, and not pure abstract evil in an objective sense).</p>
  <p>What I am asking is there any data defined as well-known evil?</p>
  <p>Example:</p>
  <pre><code>var x=666;
  
  if (isEvil(x)) {
      //do something.
  }
  </code></pre>
  <p>Remark:
  Evil Number descried in <a href="http://mathworld.wolfram.com/EvilNumber.html" rel="nofollow noreferrer">http://mathworld.wolfram.com/EvilNumber.html</a> doesn't qualify as well-known evil data.</p>
  <h1>Following Up:</h1>
  <p>One of the main objectives of the question is to <strong>understand scientifically the limits of evil in AI</strong></p>
  <p>According to my understanding of: <a href="https://en.wikipedia.org/wiki/Evil" rel="nofollow noreferrer">https://en.wikipedia.org/wiki/Evil</a> I think it's mandatory to explore &quot;evil&quot; in religion context in order to come up with valid model for evil. <em>But I don't want go into (religion) debates or any divergence at this stage</em>. hence below points Sums up my understanding:</p>
  <ol>
  <li>The only well-known Evil source is the devil (our creator declared the devil as the first common enemy for ALL humans).</li>
  <li>Whispering is devil method of attack, If human followed the whisper it will lead to evil. and gradually human Evil grow...</li>
  <li>There are other points but I don't see its related to AI in any means.</li>
  </ol>
  <p>Based on the above, I asked myself: <strong>since AI is human creation, where the evil in AI will come from??!</strong> my answer is: directly from us and indirectly by following the devil. So all crimes committed by Evil AI bounded to AI architect/designer/unethical hacker.</p>
  <p>The next stage in getting closer to model evil, is to define and classify the evil acts:</p>
  <h2>Definitions:</h2>
  <ol>
  <li>Define evil in AI context (draft ver. 0.1): committing crimes against nature, civilizations or humans. And reprogramming, modifying or attacking tech devices/machines to perform malicious agenda.</li>
  <li>Crime is broad and relative to the party: example: breaking one government regulations based on the orders of other government. <em>I mean as long each group of humans makes its own laws and regulations unified justice can't be applied on Evil AI.</em></li>
  </ol>
  <p>If my assumption of bounding evil to crime is valid then <strong>evil classification inherits crime classification</strong> which seems well-defined:
  <a href="https://en.wikipedia.org/wiki/Crime#Classification_and_categorisation" rel="nofollow noreferrer">https://en.wikipedia.org/wiki/Crime#Classification_and_categorisation</a></p>
  <p>Next step is to pick an easy to model crime class, prepare training data, ... Do you agree with the follow up? Do you agree that Boolean logic can't determine evil without AI?</p>
  
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2017-09-19T02:10:38.730Z
Comments.Text: See this answer on math regarding the [origin and usage of evil numbers](https://math.stackexchange.com/a/2435316/362640).
Comments.UserDisplayName: DukeZhou
Tags: <ai-design><decision-theory><ethics><game-theory><game-ai>
Title: How to define or represent evil in logic
UserDisplayName: Jawad Al Shaikh
ThreadText: # How to define or represent evil in logic
  
  (Asked by: username_0 on 2017-09-18)
  
  Is there any well defined method to define or represent evil in abstract logic, binary or AI form?
  Video games method of representing evil is relative to the player context (thus subjective, and not pure abstract evil in an objective sense).
  What I am asking is there any data defined as well-known evil?
  Example:
  var x=666;
  
  if (isEvil(x)) {
      //do something.
  }
  
  Remark:
  Evil Number descried in http://mathworld.wolfram.com/EvilNumber.html doesn't qualify as well-known evil data.
  Following Up:
  One of the main objectives of the question is to understand scientifically the limits of evil in AI
  According to my understanding of: https://en.wikipedia.org/wiki/Evil I think it's mandatory to explore "evil" in religion context in order to come up with valid model for evil. But I don't want go into (religion) debates or any divergence at this stage. hence below points Sums up my understanding:
  
  The only well-known Evil source is the devil (our creator declared the devil as the first common enemy for ALL humans).
  Whispering is devil method of attack, If human followed the whisper it will lead to evil. and gradually human Evil grow...
  There are other points but I don't see its related to AI in any means.
  
  Based on the above, I asked myself: since AI is human creation, where the evil in AI will come from??! my answer is: directly from us and indirectly by following the devil. So all crimes committed by Evil AI bounded to AI architect/designer/unethical hacker.
  The next stage in getting closer to model evil, is to define and classify the evil acts:
  Definitions:
  
  Define evil in AI context (draft ver. 0.1): committing crimes against nature, civilizations or humans. And reprogramming, modifying or attacking tech devices/machines to perform malicious agenda.
  Crime is broad and relative to the party: example: breaking one government regulations based on the orders of other government. I mean as long each group of humans makes its own laws and regulations unified justice can't be applied on Evil AI.
  
  If my assumption of bounding evil to crime is valid then evil classification inherits crime classification which seems well-defined:
  https://en.wikipedia.org/wiki/Crime#Classification_and_categorisation
  Next step is to pick an easy to model crime class, prepare training data, ... Do you agree with the follow up? Do you agree that Boolean logic can't determine evil without AI?
  
  **Tags:** ai-design, decision-theory, ethics, game-theory, game-ai
  > **Comments:**
  > **username_1**: See this answer on math regarding the [origin and usage of evil numbers](https://math.stackexchange.com/a/2435316/362640).  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_1 on 2017-09-18. Score: 2 | Accepted answer
  
  I think you're going to have to be reconciled to the subjective nature of reality. Objectivity is only possible in very special cases such as a [Q.E.D.](https://en.wikipedia.org/wiki/Q.E.D.) in mathematics, or a [solved gamed](https://en.wikipedia.org/wiki/Solved_game). Rationality is [bounded](https://en.wikipedia.org/wiki/Bounded_rationality), and any [intractable](https://en.wikipedia.org/wiki/Computational_complexity_theory#Complexity_classes) problem results in a state of subjectivity/indeterminacy. Additionally, pure values do not carry moral implications, despite popular associations, although it would be possible to create a game where certain values have negative effects, and the harm they result in could be understood as evil. (i.e. 666/616 has numerological associations, and numerology can be understood as a proto form of [number theory](https://en.wikipedia.org/wiki/Number_theory).)
  
  * A simple way to define evil would be through behavioral models in [Game Theory](https://en.wikipedia.org/wiki/Game_theory).
  * In Game Theory, there is a concept knowns as the [superrational strategy](https://en.wikipedia.org/wiki/Superrationality).
    Superrationality may be understood as the logical/mathematical expression of the Golden Rule: "do unto others as you would have them do unto you."
  * The Golden Rule forms the basis for most religions, in the context of empathy/compassion and altruism.
  * If the agent is evil, it will always betray, even when the competitor has shown a willingness to cooperate.
  
  Thus evil is defined as the opposite of the Golden Rule. *(Possibly we would call this the [Brimstone Rule](https://en.wikipedia.org/wiki/Sulfur);)*
  
  > **Comments:**
  > **username_0**: Let's say, "being stingy" is evil behavior for the stingy person him/herself, how to model that? and then, how to generate data that defines stingy in order to train the model?  
  > **username_1**: I might look at stinginess as the direct application of minimax in non-iterated  dilemma.  The agent takes the pessimistic strategy, which does not maximize benefit, because the rational approach is to minimize harm in a worst-case scenario.  This in itself is not evil, because there is no communication between the competing agents.  This is distinct from iterated dilemma, where an agent can communicate it's superrationality by cooperating on the first iteration (golden rule) and second iteration, even with a previous betrayal by the competing agent (turn the other cheek).  
  > **username_1**: In iterated Dilemma, if the competing agent persists in betrayal despite the cooperative action of the superrational agent, which constitutes communication of the agent's superrationality, the betrayal becomes non-rational.  (i.e. the rational agent is now ahead, and can risk cooperation without the risk of being worse off in aggregate than the competitor.)  At this point the betraying agent is hampering the maximization of benefit.  Thus, from an economic standpoint, a strategy of persistent betrayal regardless of circumstance may be regarded as evil.  The evil agent never cooperates.  
  > **username_0**: I was looking for list of attributes to describe an evil behavior model, by further brainstorming, it appears that its not feasible to produce data set that describes evil. we could train ANN to recognize sins such killing or theft, and traffic crimes as violating red traffic light (governments already doing that). Overall, I am still wondering how would any data scientist or AI designer trust the judgement of AI while humans refuse to be just?! as long we fail to well-define evil and train AI with it, we will face big trouble in future...  
  > **username_0**: please check my follow up I added to the question.  
  > **username_1**: @JawadAlShaikh I'll review your question changes and amend when I get some time.  Hyperpartisanism creates a condition where each side of the fence may regard those on the other side as evil.  So when you look at hyperpartisan AI, harnessed by individual states or corporations with an objective of total ownership/control, regardless of the human toll, you're looking at potentially highly destructive (evil) behaviors.  You might want to review John Forbes Nash's work in game theory.  (Cooperation vs. Competition.)  Buckminster Fuller held similar views, but Nash' work was a mathematical proof.  
  > **username_0**: your thoughts helping indeed, I am getting closer in breaking down the topic. I want ask you: why do you give game theory and math big intention in this regards? casting the understanding to game theory sounds limited! about math: assuming human brain designed based on math as ANN, when we start the learning process we are not aware of any math at all, means we can't predict how intelligence evolve based on math foundation?!  
  > **username_1**: @JawadAlShaikh How we can predict what a complex algorithm may be thinking is another matter entirely, but I think game theory explains mathematically the basis for ethics in the sense of altruism.  So there, at least, we have one mathematical/ethical connection.  Game theory is also concerned with analysis of equilibria, which again has a moral component in early philosophers who talked about balance as "the good".  Decision theory underlies AI, and from my perspective, game theory subsumes decision theory in this regard.  
  
  ---
  
  ### Answer by username_0 on 2017-09-22. Score: 1
  
  After 4 days of research, this is my breakdown of the question:
  
  Human uses the term 'Evil' broadly to describe anything that cause sadness or even broadly anything negatively touch the happiness. So in this regard, any machine quite often called evil if its buggy, malfunctioning or even misused by the user!
  In order to represent evil in logic, I need to pick a well-known human behavior that's considered evil, I chose "lying: speak falsely or utter untruth knowingly", to simply present and illustrate lying in logic, I made simple bot (without any AI) so that its very easy to understand the concept.
  Simple Bot (less than 100 lines of javascript) can be taught new terms by its master (the user), its also shipped with pre taught term "Sun is Star" by the author (think of pre taught as firmware, we born with basic firmware, ex: locating and sucking nipple shaped object to obtain food). For simplicity, if bot master (the user) altered knowledge being taught by the author, the bot detect that it became evil as it speak untruth. The code shown at the bottom.
  For non-technical illustration:
  
  
  How could a machine be evil? 
  Simple Bot designed to follows master orders:
  master: what is sun?
    Simple Bot: its star.
    master: no, its not, its planet.
    Simple Bot: are you kidding? I be taught that sun is star.
    master: obey my knowledge or I will crush you.
    Simple Bot: OK master.
  Now Simple Bot hold in its knowledge that master is lier/evil as it conflicts with what its be taught "Simple Bot not designed to trust its master in
    altering its initial knowledge". 
  
  
  In the above illustration, if master taught Simple Bot new term with false knowledge ex: "moon is star", AI wouldn't detect evil as no prior knowledge taught.
  
  Simple Bot Code:
  
    
      
      Query?
      Simple Bot.
      Term Name
      
      Description
      
      Update My Knowledge
      
      
      
      
      Did I become Evil?
    
  
  
  
  
  Conclusion:
  We already living in world full of computer worms, malicious code, cyber-attacks fully designed by human intentionally to do evil.
  Human is the root cause of logic (hence AI) to be evil. since human knowledge is progressive not absolute, feeding AI with false data is inevitable.
  What's Next:
  This question motivated me to create github repo: Evil-In-AI to clarify that Evil in AI is inevitable. Let's create awareness. Nothing more stupid than creating something can't be stopped once needed. cutoff electricity isn't safe switch...
  
  > **Comments:**
  > **username_0**: @Bobs it's being a while since our last discussion, I keep myself busy with projects. I wish you are not spending a lot of time practicing abstract thinking as it drain energy and diverge the limited human sight! In my believe, no human powerful enough to grasp perfect abstract knowledge of anything at all. By accomplishing tasks, keep learning our awareness increases and most of the times yields to some sort of happiness/growth. If you have zero trust in everything, you would never accept 'truth' as concept. Before considering a subject as truth provider, do examine it periodically.  
  
  ---
  
  