Answers.Body: <p>You're simply adding a redundant feature by having it as two: <span class="math-container">$X_2 = 1 - X_1$</span>. It would be equally useful to duplicate the first column. At best this will not improve your model, at worst it will decrease accuracy.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-10-31T09:31:18.320Z
Answers.LastActivityDate: 2020-10-31T09:31:18.320Z
Answers.UserDisplayName: Cameron Chandler
Body: <p>Let's assume I have a simple feedforward neural network whose input contains binary 0/1 features and output is also binary two classes.</p>
  <p>Is it better, worse, or maybe totally indifferent, for every such binary feature to be in just one column or maybe it would be better to split one feature into two columns in a way that the second column will have the opposite value, like that:</p>
  <pre><code>feature_x (one column scenario) 
  
  [0]
  
  [1]
  
  [0]
  
  
  feature_x (two columns scenario)
  
  [0, 1]
  
  [1, 0]
  
  [0, 1]
  </code></pre>
  <p>I know this might seem a bit weird and probably it is not necessary, but I have a feeling like there might be a difference for a network especially for its inner workings and how neurons in the next layers see such data. Has anyone ever researched that aspect?</p>
  
Tags: <deep-learning><deep-neural-networks><data-preprocessing><geometric-deep-learning><binary-classification>
Title: Should binary feature be in one or two columns in deep neural networks?
UserDisplayName: GKozinski
ThreadText: # Should binary feature be in one or two columns in deep neural networks?
  
  (Asked by: username_0 on 2020-10-30)
  
  Let's assume I have a simple feedforward neural network whose input contains binary 0/1 features and output is also binary two classes.
  Is it better, worse, or maybe totally indifferent, for every such binary feature to be in just one column or maybe it would be better to split one feature into two columns in a way that the second column will have the opposite value, like that:
  feature_x (one column scenario) 
  
  [0]
  
  [1]
  
  [0]
  
  
  feature_x (two columns scenario)
  
  [0, 1]
  
  [1, 0]
  
  [0, 1]
  
  I know this might seem a bit weird and probably it is not necessary, but I have a feeling like there might be a difference for a network especially for its inner workings and how neurons in the next layers see such data. Has anyone ever researched that aspect?
  
  **Tags:** deep-learning, deep-neural-networks, data-preprocessing, geometric-deep-learning, binary-classification
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2020-10-31. Score: 0 | Accepted answer
  
  You're simply adding a redundant feature by having it as two: $X\_2 = 1 - X\_1$. It would be equally useful to duplicate the first column. At best this will not improve your model, at worst it will decrease accuracy.
  
  
  ---
  
  