Body: <p>I'm a grad student from EE.</p>
  
  <p>So, basically, there's an electrical circuit that is supposed to output "0" or "1" by exactly 50 to 50 chance. It generates a number of big arrays of 0s and 1s, each of which amounts to more than 4,000 of the numbers.</p>
  
  <p>But because these arrays are physically generated in a fab, <strong>I assume it might develop some dependencies among numbers and some output could be predicted by more than 50% chance</strong>. For example, due to some variations in the process, "1" can be more likely to come than "0" after a sequence of "001100".</p>
  
  <p>Then let's say I make a simple deep neural network which takes 7 inputs and gives 1 output. I simply slice my array by 8 numbers, 7 of which are given to the input and the last one is used as a label (the true answer). I train my simple DNN using all these sliced numbers and it will learn some sequences. Finally, I apply my NN to a test set, and if it predicts the next number with an accuracy of more than 50%, that proves my assumption, and if it doesn't that is also good for me because it says my circuits are good.</p>
  
  <p>Would it work?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-05-10T04:30:48.143Z
Comments.Text: It could work yes but given the described problem an RNN (Recurrent Neural Network) would probably be a better option since you would be able to process sequences with arbitrary length.
Comments.UserDisplayName: Daniel Oliveira
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-05-10T04:49:44.383Z
Comments.Text: I'm afraid my desktop can't take too much load. Would it be lighter than a simple 3-layer NN?
Comments.UserDisplayName: Hoon
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-05-10T06:03:19.460Z
Comments.Text: @DuttaA if the system is purely random he will get around 50% accuracy in a big enough test set, this is independent of the NN predictions. If he gets much higher or much lesser accuracy values he can infer that the system is biased.
Comments.UserDisplayName: Daniel Oliveira
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-05-10T06:06:32.080Z
Comments.Text: @Hoon predicting with an RNN is not much heavier than predicting with simple Feedforward neural network. Only the training part will be heavier for the RNN due to backpropagation through time. I recommend that you start by training a simple NN and check how it performs. If it does not work then try a more complex model. If it still does work maybe your system is purely random and there are no patters no learn.
Comments.UserDisplayName: Daniel Oliveira
Tags: <neural-networks><deep-learning><classification>
Title: Would this NN for my chip outputs work?
UserDisplayName: Hoon
ThreadText: # Would this NN for my chip outputs work?
  
  (Asked by: username_0 on 2019-05-10)
  
  I'm a grad student from EE.
  
  So, basically, there's an electrical circuit that is supposed to output "0" or "1" by exactly 50 to 50 chance. It generates a number of big arrays of 0s and 1s, each of which amounts to more than 4,000 of the numbers.
  
  But because these arrays are physically generated in a fab, **I assume it might develop some dependencies among numbers and some output could be predicted by more than 50% chance**. For example, due to some variations in the process, "1" can be more likely to come than "0" after a sequence of "001100".
  
  Then let's say I make a simple deep neural network which takes 7 inputs and gives 1 output. I simply slice my array by 8 numbers, 7 of which are given to the input and the last one is used as a label (the true answer). I train my simple DNN using all these sliced numbers and it will learn some sequences. Finally, I apply my NN to a test set, and if it predicts the next number with an accuracy of more than 50%, that proves my assumption, and if it doesn't that is also good for me because it says my circuits are good.
  
  Would it work?
  
  **Tags:** neural-networks, deep-learning, classification
  
  > **Comments:**
  > **username_1**: It could work yes but given the described problem an RNN (Recurrent Neural Network) would probably be a better option since you would be able to process sequences with arbitrary length.  
  > **username_0**: I'm afraid my desktop can't take too much load. Would it be lighter than a simple 3-layer NN?  
  > **username_1**: @DuttaA if the system is purely random he will get around 50% accuracy in a big enough test set, this is independent of the NN predictions. If he gets much higher or much lesser accuracy values he can infer that the system is biased.  
  > **username_1**: @username_0 predicting with an RNN is not much heavier than predicting with simple Feedforward neural network. Only the training part will be heavier for the RNN due to backpropagation through time. I recommend that you start by training a simple NN and check how it performs. If it does not work then try a more complex model. If it still does work maybe your system is purely random and there are no patters no learn.  
  
  ---
  
  ## 0 answers
  
  