Solved by KFrank in post #2 
              
              
                Hi Deep! 

No, this way of looking at it isn’t correct. 
The reason is that the weights in your layers can be negative and 
the biases are not constrained.  So a negative input value can be 
multiplied by a negative weight or have a positive bias added to it, 
and therefore become positive, before i…