Solved by ptrblck in post #2 
              
              
                If you’ve normalized the input data, it’ll have a zero mean and unit variance. 
Clamping it to [0, 1] might delete a lot of important features, which could explain the bad accuracy.