I still don’t fully understand, especially I’m not sure what you mean by production.
Concatenating linear layers together will only give you a linear model. So doing that is basically waste of computation,.
With such a small network and binary input, even with N(0, 1) initialization, it shouldn’t output very large values. Although considering you are using a linear model, weights might work together to amplify the input.